-- Logs begin at Wed 2021-12-15 02:18:02 UTC, end at Wed 2021-12-15 03:48:57 UTC. -- Dec 15 02:55:00.621411 dv-cinder-818037-9-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Dec 15 02:55:00.630851 dv-cinder-818037-9-iscsi devstack@n-api.service[101796]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Dec 15 02:55:00.633690 dv-cinder-818037-9-iscsi devstack@n-api.service[101796]: *** Starting uWSGI 2.0.18-debian (64bit) on [Wed Dec 15 02:55:00 2021] *** Dec 15 02:55:00.633690 dv-cinder-818037-9-iscsi devstack@n-api.service[101796]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Dec 15 02:55:00.633690 dv-cinder-818037-9-iscsi devstack@n-api.service[101796]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Dec 15 02:55:00.633690 dv-cinder-818037-9-iscsi devstack@n-api.service[101796]: nodename: dv-cinder-818037-9-iscsi Dec 15 02:55:00.633690 dv-cinder-818037-9-iscsi devstack@n-api.service[101796]: machine: x86_64 Dec 15 02:55:00.633690 dv-cinder-818037-9-iscsi devstack@n-api.service[101796]: clock source: unix Dec 15 02:55:00.633690 dv-cinder-818037-9-iscsi devstack@n-api.service[101796]: pcre jit disabled Dec 15 02:55:00.633690 dv-cinder-818037-9-iscsi devstack@n-api.service[101796]: detected number of CPU cores: 4 Dec 15 02:55:00.633690 dv-cinder-818037-9-iscsi devstack@n-api.service[101796]: current working directory: / Dec 15 02:55:00.633690 dv-cinder-818037-9-iscsi devstack@n-api.service[101796]: detected binary path: /usr/bin/uwsgi-core Dec 15 02:55:00.634511 dv-cinder-818037-9-iscsi devstack@n-api.service[101796]: your processes number limit is 47680 Dec 15 02:55:00.634511 dv-cinder-818037-9-iscsi devstack@n-api.service[101796]: your memory page size is 4096 bytes Dec 15 02:55:00.634511 dv-cinder-818037-9-iscsi devstack@n-api.service[101796]: detected max file descriptor number: 2048 Dec 15 02:55:00.634511 dv-cinder-818037-9-iscsi devstack@n-api.service[101796]: lock engine: pthread robust mutexes Dec 15 02:55:00.634511 dv-cinder-818037-9-iscsi devstack@n-api.service[101796]: thunder lock: enabled Dec 15 02:55:00.634511 dv-cinder-818037-9-iscsi devstack@n-api.service[101796]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Dec 15 02:55:00.634511 dv-cinder-818037-9-iscsi devstack@n-api.service[101796]: Python version: 3.8.10 (default, Sep 28 2021, 16:10:42) [GCC 9.3.0] Dec 15 02:55:00.676958 dv-cinder-818037-9-iscsi devstack@n-api.service[101796]: Python main interpreter initialized at 0x55902faa29c0 Dec 15 02:55:00.676958 dv-cinder-818037-9-iscsi devstack@n-api.service[101796]: python threads support enabled Dec 15 02:55:00.676958 dv-cinder-818037-9-iscsi devstack@n-api.service[101796]: your server socket listen backlog is limited to 100 connections Dec 15 02:55:00.676958 dv-cinder-818037-9-iscsi devstack@n-api.service[101796]: your mercy for graceful operations on workers is 90 seconds Dec 15 02:55:00.677338 dv-cinder-818037-9-iscsi devstack@n-api.service[101796]: mapped 403077 bytes (393 KB) for 2 cores Dec 15 02:55:00.677416 dv-cinder-818037-9-iscsi devstack@n-api.service[101796]: *** Operational MODE: preforking *** Dec 15 02:55:00.677639 dv-cinder-818037-9-iscsi devstack@n-api.service[101796]: *** uWSGI is running in multiple interpreter mode *** Dec 15 02:55:00.677639 dv-cinder-818037-9-iscsi devstack@n-api.service[101796]: spawned uWSGI master process (pid: 101796) Dec 15 02:55:00.681862 dv-cinder-818037-9-iscsi devstack@n-api.service[101796]: spawned uWSGI worker 1 (pid: 101847, cores: 1) Dec 15 02:55:00.681862 dv-cinder-818037-9-iscsi devstack@n-api.service[101796]: spawned uWSGI worker 2 (pid: 101848, cores: 1) Dec 15 02:55:00.681862 dv-cinder-818037-9-iscsi devstack@n-api.service[101796]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Dec 15 02:55:00.677834 dv-cinder-818037-9-iscsi systemd[1]: Started Devstack devstack@n-api.service. Dec 15 02:55:02.398134 dv-cinder-818037-9-iscsi devstack@n-api.service[101848]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Dec 15 02:55:02.398134 dv-cinder-818037-9-iscsi devstack@n-api.service[101848]: from cryptography.utils import int_from_bytes Dec 15 02:55:02.398810 dv-cinder-818037-9-iscsi devstack@n-api.service[101848]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Dec 15 02:55:02.398810 dv-cinder-818037-9-iscsi devstack@n-api.service[101848]: from cryptography.utils import int_from_bytes Dec 15 02:55:02.402137 dv-cinder-818037-9-iscsi devstack@n-api.service[101847]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Dec 15 02:55:02.402137 dv-cinder-818037-9-iscsi devstack@n-api.service[101847]: from cryptography.utils import int_from_bytes Dec 15 02:55:02.402604 dv-cinder-818037-9-iscsi devstack@n-api.service[101847]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Dec 15 02:55:02.402604 dv-cinder-818037-9-iscsi devstack@n-api.service[101847]: from cryptography.utils import int_from_bytes Dec 15 02:55:04.983517 dv-cinder-818037-9-iscsi devstack@n-api.service[101848]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=101848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Dec 15 02:55:04.984068 dv-cinder-818037-9-iscsi devstack@n-api.service[101848]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=101848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Dec 15 02:55:04.984257 dv-cinder-818037-9-iscsi devstack@n-api.service[101848]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=101848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Dec 15 02:55:04.984618 dv-cinder-818037-9-iscsi devstack@n-api.service[101848]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=101848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Dec 15 02:55:04.984878 dv-cinder-818037-9-iscsi devstack@n-api.service[101848]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=101848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Dec 15 02:55:04.984978 dv-cinder-818037-9-iscsi devstack@n-api.service[101847]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=101847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Dec 15 02:55:04.985328 dv-cinder-818037-9-iscsi devstack@n-api.service[101847]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=101847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Dec 15 02:55:04.985416 dv-cinder-818037-9-iscsi devstack@n-api.service[101848]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=101848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 02:55:04.985584 dv-cinder-818037-9-iscsi devstack@n-api.service[101848]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=101848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 02:55:04.985676 dv-cinder-818037-9-iscsi devstack@n-api.service[101847]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=101847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Dec 15 02:55:04.985911 dv-cinder-818037-9-iscsi devstack@n-api.service[101848]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=101848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 02:55:04.986047 dv-cinder-818037-9-iscsi devstack@n-api.service[101847]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=101847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Dec 15 02:55:04.986245 dv-cinder-818037-9-iscsi devstack@n-api.service[101847]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=101847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Dec 15 02:55:04.986340 dv-cinder-818037-9-iscsi devstack@n-api.service[101848]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=101848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 02:55:04.986585 dv-cinder-818037-9-iscsi devstack@n-api.service[101848]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=101848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 02:55:04.986683 dv-cinder-818037-9-iscsi devstack@n-api.service[101847]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=101847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 02:55:04.986899 dv-cinder-818037-9-iscsi devstack@n-api.service[101848]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=101848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 02:55:04.986990 dv-cinder-818037-9-iscsi devstack@n-api.service[101847]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=101847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 02:55:04.987222 dv-cinder-818037-9-iscsi devstack@n-api.service[101848]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=101848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 02:55:04.987312 dv-cinder-818037-9-iscsi devstack@n-api.service[101847]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=101847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 02:55:04.987545 dv-cinder-818037-9-iscsi devstack@n-api.service[101848]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=101848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 02:55:04.987640 dv-cinder-818037-9-iscsi devstack@n-api.service[101847]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=101847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 02:55:04.987878 dv-cinder-818037-9-iscsi devstack@n-api.service[101848]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=101848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 02:55:04.987969 dv-cinder-818037-9-iscsi devstack@n-api.service[101847]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=101847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 02:55:04.988139 dv-cinder-818037-9-iscsi devstack@n-api.service[101848]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=101848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 02:55:04.988237 dv-cinder-818037-9-iscsi devstack@n-api.service[101847]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=101847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 02:55:04.988456 dv-cinder-818037-9-iscsi devstack@n-api.service[101848]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=101848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 02:55:04.988547 dv-cinder-818037-9-iscsi devstack@n-api.service[101847]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=101847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 02:55:04.988783 dv-cinder-818037-9-iscsi devstack@n-api.service[101848]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-818037-9-iscsi {{(pid=101848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 02:55:04.988874 dv-cinder-818037-9-iscsi devstack@n-api.service[101847]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=101847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 02:55:04.989108 dv-cinder-818037-9-iscsi devstack@n-api.service[101848]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=101848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 02:55:04.989198 dv-cinder-818037-9-iscsi devstack@n-api.service[101847]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=101847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 02:55:04.989392 dv-cinder-818037-9-iscsi devstack@n-api.service[101847]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=101847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 02:55:04.989482 dv-cinder-818037-9-iscsi devstack@n-api.service[101848]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=101848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 02:55:04.989712 dv-cinder-818037-9-iscsi devstack@n-api.service[101847]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=101847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 02:55:04.989845 dv-cinder-818037-9-iscsi devstack@n-api.service[101848]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=101848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 02:55:04.990062 dv-cinder-818037-9-iscsi devstack@n-api.service[101848]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=101848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 02:55:04.990193 dv-cinder-818037-9-iscsi devstack@n-api.service[101847]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-818037-9-iscsi {{(pid=101847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 02:55:04.990371 dv-cinder-818037-9-iscsi devstack@n-api.service[101848]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=101848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 02:55:04.990507 dv-cinder-818037-9-iscsi devstack@n-api.service[101847]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=101847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 02:55:04.990713 dv-cinder-818037-9-iscsi devstack@n-api.service[101847]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=101847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 02:55:04.990844 dv-cinder-818037-9-iscsi devstack@n-api.service[101848]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=101848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 02:55:04.991019 dv-cinder-818037-9-iscsi devstack@n-api.service[101848]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=101848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 02:55:04.991154 dv-cinder-818037-9-iscsi devstack@n-api.service[101847]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=101847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 02:55:04.991341 dv-cinder-818037-9-iscsi devstack@n-api.service[101847]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=101847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 02:55:04.991520 dv-cinder-818037-9-iscsi devstack@n-api.service[101848]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=101848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 02:55:04.991956 dv-cinder-818037-9-iscsi devstack@n-api.service[101847]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=101847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 02:55:04.992081 dv-cinder-818037-9-iscsi devstack@n-api.service[101848]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=101848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 02:55:04.992191 dv-cinder-818037-9-iscsi devstack@n-api.service[101847]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=101847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 02:55:04.992306 dv-cinder-818037-9-iscsi devstack@n-api.service[101848]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=101848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 02:55:04.992410 dv-cinder-818037-9-iscsi devstack@n-api.service[101847]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=101847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 02:55:04.992558 dv-cinder-818037-9-iscsi devstack@n-api.service[101848]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=101848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 02:55:04.992783 dv-cinder-818037-9-iscsi devstack@n-api.service[101847]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=101847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 02:55:04.992984 dv-cinder-818037-9-iscsi devstack@n-api.service[101848]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=101848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 02:55:04.993185 dv-cinder-818037-9-iscsi devstack@n-api.service[101847]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=101847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 02:55:04.993371 dv-cinder-818037-9-iscsi devstack@n-api.service[101848]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=101848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 02:55:04.993560 dv-cinder-818037-9-iscsi devstack@n-api.service[101847]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=101847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 02:55:04.993750 dv-cinder-818037-9-iscsi devstack@n-api.service[101848]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=101848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 02:55:04.993936 dv-cinder-818037-9-iscsi devstack@n-api.service[101847]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=101847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 02:55:04.994156 dv-cinder-818037-9-iscsi devstack@n-api.service[101848]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=101848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 02:55:04.994346 dv-cinder-818037-9-iscsi devstack@n-api.service[101847]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=101847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 02:55:04.994556 dv-cinder-818037-9-iscsi devstack@n-api.service[101848]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=101848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 02:55:04.994740 dv-cinder-818037-9-iscsi devstack@n-api.service[101847]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=101847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 02:55:04.994928 dv-cinder-818037-9-iscsi devstack@n-api.service[101848]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=101848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 02:55:04.995116 dv-cinder-818037-9-iscsi devstack@n-api.service[101847]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=101847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 02:55:04.995315 dv-cinder-818037-9-iscsi devstack@n-api.service[101848]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=101848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 02:55:04.995464 dv-cinder-818037-9-iscsi devstack@n-api.service[101847]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=101847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 02:55:04.995681 dv-cinder-818037-9-iscsi devstack@n-api.service[101848]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-818037-9-iscsi {{(pid=101848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 02:55:04.995874 dv-cinder-818037-9-iscsi devstack@n-api.service[101847]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=101847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 02:55:04.996059 dv-cinder-818037-9-iscsi devstack@n-api.service[101848]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=101848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 02:55:04.996250 dv-cinder-818037-9-iscsi devstack@n-api.service[101847]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=101847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 02:55:04.996438 dv-cinder-818037-9-iscsi devstack@n-api.service[101848]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=101848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 02:55:04.996631 dv-cinder-818037-9-iscsi devstack@n-api.service[101847]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=101847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 02:55:04.996822 dv-cinder-818037-9-iscsi devstack@n-api.service[101848]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=101848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 02:55:04.997014 dv-cinder-818037-9-iscsi devstack@n-api.service[101847]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-818037-9-iscsi {{(pid=101847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 02:55:04.997214 dv-cinder-818037-9-iscsi devstack@n-api.service[101848]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=101848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 02:55:04.997399 dv-cinder-818037-9-iscsi devstack@n-api.service[101847]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=101847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 02:55:04.997558 dv-cinder-818037-9-iscsi devstack@n-api.service[101848]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=101848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 02:55:04.997712 dv-cinder-818037-9-iscsi devstack@n-api.service[101847]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=101847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 02:55:04.997876 dv-cinder-818037-9-iscsi devstack@n-api.service[101848]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=101848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 02:55:04.998049 dv-cinder-818037-9-iscsi devstack@n-api.service[101847]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=101847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 02:55:04.998264 dv-cinder-818037-9-iscsi devstack@n-api.service[101848]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=101848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 02:55:04.998450 dv-cinder-818037-9-iscsi devstack@n-api.service[101847]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=101847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 02:55:04.998627 dv-cinder-818037-9-iscsi devstack@n-api.service[101848]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=101848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 02:55:04.998761 dv-cinder-818037-9-iscsi devstack@n-api.service[101847]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=101847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 02:55:04.998892 dv-cinder-818037-9-iscsi devstack@n-api.service[101848]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=101848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 02:55:04.999013 dv-cinder-818037-9-iscsi devstack@n-api.service[101847]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=101847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 02:55:04.999168 dv-cinder-818037-9-iscsi devstack@n-api.service[101848]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=101848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 02:55:04.999297 dv-cinder-818037-9-iscsi devstack@n-api.service[101847]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=101847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 02:55:04.999430 dv-cinder-818037-9-iscsi devstack@n-api.service[101848]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=101848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 02:55:04.999552 dv-cinder-818037-9-iscsi devstack@n-api.service[101847]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=101847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 02:55:04.999673 dv-cinder-818037-9-iscsi devstack@n-api.service[101848]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=101848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 02:55:04.999792 dv-cinder-818037-9-iscsi devstack@n-api.service[101847]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=101847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 02:55:04.999912 dv-cinder-818037-9-iscsi devstack@n-api.service[101848]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=101848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 02:55:05.000042 dv-cinder-818037-9-iscsi devstack@n-api.service[101847]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=101847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 02:55:05.000170 dv-cinder-818037-9-iscsi devstack@n-api.service[101848]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=101848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 02:55:05.000300 dv-cinder-818037-9-iscsi devstack@n-api.service[101847]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=101847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 02:55:05.000454 dv-cinder-818037-9-iscsi devstack@n-api.service[101848]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=101848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 02:55:05.000577 dv-cinder-818037-9-iscsi devstack@n-api.service[101847]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=101847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 02:55:05.000697 dv-cinder-818037-9-iscsi devstack@n-api.service[101848]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=101848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 02:55:05.000829 dv-cinder-818037-9-iscsi devstack@n-api.service[101847]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=101847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 02:55:05.000964 dv-cinder-818037-9-iscsi devstack@n-api.service[101848]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=101848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 02:55:05.001094 dv-cinder-818037-9-iscsi devstack@n-api.service[101847]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=101847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 02:55:05.001221 dv-cinder-818037-9-iscsi devstack@n-api.service[101848]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=101848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 02:55:05.001344 dv-cinder-818037-9-iscsi devstack@n-api.service[101847]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=101847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 02:55:05.001469 dv-cinder-818037-9-iscsi devstack@n-api.service[101848]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=101848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 02:55:05.001600 dv-cinder-818037-9-iscsi devstack@n-api.service[101847]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=101847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 02:55:05.001721 dv-cinder-818037-9-iscsi devstack@n-api.service[101848]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=101848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 02:55:05.001848 dv-cinder-818037-9-iscsi devstack@n-api.service[101847]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=101847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 02:55:05.001969 dv-cinder-818037-9-iscsi devstack@n-api.service[101848]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=101848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 02:55:05.002127 dv-cinder-818037-9-iscsi devstack@n-api.service[101847]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=101847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 02:55:05.002255 dv-cinder-818037-9-iscsi devstack@n-api.service[101848]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=101848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 02:55:05.002390 dv-cinder-818037-9-iscsi devstack@n-api.service[101847]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=101847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 02:55:05.002518 dv-cinder-818037-9-iscsi devstack@n-api.service[101848]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=101848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 02:55:05.002645 dv-cinder-818037-9-iscsi devstack@n-api.service[101847]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=101847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 02:55:05.002765 dv-cinder-818037-9-iscsi devstack@n-api.service[101848]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=101848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 02:55:05.002894 dv-cinder-818037-9-iscsi devstack@n-api.service[101847]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=101847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 02:55:05.003024 dv-cinder-818037-9-iscsi devstack@n-api.service[101848]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=101848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 02:55:05.003024 dv-cinder-818037-9-iscsi devstack@n-api.service[101848]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=101848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 02:55:05.003317 dv-cinder-818037-9-iscsi devstack@n-api.service[101847]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=101847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 02:55:05.003447 dv-cinder-818037-9-iscsi devstack@n-api.service[101848]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=101848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 02:55:05.003579 dv-cinder-818037-9-iscsi devstack@n-api.service[101847]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=101847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 02:55:05.003700 dv-cinder-818037-9-iscsi devstack@n-api.service[101848]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=101848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 02:55:05.003832 dv-cinder-818037-9-iscsi devstack@n-api.service[101847]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=101847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 02:55:05.003959 dv-cinder-818037-9-iscsi devstack@n-api.service[101848]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=101848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 02:55:05.004090 dv-cinder-818037-9-iscsi devstack@n-api.service[101847]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=101847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 02:55:05.004216 dv-cinder-818037-9-iscsi devstack@n-api.service[101847]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=101847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 02:55:05.004342 dv-cinder-818037-9-iscsi devstack@n-api.service[101848]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=101848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 02:55:05.004474 dv-cinder-818037-9-iscsi devstack@n-api.service[101847]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=101847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 02:55:05.004596 dv-cinder-818037-9-iscsi devstack@n-api.service[101848]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=101848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 02:55:05.004791 dv-cinder-818037-9-iscsi devstack@n-api.service[101847]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=101847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 02:55:05.004925 dv-cinder-818037-9-iscsi devstack@n-api.service[101848]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=101848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 02:55:05.005371 dv-cinder-818037-9-iscsi devstack@n-api.service[101847]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=101847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 02:55:05.005509 dv-cinder-818037-9-iscsi devstack@n-api.service[101848]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=101848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 02:55:05.005682 dv-cinder-818037-9-iscsi devstack@n-api.service[101848]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=101848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 02:55:05.005805 dv-cinder-818037-9-iscsi devstack@n-api.service[101847]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=101847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 02:55:05.006033 dv-cinder-818037-9-iscsi devstack@n-api.service[101848]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=101848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 02:55:05.006201 dv-cinder-818037-9-iscsi devstack@n-api.service[101847]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=101847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 02:55:05.006358 dv-cinder-818037-9-iscsi devstack@n-api.service[101848]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=101848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 02:55:05.006495 dv-cinder-818037-9-iscsi devstack@n-api.service[101847]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=101847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 02:55:05.006671 dv-cinder-818037-9-iscsi devstack@n-api.service[101847]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=101847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 02:55:05.006801 dv-cinder-818037-9-iscsi devstack@n-api.service[101848]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=101848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 02:55:05.006986 dv-cinder-818037-9-iscsi devstack@n-api.service[101847]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=101847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 02:55:05.007118 dv-cinder-818037-9-iscsi devstack@n-api.service[101848]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=101848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 02:55:05.007301 dv-cinder-818037-9-iscsi devstack@n-api.service[101847]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=101847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 02:55:05.007434 dv-cinder-818037-9-iscsi devstack@n-api.service[101848]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=101848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 02:55:05.007614 dv-cinder-818037-9-iscsi devstack@n-api.service[101848]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=101848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 02:55:05.007743 dv-cinder-818037-9-iscsi devstack@n-api.service[101847]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=101847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 02:55:05.007937 dv-cinder-818037-9-iscsi devstack@n-api.service[101847]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=101847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 02:55:05.008060 dv-cinder-818037-9-iscsi devstack@n-api.service[101848]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=101848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 02:55:05.008259 dv-cinder-818037-9-iscsi devstack@n-api.service[101847]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=101847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 02:55:05.008392 dv-cinder-818037-9-iscsi devstack@n-api.service[101848]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.18 {{(pid=101848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 02:55:05.008575 dv-cinder-818037-9-iscsi devstack@n-api.service[101848]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.18 {{(pid=101848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 02:55:05.008705 dv-cinder-818037-9-iscsi devstack@n-api.service[101847]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=101847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 02:55:05.008889 dv-cinder-818037-9-iscsi devstack@n-api.service[101848]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=101848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 02:55:05.009013 dv-cinder-818037-9-iscsi devstack@n-api.service[101847]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=101847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 02:55:05.009212 dv-cinder-818037-9-iscsi devstack@n-api.service[101847]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=101847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 02:55:05.009347 dv-cinder-818037-9-iscsi devstack@n-api.service[101848]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=101848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 02:55:05.009541 dv-cinder-818037-9-iscsi devstack@n-api.service[101848]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=101848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 02:55:05.009664 dv-cinder-818037-9-iscsi devstack@n-api.service[101847]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.18 {{(pid=101847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 02:55:05.009855 dv-cinder-818037-9-iscsi devstack@n-api.service[101848]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=101848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 02:55:05.009995 dv-cinder-818037-9-iscsi devstack@n-api.service[101847]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.18 {{(pid=101847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 02:55:05.010195 dv-cinder-818037-9-iscsi devstack@n-api.service[101847]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=101847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 02:55:05.010320 dv-cinder-818037-9-iscsi devstack@n-api.service[101848]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=101848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 02:55:05.010519 dv-cinder-818037-9-iscsi devstack@n-api.service[101848]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=101848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 02:55:05.010648 dv-cinder-818037-9-iscsi devstack@n-api.service[101847]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=101847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 02:55:05.010832 dv-cinder-818037-9-iscsi devstack@n-api.service[101848]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=101848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 02:55:05.010962 dv-cinder-818037-9-iscsi devstack@n-api.service[101847]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=101847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 02:55:05.011140 dv-cinder-818037-9-iscsi devstack@n-api.service[101848]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=101848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 02:55:05.011271 dv-cinder-818037-9-iscsi devstack@n-api.service[101847]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=101847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 02:55:05.011450 dv-cinder-818037-9-iscsi devstack@n-api.service[101848]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=101848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 02:55:05.011575 dv-cinder-818037-9-iscsi devstack@n-api.service[101847]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=101847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 02:55:05.011775 dv-cinder-818037-9-iscsi devstack@n-api.service[101847]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=101847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 02:55:05.011897 dv-cinder-818037-9-iscsi devstack@n-api.service[101848]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=101848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 02:55:05.012090 dv-cinder-818037-9-iscsi devstack@n-api.service[101847]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=101847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 02:55:05.012216 dv-cinder-818037-9-iscsi devstack@n-api.service[101848]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=101848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 02:55:05.012402 dv-cinder-818037-9-iscsi devstack@n-api.service[101847]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=101847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 02:55:05.012534 dv-cinder-818037-9-iscsi devstack@n-api.service[101848]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=101848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 02:55:05.012654 dv-cinder-818037-9-iscsi devstack@n-api.service[101848]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=101848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 02:55:05.012778 dv-cinder-818037-9-iscsi devstack@n-api.service[101847]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=101847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 02:55:05.012945 dv-cinder-818037-9-iscsi devstack@n-api.service[101848]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=101848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 02:55:05.013070 dv-cinder-818037-9-iscsi devstack@n-api.service[101847]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=101847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 02:55:05.013256 dv-cinder-818037-9-iscsi devstack@n-api.service[101848]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=101848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 02:55:05.013381 dv-cinder-818037-9-iscsi devstack@n-api.service[101847]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=101847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 02:55:05.013575 dv-cinder-818037-9-iscsi devstack@n-api.service[101848]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=101848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 02:55:05.013708 dv-cinder-818037-9-iscsi devstack@n-api.service[101847]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=101847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 02:55:05.013886 dv-cinder-818037-9-iscsi devstack@n-api.service[101848]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=101848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 02:55:05.014042 dv-cinder-818037-9-iscsi devstack@n-api.service[101847]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=101847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 02:55:05.014213 dv-cinder-818037-9-iscsi devstack@n-api.service[101847]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=101847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 02:55:05.014335 dv-cinder-818037-9-iscsi devstack@n-api.service[101848]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=101848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 02:55:05.014524 dv-cinder-818037-9-iscsi devstack@n-api.service[101848]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=101848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 02:55:05.014661 dv-cinder-818037-9-iscsi devstack@n-api.service[101847]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=101847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 02:55:05.014827 dv-cinder-818037-9-iscsi devstack@n-api.service[101848]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=101848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 02:55:05.014951 dv-cinder-818037-9-iscsi devstack@n-api.service[101847]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=101847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 02:55:05.015137 dv-cinder-818037-9-iscsi devstack@n-api.service[101848]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=101848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 02:55:05.015261 dv-cinder-818037-9-iscsi devstack@n-api.service[101847]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=101847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 02:55:05.015447 dv-cinder-818037-9-iscsi devstack@n-api.service[101847]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=101847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 02:55:05.015583 dv-cinder-818037-9-iscsi devstack@n-api.service[101848]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=101848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 02:55:05.015756 dv-cinder-818037-9-iscsi devstack@n-api.service[101848]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=101848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 02:55:05.015889 dv-cinder-818037-9-iscsi devstack@n-api.service[101847]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=101847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 02:55:05.016059 dv-cinder-818037-9-iscsi devstack@n-api.service[101847]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=101847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 02:55:05.016188 dv-cinder-818037-9-iscsi devstack@n-api.service[101848]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=101848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 02:55:05.016368 dv-cinder-818037-9-iscsi devstack@n-api.service[101848]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=101848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 02:55:05.016499 dv-cinder-818037-9-iscsi devstack@n-api.service[101847]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=101847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 02:55:05.016675 dv-cinder-818037-9-iscsi devstack@n-api.service[101848]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=101848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 02:55:05.016798 dv-cinder-818037-9-iscsi devstack@n-api.service[101847]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=101847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 02:55:05.016983 dv-cinder-818037-9-iscsi devstack@n-api.service[101847]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=101847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 02:55:05.017112 dv-cinder-818037-9-iscsi devstack@n-api.service[101848]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=101848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 02:55:05.017288 dv-cinder-818037-9-iscsi devstack@n-api.service[101848]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=101848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 02:55:05.017420 dv-cinder-818037-9-iscsi devstack@n-api.service[101847]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=101847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 02:55:05.017597 dv-cinder-818037-9-iscsi devstack@n-api.service[101847]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=101847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 02:55:05.017721 dv-cinder-818037-9-iscsi devstack@n-api.service[101848]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=101848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 02:55:05.017906 dv-cinder-818037-9-iscsi devstack@n-api.service[101847]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=101847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 02:55:05.018047 dv-cinder-818037-9-iscsi devstack@n-api.service[101848]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=101848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 02:55:05.018245 dv-cinder-818037-9-iscsi devstack@n-api.service[101847]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=101847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 02:55:05.018376 dv-cinder-818037-9-iscsi devstack@n-api.service[101848]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=101848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 02:55:05.018553 dv-cinder-818037-9-iscsi devstack@n-api.service[101848]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=101848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 02:55:05.018682 dv-cinder-818037-9-iscsi devstack@n-api.service[101847]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=101847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 02:55:05.018861 dv-cinder-818037-9-iscsi devstack@n-api.service[101847]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=101847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 02:55:05.018983 dv-cinder-818037-9-iscsi devstack@n-api.service[101848]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=101848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 02:55:05.019167 dv-cinder-818037-9-iscsi devstack@n-api.service[101848]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=101848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 02:55:05.019290 dv-cinder-818037-9-iscsi devstack@n-api.service[101847]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=101847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 02:55:05.019483 dv-cinder-818037-9-iscsi devstack@n-api.service[101848]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=101848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 02:55:05.019617 dv-cinder-818037-9-iscsi devstack@n-api.service[101847]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=101847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 02:55:05.019794 dv-cinder-818037-9-iscsi devstack@n-api.service[101847]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=101847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 02:55:05.019910 dv-cinder-818037-9-iscsi devstack@n-api.service[101848]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=101848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 02:55:05.020103 dv-cinder-818037-9-iscsi devstack@n-api.service[101848]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=101848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 02:55:05.020226 dv-cinder-818037-9-iscsi devstack@n-api.service[101847]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=101847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 02:55:05.020412 dv-cinder-818037-9-iscsi devstack@n-api.service[101847]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=101847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 02:55:05.020543 dv-cinder-818037-9-iscsi devstack@n-api.service[101848]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=101848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 02:55:05.020723 dv-cinder-818037-9-iscsi devstack@n-api.service[101847]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=101847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 02:55:05.020861 dv-cinder-818037-9-iscsi devstack@n-api.service[101848]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=101848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 02:55:05.021033 dv-cinder-818037-9-iscsi devstack@n-api.service[101848]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=101848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 02:55:05.021171 dv-cinder-818037-9-iscsi devstack@n-api.service[101847]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=101847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 02:55:05.021342 dv-cinder-818037-9-iscsi devstack@n-api.service[101848]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=101848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 02:55:05.021472 dv-cinder-818037-9-iscsi devstack@n-api.service[101847]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=101847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 02:55:05.021654 dv-cinder-818037-9-iscsi devstack@n-api.service[101847]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=101847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 02:55:05.022304 dv-cinder-818037-9-iscsi devstack@n-api.service[101848]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=101848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 02:55:05.022514 dv-cinder-818037-9-iscsi devstack@n-api.service[101847]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=101847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 02:55:05.022640 dv-cinder-818037-9-iscsi devstack@n-api.service[101848]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=101848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 02:55:05.022829 dv-cinder-818037-9-iscsi devstack@n-api.service[101847]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=101847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 02:55:05.022960 dv-cinder-818037-9-iscsi devstack@n-api.service[101848]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=101848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 02:55:05.023140 dv-cinder-818037-9-iscsi devstack@n-api.service[101847]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=101847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 02:55:05.023270 dv-cinder-818037-9-iscsi devstack@n-api.service[101848]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=101848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 02:55:05.023466 dv-cinder-818037-9-iscsi devstack@n-api.service[101847]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=101847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 02:55:05.023589 dv-cinder-818037-9-iscsi devstack@n-api.service[101848]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=101848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 02:55:05.023762 dv-cinder-818037-9-iscsi devstack@n-api.service[101848]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=101848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 02:55:05.023891 dv-cinder-818037-9-iscsi devstack@n-api.service[101847]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=101847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 02:55:05.024074 dv-cinder-818037-9-iscsi devstack@n-api.service[101847]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=101847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 02:55:05.024197 dv-cinder-818037-9-iscsi devstack@n-api.service[101848]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=101848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 02:55:05.024385 dv-cinder-818037-9-iscsi devstack@n-api.service[101848]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=101848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 02:55:05.024509 dv-cinder-818037-9-iscsi devstack@n-api.service[101847]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=101847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 02:55:05.024690 dv-cinder-818037-9-iscsi devstack@n-api.service[101847]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=101847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 02:55:05.024812 dv-cinder-818037-9-iscsi devstack@n-api.service[101848]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=101848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 02:55:05.024993 dv-cinder-818037-9-iscsi devstack@n-api.service[101848]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=101848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 02:55:05.025116 dv-cinder-818037-9-iscsi devstack@n-api.service[101847]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=101847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 02:55:05.025302 dv-cinder-818037-9-iscsi devstack@n-api.service[101848]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=101848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 02:55:05.025436 dv-cinder-818037-9-iscsi devstack@n-api.service[101847]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=101847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 02:55:05.025611 dv-cinder-818037-9-iscsi devstack@n-api.service[101848]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=101848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 02:55:05.025735 dv-cinder-818037-9-iscsi devstack@n-api.service[101847]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=101847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 02:55:05.025919 dv-cinder-818037-9-iscsi devstack@n-api.service[101848]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=101848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 02:55:05.026072 dv-cinder-818037-9-iscsi devstack@n-api.service[101847]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=101847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 02:55:05.026251 dv-cinder-818037-9-iscsi devstack@n-api.service[101848]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=101848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 02:55:05.026375 dv-cinder-818037-9-iscsi devstack@n-api.service[101847]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=101847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 02:55:05.026559 dv-cinder-818037-9-iscsi devstack@n-api.service[101847]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=101847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 02:55:05.026688 dv-cinder-818037-9-iscsi devstack@n-api.service[101848]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=101848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 02:55:05.026858 dv-cinder-818037-9-iscsi devstack@n-api.service[101848]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=101848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 02:55:05.026997 dv-cinder-818037-9-iscsi devstack@n-api.service[101847]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=101847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 02:55:05.027168 dv-cinder-818037-9-iscsi devstack@n-api.service[101847]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=101847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 02:55:05.027290 dv-cinder-818037-9-iscsi devstack@n-api.service[101848]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=101848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 02:55:05.027476 dv-cinder-818037-9-iscsi devstack@n-api.service[101847]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=101847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 02:55:05.027601 dv-cinder-818037-9-iscsi devstack@n-api.service[101848]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=101848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 02:55:05.027785 dv-cinder-818037-9-iscsi devstack@n-api.service[101847]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=101847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 02:55:05.027919 dv-cinder-818037-9-iscsi devstack@n-api.service[101848]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=101848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 02:55:05.028092 dv-cinder-818037-9-iscsi devstack@n-api.service[101847]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=101847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 02:55:05.028217 dv-cinder-818037-9-iscsi devstack@n-api.service[101848]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=101848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 02:55:05.028398 dv-cinder-818037-9-iscsi devstack@n-api.service[101848]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=101848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 02:55:05.028521 dv-cinder-818037-9-iscsi devstack@n-api.service[101847]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=101847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 02:55:05.028720 dv-cinder-818037-9-iscsi devstack@n-api.service[101848]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=101848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 02:55:05.028853 dv-cinder-818037-9-iscsi devstack@n-api.service[101847]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=101847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 02:55:05.029037 dv-cinder-818037-9-iscsi devstack@n-api.service[101847]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=101847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 02:55:05.029159 dv-cinder-818037-9-iscsi devstack@n-api.service[101848]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=101848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:55:05.029351 dv-cinder-818037-9-iscsi devstack@n-api.service[101847]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=101847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 02:55:05.029475 dv-cinder-818037-9-iscsi devstack@n-api.service[101848]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=101848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:55:05.029662 dv-cinder-818037-9-iscsi devstack@n-api.service[101847]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=101847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 02:55:05.029793 dv-cinder-818037-9-iscsi devstack@n-api.service[101848]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=101848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:55:05.030021 dv-cinder-818037-9-iscsi devstack@n-api.service[101847]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=101847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 02:55:05.030153 dv-cinder-818037-9-iscsi devstack@n-api.service[101848]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=101848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:55:05.030345 dv-cinder-818037-9-iscsi devstack@n-api.service[101847]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=101847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:55:05.030469 dv-cinder-818037-9-iscsi devstack@n-api.service[101848]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=101848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:55:05.030682 dv-cinder-818037-9-iscsi devstack@n-api.service[101847]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=101847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:55:05.030813 dv-cinder-818037-9-iscsi devstack@n-api.service[101848]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=101848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:55:05.031002 dv-cinder-818037-9-iscsi devstack@n-api.service[101848]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=101848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:55:05.031125 dv-cinder-818037-9-iscsi devstack@n-api.service[101847]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=101847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:55:05.031318 dv-cinder-818037-9-iscsi devstack@n-api.service[101848]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=101848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:55:05.031443 dv-cinder-818037-9-iscsi devstack@n-api.service[101847]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=101847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:55:05.031636 dv-cinder-818037-9-iscsi devstack@n-api.service[101848]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=101848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:55:05.031767 dv-cinder-818037-9-iscsi devstack@n-api.service[101847]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=101847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:55:05.031967 dv-cinder-818037-9-iscsi devstack@n-api.service[101848]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=101848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:55:05.032092 dv-cinder-818037-9-iscsi devstack@n-api.service[101847]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=101847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:55:05.032285 dv-cinder-818037-9-iscsi devstack@n-api.service[101848]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=101848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:55:05.032451 dv-cinder-818037-9-iscsi devstack@n-api.service[101847]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=101847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:55:05.032580 dv-cinder-818037-9-iscsi devstack@n-api.service[101848]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=101848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:55:05.032708 dv-cinder-818037-9-iscsi devstack@n-api.service[101847]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=101847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:55:05.032896 dv-cinder-818037-9-iscsi devstack@n-api.service[101848]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=101848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:55:05.033027 dv-cinder-818037-9-iscsi devstack@n-api.service[101847]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=101847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:55:05.033219 dv-cinder-818037-9-iscsi devstack@n-api.service[101848]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=101848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:55:05.033352 dv-cinder-818037-9-iscsi devstack@n-api.service[101847]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=101847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:55:05.033535 dv-cinder-818037-9-iscsi devstack@n-api.service[101847]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=101847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:55:05.033658 dv-cinder-818037-9-iscsi devstack@n-api.service[101848]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=101848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:55:05.033857 dv-cinder-818037-9-iscsi devstack@n-api.service[101847]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=101847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:55:05.034000 dv-cinder-818037-9-iscsi devstack@n-api.service[101848]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=101848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:55:05.034200 dv-cinder-818037-9-iscsi devstack@n-api.service[101847]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=101847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:55:05.034337 dv-cinder-818037-9-iscsi devstack@n-api.service[101848]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=101848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:55:05.034521 dv-cinder-818037-9-iscsi devstack@n-api.service[101848]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=101848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:55:05.034668 dv-cinder-818037-9-iscsi devstack@n-api.service[101847]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=101847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:55:05.034847 dv-cinder-818037-9-iscsi devstack@n-api.service[101847]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=101847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:55:05.034971 dv-cinder-818037-9-iscsi devstack@n-api.service[101848]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=101848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:55:05.035161 dv-cinder-818037-9-iscsi devstack@n-api.service[101848]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=101848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:55:05.035296 dv-cinder-818037-9-iscsi devstack@n-api.service[101847]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=101847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:55:05.035485 dv-cinder-818037-9-iscsi devstack@n-api.service[101848]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=101848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:55:05.035616 dv-cinder-818037-9-iscsi devstack@n-api.service[101847]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=101847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:55:05.035805 dv-cinder-818037-9-iscsi devstack@n-api.service[101847]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=101847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:55:05.035952 dv-cinder-818037-9-iscsi devstack@n-api.service[101848]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=101848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:55:05.036127 dv-cinder-818037-9-iscsi devstack@n-api.service[101848]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=101848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:55:05.036263 dv-cinder-818037-9-iscsi devstack@n-api.service[101847]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=101847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:55:05.036442 dv-cinder-818037-9-iscsi devstack@n-api.service[101848]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=101848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:55:05.036560 dv-cinder-818037-9-iscsi devstack@n-api.service[101847]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=101847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:55:05.036767 dv-cinder-818037-9-iscsi devstack@n-api.service[101847]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=101847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:55:05.036890 dv-cinder-818037-9-iscsi devstack@n-api.service[101848]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=101848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:55:05.037103 dv-cinder-818037-9-iscsi devstack@n-api.service[101847]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=101847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:55:05.037240 dv-cinder-818037-9-iscsi devstack@n-api.service[101848]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=101848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:55:05.037466 dv-cinder-818037-9-iscsi devstack@n-api.service[101848]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=101848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:55:05.038178 dv-cinder-818037-9-iscsi devstack@n-api.service[101847]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=101847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:55:05.038335 dv-cinder-818037-9-iscsi devstack@n-api.service[101848]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=101848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:55:05.038468 dv-cinder-818037-9-iscsi devstack@n-api.service[101847]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=101847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:55:05.038654 dv-cinder-818037-9-iscsi devstack@n-api.service[101848]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=101848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:55:05.038786 dv-cinder-818037-9-iscsi devstack@n-api.service[101847]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=101847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:55:05.038982 dv-cinder-818037-9-iscsi devstack@n-api.service[101848]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=101848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:55:05.039114 dv-cinder-818037-9-iscsi devstack@n-api.service[101847]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=101847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:55:05.039301 dv-cinder-818037-9-iscsi devstack@n-api.service[101848]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=101848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:55:05.039426 dv-cinder-818037-9-iscsi devstack@n-api.service[101847]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=101847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:55:05.039628 dv-cinder-818037-9-iscsi devstack@n-api.service[101848]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=101848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:55:05.039758 dv-cinder-818037-9-iscsi devstack@n-api.service[101847]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=101847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:55:05.039939 dv-cinder-818037-9-iscsi devstack@n-api.service[101848]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=101848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:55:05.040065 dv-cinder-818037-9-iscsi devstack@n-api.service[101847]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=101847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:55:05.040280 dv-cinder-818037-9-iscsi devstack@n-api.service[101848]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=101848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:55:05.040405 dv-cinder-818037-9-iscsi devstack@n-api.service[101847]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=101847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:55:05.040597 dv-cinder-818037-9-iscsi devstack@n-api.service[101848]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=101848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:55:05.040729 dv-cinder-818037-9-iscsi devstack@n-api.service[101847]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=101847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:55:05.040914 dv-cinder-818037-9-iscsi devstack@n-api.service[101848]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=101848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:55:05.041039 dv-cinder-818037-9-iscsi devstack@n-api.service[101847]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=101847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:55:05.041252 dv-cinder-818037-9-iscsi devstack@n-api.service[101847]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=101847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:55:05.041378 dv-cinder-818037-9-iscsi devstack@n-api.service[101848]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=101848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:55:05.041571 dv-cinder-818037-9-iscsi devstack@n-api.service[101848]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=101848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:55:05.041696 dv-cinder-818037-9-iscsi devstack@n-api.service[101847]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=101847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:55:05.041889 dv-cinder-818037-9-iscsi devstack@n-api.service[101848]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=101848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:55:05.042048 dv-cinder-818037-9-iscsi devstack@n-api.service[101847]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=101847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:55:05.042225 dv-cinder-818037-9-iscsi devstack@n-api.service[101848]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=101848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:55:05.042357 dv-cinder-818037-9-iscsi devstack@n-api.service[101847]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=101847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:55:05.042534 dv-cinder-818037-9-iscsi devstack@n-api.service[101848]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=101848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:55:05.042659 dv-cinder-818037-9-iscsi devstack@n-api.service[101847]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=101847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:55:05.042842 dv-cinder-818037-9-iscsi devstack@n-api.service[101848]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=101848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:55:05.042975 dv-cinder-818037-9-iscsi devstack@n-api.service[101847]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=101847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:55:05.043153 dv-cinder-818037-9-iscsi devstack@n-api.service[101848]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=101848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:55:05.043290 dv-cinder-818037-9-iscsi devstack@n-api.service[101847]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=101847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:55:05.043461 dv-cinder-818037-9-iscsi devstack@n-api.service[101848]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=101848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:55:05.043579 dv-cinder-818037-9-iscsi devstack@n-api.service[101847]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=101847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:55:05.043777 dv-cinder-818037-9-iscsi devstack@n-api.service[101847]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=101847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:55:05.043909 dv-cinder-818037-9-iscsi devstack@n-api.service[101848]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=101848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:55:05.044090 dv-cinder-818037-9-iscsi devstack@n-api.service[101847]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=101847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:55:05.044225 dv-cinder-818037-9-iscsi devstack@n-api.service[101848]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=101848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:55:05.044400 dv-cinder-818037-9-iscsi devstack@n-api.service[101848]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=101848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:55:05.044524 dv-cinder-818037-9-iscsi devstack@n-api.service[101847]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=101847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:55:05.044710 dv-cinder-818037-9-iscsi devstack@n-api.service[101847]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=101847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:55:05.044840 dv-cinder-818037-9-iscsi devstack@n-api.service[101848]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=101848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:55:05.045029 dv-cinder-818037-9-iscsi devstack@n-api.service[101848]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=101848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:55:05.045161 dv-cinder-818037-9-iscsi devstack@n-api.service[101847]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=101847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:55:05.045343 dv-cinder-818037-9-iscsi devstack@n-api.service[101848]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=101848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:55:05.045475 dv-cinder-818037-9-iscsi devstack@n-api.service[101847]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=101847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:55:05.045656 dv-cinder-818037-9-iscsi devstack@n-api.service[101847]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=101847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:55:05.045779 dv-cinder-818037-9-iscsi devstack@n-api.service[101848]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=101848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:55:05.045964 dv-cinder-818037-9-iscsi devstack@n-api.service[101848]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=101848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:55:05.046157 dv-cinder-818037-9-iscsi devstack@n-api.service[101847]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=101847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:55:05.046288 dv-cinder-818037-9-iscsi devstack@n-api.service[101848]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=101848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:55:05.046410 dv-cinder-818037-9-iscsi devstack@n-api.service[101847]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=101847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:55:05.046605 dv-cinder-818037-9-iscsi devstack@n-api.service[101848]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=101848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:55:05.046729 dv-cinder-818037-9-iscsi devstack@n-api.service[101847]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=101847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:55:05.046921 dv-cinder-818037-9-iscsi devstack@n-api.service[101848]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=101848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:55:05.047046 dv-cinder-818037-9-iscsi devstack@n-api.service[101847]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=101847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:55:05.047215 dv-cinder-818037-9-iscsi devstack@n-api.service[101847]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=101847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:55:05.047339 dv-cinder-818037-9-iscsi devstack@n-api.service[101848]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=101848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:55:05.047530 dv-cinder-818037-9-iscsi devstack@n-api.service[101848]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=101848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:55:05.047654 dv-cinder-818037-9-iscsi devstack@n-api.service[101847]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=101847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:55:05.047842 dv-cinder-818037-9-iscsi devstack@n-api.service[101848]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=101848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:55:05.047968 dv-cinder-818037-9-iscsi devstack@n-api.service[101847]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=101847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:55:05.048149 dv-cinder-818037-9-iscsi devstack@n-api.service[101847]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=101847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:55:05.048273 dv-cinder-818037-9-iscsi devstack@n-api.service[101848]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=101848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:55:05.048467 dv-cinder-818037-9-iscsi devstack@n-api.service[101848]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=101848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:55:05.048590 dv-cinder-818037-9-iscsi devstack@n-api.service[101847]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=101847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:55:05.048775 dv-cinder-818037-9-iscsi devstack@n-api.service[101848]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=101848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:55:05.048910 dv-cinder-818037-9-iscsi devstack@n-api.service[101847]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=101847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:55:05.049090 dv-cinder-818037-9-iscsi devstack@n-api.service[101847]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=101847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:55:05.049223 dv-cinder-818037-9-iscsi devstack@n-api.service[101848]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=101848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:55:05.049403 dv-cinder-818037-9-iscsi devstack@n-api.service[101848]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=101848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:55:05.049533 dv-cinder-818037-9-iscsi devstack@n-api.service[101847]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=101847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:55:05.049719 dv-cinder-818037-9-iscsi devstack@n-api.service[101847]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=101847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:55:05.049849 dv-cinder-818037-9-iscsi devstack@n-api.service[101848]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=101848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:55:05.050055 dv-cinder-818037-9-iscsi devstack@n-api.service[101847]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=101847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:55:05.050195 dv-cinder-818037-9-iscsi devstack@n-api.service[101848]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=101848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:55:05.050379 dv-cinder-818037-9-iscsi devstack@n-api.service[101847]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=101847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:55:05.050512 dv-cinder-818037-9-iscsi devstack@n-api.service[101848]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=101848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:55:05.050694 dv-cinder-818037-9-iscsi devstack@n-api.service[101848]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=101848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:55:05.050818 dv-cinder-818037-9-iscsi devstack@n-api.service[101847]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=101847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:55:05.051009 dv-cinder-818037-9-iscsi devstack@n-api.service[101848]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=101848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:55:05.051134 dv-cinder-818037-9-iscsi devstack@n-api.service[101847]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=101847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:55:05.051327 dv-cinder-818037-9-iscsi devstack@n-api.service[101847]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=101847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:55:05.051461 dv-cinder-818037-9-iscsi devstack@n-api.service[101848]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=101848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:55:05.051656 dv-cinder-818037-9-iscsi devstack@n-api.service[101847]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=101847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:55:05.051781 dv-cinder-818037-9-iscsi devstack@n-api.service[101848]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=101848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:55:05.051966 dv-cinder-818037-9-iscsi devstack@n-api.service[101848]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=101848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:55:05.052088 dv-cinder-818037-9-iscsi devstack@n-api.service[101847]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=101847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:55:05.052283 dv-cinder-818037-9-iscsi devstack@n-api.service[101847]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=101847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:55:05.052415 dv-cinder-818037-9-iscsi devstack@n-api.service[101848]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=101848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:55:05.052613 dv-cinder-818037-9-iscsi devstack@n-api.service[101848]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=101848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:55:05.052736 dv-cinder-818037-9-iscsi devstack@n-api.service[101847]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=101847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:55:05.052933 dv-cinder-818037-9-iscsi devstack@n-api.service[101848]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=101848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:55:05.053066 dv-cinder-818037-9-iscsi devstack@n-api.service[101847]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=101847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:55:05.053270 dv-cinder-818037-9-iscsi devstack@n-api.service[101848]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=101848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:55:05.053403 dv-cinder-818037-9-iscsi devstack@n-api.service[101847]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=101847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:55:05.053584 dv-cinder-818037-9-iscsi devstack@n-api.service[101848]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=101848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:55:05.053716 dv-cinder-818037-9-iscsi devstack@n-api.service[101847]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=101847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:55:05.053894 dv-cinder-818037-9-iscsi devstack@n-api.service[101848]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=101848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:55:05.054053 dv-cinder-818037-9-iscsi devstack@n-api.service[101847]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=101847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:55:05.054228 dv-cinder-818037-9-iscsi devstack@n-api.service[101848]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=101848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:55:05.054355 dv-cinder-818037-9-iscsi devstack@n-api.service[101847]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=101847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:55:05.054538 dv-cinder-818037-9-iscsi devstack@n-api.service[101848]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=101848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:55:05.054663 dv-cinder-818037-9-iscsi devstack@n-api.service[101847]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=101847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:55:05.054850 dv-cinder-818037-9-iscsi devstack@n-api.service[101847]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=101847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:55:05.054974 dv-cinder-818037-9-iscsi devstack@n-api.service[101848]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=101848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:55:05.055158 dv-cinder-818037-9-iscsi devstack@n-api.service[101848]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=101848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:55:05.055286 dv-cinder-818037-9-iscsi devstack@n-api.service[101847]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=101847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:55:05.055465 dv-cinder-818037-9-iscsi devstack@n-api.service[101847]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=101847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:55:05.055588 dv-cinder-818037-9-iscsi devstack@n-api.service[101848]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=101848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:55:05.055771 dv-cinder-818037-9-iscsi devstack@n-api.service[101848]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=101848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:55:05.055894 dv-cinder-818037-9-iscsi devstack@n-api.service[101847]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=101847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:55:05.056079 dv-cinder-818037-9-iscsi devstack@n-api.service[101848]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=101848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:55:05.056212 dv-cinder-818037-9-iscsi devstack@n-api.service[101847]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=101847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:55:05.056387 dv-cinder-818037-9-iscsi devstack@n-api.service[101847]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=101847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:55:05.056512 dv-cinder-818037-9-iscsi devstack@n-api.service[101848]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=101848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:55:05.056699 dv-cinder-818037-9-iscsi devstack@n-api.service[101847]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=101847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:55:05.056823 dv-cinder-818037-9-iscsi devstack@n-api.service[101848]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=101848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:55:05.057009 dv-cinder-818037-9-iscsi devstack@n-api.service[101847]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=101847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:55:05.057134 dv-cinder-818037-9-iscsi devstack@n-api.service[101848]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=101848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:55:05.057315 dv-cinder-818037-9-iscsi devstack@n-api.service[101848]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=101848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:55:05.057438 dv-cinder-818037-9-iscsi devstack@n-api.service[101847]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=101847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:55:05.057620 dv-cinder-818037-9-iscsi devstack@n-api.service[101847]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=101847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:55:05.057752 dv-cinder-818037-9-iscsi devstack@n-api.service[101848]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=101848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:55:05.057925 dv-cinder-818037-9-iscsi devstack@n-api.service[101848]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=101848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:55:05.058074 dv-cinder-818037-9-iscsi devstack@n-api.service[101847]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=101847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:55:05.058272 dv-cinder-818037-9-iscsi devstack@n-api.service[101847]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=101847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:55:05.058403 dv-cinder-818037-9-iscsi devstack@n-api.service[101848]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=101848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:55:05.058585 dv-cinder-818037-9-iscsi devstack@n-api.service[101847]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=101847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:55:05.058719 dv-cinder-818037-9-iscsi devstack@n-api.service[101848]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=101848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:55:05.058895 dv-cinder-818037-9-iscsi devstack@n-api.service[101847]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=101847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:55:05.059027 dv-cinder-818037-9-iscsi devstack@n-api.service[101848]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=101848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:55:05.059212 dv-cinder-818037-9-iscsi devstack@n-api.service[101847]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=101847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:55:05.059337 dv-cinder-818037-9-iscsi devstack@n-api.service[101848]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=101848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:55:05.059559 dv-cinder-818037-9-iscsi devstack@n-api.service[101848]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=101848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:55:05.059701 dv-cinder-818037-9-iscsi devstack@n-api.service[101847]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=101847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:55:05.059868 dv-cinder-818037-9-iscsi devstack@n-api.service[101847]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=101847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:55:05.059999 dv-cinder-818037-9-iscsi devstack@n-api.service[101848]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=101848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:55:05.060195 dv-cinder-818037-9-iscsi devstack@n-api.service[101848]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=101848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:55:05.060318 dv-cinder-818037-9-iscsi devstack@n-api.service[101847]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=101847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:55:05.060513 dv-cinder-818037-9-iscsi devstack@n-api.service[101848]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=101848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:55:05.060646 dv-cinder-818037-9-iscsi devstack@n-api.service[101847]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=101847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:55:05.060827 dv-cinder-818037-9-iscsi devstack@n-api.service[101848]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=101848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:55:05.060953 dv-cinder-818037-9-iscsi devstack@n-api.service[101847]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=101847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:55:05.061146 dv-cinder-818037-9-iscsi devstack@n-api.service[101848]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=101848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:55:05.061279 dv-cinder-818037-9-iscsi devstack@n-api.service[101847]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=101847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:55:05.061463 dv-cinder-818037-9-iscsi devstack@n-api.service[101848]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=101848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:55:05.061594 dv-cinder-818037-9-iscsi devstack@n-api.service[101847]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=101847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:55:05.061780 dv-cinder-818037-9-iscsi devstack@n-api.service[101848]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=101848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:55:05.061904 dv-cinder-818037-9-iscsi devstack@n-api.service[101847]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=101847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:55:05.062117 dv-cinder-818037-9-iscsi devstack@n-api.service[101847]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=101847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:55:05.062253 dv-cinder-818037-9-iscsi devstack@n-api.service[101848]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=101848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:55:05.062433 dv-cinder-818037-9-iscsi devstack@n-api.service[101848]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=101848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:55:05.062557 dv-cinder-818037-9-iscsi devstack@n-api.service[101847]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=101847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:55:05.062748 dv-cinder-818037-9-iscsi devstack@n-api.service[101847]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=101847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:55:05.062872 dv-cinder-818037-9-iscsi devstack@n-api.service[101848]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=101848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:55:05.063060 dv-cinder-818037-9-iscsi devstack@n-api.service[101848]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=101848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:55:05.063183 dv-cinder-818037-9-iscsi devstack@n-api.service[101847]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=101847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:55:05.063387 dv-cinder-818037-9-iscsi devstack@n-api.service[101847]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=101847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:55:05.063518 dv-cinder-818037-9-iscsi devstack@n-api.service[101848]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=101848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:55:05.063701 dv-cinder-818037-9-iscsi devstack@n-api.service[101848]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=101848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:55:05.063825 dv-cinder-818037-9-iscsi devstack@n-api.service[101847]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=101847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:55:05.064025 dv-cinder-818037-9-iscsi devstack@n-api.service[101847]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=101847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:55:05.064154 dv-cinder-818037-9-iscsi devstack@n-api.service[101848]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=101848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:55:05.064329 dv-cinder-818037-9-iscsi devstack@n-api.service[101848]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=101848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:55:05.064460 dv-cinder-818037-9-iscsi devstack@n-api.service[101847]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=101847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:55:05.064647 dv-cinder-818037-9-iscsi devstack@n-api.service[101848]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=101848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:55:05.064771 dv-cinder-818037-9-iscsi devstack@n-api.service[101847]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=101847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:55:05.064960 dv-cinder-818037-9-iscsi devstack@n-api.service[101847]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=101847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:55:05.065095 dv-cinder-818037-9-iscsi devstack@n-api.service[101848]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=101848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:55:05.065289 dv-cinder-818037-9-iscsi devstack@n-api.service[101847]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=101847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:55:05.065414 dv-cinder-818037-9-iscsi devstack@n-api.service[101848]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=101848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:55:05.065601 dv-cinder-818037-9-iscsi devstack@n-api.service[101847]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=101847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:55:05.065727 dv-cinder-818037-9-iscsi devstack@n-api.service[101848]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=101848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:55:05.065922 dv-cinder-818037-9-iscsi devstack@n-api.service[101847]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=101847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:55:05.066078 dv-cinder-818037-9-iscsi devstack@n-api.service[101848]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=101848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:55:05.066275 dv-cinder-818037-9-iscsi devstack@n-api.service[101848]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=101848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:55:05.066398 dv-cinder-818037-9-iscsi devstack@n-api.service[101847]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=101847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:55:05.066592 dv-cinder-818037-9-iscsi devstack@n-api.service[101848]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=101848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:55:05.066717 dv-cinder-818037-9-iscsi devstack@n-api.service[101847]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=101847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:55:05.066906 dv-cinder-818037-9-iscsi devstack@n-api.service[101848]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=101848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:55:05.067040 dv-cinder-818037-9-iscsi devstack@n-api.service[101847]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=101847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:55:05.067224 dv-cinder-818037-9-iscsi devstack@n-api.service[101848]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=101848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:55:05.067355 dv-cinder-818037-9-iscsi devstack@n-api.service[101847]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=101847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:55:05.067542 dv-cinder-818037-9-iscsi devstack@n-api.service[101848]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=101848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:55:05.067667 dv-cinder-818037-9-iscsi devstack@n-api.service[101847]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=101847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:55:05.067857 dv-cinder-818037-9-iscsi devstack@n-api.service[101848]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=101848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:55:05.067991 dv-cinder-818037-9-iscsi devstack@n-api.service[101847]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=101847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:55:05.068171 dv-cinder-818037-9-iscsi devstack@n-api.service[101847]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=101847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:55:05.068294 dv-cinder-818037-9-iscsi devstack@n-api.service[101848]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=101848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:55:05.068485 dv-cinder-818037-9-iscsi devstack@n-api.service[101848]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=101848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:55:05.068608 dv-cinder-818037-9-iscsi devstack@n-api.service[101847]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=101847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:55:05.068830 dv-cinder-818037-9-iscsi devstack@n-api.service[101847]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=101847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:55:05.068970 dv-cinder-818037-9-iscsi devstack@n-api.service[101848]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=101848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:55:05.069141 dv-cinder-818037-9-iscsi devstack@n-api.service[101848]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=101848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:55:05.069264 dv-cinder-818037-9-iscsi devstack@n-api.service[101847]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=101847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:55:05.069465 dv-cinder-818037-9-iscsi devstack@n-api.service[101847]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=101847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:55:05.069588 dv-cinder-818037-9-iscsi devstack@n-api.service[101848]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=101848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:55:05.069777 dv-cinder-818037-9-iscsi devstack@n-api.service[101848]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=101848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:55:05.069901 dv-cinder-818037-9-iscsi devstack@n-api.service[101847]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=101847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:55:05.070125 dv-cinder-818037-9-iscsi devstack@n-api.service[101847]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=101847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:55:05.070251 dv-cinder-818037-9-iscsi devstack@n-api.service[101848]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=101848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:55:05.070433 dv-cinder-818037-9-iscsi devstack@n-api.service[101848]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=101848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:55:05.070556 dv-cinder-818037-9-iscsi devstack@n-api.service[101847]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=101847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:55:05.070751 dv-cinder-818037-9-iscsi devstack@n-api.service[101848]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=101848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:55:05.070883 dv-cinder-818037-9-iscsi devstack@n-api.service[101847]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=101847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:55:05.071065 dv-cinder-818037-9-iscsi devstack@n-api.service[101847]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=101847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:55:05.071197 dv-cinder-818037-9-iscsi devstack@n-api.service[101848]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=101848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:55:05.071392 dv-cinder-818037-9-iscsi devstack@n-api.service[101847]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=101847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:55:05.071517 dv-cinder-818037-9-iscsi devstack@n-api.service[101848]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=101848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:55:05.071703 dv-cinder-818037-9-iscsi devstack@n-api.service[101847]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=101847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:55:05.071835 dv-cinder-818037-9-iscsi devstack@n-api.service[101848]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=101848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:55:05.072019 dv-cinder-818037-9-iscsi devstack@n-api.service[101848]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=101848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:55:05.072143 dv-cinder-818037-9-iscsi devstack@n-api.service[101847]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=101847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:55:05.072342 dv-cinder-818037-9-iscsi devstack@n-api.service[101848]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=101848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:55:05.072467 dv-cinder-818037-9-iscsi devstack@n-api.service[101847]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=101847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:55:05.072655 dv-cinder-818037-9-iscsi devstack@n-api.service[101848]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=101848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:55:05.072788 dv-cinder-818037-9-iscsi devstack@n-api.service[101847]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=101847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:55:05.072967 dv-cinder-818037-9-iscsi devstack@n-api.service[101848]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=101848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:55:05.073091 dv-cinder-818037-9-iscsi devstack@n-api.service[101847]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=101847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:55:05.073280 dv-cinder-818037-9-iscsi devstack@n-api.service[101848]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=101848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:55:05.073417 dv-cinder-818037-9-iscsi devstack@n-api.service[101847]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=101847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:55:05.073590 dv-cinder-818037-9-iscsi devstack@n-api.service[101848]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=101848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:55:05.073714 dv-cinder-818037-9-iscsi devstack@n-api.service[101847]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=101847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:55:05.073899 dv-cinder-818037-9-iscsi devstack@n-api.service[101848]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=101848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:55:05.074041 dv-cinder-818037-9-iscsi devstack@n-api.service[101847]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=101847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:55:05.074240 dv-cinder-818037-9-iscsi devstack@n-api.service[101847]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=101847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:55:05.074377 dv-cinder-818037-9-iscsi devstack@n-api.service[101848]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=101848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:55:05.074556 dv-cinder-818037-9-iscsi devstack@n-api.service[101848]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=101848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:55:05.074679 dv-cinder-818037-9-iscsi devstack@n-api.service[101847]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=101847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:55:05.074868 dv-cinder-818037-9-iscsi devstack@n-api.service[101847]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=101847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:55:05.074991 dv-cinder-818037-9-iscsi devstack@n-api.service[101848]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=101848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:55:05.075178 dv-cinder-818037-9-iscsi devstack@n-api.service[101848]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=101848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:55:05.075313 dv-cinder-818037-9-iscsi devstack@n-api.service[101847]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=101847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:55:05.075486 dv-cinder-818037-9-iscsi devstack@n-api.service[101848]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=101848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:55:05.075611 dv-cinder-818037-9-iscsi devstack@n-api.service[101847]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=101847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:55:05.075803 dv-cinder-818037-9-iscsi devstack@n-api.service[101847]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=101847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:55:05.075933 dv-cinder-818037-9-iscsi devstack@n-api.service[101848]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=101848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:55:05.076114 dv-cinder-818037-9-iscsi devstack@n-api.service[101848]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=101848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:55:05.076312 dv-cinder-818037-9-iscsi devstack@n-api.service[101847]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=101847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:55:05.076437 dv-cinder-818037-9-iscsi devstack@n-api.service[101848]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=101848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:55:05.076557 dv-cinder-818037-9-iscsi devstack@n-api.service[101847]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=101847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:55:05.076719 dv-cinder-818037-9-iscsi devstack@n-api.service[101848]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=101848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:55:05.076844 dv-cinder-818037-9-iscsi devstack@n-api.service[101847]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=101847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:55:05.077036 dv-cinder-818037-9-iscsi devstack@n-api.service[101848]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=101848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:55:05.077161 dv-cinder-818037-9-iscsi devstack@n-api.service[101847]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=101847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:55:05.077349 dv-cinder-818037-9-iscsi devstack@n-api.service[101847]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=101847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:55:05.077474 dv-cinder-818037-9-iscsi devstack@n-api.service[101848]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=101848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:55:05.077664 dv-cinder-818037-9-iscsi devstack@n-api.service[101847]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=101847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:55:05.077795 dv-cinder-818037-9-iscsi devstack@n-api.service[101848]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=101848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:55:05.077993 dv-cinder-818037-9-iscsi devstack@n-api.service[101847]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=101847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:55:05.078131 dv-cinder-818037-9-iscsi devstack@n-api.service[101848]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=101848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:55:05.078317 dv-cinder-818037-9-iscsi devstack@n-api.service[101847]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=101847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:55:05.078441 dv-cinder-818037-9-iscsi devstack@n-api.service[101848]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=101848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:55:05.078626 dv-cinder-818037-9-iscsi devstack@n-api.service[101848]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=101848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:55:05.078749 dv-cinder-818037-9-iscsi devstack@n-api.service[101847]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=101847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:55:05.078937 dv-cinder-818037-9-iscsi devstack@n-api.service[101848]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=101848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:55:05.079062 dv-cinder-818037-9-iscsi devstack@n-api.service[101847]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=101847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:55:05.079263 dv-cinder-818037-9-iscsi devstack@n-api.service[101848]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=101848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:55:05.079397 dv-cinder-818037-9-iscsi devstack@n-api.service[101847]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=101847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:55:05.079577 dv-cinder-818037-9-iscsi devstack@n-api.service[101848]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=101848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:55:05.079702 dv-cinder-818037-9-iscsi devstack@n-api.service[101847]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=101847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:55:05.079888 dv-cinder-818037-9-iscsi devstack@n-api.service[101847]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=101847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:55:05.080021 dv-cinder-818037-9-iscsi devstack@n-api.service[101848]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=101848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:55:05.080195 dv-cinder-818037-9-iscsi devstack@n-api.service[101848]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=101848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:55:05.080319 dv-cinder-818037-9-iscsi devstack@n-api.service[101847]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=101847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:55:05.080504 dv-cinder-818037-9-iscsi devstack@n-api.service[101848]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=101848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:55:05.080636 dv-cinder-818037-9-iscsi devstack@n-api.service[101847]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=101847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:55:05.080823 dv-cinder-818037-9-iscsi devstack@n-api.service[101847]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=101847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:55:05.080947 dv-cinder-818037-9-iscsi devstack@n-api.service[101848]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=101848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:55:05.081137 dv-cinder-818037-9-iscsi devstack@n-api.service[101847]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=101847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:55:05.081261 dv-cinder-818037-9-iscsi devstack@n-api.service[101848]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=101848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:55:05.081449 dv-cinder-818037-9-iscsi devstack@n-api.service[101847]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=101847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:55:05.081582 dv-cinder-818037-9-iscsi devstack@n-api.service[101848]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=101848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:55:05.081764 dv-cinder-818037-9-iscsi devstack@n-api.service[101847]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=101847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:55:05.081889 dv-cinder-818037-9-iscsi devstack@n-api.service[101848]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=101848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:55:05.082110 dv-cinder-818037-9-iscsi devstack@n-api.service[101848]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=101848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:55:05.082236 dv-cinder-818037-9-iscsi devstack@n-api.service[101847]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=101847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:55:05.082426 dv-cinder-818037-9-iscsi devstack@n-api.service[101848]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=101848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:55:05.082560 dv-cinder-818037-9-iscsi devstack@n-api.service[101847]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=101847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:55:05.082738 dv-cinder-818037-9-iscsi devstack@n-api.service[101847]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=101847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:55:05.082862 dv-cinder-818037-9-iscsi devstack@n-api.service[101848]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=101848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:55:05.083049 dv-cinder-818037-9-iscsi devstack@n-api.service[101848]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=101848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:55:05.083172 dv-cinder-818037-9-iscsi devstack@n-api.service[101847]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=101847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:55:05.083361 dv-cinder-818037-9-iscsi devstack@n-api.service[101848]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=101848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:55:05.083495 dv-cinder-818037-9-iscsi devstack@n-api.service[101847]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=101847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:55:05.083677 dv-cinder-818037-9-iscsi devstack@n-api.service[101847]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=101847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:55:05.083801 dv-cinder-818037-9-iscsi devstack@n-api.service[101848]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=101848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:55:05.083992 dv-cinder-818037-9-iscsi devstack@n-api.service[101848]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=101848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:55:05.084115 dv-cinder-818037-9-iscsi devstack@n-api.service[101847]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=101847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:55:05.084817 dv-cinder-818037-9-iscsi devstack@n-api.service[101848]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=101848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:55:05.084961 dv-cinder-818037-9-iscsi devstack@n-api.service[101847]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=101847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:55:05.085136 dv-cinder-818037-9-iscsi devstack@n-api.service[101848]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=101848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:55:05.085262 dv-cinder-818037-9-iscsi devstack@n-api.service[101847]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=101847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:55:05.085453 dv-cinder-818037-9-iscsi devstack@n-api.service[101848]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=101848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:55:05.085578 dv-cinder-818037-9-iscsi devstack@n-api.service[101847]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=101847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:55:05.085771 dv-cinder-818037-9-iscsi devstack@n-api.service[101847]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=101847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:55:05.085896 dv-cinder-818037-9-iscsi devstack@n-api.service[101848]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=101848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:55:05.086108 dv-cinder-818037-9-iscsi devstack@n-api.service[101847]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=101847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:55:05.086234 dv-cinder-818037-9-iscsi devstack@n-api.service[101848]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=101848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:55:05.086430 dv-cinder-818037-9-iscsi devstack@n-api.service[101847]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=101847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:55:05.086556 dv-cinder-818037-9-iscsi devstack@n-api.service[101848]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=101848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:55:05.086741 dv-cinder-818037-9-iscsi devstack@n-api.service[101848]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=101848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:55:05.086866 dv-cinder-818037-9-iscsi devstack@n-api.service[101847]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=101847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:55:05.087055 dv-cinder-818037-9-iscsi devstack@n-api.service[101847]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=101847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:55:05.087178 dv-cinder-818037-9-iscsi devstack@n-api.service[101848]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=101848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:55:05.087369 dv-cinder-818037-9-iscsi devstack@n-api.service[101848]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=101848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:55:05.087492 dv-cinder-818037-9-iscsi devstack@n-api.service[101847]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=101847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:55:05.087679 dv-cinder-818037-9-iscsi devstack@n-api.service[101848]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=101848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:55:05.087804 dv-cinder-818037-9-iscsi devstack@n-api.service[101847]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=101847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:55:05.087994 dv-cinder-818037-9-iscsi devstack@n-api.service[101848]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=101848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:55:05.088125 dv-cinder-818037-9-iscsi devstack@n-api.service[101847]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=101847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:55:05.088308 dv-cinder-818037-9-iscsi devstack@n-api.service[101847]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=101847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:55:05.088432 dv-cinder-818037-9-iscsi devstack@n-api.service[101848]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=101848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:55:05.088626 dv-cinder-818037-9-iscsi devstack@n-api.service[101847]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=101847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:55:05.088875 dv-cinder-818037-9-iscsi devstack@n-api.service[101848]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=101848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:55:05.089001 dv-cinder-818037-9-iscsi devstack@n-api.service[101847]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=101847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:55:05.089214 dv-cinder-818037-9-iscsi devstack@n-api.service[101848]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=101848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:55:05.089339 dv-cinder-818037-9-iscsi devstack@n-api.service[101847]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=101847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:55:05.089535 dv-cinder-818037-9-iscsi devstack@n-api.service[101848]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=101848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:55:05.089660 dv-cinder-818037-9-iscsi devstack@n-api.service[101847]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=101847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:55:05.089860 dv-cinder-818037-9-iscsi devstack@n-api.service[101848]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=101848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:55:05.090155 dv-cinder-818037-9-iscsi devstack@n-api.service[101847]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=101847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:55:05.090316 dv-cinder-818037-9-iscsi devstack@n-api.service[101848]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=101848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:55:05.090476 dv-cinder-818037-9-iscsi devstack@n-api.service[101847]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=101847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:55:05.090615 dv-cinder-818037-9-iscsi devstack@n-api.service[101848]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=101848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:55:05.090801 dv-cinder-818037-9-iscsi devstack@n-api.service[101847]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=101847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:55:05.090926 dv-cinder-818037-9-iscsi devstack@n-api.service[101848]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=101848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:55:05.091128 dv-cinder-818037-9-iscsi devstack@n-api.service[101847]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=101847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:55:05.091253 dv-cinder-818037-9-iscsi devstack@n-api.service[101848]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=101848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:55:05.091455 dv-cinder-818037-9-iscsi devstack@n-api.service[101847]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=101847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:55:05.091590 dv-cinder-818037-9-iscsi devstack@n-api.service[101848]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=101848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:55:05.091779 dv-cinder-818037-9-iscsi devstack@n-api.service[101848]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=101848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:55:05.091908 dv-cinder-818037-9-iscsi devstack@n-api.service[101847]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=101847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:55:05.092096 dv-cinder-818037-9-iscsi devstack@n-api.service[101848]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=101848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:55:05.092221 dv-cinder-818037-9-iscsi devstack@n-api.service[101847]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=101847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:55:05.092407 dv-cinder-818037-9-iscsi devstack@n-api.service[101848]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=101848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:55:05.092533 dv-cinder-818037-9-iscsi devstack@n-api.service[101847]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=101847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:55:05.092716 dv-cinder-818037-9-iscsi devstack@n-api.service[101848]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=101848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:55:05.092847 dv-cinder-818037-9-iscsi devstack@n-api.service[101847]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=101847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:55:05.093029 dv-cinder-818037-9-iscsi devstack@n-api.service[101848]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=101848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:55:05.093154 dv-cinder-818037-9-iscsi devstack@n-api.service[101847]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=101847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:55:05.093338 dv-cinder-818037-9-iscsi devstack@n-api.service[101848]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=101848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:55:05.093463 dv-cinder-818037-9-iscsi devstack@n-api.service[101847]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=101847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:55:05.093646 dv-cinder-818037-9-iscsi devstack@n-api.service[101847]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=101847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:55:05.093770 dv-cinder-818037-9-iscsi devstack@n-api.service[101848]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=101848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:55:05.093952 dv-cinder-818037-9-iscsi devstack@n-api.service[101848]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=101848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:55:05.094089 dv-cinder-818037-9-iscsi devstack@n-api.service[101847]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=101847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:55:05.094294 dv-cinder-818037-9-iscsi devstack@n-api.service[101848]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=101848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:55:05.094420 dv-cinder-818037-9-iscsi devstack@n-api.service[101847]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=101847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:55:05.094607 dv-cinder-818037-9-iscsi devstack@n-api.service[101848]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=101848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:55:05.094732 dv-cinder-818037-9-iscsi devstack@n-api.service[101847]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=101847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:55:05.094913 dv-cinder-818037-9-iscsi devstack@n-api.service[101847]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=101847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:55:05.095037 dv-cinder-818037-9-iscsi devstack@n-api.service[101848]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=101848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:55:05.095226 dv-cinder-818037-9-iscsi devstack@n-api.service[101847]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=101847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:55:05.095352 dv-cinder-818037-9-iscsi devstack@n-api.service[101848]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=101848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:55:05.095537 dv-cinder-818037-9-iscsi devstack@n-api.service[101848]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=101848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:55:05.095670 dv-cinder-818037-9-iscsi devstack@n-api.service[101847]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=101847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:55:05.095843 dv-cinder-818037-9-iscsi devstack@n-api.service[101847]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=101847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:55:05.095973 dv-cinder-818037-9-iscsi devstack@n-api.service[101848]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=101848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:55:05.096149 dv-cinder-818037-9-iscsi devstack@n-api.service[101848]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=101848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:55:05.096285 dv-cinder-818037-9-iscsi devstack@n-api.service[101847]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=101847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:55:05.096467 dv-cinder-818037-9-iscsi devstack@n-api.service[101848]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=101848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:55:05.096598 dv-cinder-818037-9-iscsi devstack@n-api.service[101847]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=101847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:55:05.096774 dv-cinder-818037-9-iscsi devstack@n-api.service[101848]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=101848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:55:05.096900 dv-cinder-818037-9-iscsi devstack@n-api.service[101847]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=101847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:55:05.097094 dv-cinder-818037-9-iscsi devstack@n-api.service[101847]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=101847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:55:05.097225 dv-cinder-818037-9-iscsi devstack@n-api.service[101848]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=101848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:55:05.097403 dv-cinder-818037-9-iscsi devstack@n-api.service[101847]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=101847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:55:05.097535 dv-cinder-818037-9-iscsi devstack@n-api.service[101848]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=101848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:55:05.097708 dv-cinder-818037-9-iscsi devstack@n-api.service[101848]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=101848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:55:05.097838 dv-cinder-818037-9-iscsi devstack@n-api.service[101847]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=101847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:55:05.098037 dv-cinder-818037-9-iscsi devstack@n-api.service[101848]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=101848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:55:05.098166 dv-cinder-818037-9-iscsi devstack@n-api.service[101847]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=101847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:55:05.098350 dv-cinder-818037-9-iscsi devstack@n-api.service[101848]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=101848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:55:05.098477 dv-cinder-818037-9-iscsi devstack@n-api.service[101847]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=101847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:55:05.098665 dv-cinder-818037-9-iscsi devstack@n-api.service[101847]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=101847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:55:05.098790 dv-cinder-818037-9-iscsi devstack@n-api.service[101848]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=101848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:55:05.098977 dv-cinder-818037-9-iscsi devstack@n-api.service[101847]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=101847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:55:05.099123 dv-cinder-818037-9-iscsi devstack@n-api.service[101848]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=101848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:55:05.099280 dv-cinder-818037-9-iscsi devstack@n-api.service[101847]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=101847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:55:05.099414 dv-cinder-818037-9-iscsi devstack@n-api.service[101848]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=101848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:55:05.099596 dv-cinder-818037-9-iscsi devstack@n-api.service[101847]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=101847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:55:05.099721 dv-cinder-818037-9-iscsi devstack@n-api.service[101848]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=101848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:55:05.100503 dv-cinder-818037-9-iscsi devstack@n-api.service[101848]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=101848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:55:05.100644 dv-cinder-818037-9-iscsi devstack@n-api.service[101847]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=101847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:55:05.100820 dv-cinder-818037-9-iscsi devstack@n-api.service[101848]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=101848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:55:05.100945 dv-cinder-818037-9-iscsi devstack@n-api.service[101847]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=101847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:55:05.101130 dv-cinder-818037-9-iscsi devstack@n-api.service[101848]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=101848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:55:05.101256 dv-cinder-818037-9-iscsi devstack@n-api.service[101847]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=101847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:55:05.101457 dv-cinder-818037-9-iscsi devstack@n-api.service[101848]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=101848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:55:05.101659 dv-cinder-818037-9-iscsi devstack@n-api.service[101847]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=101847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:55:05.101789 dv-cinder-818037-9-iscsi devstack@n-api.service[101848]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=101848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:55:05.101913 dv-cinder-818037-9-iscsi devstack@n-api.service[101847]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=101847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:55:05.102086 dv-cinder-818037-9-iscsi devstack@n-api.service[101848]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=101848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:55:05.102211 dv-cinder-818037-9-iscsi devstack@n-api.service[101847]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=101847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:55:05.102396 dv-cinder-818037-9-iscsi devstack@n-api.service[101848]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=101848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:55:05.102537 dv-cinder-818037-9-iscsi devstack@n-api.service[101847]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=101847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:55:05.102710 dv-cinder-818037-9-iscsi devstack@n-api.service[101848]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=101848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:55:05.102835 dv-cinder-818037-9-iscsi devstack@n-api.service[101847]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=101847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:55:05.103024 dv-cinder-818037-9-iscsi devstack@n-api.service[101848]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=101848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:55:05.103155 dv-cinder-818037-9-iscsi devstack@n-api.service[101847]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=101847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:55:05.103332 dv-cinder-818037-9-iscsi devstack@n-api.service[101847]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=101847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:55:05.103456 dv-cinder-818037-9-iscsi devstack@n-api.service[101848]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=101848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:55:05.103641 dv-cinder-818037-9-iscsi devstack@n-api.service[101847]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=101847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:55:05.103767 dv-cinder-818037-9-iscsi devstack@n-api.service[101848]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=101848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:55:05.103953 dv-cinder-818037-9-iscsi devstack@n-api.service[101848]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=101848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:55:05.104077 dv-cinder-818037-9-iscsi devstack@n-api.service[101847]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=101847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:55:05.104264 dv-cinder-818037-9-iscsi devstack@n-api.service[101847]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=101847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:55:05.104389 dv-cinder-818037-9-iscsi devstack@n-api.service[101848]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=101848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:55:05.104573 dv-cinder-818037-9-iscsi devstack@n-api.service[101847]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=101847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:55:05.104707 dv-cinder-818037-9-iscsi devstack@n-api.service[101848]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=101848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:55:05.104880 dv-cinder-818037-9-iscsi devstack@n-api.service[101848]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=101848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:55:05.105004 dv-cinder-818037-9-iscsi devstack@n-api.service[101847]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=101847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:55:05.105192 dv-cinder-818037-9-iscsi devstack@n-api.service[101848]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=101848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:55:05.105318 dv-cinder-818037-9-iscsi devstack@n-api.service[101847]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=101847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:55:05.105498 dv-cinder-818037-9-iscsi devstack@n-api.service[101848]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=101848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:55:05.105629 dv-cinder-818037-9-iscsi devstack@n-api.service[101847]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=101847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:55:05.105810 dv-cinder-818037-9-iscsi devstack@n-api.service[101847]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=101847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:55:05.105940 dv-cinder-818037-9-iscsi devstack@n-api.service[101848]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=101848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:55:05.106145 dv-cinder-818037-9-iscsi devstack@n-api.service[101848]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=101848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:55:05.106270 dv-cinder-818037-9-iscsi devstack@n-api.service[101847]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=101847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:55:05.106453 dv-cinder-818037-9-iscsi devstack@n-api.service[101848]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=101848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:55:05.106578 dv-cinder-818037-9-iscsi devstack@n-api.service[101847]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=101847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:55:05.106760 dv-cinder-818037-9-iscsi devstack@n-api.service[101847]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=101847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:55:05.106893 dv-cinder-818037-9-iscsi devstack@n-api.service[101848]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=101848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:55:05.107071 dv-cinder-818037-9-iscsi devstack@n-api.service[101848]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=101848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:55:05.107195 dv-cinder-818037-9-iscsi devstack@n-api.service[101847]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=101847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:55:05.107383 dv-cinder-818037-9-iscsi devstack@n-api.service[101847]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=101847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:55:05.107513 dv-cinder-818037-9-iscsi devstack@n-api.service[101848]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=101848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:55:05.107685 dv-cinder-818037-9-iscsi devstack@n-api.service[101848]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=101848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:55:05.107821 dv-cinder-818037-9-iscsi devstack@n-api.service[101847]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=101847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:55:05.107989 dv-cinder-818037-9-iscsi devstack@n-api.service[101847]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=101847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:55:05.108112 dv-cinder-818037-9-iscsi devstack@n-api.service[101848]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=101848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:55:05.108294 dv-cinder-818037-9-iscsi devstack@n-api.service[101848]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=101848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:55:05.108417 dv-cinder-818037-9-iscsi devstack@n-api.service[101847]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=101847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:55:05.108605 dv-cinder-818037-9-iscsi devstack@n-api.service[101847]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=101847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:55:05.108736 dv-cinder-818037-9-iscsi devstack@n-api.service[101848]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=101848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:55:05.108908 dv-cinder-818037-9-iscsi devstack@n-api.service[101848]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=101848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:55:05.109039 dv-cinder-818037-9-iscsi devstack@n-api.service[101847]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=101847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:55:05.109217 dv-cinder-818037-9-iscsi devstack@n-api.service[101848]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=101848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:55:05.109348 dv-cinder-818037-9-iscsi devstack@n-api.service[101847]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=101847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:55:05.109523 dv-cinder-818037-9-iscsi devstack@n-api.service[101847]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=101847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:55:05.109654 dv-cinder-818037-9-iscsi devstack@n-api.service[101848]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=101848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:55:05.109833 dv-cinder-818037-9-iscsi devstack@n-api.service[101848]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=101848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:55:05.109958 dv-cinder-818037-9-iscsi devstack@n-api.service[101847]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=101847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:55:05.110167 dv-cinder-818037-9-iscsi devstack@n-api.service[101847]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=101847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:55:05.110291 dv-cinder-818037-9-iscsi devstack@n-api.service[101848]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=101848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:55:05.110477 dv-cinder-818037-9-iscsi devstack@n-api.service[101847]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=101847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:55:05.110604 dv-cinder-818037-9-iscsi devstack@n-api.service[101848]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=101848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:55:05.110785 dv-cinder-818037-9-iscsi devstack@n-api.service[101847]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=101847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:55:05.110915 dv-cinder-818037-9-iscsi devstack@n-api.service[101848]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=101848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:55:05.111099 dv-cinder-818037-9-iscsi devstack@n-api.service[101847]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=101847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:55:05.111231 dv-cinder-818037-9-iscsi devstack@n-api.service[101848]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=101848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:55:05.111405 dv-cinder-818037-9-iscsi devstack@n-api.service[101848]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=101848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:55:05.111530 dv-cinder-818037-9-iscsi devstack@n-api.service[101847]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=101847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:55:05.111710 dv-cinder-818037-9-iscsi devstack@n-api.service[101847]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=101847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:55:05.111834 dv-cinder-818037-9-iscsi devstack@n-api.service[101848]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=101848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:55:05.112021 dv-cinder-818037-9-iscsi devstack@n-api.service[101848]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=101848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:55:05.112146 dv-cinder-818037-9-iscsi devstack@n-api.service[101847]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=101847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:55:05.112328 dv-cinder-818037-9-iscsi devstack@n-api.service[101848]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=101848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:55:05.112453 dv-cinder-818037-9-iscsi devstack@n-api.service[101847]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=101847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:55:05.112635 dv-cinder-818037-9-iscsi devstack@n-api.service[101847]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=101847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:55:05.112766 dv-cinder-818037-9-iscsi devstack@n-api.service[101848]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=101848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:55:05.112943 dv-cinder-818037-9-iscsi devstack@n-api.service[101847]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=101847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:55:05.113074 dv-cinder-818037-9-iscsi devstack@n-api.service[101848]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=101848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:55:05.113257 dv-cinder-818037-9-iscsi devstack@n-api.service[101847]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=101847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:55:05.113390 dv-cinder-818037-9-iscsi devstack@n-api.service[101848]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=101848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:55:05.113564 dv-cinder-818037-9-iscsi devstack@n-api.service[101847]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=101847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:55:05.113688 dv-cinder-818037-9-iscsi devstack@n-api.service[101848]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=101848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:55:05.113870 dv-cinder-818037-9-iscsi devstack@n-api.service[101848]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=101848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:55:05.114039 dv-cinder-818037-9-iscsi devstack@n-api.service[101847]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=101847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:55:05.114208 dv-cinder-818037-9-iscsi devstack@n-api.service[101847]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=101847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:55:05.114331 dv-cinder-818037-9-iscsi devstack@n-api.service[101848]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=101848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:55:05.114516 dv-cinder-818037-9-iscsi devstack@n-api.service[101848]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=101848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:55:05.114639 dv-cinder-818037-9-iscsi devstack@n-api.service[101847]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=101847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:55:05.114827 dv-cinder-818037-9-iscsi devstack@n-api.service[101848]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=101848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:55:05.114964 dv-cinder-818037-9-iscsi devstack@n-api.service[101847]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=101847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:55:05.115137 dv-cinder-818037-9-iscsi devstack@n-api.service[101847]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=101847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:55:05.115261 dv-cinder-818037-9-iscsi devstack@n-api.service[101848]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=101848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:55:05.115449 dv-cinder-818037-9-iscsi devstack@n-api.service[101848]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=101848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:55:05.115581 dv-cinder-818037-9-iscsi devstack@n-api.service[101847]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=101847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:55:05.115780 dv-cinder-818037-9-iscsi devstack@n-api.service[101848]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=101848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:55:05.115914 dv-cinder-818037-9-iscsi devstack@n-api.service[101847]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=101847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:55:05.116089 dv-cinder-818037-9-iscsi devstack@n-api.service[101848]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=101848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:55:05.116220 dv-cinder-818037-9-iscsi devstack@n-api.service[101847]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=101847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:55:05.116399 dv-cinder-818037-9-iscsi devstack@n-api.service[101847]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=101847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:55:05.116523 dv-cinder-818037-9-iscsi devstack@n-api.service[101848]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=101848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:55:05.116704 dv-cinder-818037-9-iscsi devstack@n-api.service[101848]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=101848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:55:05.116837 dv-cinder-818037-9-iscsi devstack@n-api.service[101847]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=101847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:55:05.117011 dv-cinder-818037-9-iscsi devstack@n-api.service[101847]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=101847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:55:05.117134 dv-cinder-818037-9-iscsi devstack@n-api.service[101848]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=101848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:55:05.117322 dv-cinder-818037-9-iscsi devstack@n-api.service[101847]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=101847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:55:05.117448 dv-cinder-818037-9-iscsi devstack@n-api.service[101848]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=101848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:55:05.117632 dv-cinder-818037-9-iscsi devstack@n-api.service[101847]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=101847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:55:05.117764 dv-cinder-818037-9-iscsi devstack@n-api.service[101848]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=101848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:55:05.117940 dv-cinder-818037-9-iscsi devstack@n-api.service[101848]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=101848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:55:05.118083 dv-cinder-818037-9-iscsi devstack@n-api.service[101847]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=101847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:55:05.118272 dv-cinder-818037-9-iscsi devstack@n-api.service[101847]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=101847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:55:05.118396 dv-cinder-818037-9-iscsi devstack@n-api.service[101848]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=101848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:55:05.118602 dv-cinder-818037-9-iscsi devstack@n-api.service[101847]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=101847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:55:05.118728 dv-cinder-818037-9-iscsi devstack@n-api.service[101848]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=101848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:55:05.118918 dv-cinder-818037-9-iscsi devstack@n-api.service[101847]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=101847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:55:05.119043 dv-cinder-818037-9-iscsi devstack@n-api.service[101848]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=101848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:55:05.119230 dv-cinder-818037-9-iscsi devstack@n-api.service[101847]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=101847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:55:05.119355 dv-cinder-818037-9-iscsi devstack@n-api.service[101848]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=101848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:55:05.119543 dv-cinder-818037-9-iscsi devstack@n-api.service[101847]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=101847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:55:05.119669 dv-cinder-818037-9-iscsi devstack@n-api.service[101848]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=101848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:55:05.119851 dv-cinder-818037-9-iscsi devstack@n-api.service[101847]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=101847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:55:05.119999 dv-cinder-818037-9-iscsi devstack@n-api.service[101848]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=101848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:55:05.120197 dv-cinder-818037-9-iscsi devstack@n-api.service[101847]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=101847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:55:05.120323 dv-cinder-818037-9-iscsi devstack@n-api.service[101848]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=101848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:55:05.120508 dv-cinder-818037-9-iscsi devstack@n-api.service[101847]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=101847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:55:05.120634 dv-cinder-818037-9-iscsi devstack@n-api.service[101848]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=101848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:55:05.120834 dv-cinder-818037-9-iscsi devstack@n-api.service[101848]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=101848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:55:05.120951 dv-cinder-818037-9-iscsi devstack@n-api.service[101847]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=101847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:55:05.121150 dv-cinder-818037-9-iscsi devstack@n-api.service[101848]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=101848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:55:05.121283 dv-cinder-818037-9-iscsi devstack@n-api.service[101847]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=101847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:55:05.121466 dv-cinder-818037-9-iscsi devstack@n-api.service[101848]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=101848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:55:05.121591 dv-cinder-818037-9-iscsi devstack@n-api.service[101847]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=101847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:55:05.121772 dv-cinder-818037-9-iscsi devstack@n-api.service[101848]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=101848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:55:05.121896 dv-cinder-818037-9-iscsi devstack@n-api.service[101847]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=101847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:55:05.122113 dv-cinder-818037-9-iscsi devstack@n-api.service[101847]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=101847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:55:05.122249 dv-cinder-818037-9-iscsi devstack@n-api.service[101848]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=101848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:55:05.122431 dv-cinder-818037-9-iscsi devstack@n-api.service[101848]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=101848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:55:05.122563 dv-cinder-818037-9-iscsi devstack@n-api.service[101847]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=101847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:55:05.122748 dv-cinder-818037-9-iscsi devstack@n-api.service[101847]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=101847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:55:05.122871 dv-cinder-818037-9-iscsi devstack@n-api.service[101848]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=101848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:55:05.123052 dv-cinder-818037-9-iscsi devstack@n-api.service[101848]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=101848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:55:05.123183 dv-cinder-818037-9-iscsi devstack@n-api.service[101847]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=101847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:55:05.123358 dv-cinder-818037-9-iscsi devstack@n-api.service[101848]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=101848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:55:05.123483 dv-cinder-818037-9-iscsi devstack@n-api.service[101847]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=101847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:55:05.123671 dv-cinder-818037-9-iscsi devstack@n-api.service[101847]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=101847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:55:05.123795 dv-cinder-818037-9-iscsi devstack@n-api.service[101848]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=101848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:55:05.123985 dv-cinder-818037-9-iscsi devstack@n-api.service[101848]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=101848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:55:05.124134 dv-cinder-818037-9-iscsi devstack@n-api.service[101847]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=101847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:55:05.124292 dv-cinder-818037-9-iscsi devstack@n-api.service[101847]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=101847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:55:05.124410 dv-cinder-818037-9-iscsi devstack@n-api.service[101848]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=101848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:55:05.124602 dv-cinder-818037-9-iscsi devstack@n-api.service[101847]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=101847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:55:05.124728 dv-cinder-818037-9-iscsi devstack@n-api.service[101848]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=101848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:55:05.124924 dv-cinder-818037-9-iscsi devstack@n-api.service[101848]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=101848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:55:05.125060 dv-cinder-818037-9-iscsi devstack@n-api.service[101847]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=101847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:55:05.125244 dv-cinder-818037-9-iscsi devstack@n-api.service[101847]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=101847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:55:05.125368 dv-cinder-818037-9-iscsi devstack@n-api.service[101848]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=101848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:55:05.125549 dv-cinder-818037-9-iscsi devstack@n-api.service[101848]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=101848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:55:05.125673 dv-cinder-818037-9-iscsi devstack@n-api.service[101847]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=101847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:55:05.125861 dv-cinder-818037-9-iscsi devstack@n-api.service[101848]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=101848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:55:05.126008 dv-cinder-818037-9-iscsi devstack@n-api.service[101847]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=101847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:55:05.126200 dv-cinder-818037-9-iscsi devstack@n-api.service[101848]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=101848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:55:05.126333 dv-cinder-818037-9-iscsi devstack@n-api.service[101847]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=101847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:55:05.126512 dv-cinder-818037-9-iscsi devstack@n-api.service[101848]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=101848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:55:05.126636 dv-cinder-818037-9-iscsi devstack@n-api.service[101847]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=101847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:55:05.126824 dv-cinder-818037-9-iscsi devstack@n-api.service[101848]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=101848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:55:05.126956 dv-cinder-818037-9-iscsi devstack@n-api.service[101847]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=101847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:55:05.127137 dv-cinder-818037-9-iscsi devstack@n-api.service[101847]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=101847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:55:05.127260 dv-cinder-818037-9-iscsi devstack@n-api.service[101848]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=101848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:55:05.127450 dv-cinder-818037-9-iscsi devstack@n-api.service[101848]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=101848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:55:05.127573 dv-cinder-818037-9-iscsi devstack@n-api.service[101847]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=101847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:55:05.127762 dv-cinder-818037-9-iscsi devstack@n-api.service[101847]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=101847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:55:05.127887 dv-cinder-818037-9-iscsi devstack@n-api.service[101848]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=101848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:55:05.128074 dv-cinder-818037-9-iscsi devstack@n-api.service[101848]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=101848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:55:05.128229 dv-cinder-818037-9-iscsi devstack@n-api.service[101847]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=101847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:55:05.128388 dv-cinder-818037-9-iscsi devstack@n-api.service[101847]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=101847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:55:05.128511 dv-cinder-818037-9-iscsi devstack@n-api.service[101848]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=101848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:55:05.128699 dv-cinder-818037-9-iscsi devstack@n-api.service[101848]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=101848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:55:05.128824 dv-cinder-818037-9-iscsi devstack@n-api.service[101847]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=101847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:55:05.129006 dv-cinder-818037-9-iscsi devstack@n-api.service[101848]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=101848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:55:05.129130 dv-cinder-818037-9-iscsi devstack@n-api.service[101847]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=101847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:55:05.129318 dv-cinder-818037-9-iscsi devstack@n-api.service[101848]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=101848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:55:05.129450 dv-cinder-818037-9-iscsi devstack@n-api.service[101847]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=101847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:55:05.129629 dv-cinder-818037-9-iscsi devstack@n-api.service[101848]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=101848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:55:05.129760 dv-cinder-818037-9-iscsi devstack@n-api.service[101847]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=101847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:55:05.129935 dv-cinder-818037-9-iscsi devstack@n-api.service[101848]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=101848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:55:05.130381 dv-cinder-818037-9-iscsi devstack@n-api.service[101847]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=101847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:55:05.130526 dv-cinder-818037-9-iscsi devstack@n-api.service[101847]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=101847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:55:05.130721 dv-cinder-818037-9-iscsi devstack@n-api.service[101848]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=101848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:55:05.130850 dv-cinder-818037-9-iscsi devstack@n-api.service[101847]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=101847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:55:05.130980 dv-cinder-818037-9-iscsi devstack@n-api.service[101848]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=101848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:55:05.131203 dv-cinder-818037-9-iscsi devstack@n-api.service[101847]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=101847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:55:05.131338 dv-cinder-818037-9-iscsi devstack@n-api.service[101848]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=101848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:55:05.131489 dv-cinder-818037-9-iscsi devstack@n-api.service[101847]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=101847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:55:05.131628 dv-cinder-818037-9-iscsi devstack@n-api.service[101848]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=101848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:55:05.131824 dv-cinder-818037-9-iscsi devstack@n-api.service[101847]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=101847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:55:05.131956 dv-cinder-818037-9-iscsi devstack@n-api.service[101848]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=101848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:55:05.132147 dv-cinder-818037-9-iscsi devstack@n-api.service[101847]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=101847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:55:05.132269 dv-cinder-818037-9-iscsi devstack@n-api.service[101848]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=101848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:55:05.132448 dv-cinder-818037-9-iscsi devstack@n-api.service[101847]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=101847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:55:05.132588 dv-cinder-818037-9-iscsi devstack@n-api.service[101848]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=101848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:55:05.132765 dv-cinder-818037-9-iscsi devstack@n-api.service[101847]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=101847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:55:05.132890 dv-cinder-818037-9-iscsi devstack@n-api.service[101848]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=101848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:55:05.133078 dv-cinder-818037-9-iscsi devstack@n-api.service[101847]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=101847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:55:05.133204 dv-cinder-818037-9-iscsi devstack@n-api.service[101848]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=101848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:55:05.133398 dv-cinder-818037-9-iscsi devstack@n-api.service[101847]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=101847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:55:05.133524 dv-cinder-818037-9-iscsi devstack@n-api.service[101848]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=101848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:55:05.133709 dv-cinder-818037-9-iscsi devstack@n-api.service[101847]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=101847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:55:05.133835 dv-cinder-818037-9-iscsi devstack@n-api.service[101848]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=101848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:55:05.134120 dv-cinder-818037-9-iscsi devstack@n-api.service[101848]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=101848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:55:05.134254 dv-cinder-818037-9-iscsi devstack@n-api.service[101847]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=101847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:55:05.134431 dv-cinder-818037-9-iscsi devstack@n-api.service[101848]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=101848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:55:05.134563 dv-cinder-818037-9-iscsi devstack@n-api.service[101847]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=101847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:55:05.134750 dv-cinder-818037-9-iscsi devstack@n-api.service[101848]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=101848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:55:05.134876 dv-cinder-818037-9-iscsi devstack@n-api.service[101847]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=101847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:55:05.135068 dv-cinder-818037-9-iscsi devstack@n-api.service[101848]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=101848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:55:05.135194 dv-cinder-818037-9-iscsi devstack@n-api.service[101847]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=101847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:55:05.135377 dv-cinder-818037-9-iscsi devstack@n-api.service[101848]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=101848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:55:05.135503 dv-cinder-818037-9-iscsi devstack@n-api.service[101847]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=101847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:55:05.135699 dv-cinder-818037-9-iscsi devstack@n-api.service[101847]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=101847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:55:05.135822 dv-cinder-818037-9-iscsi devstack@n-api.service[101848]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=101848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:55:05.136023 dv-cinder-818037-9-iscsi devstack@n-api.service[101847]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=101847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:55:05.136156 dv-cinder-818037-9-iscsi devstack@n-api.service[101848]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=101848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:55:05.136348 dv-cinder-818037-9-iscsi devstack@n-api.service[101847]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=101847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:55:05.136474 dv-cinder-818037-9-iscsi devstack@n-api.service[101848]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=101848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:55:05.136663 dv-cinder-818037-9-iscsi devstack@n-api.service[101847]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=101847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:55:05.136788 dv-cinder-818037-9-iscsi devstack@n-api.service[101848]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=101848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:55:05.136997 dv-cinder-818037-9-iscsi devstack@n-api.service[101848]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=101848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:55:05.137129 dv-cinder-818037-9-iscsi devstack@n-api.service[101847]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=101847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:55:05.137303 dv-cinder-818037-9-iscsi devstack@n-api.service[101848]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=101848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:55:05.137428 dv-cinder-818037-9-iscsi devstack@n-api.service[101847]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=101847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:55:05.137621 dv-cinder-818037-9-iscsi devstack@n-api.service[101848]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=101848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:55:05.137746 dv-cinder-818037-9-iscsi devstack@n-api.service[101847]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=101847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:55:05.137951 dv-cinder-818037-9-iscsi devstack@n-api.service[101848]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=101848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:55:05.138114 dv-cinder-818037-9-iscsi devstack@n-api.service[101847]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=101847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:55:05.138283 dv-cinder-818037-9-iscsi devstack@n-api.service[101848]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=101848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:55:05.138407 dv-cinder-818037-9-iscsi devstack@n-api.service[101847]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=101847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:55:05.138590 dv-cinder-818037-9-iscsi devstack@n-api.service[101848]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=101848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:55:05.138715 dv-cinder-818037-9-iscsi devstack@n-api.service[101847]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=101847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:55:05.138897 dv-cinder-818037-9-iscsi devstack@n-api.service[101848]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=101848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:55:05.139031 dv-cinder-818037-9-iscsi devstack@n-api.service[101847]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=101847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:55:05.139224 dv-cinder-818037-9-iscsi devstack@n-api.service[101848]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=101848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:55:05.139357 dv-cinder-818037-9-iscsi devstack@n-api.service[101847]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=101847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:55:05.139534 dv-cinder-818037-9-iscsi devstack@n-api.service[101848]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=101848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:55:05.139665 dv-cinder-818037-9-iscsi devstack@n-api.service[101847]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=101847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:55:05.139850 dv-cinder-818037-9-iscsi devstack@n-api.service[101847]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=101847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:55:05.139983 dv-cinder-818037-9-iscsi devstack@n-api.service[101848]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=101848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:55:05.140162 dv-cinder-818037-9-iscsi devstack@n-api.service[101847]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=101847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:55:05.140286 dv-cinder-818037-9-iscsi devstack@n-api.service[101848]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=101848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:55:05.140493 dv-cinder-818037-9-iscsi devstack@n-api.service[101847]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=101847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:55:05.140620 dv-cinder-818037-9-iscsi devstack@n-api.service[101848]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=101848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:55:05.140808 dv-cinder-818037-9-iscsi devstack@n-api.service[101847]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=101847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:55:05.140934 dv-cinder-818037-9-iscsi devstack@n-api.service[101848]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=101848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:55:05.141137 dv-cinder-818037-9-iscsi devstack@n-api.service[101847]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=101847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:55:05.141262 dv-cinder-818037-9-iscsi devstack@n-api.service[101848]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=101848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:55:05.141560 dv-cinder-818037-9-iscsi devstack@n-api.service[101847]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=101847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:55:05.141686 dv-cinder-818037-9-iscsi devstack@n-api.service[101848]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=101848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:55:05.141874 dv-cinder-818037-9-iscsi devstack@n-api.service[101848]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=101848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:55:05.142028 dv-cinder-818037-9-iscsi devstack@n-api.service[101847]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=101847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:55:05.142218 dv-cinder-818037-9-iscsi devstack@n-api.service[101847]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=101847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:55:05.142344 dv-cinder-818037-9-iscsi devstack@n-api.service[101848]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=101848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:55:05.142539 dv-cinder-818037-9-iscsi devstack@n-api.service[101848]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=101848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:55:05.142669 dv-cinder-818037-9-iscsi devstack@n-api.service[101847]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=101847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:55:05.142869 dv-cinder-818037-9-iscsi devstack@n-api.service[101848]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=101848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:55:05.142995 dv-cinder-818037-9-iscsi devstack@n-api.service[101847]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=101847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:55:05.143179 dv-cinder-818037-9-iscsi devstack@n-api.service[101848]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=101848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:55:05.143303 dv-cinder-818037-9-iscsi devstack@n-api.service[101847]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=101847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:55:05.143496 dv-cinder-818037-9-iscsi devstack@n-api.service[101848]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=101848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:55:05.143621 dv-cinder-818037-9-iscsi devstack@n-api.service[101847]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=101847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:55:05.143808 dv-cinder-818037-9-iscsi devstack@n-api.service[101848]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=101848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:55:05.143956 dv-cinder-818037-9-iscsi devstack@n-api.service[101847]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=101847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:55:05.144137 dv-cinder-818037-9-iscsi devstack@n-api.service[101848]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=101848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:55:05.144262 dv-cinder-818037-9-iscsi devstack@n-api.service[101847]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=101847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:55:05.144463 dv-cinder-818037-9-iscsi devstack@n-api.service[101847]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=101847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:55:05.144592 dv-cinder-818037-9-iscsi devstack@n-api.service[101848]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=101848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:55:05.144779 dv-cinder-818037-9-iscsi devstack@n-api.service[101848]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=101848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:55:05.144902 dv-cinder-818037-9-iscsi devstack@n-api.service[101847]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=101847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:55:05.145094 dv-cinder-818037-9-iscsi devstack@n-api.service[101847]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=101847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:55:05.145217 dv-cinder-818037-9-iscsi devstack@n-api.service[101848]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=101848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:55:05.145400 dv-cinder-818037-9-iscsi devstack@n-api.service[101848]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=101848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:55:05.145530 dv-cinder-818037-9-iscsi devstack@n-api.service[101847]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=101847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:55:05.145725 dv-cinder-818037-9-iscsi devstack@n-api.service[101848]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=101848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:55:05.145857 dv-cinder-818037-9-iscsi devstack@n-api.service[101847]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=101847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:55:05.146051 dv-cinder-818037-9-iscsi devstack@n-api.service[101847]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=101847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:55:05.146181 dv-cinder-818037-9-iscsi devstack@n-api.service[101848]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=101848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:55:05.146378 dv-cinder-818037-9-iscsi devstack@n-api.service[101848]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=101848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:55:05.146510 dv-cinder-818037-9-iscsi devstack@n-api.service[101847]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=101847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:55:05.146687 dv-cinder-818037-9-iscsi devstack@n-api.service[101847]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=101847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:55:05.147320 dv-cinder-818037-9-iscsi devstack@n-api.service[101848]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=101848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:55:05.147547 dv-cinder-818037-9-iscsi devstack@n-api.service[101847]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=101847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:55:05.147666 dv-cinder-818037-9-iscsi devstack@n-api.service[101848]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=101848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:55:05.147877 dv-cinder-818037-9-iscsi devstack@n-api.service[101847]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=101847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:55:05.148012 dv-cinder-818037-9-iscsi devstack@n-api.service[101848]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=101848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:55:05.148198 dv-cinder-818037-9-iscsi devstack@n-api.service[101847]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=101847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:55:05.148324 dv-cinder-818037-9-iscsi devstack@n-api.service[101848]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=101848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:55:05.148525 dv-cinder-818037-9-iscsi devstack@n-api.service[101847]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=101847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:55:05.148680 dv-cinder-818037-9-iscsi devstack@n-api.service[101848]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=101848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:55:05.148874 dv-cinder-818037-9-iscsi devstack@n-api.service[101848]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=101848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:55:05.149005 dv-cinder-818037-9-iscsi devstack@n-api.service[101847]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=101847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:55:05.149185 dv-cinder-818037-9-iscsi devstack@n-api.service[101848]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=101848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:55:05.149319 dv-cinder-818037-9-iscsi devstack@n-api.service[101847]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=101847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:55:05.149494 dv-cinder-818037-9-iscsi devstack@n-api.service[101848]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=101848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:55:05.149631 dv-cinder-818037-9-iscsi devstack@n-api.service[101847]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=101847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:55:05.149808 dv-cinder-818037-9-iscsi devstack@n-api.service[101848]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=101848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:55:05.149935 dv-cinder-818037-9-iscsi devstack@n-api.service[101847]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=101847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:55:05.150143 dv-cinder-818037-9-iscsi devstack@n-api.service[101848]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=101848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:55:05.150296 dv-cinder-818037-9-iscsi devstack@n-api.service[101847]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=101847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:55:05.150451 dv-cinder-818037-9-iscsi devstack@n-api.service[101848]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=101848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:55:05.150612 dv-cinder-818037-9-iscsi devstack@n-api.service[101847]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=101847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:55:05.150782 dv-cinder-818037-9-iscsi devstack@n-api.service[101848]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=101848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:55:05.150917 dv-cinder-818037-9-iscsi devstack@n-api.service[101847]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=101847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:55:05.151090 dv-cinder-818037-9-iscsi devstack@n-api.service[101848]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=101848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:55:05.151223 dv-cinder-818037-9-iscsi devstack@n-api.service[101847]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=101847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:55:05.151406 dv-cinder-818037-9-iscsi devstack@n-api.service[101848]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=101848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:55:05.151531 dv-cinder-818037-9-iscsi devstack@n-api.service[101847]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=101847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:55:05.151719 dv-cinder-818037-9-iscsi devstack@n-api.service[101848]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=101848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:55:05.151845 dv-cinder-818037-9-iscsi devstack@n-api.service[101847]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=101847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:55:05.152034 dv-cinder-818037-9-iscsi devstack@n-api.service[101848]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=101848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:55:05.152169 dv-cinder-818037-9-iscsi devstack@n-api.service[101847]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=101847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:55:05.152340 dv-cinder-818037-9-iscsi devstack@n-api.service[101848]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=101848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:55:05.152465 dv-cinder-818037-9-iscsi devstack@n-api.service[101847]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=101847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:55:05.152649 dv-cinder-818037-9-iscsi devstack@n-api.service[101848]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=101848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:55:05.152781 dv-cinder-818037-9-iscsi devstack@n-api.service[101847]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=101847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:55:05.152976 dv-cinder-818037-9-iscsi devstack@n-api.service[101848]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=101848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:55:05.153287 dv-cinder-818037-9-iscsi devstack@n-api.service[101847]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=101847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:55:05.153413 dv-cinder-818037-9-iscsi devstack@n-api.service[101848]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=101848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:55:05.153622 dv-cinder-818037-9-iscsi devstack@n-api.service[101847]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=101847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:55:05.153748 dv-cinder-818037-9-iscsi devstack@n-api.service[101848]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=101848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:55:05.153937 dv-cinder-818037-9-iscsi devstack@n-api.service[101847]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=101847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:55:05.154241 dv-cinder-818037-9-iscsi devstack@n-api.service[101848]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=101848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:55:05.154369 dv-cinder-818037-9-iscsi devstack@n-api.service[101847]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=101847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:55:05.154601 dv-cinder-818037-9-iscsi devstack@n-api.service[101847]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=101847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:55:05.154798 dv-cinder-818037-9-iscsi devstack@n-api.service[101848]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=101848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:55:05.154923 dv-cinder-818037-9-iscsi devstack@n-api.service[101847]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=101847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:55:05.155238 dv-cinder-818037-9-iscsi devstack@n-api.service[101847]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=101847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:55:05.155375 dv-cinder-818037-9-iscsi devstack@n-api.service[101848]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=101848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:55:05.155553 dv-cinder-818037-9-iscsi devstack@n-api.service[101847]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=101847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:55:05.155882 dv-cinder-818037-9-iscsi devstack@n-api.service[101847]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=101847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:55:05.156013 dv-cinder-818037-9-iscsi devstack@n-api.service[101848]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=101848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:55:05.156211 dv-cinder-818037-9-iscsi devstack@n-api.service[101847]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=101847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:55:05.156494 dv-cinder-818037-9-iscsi devstack@n-api.service[101848]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=101848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:55:05.156620 dv-cinder-818037-9-iscsi devstack@n-api.service[101847]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=101847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:55:05.156838 dv-cinder-818037-9-iscsi devstack@n-api.service[101847]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=101847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:55:05.157100 dv-cinder-818037-9-iscsi devstack@n-api.service[101848]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=101848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:55:05.157227 dv-cinder-818037-9-iscsi devstack@n-api.service[101847]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=101847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:55:05.157455 dv-cinder-818037-9-iscsi devstack@n-api.service[101847]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=101847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:55:05.157689 dv-cinder-818037-9-iscsi devstack@n-api.service[101848]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=101848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:55:05.157822 dv-cinder-818037-9-iscsi devstack@n-api.service[101847]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=101847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:55:05.158088 dv-cinder-818037-9-iscsi devstack@n-api.service[101847]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=101847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:55:05.158303 dv-cinder-818037-9-iscsi devstack@n-api.service[101848]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=101848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:55:05.158429 dv-cinder-818037-9-iscsi devstack@n-api.service[101847]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=101847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:55:05.158740 dv-cinder-818037-9-iscsi devstack@n-api.service[101847]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=101847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:55:05.158895 dv-cinder-818037-9-iscsi devstack@n-api.service[101848]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=101848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:55:05.159068 dv-cinder-818037-9-iscsi devstack@n-api.service[101847]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=101847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:55:05.159406 dv-cinder-818037-9-iscsi devstack@n-api.service[101847]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=101847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:55:05.159531 dv-cinder-818037-9-iscsi devstack@n-api.service[101848]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=101848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:55:05.159742 dv-cinder-818037-9-iscsi devstack@n-api.service[101847]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=101847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:55:05.160063 dv-cinder-818037-9-iscsi devstack@n-api.service[101847]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=101847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:55:05.160187 dv-cinder-818037-9-iscsi devstack@n-api.service[101848]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=101848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:55:05.160403 dv-cinder-818037-9-iscsi devstack@n-api.service[101847]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=101847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:55:05.160709 dv-cinder-818037-9-iscsi devstack@n-api.service[101848]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=101848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:55:05.160835 dv-cinder-818037-9-iscsi devstack@n-api.service[101847]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=101847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:55:05.161043 dv-cinder-818037-9-iscsi devstack@n-api.service[101847]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=101847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:55:05.161346 dv-cinder-818037-9-iscsi devstack@n-api.service[101848]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=101848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:55:05.161473 dv-cinder-818037-9-iscsi devstack@n-api.service[101847]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=101847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:55:05.161687 dv-cinder-818037-9-iscsi devstack@n-api.service[101847]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=101847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:55:05.161958 dv-cinder-818037-9-iscsi devstack@n-api.service[101848]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=101848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:55:05.162108 dv-cinder-818037-9-iscsi devstack@n-api.service[101847]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=101847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:55:05.162325 dv-cinder-818037-9-iscsi devstack@n-api.service[101847]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=101847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:55:05.163147 dv-cinder-818037-9-iscsi devstack@n-api.service[101848]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=101848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:55:05.163279 dv-cinder-818037-9-iscsi devstack@n-api.service[101847]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=101847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:55:05.163494 dv-cinder-818037-9-iscsi devstack@n-api.service[101847]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=101847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:55:05.163780 dv-cinder-818037-9-iscsi devstack@n-api.service[101848]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=101848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:55:05.163907 dv-cinder-818037-9-iscsi devstack@n-api.service[101847]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=101847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:55:05.164105 dv-cinder-818037-9-iscsi devstack@n-api.service[101847]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=101847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:55:05.164378 dv-cinder-818037-9-iscsi devstack@n-api.service[101848]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=101848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:55:05.164506 dv-cinder-818037-9-iscsi devstack@n-api.service[101847]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=101847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:55:05.164808 dv-cinder-818037-9-iscsi devstack@n-api.service[101848]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=101848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:55:05.164934 dv-cinder-818037-9-iscsi devstack@n-api.service[101847]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=101847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:55:05.165117 dv-cinder-818037-9-iscsi devstack@n-api.service[101847]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=101847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:55:05.165276 dv-cinder-818037-9-iscsi devstack@n-api.service[101848]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=101848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:55:05.165429 dv-cinder-818037-9-iscsi devstack@n-api.service[101847]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=101847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:55:05.165760 dv-cinder-818037-9-iscsi devstack@n-api.service[101847]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=101847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:55:05.165884 dv-cinder-818037-9-iscsi devstack@n-api.service[101848]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=101848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:55:05.166109 dv-cinder-818037-9-iscsi devstack@n-api.service[101847]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=101847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:55:05.166236 dv-cinder-818037-9-iscsi devstack@n-api.service[101848]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=101848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:55:05.166431 dv-cinder-818037-9-iscsi devstack@n-api.service[101848]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=101848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:55:05.166557 dv-cinder-818037-9-iscsi devstack@n-api.service[101847]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=101847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:55:05.166749 dv-cinder-818037-9-iscsi devstack@n-api.service[101847]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=101847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:55:05.166874 dv-cinder-818037-9-iscsi devstack@n-api.service[101848]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=101848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:55:05.167065 dv-cinder-818037-9-iscsi devstack@n-api.service[101847]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=101847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:55:05.167198 dv-cinder-818037-9-iscsi devstack@n-api.service[101848]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=101848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:55:05.167378 dv-cinder-818037-9-iscsi devstack@n-api.service[101847]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=101847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:55:05.167504 dv-cinder-818037-9-iscsi devstack@n-api.service[101848]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=101848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:55:05.167690 dv-cinder-818037-9-iscsi devstack@n-api.service[101847]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=101847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:55:05.167816 dv-cinder-818037-9-iscsi devstack@n-api.service[101848]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=101848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:55:05.168009 dv-cinder-818037-9-iscsi devstack@n-api.service[101848]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=101848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:55:05.168172 dv-cinder-818037-9-iscsi devstack@n-api.service[101847]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=101847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:55:05.168364 dv-cinder-818037-9-iscsi devstack@n-api.service[101848]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=101848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:55:05.168497 dv-cinder-818037-9-iscsi devstack@n-api.service[101847]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=101847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:55:05.168904 dv-cinder-818037-9-iscsi devstack@n-api.service[101848]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=101848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:55:05.169047 dv-cinder-818037-9-iscsi devstack@n-api.service[101847]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=101847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:55:05.169177 dv-cinder-818037-9-iscsi devstack@n-api.service[101847]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=101847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:55:05.169308 dv-cinder-818037-9-iscsi devstack@n-api.service[101848]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=101848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:55:05.169460 dv-cinder-818037-9-iscsi devstack@n-api.service[101847]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=101847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:55:05.169797 dv-cinder-818037-9-iscsi devstack@n-api.service[101847]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=101847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:55:05.169930 dv-cinder-818037-9-iscsi devstack@n-api.service[101848]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=101848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:55:05.170143 dv-cinder-818037-9-iscsi devstack@n-api.service[101847]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=101847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:55:05.170475 dv-cinder-818037-9-iscsi devstack@n-api.service[101848]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=101848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:55:05.170611 dv-cinder-818037-9-iscsi devstack@n-api.service[101847]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=101847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:55:05.170801 dv-cinder-818037-9-iscsi devstack@n-api.service[101847]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=101847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:55:05.171086 dv-cinder-818037-9-iscsi devstack@n-api.service[101848]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=101848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:55:05.171219 dv-cinder-818037-9-iscsi devstack@n-api.service[101847]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=101847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:55:05.171440 dv-cinder-818037-9-iscsi devstack@n-api.service[101847]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=101847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:55:05.171682 dv-cinder-818037-9-iscsi devstack@n-api.service[101848]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=101848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:55:05.171818 dv-cinder-818037-9-iscsi devstack@n-api.service[101847]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=101847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:55:05.172075 dv-cinder-818037-9-iscsi devstack@n-api.service[101847]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=101847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:55:05.172278 dv-cinder-818037-9-iscsi devstack@n-api.service[101848]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=101848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:55:05.172403 dv-cinder-818037-9-iscsi devstack@n-api.service[101847]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=101847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:55:05.172710 dv-cinder-818037-9-iscsi devstack@n-api.service[101847]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=101847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:55:05.172846 dv-cinder-818037-9-iscsi devstack@n-api.service[101848]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=101848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:55:05.173027 dv-cinder-818037-9-iscsi devstack@n-api.service[101847]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=101847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:55:05.173351 dv-cinder-818037-9-iscsi devstack@n-api.service[101847]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=101847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:55:05.173475 dv-cinder-818037-9-iscsi devstack@n-api.service[101848]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=101848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:55:05.173675 dv-cinder-818037-9-iscsi devstack@n-api.service[101847]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=101847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:55:05.174015 dv-cinder-818037-9-iscsi devstack@n-api.service[101847]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=101847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:55:05.174157 dv-cinder-818037-9-iscsi devstack@n-api.service[101848]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=101848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:55:05.174557 dv-cinder-818037-9-iscsi devstack@n-api.service[101847]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=101847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:55:05.174683 dv-cinder-818037-9-iscsi devstack@n-api.service[101848]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=101848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:55:05.174900 dv-cinder-818037-9-iscsi devstack@n-api.service[101847]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=101847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:55:05.175226 dv-cinder-818037-9-iscsi devstack@n-api.service[101847]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=101847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:55:05.175351 dv-cinder-818037-9-iscsi devstack@n-api.service[101848]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=101848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:55:05.175549 dv-cinder-818037-9-iscsi devstack@n-api.service[101847]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=101847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:55:05.175873 dv-cinder-818037-9-iscsi devstack@n-api.service[101848]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=101848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:55:05.176000 dv-cinder-818037-9-iscsi devstack@n-api.service[101847]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=101847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:55:05.176196 dv-cinder-818037-9-iscsi devstack@n-api.service[101847]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=101847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:55:05.176474 dv-cinder-818037-9-iscsi devstack@n-api.service[101848]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=101848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:55:05.176604 dv-cinder-818037-9-iscsi devstack@n-api.service[101847]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=101847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:55:05.176827 dv-cinder-818037-9-iscsi devstack@n-api.service[101847]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=101847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:55:05.177112 dv-cinder-818037-9-iscsi devstack@n-api.service[101848]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=101848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:55:05.177238 dv-cinder-818037-9-iscsi devstack@n-api.service[101847]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=101847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:55:05.177450 dv-cinder-818037-9-iscsi devstack@n-api.service[101847]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=101847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:55:05.177707 dv-cinder-818037-9-iscsi devstack@n-api.service[101848]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=101848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:55:05.177842 dv-cinder-818037-9-iscsi devstack@n-api.service[101847]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=101847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:55:05.178153 dv-cinder-818037-9-iscsi devstack@n-api.service[101847]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=101847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:55:05.178284 dv-cinder-818037-9-iscsi devstack@n-api.service[101848]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=101848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:55:05.178486 dv-cinder-818037-9-iscsi devstack@n-api.service[101847]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=101847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:55:05.178731 dv-cinder-818037-9-iscsi devstack@n-api.service[101848]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=101848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:55:05.178863 dv-cinder-818037-9-iscsi devstack@n-api.service[101847]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=101847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:55:05.179148 dv-cinder-818037-9-iscsi devstack@n-api.service[101847]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=101847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:55:05.179274 dv-cinder-818037-9-iscsi devstack@n-api.service[101848]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=101848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:55:05.179474 dv-cinder-818037-9-iscsi devstack@n-api.service[101847]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=101847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:55:05.179601 dv-cinder-818037-9-iscsi devstack@n-api.service[101848]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=101848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:55:05.179798 dv-cinder-818037-9-iscsi devstack@n-api.service[101847]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=101847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:55:05.179924 dv-cinder-818037-9-iscsi devstack@n-api.service[101848]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=101848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:55:05.180127 dv-cinder-818037-9-iscsi devstack@n-api.service[101847]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=101847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:55:05.180255 dv-cinder-818037-9-iscsi devstack@n-api.service[101848]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=101848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:55:05.180451 dv-cinder-818037-9-iscsi devstack@n-api.service[101847]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=101847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:55:05.180576 dv-cinder-818037-9-iscsi devstack@n-api.service[101848]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=101848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:55:05.180812 dv-cinder-818037-9-iscsi devstack@n-api.service[101847]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=101847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:55:05.180950 dv-cinder-818037-9-iscsi devstack@n-api.service[101848]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=101848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:55:05.181135 dv-cinder-818037-9-iscsi devstack@n-api.service[101847]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=101847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:55:05.181262 dv-cinder-818037-9-iscsi devstack@n-api.service[101848]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=101848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:55:05.181449 dv-cinder-818037-9-iscsi devstack@n-api.service[101847]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=101847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:55:05.181568 dv-cinder-818037-9-iscsi devstack@n-api.service[101848]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=101848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:55:05.181771 dv-cinder-818037-9-iscsi devstack@n-api.service[101847]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=101847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:55:05.181909 dv-cinder-818037-9-iscsi devstack@n-api.service[101848]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=101848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:55:05.182116 dv-cinder-818037-9-iscsi devstack@n-api.service[101847]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=101847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:55:05.182252 dv-cinder-818037-9-iscsi devstack@n-api.service[101848]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=101848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:55:05.182441 dv-cinder-818037-9-iscsi devstack@n-api.service[101847]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=101847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:55:05.182650 dv-cinder-818037-9-iscsi devstack@n-api.service[101848]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=101848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:55:05.182775 dv-cinder-818037-9-iscsi devstack@n-api.service[101847]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=101847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:55:05.182991 dv-cinder-818037-9-iscsi devstack@n-api.service[101848]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=101848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:55:05.183118 dv-cinder-818037-9-iscsi devstack@n-api.service[101847]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=101847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:55:05.183316 dv-cinder-818037-9-iscsi devstack@n-api.service[101848]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=101848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:55:05.183442 dv-cinder-818037-9-iscsi devstack@n-api.service[101847]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=101847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:55:05.183642 dv-cinder-818037-9-iscsi devstack@n-api.service[101848]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=101848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:55:05.183779 dv-cinder-818037-9-iscsi devstack@n-api.service[101847]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=101847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:55:05.183965 dv-cinder-818037-9-iscsi devstack@n-api.service[101848]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=101848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:55:05.184091 dv-cinder-818037-9-iscsi devstack@n-api.service[101847]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=101847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:55:05.184288 dv-cinder-818037-9-iscsi devstack@n-api.service[101847]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=101847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:55:05.184419 dv-cinder-818037-9-iscsi devstack@n-api.service[101848]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=101848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:55:05.184609 dv-cinder-818037-9-iscsi devstack@n-api.service[101847]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=101847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:55:05.184776 dv-cinder-818037-9-iscsi devstack@n-api.service[101848]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=101848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:55:05.184927 dv-cinder-818037-9-iscsi devstack@n-api.service[101848]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=101848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:55:05.185050 dv-cinder-818037-9-iscsi devstack@n-api.service[101847]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=101847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:55:05.185246 dv-cinder-818037-9-iscsi devstack@n-api.service[101848]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=101848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:55:05.185372 dv-cinder-818037-9-iscsi devstack@n-api.service[101847]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=101847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:55:05.185562 dv-cinder-818037-9-iscsi devstack@n-api.service[101848]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=101848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:55:05.185697 dv-cinder-818037-9-iscsi devstack@n-api.service[101847]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=101847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:55:05.185881 dv-cinder-818037-9-iscsi devstack@n-api.service[101848]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=101848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:55:05.186041 dv-cinder-818037-9-iscsi devstack@n-api.service[101847]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=101847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:55:05.186233 dv-cinder-818037-9-iscsi devstack@n-api.service[101847]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=101847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:55:05.186357 dv-cinder-818037-9-iscsi devstack@n-api.service[101848]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=101848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:55:05.186557 dv-cinder-818037-9-iscsi devstack@n-api.service[101847]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=101847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:55:05.186690 dv-cinder-818037-9-iscsi devstack@n-api.service[101848]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=101848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:55:05.186880 dv-cinder-818037-9-iscsi devstack@n-api.service[101847]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=101847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:55:05.187013 dv-cinder-818037-9-iscsi devstack@n-api.service[101848]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=101848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:55:05.187219 dv-cinder-818037-9-iscsi devstack@n-api.service[101848]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=101848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:55:05.187401 dv-cinder-818037-9-iscsi devstack@n-api.service[101847]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=101847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:55:05.187541 dv-cinder-818037-9-iscsi devstack@n-api.service[101848]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=101848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:55:05.187732 dv-cinder-818037-9-iscsi devstack@n-api.service[101847]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=101847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:55:05.187858 dv-cinder-818037-9-iscsi devstack@n-api.service[101848]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=101848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:55:05.188065 dv-cinder-818037-9-iscsi devstack@n-api.service[101847]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=101847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:55:05.188198 dv-cinder-818037-9-iscsi devstack@n-api.service[101848]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=101848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:55:05.188397 dv-cinder-818037-9-iscsi devstack@n-api.service[101847]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=101847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:55:05.188532 dv-cinder-818037-9-iscsi devstack@n-api.service[101848]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=101848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:55:05.188728 dv-cinder-818037-9-iscsi devstack@n-api.service[101847]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=101847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:55:05.188860 dv-cinder-818037-9-iscsi devstack@n-api.service[101848]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=101848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:55:05.189051 dv-cinder-818037-9-iscsi devstack@n-api.service[101847]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=101847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:55:05.189183 dv-cinder-818037-9-iscsi devstack@n-api.service[101848]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=101848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:55:05.189374 dv-cinder-818037-9-iscsi devstack@n-api.service[101847]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=101847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:55:05.189501 dv-cinder-818037-9-iscsi devstack@n-api.service[101848]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=101848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:55:05.189709 dv-cinder-818037-9-iscsi devstack@n-api.service[101847]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=101847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:55:05.189842 dv-cinder-818037-9-iscsi devstack@n-api.service[101848]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=101848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:55:05.190050 dv-cinder-818037-9-iscsi devstack@n-api.service[101848]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=101848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:55:05.190179 dv-cinder-818037-9-iscsi devstack@n-api.service[101847]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=101847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:55:05.190366 dv-cinder-818037-9-iscsi devstack@n-api.service[101847]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=101847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:55:05.190491 dv-cinder-818037-9-iscsi devstack@n-api.service[101848]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=101848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:55:05.190683 dv-cinder-818037-9-iscsi devstack@n-api.service[101847]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=101847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:55:05.190810 dv-cinder-818037-9-iscsi devstack@n-api.service[101848]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=101848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:55:05.191001 dv-cinder-818037-9-iscsi devstack@n-api.service[101847]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=101847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:55:05.191133 dv-cinder-818037-9-iscsi devstack@n-api.service[101848]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=101848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:55:05.191312 dv-cinder-818037-9-iscsi devstack@n-api.service[101847]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=101847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:55:05.191439 dv-cinder-818037-9-iscsi devstack@n-api.service[101848]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=101848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:55:05.191631 dv-cinder-818037-9-iscsi devstack@n-api.service[101848]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=101848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:55:05.191757 dv-cinder-818037-9-iscsi devstack@n-api.service[101847]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=101847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:55:05.191947 dv-cinder-818037-9-iscsi devstack@n-api.service[101847]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=101847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:55:05.192081 dv-cinder-818037-9-iscsi devstack@n-api.service[101848]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=101848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:55:05.192260 dv-cinder-818037-9-iscsi devstack@n-api.service[101847]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=101847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:55:05.192387 dv-cinder-818037-9-iscsi devstack@n-api.service[101848]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=101848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:55:05.192579 dv-cinder-818037-9-iscsi devstack@n-api.service[101848]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=101848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:55:05.192704 dv-cinder-818037-9-iscsi devstack@n-api.service[101847]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=101847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:55:05.192893 dv-cinder-818037-9-iscsi devstack@n-api.service[101847]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=101847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:55:05.193030 dv-cinder-818037-9-iscsi devstack@n-api.service[101848]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=101848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:55:05.193222 dv-cinder-818037-9-iscsi devstack@n-api.service[101848]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=101848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:55:05.193426 dv-cinder-818037-9-iscsi devstack@n-api.service[101847]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=101847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:55:05.193553 dv-cinder-818037-9-iscsi devstack@n-api.service[101848]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=101848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:55:05.193824 dv-cinder-818037-9-iscsi devstack@n-api.service[101847]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=101847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:55:05.193952 dv-cinder-818037-9-iscsi devstack@n-api.service[101848]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=101848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:55:05.194174 dv-cinder-818037-9-iscsi devstack@n-api.service[101847]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=101847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:55:05.194302 dv-cinder-818037-9-iscsi devstack@n-api.service[101848]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=101848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:55:05.194510 dv-cinder-818037-9-iscsi devstack@n-api.service[101847]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=101847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:55:05.194637 dv-cinder-818037-9-iscsi devstack@n-api.service[101848]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=101848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:55:05.194846 dv-cinder-818037-9-iscsi devstack@n-api.service[101848]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=101848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:55:05.194980 dv-cinder-818037-9-iscsi devstack@n-api.service[101847]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=101847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:55:05.195167 dv-cinder-818037-9-iscsi devstack@n-api.service[101847]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=101847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:55:05.195369 dv-cinder-818037-9-iscsi devstack@n-api.service[101848]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=101848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:55:05.195496 dv-cinder-818037-9-iscsi devstack@n-api.service[101847]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=101847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:55:05.195692 dv-cinder-818037-9-iscsi devstack@n-api.service[101848]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=101848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:55:05.195817 dv-cinder-818037-9-iscsi devstack@n-api.service[101847]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=101847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:55:05.196031 dv-cinder-818037-9-iscsi devstack@n-api.service[101848]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=101848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:55:05.196158 dv-cinder-818037-9-iscsi devstack@n-api.service[101847]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=101847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:55:05.196361 dv-cinder-818037-9-iscsi devstack@n-api.service[101848]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=101848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:55:05.196486 dv-cinder-818037-9-iscsi devstack@n-api.service[101847]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=101847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:55:05.196691 dv-cinder-818037-9-iscsi devstack@n-api.service[101848]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=101848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:55:05.196816 dv-cinder-818037-9-iscsi devstack@n-api.service[101847]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=101847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:55:05.197011 dv-cinder-818037-9-iscsi devstack@n-api.service[101847]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=101847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:55:05.197136 dv-cinder-818037-9-iscsi devstack@n-api.service[101848]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=101848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:55:05.197321 dv-cinder-818037-9-iscsi devstack@n-api.service[101847]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=101847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:55:05.197446 dv-cinder-818037-9-iscsi devstack@n-api.service[101848]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=101848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:55:05.197632 dv-cinder-818037-9-iscsi devstack@n-api.service[101847]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=101847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:55:05.197757 dv-cinder-818037-9-iscsi devstack@n-api.service[101848]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=101848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:55:05.197948 dv-cinder-818037-9-iscsi devstack@n-api.service[101847]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=101847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:55:05.198098 dv-cinder-818037-9-iscsi devstack@n-api.service[101848]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=101848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:55:05.198283 dv-cinder-818037-9-iscsi devstack@n-api.service[101848]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=101848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:55:05.198395 dv-cinder-818037-9-iscsi devstack@n-api.service[101847]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=101847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:55:05.201489 dv-cinder-818037-9-iscsi devstack@n-api.service[101847]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=101847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:55:05.201652 dv-cinder-818037-9-iscsi devstack@n-api.service[101848]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=101848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:55:05.201652 dv-cinder-818037-9-iscsi devstack@n-api.service[101848]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=101848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:55:05.201858 dv-cinder-818037-9-iscsi devstack@n-api.service[101847]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=101847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:55:05.201962 dv-cinder-818037-9-iscsi devstack@n-api.service[101848]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=101848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:55:05.202097 dv-cinder-818037-9-iscsi devstack@n-api.service[101847]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=101847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:55:05.202203 dv-cinder-818037-9-iscsi devstack@n-api.service[101848]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=101848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:55:05.202324 dv-cinder-818037-9-iscsi devstack@n-api.service[101847]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=101847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:55:05.202430 dv-cinder-818037-9-iscsi devstack@n-api.service[101848]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=101848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:55:05.202542 dv-cinder-818037-9-iscsi devstack@n-api.service[101847]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=101847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:55:05.202645 dv-cinder-818037-9-iscsi devstack@n-api.service[101848]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=101848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:55:05.202749 dv-cinder-818037-9-iscsi devstack@n-api.service[101847]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=101847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:55:05.202851 dv-cinder-818037-9-iscsi devstack@n-api.service[101848]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=101848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:55:05.202969 dv-cinder-818037-9-iscsi devstack@n-api.service[101847]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=101847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:55:05.203073 dv-cinder-818037-9-iscsi devstack@n-api.service[101848]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=101848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:55:05.203182 dv-cinder-818037-9-iscsi devstack@n-api.service[101847]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=101847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:55:05.203182 dv-cinder-818037-9-iscsi devstack@n-api.service[101847]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=101847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:55:05.203390 dv-cinder-818037-9-iscsi devstack@n-api.service[101848]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=101848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:55:05.203493 dv-cinder-818037-9-iscsi devstack@n-api.service[101847]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=101847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:55:05.203603 dv-cinder-818037-9-iscsi devstack@n-api.service[101848]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=101848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:55:05.203713 dv-cinder-818037-9-iscsi devstack@n-api.service[101847]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=101847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:55:05.203816 dv-cinder-818037-9-iscsi devstack@n-api.service[101848]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=101848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:55:05.203930 dv-cinder-818037-9-iscsi devstack@n-api.service[101847]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=101847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:55:05.204034 dv-cinder-818037-9-iscsi devstack@n-api.service[101848]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=101848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:55:05.204147 dv-cinder-818037-9-iscsi devstack@n-api.service[101847]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=101847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:55:05.204147 dv-cinder-818037-9-iscsi devstack@n-api.service[101847]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=101847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:55:05.204353 dv-cinder-818037-9-iscsi devstack@n-api.service[101848]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=101848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:55:05.204463 dv-cinder-818037-9-iscsi devstack@n-api.service[101847]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=101847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:55:05.204566 dv-cinder-818037-9-iscsi devstack@n-api.service[101848]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=101848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:55:05.204675 dv-cinder-818037-9-iscsi devstack@n-api.service[101847]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=101847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:55:05.204792 dv-cinder-818037-9-iscsi devstack@n-api.service[101848]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=101848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:55:05.204896 dv-cinder-818037-9-iscsi devstack@n-api.service[101847]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=101847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:55:05.205005 dv-cinder-818037-9-iscsi devstack@n-api.service[101848]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=101848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:55:05.205108 dv-cinder-818037-9-iscsi devstack@n-api.service[101847]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=101847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:55:05.205217 dv-cinder-818037-9-iscsi devstack@n-api.service[101848]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=101848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:55:05.205325 dv-cinder-818037-9-iscsi devstack@n-api.service[101847]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=101847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:55:05.205440 dv-cinder-818037-9-iscsi devstack@n-api.service[101848]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=101848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:55:05.205543 dv-cinder-818037-9-iscsi devstack@n-api.service[101847]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=101847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:55:05.205645 dv-cinder-818037-9-iscsi devstack@n-api.service[101848]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=101848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:55:05.205759 dv-cinder-818037-9-iscsi devstack@n-api.service[101847]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=101847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:55:05.205862 dv-cinder-818037-9-iscsi devstack@n-api.service[101848]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=101848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:55:05.205964 dv-cinder-818037-9-iscsi devstack@n-api.service[101847]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=101847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:55:05.206124 dv-cinder-818037-9-iscsi devstack@n-api.service[101848]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=101848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:55:05.206236 dv-cinder-818037-9-iscsi devstack@n-api.service[101847]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=101847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:55:05.206864 dv-cinder-818037-9-iscsi devstack@n-api.service[101848]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=101848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:55:05.206972 dv-cinder-818037-9-iscsi devstack@n-api.service[101847]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=101847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:55:05.207260 dv-cinder-818037-9-iscsi devstack@n-api.service[101848]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=101848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:55:05.207417 dv-cinder-818037-9-iscsi devstack@n-api.service[101847]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=101847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:55:05.207527 dv-cinder-818037-9-iscsi devstack@n-api.service[101848]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=101848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:55:05.207630 dv-cinder-818037-9-iscsi devstack@n-api.service[101847]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=101847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:55:05.207732 dv-cinder-818037-9-iscsi devstack@n-api.service[101848]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=101848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:55:05.207846 dv-cinder-818037-9-iscsi devstack@n-api.service[101847]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=101847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:55:05.207986 dv-cinder-818037-9-iscsi devstack@n-api.service[101848]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=101848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:55:05.207986 dv-cinder-818037-9-iscsi devstack@n-api.service[101848]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=101848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:55:05.208220 dv-cinder-818037-9-iscsi devstack@n-api.service[101847]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=101847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:55:05.208342 dv-cinder-818037-9-iscsi devstack@n-api.service[101848]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=101848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:55:05.208464 dv-cinder-818037-9-iscsi devstack@n-api.service[101847]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=101847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:55:05.208587 dv-cinder-818037-9-iscsi devstack@n-api.service[101848]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=101848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:55:05.208718 dv-cinder-818037-9-iscsi devstack@n-api.service[101847]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=101847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:55:05.208842 dv-cinder-818037-9-iscsi devstack@n-api.service[101848]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=101848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:55:05.208963 dv-cinder-818037-9-iscsi devstack@n-api.service[101847]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=101847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:55:05.209085 dv-cinder-818037-9-iscsi devstack@n-api.service[101848]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=101848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:55:05.209085 dv-cinder-818037-9-iscsi devstack@n-api.service[101848]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=101848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:55:05.209840 dv-cinder-818037-9-iscsi devstack@n-api.service[101847]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=101847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:55:05.209995 dv-cinder-818037-9-iscsi devstack@n-api.service[101848]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=101848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:55:05.210121 dv-cinder-818037-9-iscsi devstack@n-api.service[101847]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=101847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:55:05.210256 dv-cinder-818037-9-iscsi devstack@n-api.service[101848]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=101848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:55:05.210380 dv-cinder-818037-9-iscsi devstack@n-api.service[101847]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=101847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:55:05.210512 dv-cinder-818037-9-iscsi devstack@n-api.service[101848]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=101848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:55:05.210648 dv-cinder-818037-9-iscsi devstack@n-api.service[101847]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=101847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:55:05.210772 dv-cinder-818037-9-iscsi devstack@n-api.service[101848]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=101848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:55:05.210893 dv-cinder-818037-9-iscsi devstack@n-api.service[101847]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=101847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:55:05.211021 dv-cinder-818037-9-iscsi devstack@n-api.service[101848]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=101848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:55:05.211144 dv-cinder-818037-9-iscsi devstack@n-api.service[101847]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=101847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:55:05.211265 dv-cinder-818037-9-iscsi devstack@n-api.service[101848]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=101848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:55:05.211398 dv-cinder-818037-9-iscsi devstack@n-api.service[101847]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=101847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:55:05.211521 dv-cinder-818037-9-iscsi devstack@n-api.service[101848]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=101848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:55:05.211643 dv-cinder-818037-9-iscsi devstack@n-api.service[101847]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=101847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:55:05.211765 dv-cinder-818037-9-iscsi devstack@n-api.service[101848]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=101848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:55:05.211896 dv-cinder-818037-9-iscsi devstack@n-api.service[101847]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=101847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:55:05.212019 dv-cinder-818037-9-iscsi devstack@n-api.service[101848]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=101848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:55:05.212148 dv-cinder-818037-9-iscsi devstack@n-api.service[101847]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=101847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:55:05.212280 dv-cinder-818037-9-iscsi devstack@n-api.service[101848]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=101848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:55:05.212402 dv-cinder-818037-9-iscsi devstack@n-api.service[101847]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=101847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:55:05.212530 dv-cinder-818037-9-iscsi devstack@n-api.service[101848]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=101848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:55:05.212652 dv-cinder-818037-9-iscsi devstack@n-api.service[101847]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=101847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:55:05.212782 dv-cinder-818037-9-iscsi devstack@n-api.service[101848]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=101848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:55:05.212913 dv-cinder-818037-9-iscsi devstack@n-api.service[101847]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=101847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:55:05.213036 dv-cinder-818037-9-iscsi devstack@n-api.service[101848]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=101848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:55:05.213157 dv-cinder-818037-9-iscsi devstack@n-api.service[101847]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=101847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:55:05.213278 dv-cinder-818037-9-iscsi devstack@n-api.service[101848]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=101848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:55:05.213399 dv-cinder-818037-9-iscsi devstack@n-api.service[101847]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=101847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:55:05.213599 dv-cinder-818037-9-iscsi devstack@n-api.service[101848]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=101848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:55:05.213737 dv-cinder-818037-9-iscsi devstack@n-api.service[101847]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=101847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:55:05.213863 dv-cinder-818037-9-iscsi devstack@n-api.service[101848]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=101848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:55:05.214000 dv-cinder-818037-9-iscsi devstack@n-api.service[101847]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=101847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:55:05.214123 dv-cinder-818037-9-iscsi devstack@n-api.service[101848]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=101848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:55:05.214287 dv-cinder-818037-9-iscsi devstack@n-api.service[101847]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=101847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:55:05.214426 dv-cinder-818037-9-iscsi devstack@n-api.service[101848]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=101848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:55:05.214637 dv-cinder-818037-9-iscsi devstack@n-api.service[101847]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=101847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:55:05.214764 dv-cinder-818037-9-iscsi devstack@n-api.service[101848]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=101848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:55:05.214964 dv-cinder-818037-9-iscsi devstack@n-api.service[101848]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=101848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:55:05.215089 dv-cinder-818037-9-iscsi devstack@n-api.service[101847]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=101847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:55:05.215290 dv-cinder-818037-9-iscsi devstack@n-api.service[101847]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=101847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:55:05.215423 dv-cinder-818037-9-iscsi devstack@n-api.service[101848]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=101848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:55:05.215615 dv-cinder-818037-9-iscsi devstack@n-api.service[101847]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=101847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:55:05.215742 dv-cinder-818037-9-iscsi devstack@n-api.service[101848]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=101848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:55:05.215941 dv-cinder-818037-9-iscsi devstack@n-api.service[101847]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=101847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:55:05.216153 dv-cinder-818037-9-iscsi devstack@n-api.service[101848]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=101848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:55:05.216289 dv-cinder-818037-9-iscsi devstack@n-api.service[101847]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=101847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:55:05.216550 dv-cinder-818037-9-iscsi devstack@n-api.service[101848]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=101848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:55:05.216676 dv-cinder-818037-9-iscsi devstack@n-api.service[101847]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=101847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:55:05.216867 dv-cinder-818037-9-iscsi devstack@n-api.service[101847]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=101847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:55:05.217001 dv-cinder-818037-9-iscsi devstack@n-api.service[101848]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=101848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:55:05.217184 dv-cinder-818037-9-iscsi devstack@n-api.service[101847]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=101847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:55:05.217319 dv-cinder-818037-9-iscsi devstack@n-api.service[101848]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=101848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:55:05.217507 dv-cinder-818037-9-iscsi devstack@n-api.service[101847]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=101847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:55:05.217633 dv-cinder-818037-9-iscsi devstack@n-api.service[101848]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=101848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:55:05.217844 dv-cinder-818037-9-iscsi devstack@n-api.service[101847]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=101847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:55:05.218017 dv-cinder-818037-9-iscsi devstack@n-api.service[101848]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=101848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:55:05.218178 dv-cinder-818037-9-iscsi devstack@n-api.service[101848]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=101848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:55:05.218313 dv-cinder-818037-9-iscsi devstack@n-api.service[101847]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=101847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:55:05.218489 dv-cinder-818037-9-iscsi devstack@n-api.service[101847]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=101847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:55:05.218613 dv-cinder-818037-9-iscsi devstack@n-api.service[101848]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=101848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:55:05.218816 dv-cinder-818037-9-iscsi devstack@n-api.service[101848]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=101848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:55:05.218953 dv-cinder-818037-9-iscsi devstack@n-api.service[101847]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=101847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:55:05.219134 dv-cinder-818037-9-iscsi devstack@n-api.service[101848]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=101848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:55:05.219268 dv-cinder-818037-9-iscsi devstack@n-api.service[101847]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=101847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:55:05.219449 dv-cinder-818037-9-iscsi devstack@n-api.service[101848]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=101848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:55:05.219575 dv-cinder-818037-9-iscsi devstack@n-api.service[101847]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=101847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:55:05.219765 dv-cinder-818037-9-iscsi devstack@n-api.service[101848]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=101848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:55:05.219899 dv-cinder-818037-9-iscsi devstack@n-api.service[101847]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=101847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:55:05.220081 dv-cinder-818037-9-iscsi devstack@n-api.service[101848]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=101848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:55:05.220207 dv-cinder-818037-9-iscsi devstack@n-api.service[101847]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=101847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:55:05.220396 dv-cinder-818037-9-iscsi devstack@n-api.service[101848]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=101848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:55:05.220529 dv-cinder-818037-9-iscsi devstack@n-api.service[101847]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=101847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:55:05.220711 dv-cinder-818037-9-iscsi devstack@n-api.service[101848]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=101848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:55:05.220837 dv-cinder-818037-9-iscsi devstack@n-api.service[101847]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=101847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:55:05.221029 dv-cinder-818037-9-iscsi devstack@n-api.service[101848]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=101848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:55:05.221155 dv-cinder-818037-9-iscsi devstack@n-api.service[101847]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=101847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:55:05.221332 dv-cinder-818037-9-iscsi devstack@n-api.service[101848]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=101848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:55:05.221458 dv-cinder-818037-9-iscsi devstack@n-api.service[101847]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=101847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:55:05.221646 dv-cinder-818037-9-iscsi devstack@n-api.service[101848]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=101848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:55:05.221786 dv-cinder-818037-9-iscsi devstack@n-api.service[101847]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=101847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:55:05.221965 dv-cinder-818037-9-iscsi devstack@n-api.service[101848]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=101848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:55:05.222111 dv-cinder-818037-9-iscsi devstack@n-api.service[101847]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=101847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:55:05.222331 dv-cinder-818037-9-iscsi devstack@n-api.service[101848]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=101848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:55:05.222468 dv-cinder-818037-9-iscsi devstack@n-api.service[101847]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=101847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:55:05.222656 dv-cinder-818037-9-iscsi devstack@n-api.service[101848]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=101848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:55:05.222793 dv-cinder-818037-9-iscsi devstack@n-api.service[101847]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=101847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:55:05.222978 dv-cinder-818037-9-iscsi devstack@n-api.service[101848]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=101848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:55:05.223115 dv-cinder-818037-9-iscsi devstack@n-api.service[101847]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=101847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:55:05.223298 dv-cinder-818037-9-iscsi devstack@n-api.service[101848]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=101848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:55:05.223424 dv-cinder-818037-9-iscsi devstack@n-api.service[101847]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=101847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:55:05.223621 dv-cinder-818037-9-iscsi devstack@n-api.service[101848]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=101848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:55:05.223757 dv-cinder-818037-9-iscsi devstack@n-api.service[101847]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=101847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:55:05.223936 dv-cinder-818037-9-iscsi devstack@n-api.service[101847]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=101847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:55:05.224061 dv-cinder-818037-9-iscsi devstack@n-api.service[101848]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=101848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:55:05.224250 dv-cinder-818037-9-iscsi devstack@n-api.service[101848]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=101848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:55:05.224375 dv-cinder-818037-9-iscsi devstack@n-api.service[101847]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=101847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:55:05.224564 dv-cinder-818037-9-iscsi devstack@n-api.service[101848]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=101848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:55:05.224699 dv-cinder-818037-9-iscsi devstack@n-api.service[101847]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=101847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:55:05.224896 dv-cinder-818037-9-iscsi devstack@n-api.service[101848]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=101848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:55:05.225511 dv-cinder-818037-9-iscsi devstack@n-api.service[101847]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=101847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:55:05.225740 dv-cinder-818037-9-iscsi devstack@n-api.service[101848]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=101848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:55:05.225866 dv-cinder-818037-9-iscsi devstack@n-api.service[101847]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=101847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:55:05.226105 dv-cinder-818037-9-iscsi devstack@n-api.service[101848]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=101848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:55:05.226235 dv-cinder-818037-9-iscsi devstack@n-api.service[101847]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=101847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:55:05.226426 dv-cinder-818037-9-iscsi devstack@n-api.service[101848]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=101848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:55:05.226552 dv-cinder-818037-9-iscsi devstack@n-api.service[101847]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=101847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:55:05.226736 dv-cinder-818037-9-iscsi devstack@n-api.service[101848]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=101848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:55:05.226862 dv-cinder-818037-9-iscsi devstack@n-api.service[101847]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=101847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:55:05.227076 dv-cinder-818037-9-iscsi devstack@n-api.service[101847]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=101847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:55:05.227202 dv-cinder-818037-9-iscsi devstack@n-api.service[101848]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=101848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:55:05.227405 dv-cinder-818037-9-iscsi devstack@n-api.service[101847]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=101847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:55:05.227532 dv-cinder-818037-9-iscsi devstack@n-api.service[101848]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=101848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:55:05.227736 dv-cinder-818037-9-iscsi devstack@n-api.service[101847]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=101847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:55:05.227856 dv-cinder-818037-9-iscsi devstack@n-api.service[101848]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=101848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:55:05.228061 dv-cinder-818037-9-iscsi devstack@n-api.service[101847]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=101847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:55:05.228187 dv-cinder-818037-9-iscsi devstack@n-api.service[101848]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=101848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:55:05.228380 dv-cinder-818037-9-iscsi devstack@n-api.service[101847]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=101847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:55:05.228514 dv-cinder-818037-9-iscsi devstack@n-api.service[101848]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=101848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:55:05.228703 dv-cinder-818037-9-iscsi devstack@n-api.service[101848]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=101848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:55:05.228828 dv-cinder-818037-9-iscsi devstack@n-api.service[101847]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=101847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:55:05.229027 dv-cinder-818037-9-iscsi devstack@n-api.service[101847]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=101847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:55:05.229152 dv-cinder-818037-9-iscsi devstack@n-api.service[101848]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=101848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:55:05.229341 dv-cinder-818037-9-iscsi devstack@n-api.service[101848]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=101848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:55:05.229466 dv-cinder-818037-9-iscsi devstack@n-api.service[101847]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=101847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:55:05.229659 dv-cinder-818037-9-iscsi devstack@n-api.service[101847]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=101847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:55:05.229792 dv-cinder-818037-9-iscsi devstack@n-api.service[101848]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=101848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:55:05.229971 dv-cinder-818037-9-iscsi devstack@n-api.service[101848]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=101848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:55:05.230146 dv-cinder-818037-9-iscsi devstack@n-api.service[101847]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=101847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:55:05.230312 dv-cinder-818037-9-iscsi devstack@n-api.service[101847]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=101847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:55:05.230439 dv-cinder-818037-9-iscsi devstack@n-api.service[101848]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=101848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:55:05.230637 dv-cinder-818037-9-iscsi devstack@n-api.service[101847]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=101847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:55:05.230776 dv-cinder-818037-9-iscsi devstack@n-api.service[101848]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=101848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:55:05.230969 dv-cinder-818037-9-iscsi devstack@n-api.service[101848]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=101848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:55:05.231093 dv-cinder-818037-9-iscsi devstack@n-api.service[101847]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=101847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:55:05.231302 dv-cinder-818037-9-iscsi devstack@n-api.service[101848]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=101848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:55:05.231428 dv-cinder-818037-9-iscsi devstack@n-api.service[101847]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=101847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:55:05.231609 dv-cinder-818037-9-iscsi devstack@n-api.service[101848]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=101848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:55:05.231745 dv-cinder-818037-9-iscsi devstack@n-api.service[101847]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=101847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:55:05.231915 dv-cinder-818037-9-iscsi devstack@n-api.service[101848]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=101848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:55:05.232042 dv-cinder-818037-9-iscsi devstack@n-api.service[101847]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=101847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:55:05.232225 dv-cinder-818037-9-iscsi devstack@n-api.service[101848]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=101848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:55:05.232351 dv-cinder-818037-9-iscsi devstack@n-api.service[101847]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=101847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:55:05.232537 dv-cinder-818037-9-iscsi devstack@n-api.service[101848]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=101848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:55:05.232672 dv-cinder-818037-9-iscsi devstack@n-api.service[101847]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=101847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:55:05.232869 dv-cinder-818037-9-iscsi devstack@n-api.service[101848]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=101848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:55:05.233002 dv-cinder-818037-9-iscsi devstack@n-api.service[101847]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=101847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:55:05.233186 dv-cinder-818037-9-iscsi devstack@n-api.service[101847]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=101847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:55:05.233311 dv-cinder-818037-9-iscsi devstack@n-api.service[101848]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=101848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:55:05.233509 dv-cinder-818037-9-iscsi devstack@n-api.service[101848]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=101848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:55:05.233675 dv-cinder-818037-9-iscsi devstack@n-api.service[101847]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=101847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:55:05.233831 dv-cinder-818037-9-iscsi devstack@n-api.service[101847]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=101847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:55:05.233966 dv-cinder-818037-9-iscsi devstack@n-api.service[101848]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=101848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:55:05.234177 dv-cinder-818037-9-iscsi devstack@n-api.service[101848]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=101848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:55:05.234302 dv-cinder-818037-9-iscsi devstack@n-api.service[101847]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=101847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:55:05.234498 dv-cinder-818037-9-iscsi devstack@n-api.service[101847]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=101847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:55:05.234628 dv-cinder-818037-9-iscsi devstack@n-api.service[101848]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=101848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:55:05.234807 dv-cinder-818037-9-iscsi devstack@n-api.service[101848]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=101848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:55:05.234932 dv-cinder-818037-9-iscsi devstack@n-api.service[101847]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=101847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:55:05.235130 dv-cinder-818037-9-iscsi devstack@n-api.service[101848]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=101848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:55:05.235267 dv-cinder-818037-9-iscsi devstack@n-api.service[101847]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=101847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:55:05.235451 dv-cinder-818037-9-iscsi devstack@n-api.service[101847]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=101847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:55:05.235575 dv-cinder-818037-9-iscsi devstack@n-api.service[101848]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=101848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:55:05.235767 dv-cinder-818037-9-iscsi devstack@n-api.service[101848]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=101848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:55:05.235892 dv-cinder-818037-9-iscsi devstack@n-api.service[101847]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=101847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:55:05.236079 dv-cinder-818037-9-iscsi devstack@n-api.service[101848]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=101848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:55:05.236222 dv-cinder-818037-9-iscsi devstack@n-api.service[101847]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=101847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:55:05.236416 dv-cinder-818037-9-iscsi devstack@n-api.service[101848]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=101848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:55:05.236543 dv-cinder-818037-9-iscsi devstack@n-api.service[101847]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=101847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:55:05.236731 dv-cinder-818037-9-iscsi devstack@n-api.service[101848]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=101848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:55:05.236857 dv-cinder-818037-9-iscsi devstack@n-api.service[101847]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=101847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:55:05.237049 dv-cinder-818037-9-iscsi devstack@n-api.service[101848]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=101848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:55:05.237183 dv-cinder-818037-9-iscsi devstack@n-api.service[101847]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=101847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:55:05.237366 dv-cinder-818037-9-iscsi devstack@n-api.service[101848]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=101848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:55:05.237492 dv-cinder-818037-9-iscsi devstack@n-api.service[101847]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=101847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:55:05.237680 dv-cinder-818037-9-iscsi devstack@n-api.service[101848]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=101848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:55:05.237807 dv-cinder-818037-9-iscsi devstack@n-api.service[101847]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=101847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:55:05.238032 dv-cinder-818037-9-iscsi devstack@n-api.service[101848]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=101848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:55:05.238178 dv-cinder-818037-9-iscsi devstack@n-api.service[101847]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=101847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:55:05.238326 dv-cinder-818037-9-iscsi devstack@n-api.service[101848]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=101848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:55:05.238452 dv-cinder-818037-9-iscsi devstack@n-api.service[101847]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=101847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:55:05.238658 dv-cinder-818037-9-iscsi devstack@n-api.service[101848]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=101848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:55:05.238783 dv-cinder-818037-9-iscsi devstack@n-api.service[101847]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=101847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:55:05.238991 dv-cinder-818037-9-iscsi devstack@n-api.service[101848]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=101848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:55:05.239130 dv-cinder-818037-9-iscsi devstack@n-api.service[101847]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=101847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:55:05.239254 dv-cinder-818037-9-iscsi devstack@n-api.service[101847]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=101847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Dec 15 02:55:05.239374 dv-cinder-818037-9-iscsi devstack@n-api.service[101848]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=101848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:55:05.239614 dv-cinder-818037-9-iscsi devstack@n-api.service[101848]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=101848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:55:05.239937 dv-cinder-818037-9-iscsi devstack@n-api.service[101848]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=101848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:55:05.240260 dv-cinder-818037-9-iscsi devstack@n-api.service[101848]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=101848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:55:05.240601 dv-cinder-818037-9-iscsi devstack@n-api.service[101848]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=101848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:55:05.240921 dv-cinder-818037-9-iscsi devstack@n-api.service[101848]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=101848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:55:05.241259 dv-cinder-818037-9-iscsi devstack@n-api.service[101848]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=101848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:55:05.241576 dv-cinder-818037-9-iscsi devstack@n-api.service[101848]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=101848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:55:05.241897 dv-cinder-818037-9-iscsi devstack@n-api.service[101848]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=101848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:55:05.242241 dv-cinder-818037-9-iscsi devstack@n-api.service[101848]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=101848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:55:05.242557 dv-cinder-818037-9-iscsi devstack@n-api.service[101848]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=101848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:55:05.242877 dv-cinder-818037-9-iscsi devstack@n-api.service[101848]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=101848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:55:05.243198 dv-cinder-818037-9-iscsi devstack@n-api.service[101848]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=101848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:55:05.243527 dv-cinder-818037-9-iscsi devstack@n-api.service[101848]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=101848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:55:05.243854 dv-cinder-818037-9-iscsi devstack@n-api.service[101848]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=101848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:55:05.244182 dv-cinder-818037-9-iscsi devstack@n-api.service[101848]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=101848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:55:05.244509 dv-cinder-818037-9-iscsi devstack@n-api.service[101848]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=101848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:55:05.244855 dv-cinder-818037-9-iscsi devstack@n-api.service[101848]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=101848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:55:05.245174 dv-cinder-818037-9-iscsi devstack@n-api.service[101848]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=101848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:55:05.245523 dv-cinder-818037-9-iscsi devstack@n-api.service[101848]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=101848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:55:05.245856 dv-cinder-818037-9-iscsi devstack@n-api.service[101848]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=101848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:55:05.246207 dv-cinder-818037-9-iscsi devstack@n-api.service[101848]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=101848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:55:05.246529 dv-cinder-818037-9-iscsi devstack@n-api.service[101848]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=101848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:55:05.246836 dv-cinder-818037-9-iscsi devstack@n-api.service[101848]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=101848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 02:55:05.247083 dv-cinder-818037-9-iscsi devstack@n-api.service[101848]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=101848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Dec 15 02:55:05.262033 dv-cinder-818037-9-iscsi devstack@n-api.service[101847]: DEBUG oslo_db.sqlalchemy.engines [None req-87885060-e922-4c0e-b94f-a522a608218f None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=101847) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Dec 15 02:55:05.269151 dv-cinder-818037-9-iscsi devstack@n-api.service[101848]: DEBUG oslo_db.sqlalchemy.engines [None req-ef9d73f0-1d9c-459d-91bc-7829118712dc None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=101848) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Dec 15 02:55:05.327765 dv-cinder-818037-9-iscsi devstack@n-api.service[101847]: DEBUG nova.context [None req-87885060-e922-4c0e-b94f-a522a608218f None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),d853eee3-69a6-4e08-9a63-827acdfc7836(cell1) {{(pid=101847) load_cells /opt/stack/nova/nova/context.py:464}} Dec 15 02:55:05.332025 dv-cinder-818037-9-iscsi devstack@n-api.service[101847]: DEBUG oslo_concurrency.lockutils [None req-87885060-e922-4c0e-b94f-a522a608218f None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 02:55:05.333586 dv-cinder-818037-9-iscsi devstack@n-api.service[101847]: DEBUG oslo_concurrency.lockutils [None req-87885060-e922-4c0e-b94f-a522a608218f None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=101847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 02:55:05.333701 dv-cinder-818037-9-iscsi devstack@n-api.service[101848]: DEBUG nova.context [None req-ef9d73f0-1d9c-459d-91bc-7829118712dc None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),d853eee3-69a6-4e08-9a63-827acdfc7836(cell1) {{(pid=101848) load_cells /opt/stack/nova/nova/context.py:464}} Dec 15 02:55:05.334999 dv-cinder-818037-9-iscsi devstack@n-api.service[101847]: DEBUG oslo_concurrency.lockutils [None req-87885060-e922-4c0e-b94f-a522a608218f None None] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 02:55:05.336944 dv-cinder-818037-9-iscsi devstack@n-api.service[101847]: DEBUG oslo_concurrency.lockutils [None req-87885060-e922-4c0e-b94f-a522a608218f None None] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=101847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 02:55:05.338606 dv-cinder-818037-9-iscsi devstack@n-api.service[101848]: DEBUG oslo_concurrency.lockutils [None req-ef9d73f0-1d9c-459d-91bc-7829118712dc None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 02:55:05.340198 dv-cinder-818037-9-iscsi devstack@n-api.service[101848]: DEBUG oslo_concurrency.lockutils [None req-ef9d73f0-1d9c-459d-91bc-7829118712dc None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=101848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 02:55:05.341011 dv-cinder-818037-9-iscsi devstack@n-api.service[101848]: DEBUG oslo_concurrency.lockutils [None req-ef9d73f0-1d9c-459d-91bc-7829118712dc None None] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 02:55:05.342989 dv-cinder-818037-9-iscsi devstack@n-api.service[101848]: DEBUG oslo_concurrency.lockutils [None req-ef9d73f0-1d9c-459d-91bc-7829118712dc None None] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=101848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 02:55:05.347403 dv-cinder-818037-9-iscsi devstack@n-api.service[101847]: DEBUG oslo_db.sqlalchemy.engines [None req-87885060-e922-4c0e-b94f-a522a608218f None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=101847) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Dec 15 02:55:05.350762 dv-cinder-818037-9-iscsi devstack@n-api.service[101847]: DEBUG oslo_db.sqlalchemy.engines [None req-87885060-e922-4c0e-b94f-a522a608218f None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=101847) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Dec 15 02:55:05.354878 dv-cinder-818037-9-iscsi devstack@n-api.service[101848]: DEBUG oslo_db.sqlalchemy.engines [None req-ef9d73f0-1d9c-459d-91bc-7829118712dc None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=101848) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Dec 15 02:55:05.359849 dv-cinder-818037-9-iscsi devstack@n-api.service[101848]: DEBUG oslo_db.sqlalchemy.engines [None req-ef9d73f0-1d9c-459d-91bc-7829118712dc None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=101848) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Dec 15 02:55:05.514320 dv-cinder-818037-9-iscsi devstack@n-api.service[101847]: DEBUG oslo_db.sqlalchemy.engines [None req-87885060-e922-4c0e-b94f-a522a608218f None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=101847) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Dec 15 02:55:05.517987 dv-cinder-818037-9-iscsi devstack@n-api.service[101848]: DEBUG oslo_db.sqlalchemy.engines [None req-ef9d73f0-1d9c-459d-91bc-7829118712dc None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=101848) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Dec 15 02:55:05.856689 dv-cinder-818037-9-iscsi devstack@n-api.service[101848]: WARNING keystonemiddleware.auth_token [None req-ef9d73f0-1d9c-459d-91bc-7829118712dc None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Dec 15 02:55:05.859434 dv-cinder-818037-9-iscsi devstack@n-api.service[101847]: WARNING keystonemiddleware.auth_token [None req-87885060-e922-4c0e-b94f-a522a608218f None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Dec 15 02:55:05.863293 dv-cinder-818037-9-iscsi devstack@n-api.service[101848]: WARNING keystonemiddleware.auth_token [None req-ef9d73f0-1d9c-459d-91bc-7829118712dc None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Dec 15 02:55:05.866594 dv-cinder-818037-9-iscsi devstack@n-api.service[101847]: WARNING keystonemiddleware.auth_token [None req-87885060-e922-4c0e-b94f-a522a608218f None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Dec 15 02:55:06.201945 dv-cinder-818037-9-iscsi devstack@n-api.service[101848]: WARNING keystonemiddleware.auth_token [None req-ef9d73f0-1d9c-459d-91bc-7829118712dc None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Dec 15 02:55:06.207231 dv-cinder-818037-9-iscsi devstack@n-api.service[101848]: WARNING keystonemiddleware.auth_token [None req-ef9d73f0-1d9c-459d-91bc-7829118712dc None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Dec 15 02:55:06.207350 dv-cinder-818037-9-iscsi devstack@n-api.service[101847]: WARNING keystonemiddleware.auth_token [None req-87885060-e922-4c0e-b94f-a522a608218f None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Dec 15 02:55:06.212365 dv-cinder-818037-9-iscsi devstack@n-api.service[101848]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55902faa29c0 pid: 101848 (default app) Dec 15 02:55:06.212643 dv-cinder-818037-9-iscsi devstack@n-api.service[101847]: WARNING keystonemiddleware.auth_token [None req-87885060-e922-4c0e-b94f-a522a608218f None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Dec 15 02:55:06.214461 dv-cinder-818037-9-iscsi devstack@n-api.service[101848]: DEBUG nova.api.openstack.wsgi [None req-ef9d73f0-1d9c-459d-91bc-7829118712dc None None] Calling method '>' {{(pid=101848) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 02:55:06.215635 dv-cinder-818037-9-iscsi devstack@n-api.service[101848]: INFO nova.api.openstack.requestlog [None req-ef9d73f0-1d9c-459d-91bc-7829118712dc None None] 10.222.0.18 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.001744 Dec 15 02:55:06.216047 dv-cinder-818037-9-iscsi devstack@n-api.service[101848]: [pid: 101848|app: 0|req: 1/1] 10.222.0.18 () {50 vars in 788 bytes} [Wed Dec 15 02:55:06 2021] GET /compute/v2.1/ => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 02:55:06.217901 dv-cinder-818037-9-iscsi devstack@n-api.service[101847]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55902faa29c0 pid: 101847 (default app) Dec 15 02:56:27.749245 dv-cinder-818037-9-iscsi devstack@n-api.service[101848]: DEBUG nova.api.openstack.wsgi [None req-ef9d73f0-1d9c-459d-91bc-7829118712dc None None] Calling method '>' {{(pid=101848) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 02:56:27.750314 dv-cinder-818037-9-iscsi devstack@n-api.service[101848]: INFO nova.api.openstack.requestlog [None req-ef9d73f0-1d9c-459d-91bc-7829118712dc None None] 10.222.0.18 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001429 Dec 15 02:56:27.750979 dv-cinder-818037-9-iscsi devstack@n-api.service[101848]: [pid: 101848|app: 0|req: 2/2] 10.222.0.18 () {54 vars in 930 bytes} [Wed Dec 15 02:56:27 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 02:56:28.187837 dv-cinder-818037-9-iscsi devstack@n-api.service[101847]: DEBUG nova.api.openstack.wsgi [None req-cc6c79f6-38c1-4d0e-85a5-03b83b25dac0 admin admin] Calling method '>' {{(pid=101847) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 02:56:28.218366 dv-cinder-818037-9-iscsi devstack@n-api.service[101847]: INFO nova.api.openstack.requestlog [None req-cc6c79f6-38c1-4d0e-85a5-03b83b25dac0 admin admin] 10.222.0.18 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 15 microversion: 2.61 time: 0.459678 Dec 15 02:56:28.219010 dv-cinder-818037-9-iscsi devstack@n-api.service[101847]: [pid: 101847|app: 0|req: 1/3] 10.222.0.18 () {60 vars in 1291 bytes} [Wed Dec 15 02:56:27 2021] GET /compute/v2.1/flavors/detail?is_public=True => generated 15 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 02:56:30.611506 dv-cinder-818037-9-iscsi devstack@n-api.service[101848]: DEBUG nova.api.openstack.wsgi [None req-ef9d73f0-1d9c-459d-91bc-7829118712dc None None] Calling method '>' {{(pid=101848) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 02:56:30.613073 dv-cinder-818037-9-iscsi devstack@n-api.service[101848]: INFO nova.api.openstack.requestlog [None req-ef9d73f0-1d9c-459d-91bc-7829118712dc None None] 10.222.0.18 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001554 Dec 15 02:56:30.613467 dv-cinder-818037-9-iscsi devstack@n-api.service[101848]: [pid: 101848|app: 0|req: 3/4] 10.222.0.18 () {54 vars in 930 bytes} [Wed Dec 15 02:56:30 2021] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 02:56:30.678233 dv-cinder-818037-9-iscsi devstack@n-api.service[101847]: DEBUG nova.api.openstack.wsgi [None req-1b0ad507-b00a-4ece-bdd1-a4e0cf12bacf admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 1, "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "vcpus": 1, "ram": 256, "id": "c1", "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "name": "cirros256"}} {{(pid=101847) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 02:56:30.696333 dv-cinder-818037-9-iscsi devstack@n-api.service[101847]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 15 02:56:30.696333 dv-cinder-818037-9-iscsi devstack@n-api.service[101847]: warnings.warn(msg) Dec 15 02:56:30.723903 dv-cinder-818037-9-iscsi devstack@n-api.service[101847]: INFO nova.api.openstack.requestlog [None req-1b0ad507-b00a-4ece-bdd1-a4e0cf12bacf admin admin] 10.222.0.18 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.61 time: 0.103928 Dec 15 02:56:30.724465 dv-cinder-818037-9-iscsi devstack@n-api.service[101847]: [pid: 101847|app: 0|req: 2/5] 10.222.0.18 () {64 vars in 1282 bytes} [Wed Dec 15 02:56:30 2021] POST /compute/v2.1/flavors => generated 407 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 02:56:30.939628 dv-cinder-818037-9-iscsi devstack@n-api.service[101848]: DEBUG nova.api.openstack.wsgi [None req-b53a0e22-01e0-41f6-b1b9-87aa1ba25dc3 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=101848) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 02:56:30.942199 dv-cinder-818037-9-iscsi devstack@n-api.service[101848]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 15 02:56:30.942199 dv-cinder-818037-9-iscsi devstack@n-api.service[101848]: warnings.warn(msg) Dec 15 02:56:30.990500 dv-cinder-818037-9-iscsi devstack@n-api.service[101848]: INFO nova.api.openstack.requestlog [None req-b53a0e22-01e0-41f6-b1b9-87aa1ba25dc3 admin admin] 10.222.0.18 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.257535 Dec 15 02:56:30.991305 dv-cinder-818037-9-iscsi devstack@n-api.service[101848]: [pid: 101848|app: 0|req: 4/6] 10.222.0.18 () {64 vars in 1335 bytes} [Wed Dec 15 02:56:30 2021] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 02:56:33.361910 dv-cinder-818037-9-iscsi devstack@n-api.service[101847]: DEBUG nova.api.openstack.wsgi [None req-1b0ad507-b00a-4ece-bdd1-a4e0cf12bacf admin admin] Calling method '>' {{(pid=101847) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 02:56:33.363125 dv-cinder-818037-9-iscsi devstack@n-api.service[101847]: INFO nova.api.openstack.requestlog [None req-1b0ad507-b00a-4ece-bdd1-a4e0cf12bacf admin admin] 10.222.0.18 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001740 Dec 15 02:56:33.363649 dv-cinder-818037-9-iscsi devstack@n-api.service[101847]: [pid: 101847|app: 0|req: 3/7] 10.222.0.18 () {54 vars in 930 bytes} [Wed Dec 15 02:56:33 2021] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 02:56:33.486119 dv-cinder-818037-9-iscsi devstack@n-api.service[101848]: DEBUG nova.api.openstack.wsgi [None req-36656833-084c-4cb3-95ee-cac5dc43054c admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "ds512M", "vcpus": 1, "rxtx_factor": 1.0, "ram": 512, "os-flavor-access:is_public": true, "disk": 5, "id": "d1", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=101848) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 02:56:33.506571 dv-cinder-818037-9-iscsi devstack@n-api.service[101848]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 15 02:56:33.506571 dv-cinder-818037-9-iscsi devstack@n-api.service[101848]: warnings.warn(msg) Dec 15 02:56:33.527624 dv-cinder-818037-9-iscsi devstack@n-api.service[101848]: INFO nova.api.openstack.requestlog [None req-36656833-084c-4cb3-95ee-cac5dc43054c admin admin] 10.222.0.18 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.157418 Dec 15 02:56:33.528189 dv-cinder-818037-9-iscsi devstack@n-api.service[101848]: [pid: 101848|app: 0|req: 5/8] 10.222.0.18 () {64 vars in 1282 bytes} [Wed Dec 15 02:56:33 2021] POST /compute/v2.1/flavors => generated 404 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Dec 15 02:56:33.540316 dv-cinder-818037-9-iscsi devstack@n-api.service[101847]: DEBUG nova.api.openstack.wsgi [None req-5cb156e1-573d-4b3a-9a8d-6ac4ad7cd423 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=101847) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 02:56:33.541922 dv-cinder-818037-9-iscsi devstack@n-api.service[101847]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 15 02:56:33.541922 dv-cinder-818037-9-iscsi devstack@n-api.service[101847]: warnings.warn(msg) Dec 15 02:56:33.577202 dv-cinder-818037-9-iscsi devstack@n-api.service[101847]: INFO nova.api.openstack.requestlog [None req-5cb156e1-573d-4b3a-9a8d-6ac4ad7cd423 admin admin] 10.222.0.18 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.040596 Dec 15 02:56:33.579113 dv-cinder-818037-9-iscsi devstack@n-api.service[101847]: [pid: 101847|app: 0|req: 4/9] 10.222.0.18 () {64 vars in 1335 bytes} [Wed Dec 15 02:56:33 2021] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 02:56:35.991927 dv-cinder-818037-9-iscsi devstack@n-api.service[101848]: DEBUG nova.api.openstack.wsgi [None req-36656833-084c-4cb3-95ee-cac5dc43054c admin admin] Calling method '>' {{(pid=101848) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 02:56:35.992980 dv-cinder-818037-9-iscsi devstack@n-api.service[101848]: INFO nova.api.openstack.requestlog [None req-36656833-084c-4cb3-95ee-cac5dc43054c admin admin] 10.222.0.18 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001510 Dec 15 02:56:35.993377 dv-cinder-818037-9-iscsi devstack@n-api.service[101848]: [pid: 101848|app: 0|req: 6/10] 10.222.0.18 () {54 vars in 930 bytes} [Wed Dec 15 02:56:35 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 02:56:36.051078 dv-cinder-818037-9-iscsi devstack@n-api.service[101847]: DEBUG nova.api.openstack.wsgi [None req-9fa05bcc-3a45-4880-af59-5ba7b850873d admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "disk": 10, "vcpus": 1, "id": "d2", "OS-FLV-EXT-DATA:ephemeral": 0, "name": "ds1G", "ram": 1024, "os-flavor-access:is_public": true, "swap": 0}} {{(pid=101847) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 02:56:36.070500 dv-cinder-818037-9-iscsi devstack@n-api.service[101847]: INFO nova.api.openstack.requestlog [None req-9fa05bcc-3a45-4880-af59-5ba7b850873d admin admin] 10.222.0.18 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.070728 Dec 15 02:56:36.071037 dv-cinder-818037-9-iscsi devstack@n-api.service[101847]: [pid: 101847|app: 0|req: 5/11] 10.222.0.18 () {64 vars in 1282 bytes} [Wed Dec 15 02:56:35 2021] POST /compute/v2.1/flavors => generated 404 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 02:56:36.083138 dv-cinder-818037-9-iscsi devstack@n-api.service[101848]: DEBUG nova.api.openstack.wsgi [None req-a7bc1f24-512c-4624-a74d-dbefffa17e0f admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=101848) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 02:56:36.105464 dv-cinder-818037-9-iscsi devstack@n-api.service[101848]: INFO nova.api.openstack.requestlog [None req-a7bc1f24-512c-4624-a74d-dbefffa17e0f admin admin] 10.222.0.18 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.025885 Dec 15 02:56:36.106693 dv-cinder-818037-9-iscsi devstack@n-api.service[101848]: [pid: 101848|app: 0|req: 7/12] 10.222.0.18 () {64 vars in 1335 bytes} [Wed Dec 15 02:56:36 2021] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 02:56:38.518691 dv-cinder-818037-9-iscsi devstack@n-api.service[101847]: DEBUG nova.api.openstack.wsgi [None req-9fa05bcc-3a45-4880-af59-5ba7b850873d admin admin] Calling method '>' {{(pid=101847) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 02:56:38.519785 dv-cinder-818037-9-iscsi devstack@n-api.service[101847]: INFO nova.api.openstack.requestlog [None req-9fa05bcc-3a45-4880-af59-5ba7b850873d admin admin] 10.222.0.18 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001551 Dec 15 02:56:38.520194 dv-cinder-818037-9-iscsi devstack@n-api.service[101847]: [pid: 101847|app: 0|req: 6/13] 10.222.0.18 () {54 vars in 930 bytes} [Wed Dec 15 02:56:38 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 02:56:38.576592 dv-cinder-818037-9-iscsi devstack@n-api.service[101848]: DEBUG nova.api.openstack.wsgi [None req-9d70bdf1-1882-48a6-85a9-1b9e670de9a7 admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 2, "name": "ds2G", "disk": 10, "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "ram": 2048, "id": "d3"}} {{(pid=101848) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 02:56:38.594271 dv-cinder-818037-9-iscsi devstack@n-api.service[101848]: INFO nova.api.openstack.requestlog [None req-9d70bdf1-1882-48a6-85a9-1b9e670de9a7 admin admin] 10.222.0.18 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.067576 Dec 15 02:56:38.594805 dv-cinder-818037-9-iscsi devstack@n-api.service[101848]: [pid: 101848|app: 0|req: 8/14] 10.222.0.18 () {64 vars in 1282 bytes} [Wed Dec 15 02:56:38 2021] POST /compute/v2.1/flavors => generated 404 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 02:56:38.607120 dv-cinder-818037-9-iscsi devstack@n-api.service[101847]: DEBUG nova.api.openstack.wsgi [None req-bf270788-0108-4c69-996f-cf5ac737ad94 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=101847) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 02:56:38.629037 dv-cinder-818037-9-iscsi devstack@n-api.service[101847]: INFO nova.api.openstack.requestlog [None req-bf270788-0108-4c69-996f-cf5ac737ad94 admin admin] 10.222.0.18 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.025456 Dec 15 02:56:38.629580 dv-cinder-818037-9-iscsi devstack@n-api.service[101847]: [pid: 101847|app: 0|req: 7/15] 10.222.0.18 () {64 vars in 1335 bytes} [Wed Dec 15 02:56:38 2021] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 02:56:41.007032 dv-cinder-818037-9-iscsi devstack@n-api.service[101848]: DEBUG nova.api.openstack.wsgi [None req-9d70bdf1-1882-48a6-85a9-1b9e670de9a7 admin admin] Calling method '>' {{(pid=101848) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 02:56:41.008218 dv-cinder-818037-9-iscsi devstack@n-api.service[101848]: INFO nova.api.openstack.requestlog [None req-9d70bdf1-1882-48a6-85a9-1b9e670de9a7 admin admin] 10.222.0.18 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001607 Dec 15 02:56:41.008706 dv-cinder-818037-9-iscsi devstack@n-api.service[101848]: [pid: 101848|app: 0|req: 9/16] 10.222.0.18 () {54 vars in 930 bytes} [Wed Dec 15 02:56:41 2021] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 02:56:41.068126 dv-cinder-818037-9-iscsi devstack@n-api.service[101847]: DEBUG nova.api.openstack.wsgi [None req-edb8d4f1-2395-47a5-bcf3-c5c19d696b38 admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 20, "os-flavor-access:is_public": true, "name": "ds4G", "id": "d4", "swap": 0, "ram": 4096, "vcpus": 4, "rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=101847) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 02:56:41.088194 dv-cinder-818037-9-iscsi devstack@n-api.service[101847]: INFO nova.api.openstack.requestlog [None req-edb8d4f1-2395-47a5-bcf3-c5c19d696b38 admin admin] 10.222.0.18 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.073077 Dec 15 02:56:41.089097 dv-cinder-818037-9-iscsi devstack@n-api.service[101847]: [pid: 101847|app: 0|req: 8/17] 10.222.0.18 () {64 vars in 1282 bytes} [Wed Dec 15 02:56:41 2021] POST /compute/v2.1/flavors => generated 404 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Dec 15 02:56:41.100876 dv-cinder-818037-9-iscsi devstack@n-api.service[101848]: DEBUG nova.api.openstack.wsgi [None req-b4a67bed-d2ae-4524-a511-0c04ccb74015 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=101848) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 02:56:41.125235 dv-cinder-818037-9-iscsi devstack@n-api.service[101848]: INFO nova.api.openstack.requestlog [None req-b4a67bed-d2ae-4524-a511-0c04ccb74015 admin admin] 10.222.0.18 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.027844 Dec 15 02:56:41.125904 dv-cinder-818037-9-iscsi devstack@n-api.service[101848]: [pid: 101848|app: 0|req: 10/18] 10.222.0.18 () {64 vars in 1335 bytes} [Wed Dec 15 02:56:41 2021] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 02:56:43.621240 dv-cinder-818037-9-iscsi devstack@n-api.service[101847]: DEBUG nova.api.openstack.wsgi [None req-edb8d4f1-2395-47a5-bcf3-c5c19d696b38 admin admin] Calling method '>' {{(pid=101847) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 02:56:43.622313 dv-cinder-818037-9-iscsi devstack@n-api.service[101847]: INFO nova.api.openstack.requestlog [None req-edb8d4f1-2395-47a5-bcf3-c5c19d696b38 admin admin] 10.222.0.18 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001533 Dec 15 02:56:43.622722 dv-cinder-818037-9-iscsi devstack@n-api.service[101847]: [pid: 101847|app: 0|req: 9/19] 10.222.0.18 () {54 vars in 930 bytes} [Wed Dec 15 02:56:43 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 02:56:43.692818 dv-cinder-818037-9-iscsi devstack@n-api.service[101848]: DEBUG nova.api.openstack.wsgi [None req-2f24ceb7-0bd2-4dd6-8e43-1e50293aa345 admin admin] Calling method '>' {{(pid=101848) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 02:56:43.719275 dv-cinder-818037-9-iscsi devstack@n-api.service[101848]: INFO nova.api.openstack.requestlog [None req-2f24ceb7-0bd2-4dd6-8e43-1e50293aa345 admin admin] 10.222.0.18 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 2106 microversion: 2.61 time: 0.089820 Dec 15 02:56:43.719826 dv-cinder-818037-9-iscsi devstack@n-api.service[101848]: [pid: 101848|app: 0|req: 11/20] 10.222.0.18 () {60 vars in 1291 bytes} [Wed Dec 15 02:56:43 2021] GET /compute/v2.1/flavors/detail?is_public=True => generated 2106 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 02:56:46.714512 dv-cinder-818037-9-iscsi devstack@n-api.service[101847]: DEBUG nova.api.openstack.wsgi [None req-edb8d4f1-2395-47a5-bcf3-c5c19d696b38 admin admin] Calling method '>' {{(pid=101847) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 02:56:46.715547 dv-cinder-818037-9-iscsi devstack@n-api.service[101847]: INFO nova.api.openstack.requestlog [None req-edb8d4f1-2395-47a5-bcf3-c5c19d696b38 admin admin] 10.222.0.18 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001471 Dec 15 02:56:46.715940 dv-cinder-818037-9-iscsi devstack@n-api.service[101847]: [pid: 101847|app: 0|req: 10/21] 10.222.0.18 () {54 vars in 930 bytes} [Wed Dec 15 02:56:46 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 02:56:46.785275 dv-cinder-818037-9-iscsi devstack@n-api.service[101848]: DEBUG nova.api.openstack.wsgi [None req-5a5acc91-a480-46a8-aff5-f8ca2d8d7a4f admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 1, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "swap": 0, "ram": 512, "vcpus": 1, "name": "m1.tiny", "os-flavor-access:is_public": true, "id": "1"}} {{(pid=101848) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 02:56:46.804449 dv-cinder-818037-9-iscsi devstack@n-api.service[101848]: INFO nova.api.openstack.requestlog [None req-5a5acc91-a480-46a8-aff5-f8ca2d8d7a4f admin admin] 10.222.0.18 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.081977 Dec 15 02:56:46.805027 dv-cinder-818037-9-iscsi devstack@n-api.service[101848]: [pid: 101848|app: 0|req: 12/22] 10.222.0.18 () {64 vars in 1282 bytes} [Wed Dec 15 02:56:46 2021] POST /compute/v2.1/flavors => generated 402 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 02:56:46.819627 dv-cinder-818037-9-iscsi devstack@n-api.service[101847]: DEBUG nova.api.openstack.wsgi [None req-a89459c1-ea18-482f-b6bf-8ab4a1cddde9 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=101847) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 02:56:46.845830 dv-cinder-818037-9-iscsi devstack@n-api.service[101847]: INFO nova.api.openstack.requestlog [None req-a89459c1-ea18-482f-b6bf-8ab4a1cddde9 admin admin] 10.222.0.18 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.031711 Dec 15 02:56:46.847203 dv-cinder-818037-9-iscsi devstack@n-api.service[101847]: [pid: 101847|app: 0|req: 11/23] 10.222.0.18 () {64 vars in 1332 bytes} [Wed Dec 15 02:56:46 2021] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 02:56:49.194360 dv-cinder-818037-9-iscsi devstack@n-api.service[101848]: DEBUG nova.api.openstack.wsgi [None req-5a5acc91-a480-46a8-aff5-f8ca2d8d7a4f admin admin] Calling method '>' {{(pid=101848) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 02:56:49.195412 dv-cinder-818037-9-iscsi devstack@n-api.service[101848]: INFO nova.api.openstack.requestlog [None req-5a5acc91-a480-46a8-aff5-f8ca2d8d7a4f admin admin] 10.222.0.18 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001581 Dec 15 02:56:49.195868 dv-cinder-818037-9-iscsi devstack@n-api.service[101848]: [pid: 101848|app: 0|req: 13/24] 10.222.0.18 () {54 vars in 930 bytes} [Wed Dec 15 02:56:49 2021] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 02:56:49.253274 dv-cinder-818037-9-iscsi devstack@n-api.service[101847]: DEBUG nova.api.openstack.wsgi [None req-79debe3d-441a-4558-958a-6178a9d6285a admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 2048, "disk": 20, "id": "2", "rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "os-flavor-access:is_public": true, "vcpus": 1, "name": "m1.small"}} {{(pid=101847) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 02:56:49.270029 dv-cinder-818037-9-iscsi devstack@n-api.service[101847]: INFO nova.api.openstack.requestlog [None req-79debe3d-441a-4558-958a-6178a9d6285a admin admin] 10.222.0.18 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.067696 Dec 15 02:56:49.270583 dv-cinder-818037-9-iscsi devstack@n-api.service[101847]: [pid: 101847|app: 0|req: 12/25] 10.222.0.18 () {64 vars in 1282 bytes} [Wed Dec 15 02:56:49 2021] POST /compute/v2.1/flavors => generated 405 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 02:56:49.282594 dv-cinder-818037-9-iscsi devstack@n-api.service[101848]: DEBUG nova.api.openstack.wsgi [None req-6da060c3-6f61-41ab-a7d4-2b3c76f702bf admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=101848) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 02:56:49.304375 dv-cinder-818037-9-iscsi devstack@n-api.service[101848]: INFO nova.api.openstack.requestlog [None req-6da060c3-6f61-41ab-a7d4-2b3c76f702bf admin admin] 10.222.0.18 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.025437 Dec 15 02:56:49.304948 dv-cinder-818037-9-iscsi devstack@n-api.service[101848]: [pid: 101848|app: 0|req: 14/26] 10.222.0.18 () {64 vars in 1332 bytes} [Wed Dec 15 02:56:49 2021] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 02:56:51.663042 dv-cinder-818037-9-iscsi devstack@n-api.service[101847]: DEBUG nova.api.openstack.wsgi [None req-79debe3d-441a-4558-958a-6178a9d6285a admin admin] Calling method '>' {{(pid=101847) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 02:56:51.664133 dv-cinder-818037-9-iscsi devstack@n-api.service[101847]: INFO nova.api.openstack.requestlog [None req-79debe3d-441a-4558-958a-6178a9d6285a admin admin] 10.222.0.18 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001553 Dec 15 02:56:51.664544 dv-cinder-818037-9-iscsi devstack@n-api.service[101847]: [pid: 101847|app: 0|req: 13/27] 10.222.0.18 () {54 vars in 930 bytes} [Wed Dec 15 02:56:51 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 02:56:51.720647 dv-cinder-818037-9-iscsi devstack@n-api.service[101848]: DEBUG nova.api.openstack.wsgi [None req-a6c96d88-8d73-4351-9d0a-d0d17ddb099d admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.medium", "disk": 40, "ram": 4096, "vcpus": 2, "id": "3", "rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "swap": 0}} {{(pid=101848) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 02:56:51.740546 dv-cinder-818037-9-iscsi devstack@n-api.service[101848]: INFO nova.api.openstack.requestlog [None req-a6c96d88-8d73-4351-9d0a-d0d17ddb099d admin admin] 10.222.0.18 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.069580 Dec 15 02:56:51.741096 dv-cinder-818037-9-iscsi devstack@n-api.service[101848]: [pid: 101848|app: 0|req: 15/28] 10.222.0.18 () {64 vars in 1282 bytes} [Wed Dec 15 02:56:51 2021] POST /compute/v2.1/flavors => generated 406 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 02:56:51.753240 dv-cinder-818037-9-iscsi devstack@n-api.service[101847]: DEBUG nova.api.openstack.wsgi [None req-7ea05d7a-4586-4334-be48-22a9091d5dc5 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=101847) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 02:56:51.775537 dv-cinder-818037-9-iscsi devstack@n-api.service[101847]: INFO nova.api.openstack.requestlog [None req-7ea05d7a-4586-4334-be48-22a9091d5dc5 admin admin] 10.222.0.18 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.026314 Dec 15 02:56:51.776337 dv-cinder-818037-9-iscsi devstack@n-api.service[101847]: [pid: 101847|app: 0|req: 14/29] 10.222.0.18 () {64 vars in 1332 bytes} [Wed Dec 15 02:56:51 2021] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 02:56:54.183643 dv-cinder-818037-9-iscsi devstack@n-api.service[101848]: DEBUG nova.api.openstack.wsgi [None req-a6c96d88-8d73-4351-9d0a-d0d17ddb099d admin admin] Calling method '>' {{(pid=101848) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 02:56:54.186175 dv-cinder-818037-9-iscsi devstack@n-api.service[101848]: INFO nova.api.openstack.requestlog [None req-a6c96d88-8d73-4351-9d0a-d0d17ddb099d admin admin] 10.222.0.18 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002913 Dec 15 02:56:54.186888 dv-cinder-818037-9-iscsi devstack@n-api.service[101848]: [pid: 101848|app: 0|req: 16/30] 10.222.0.18 () {54 vars in 930 bytes} [Wed Dec 15 02:56:54 2021] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 02:56:54.277942 dv-cinder-818037-9-iscsi devstack@n-api.service[101847]: DEBUG nova.api.openstack.wsgi [None req-378b7a7d-7153-4876-a199-23ed018bb034 admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "vcpus": 4, "swap": 0, "rxtx_factor": 1.0, "ram": 8192, "name": "m1.large", "id": "4", "OS-FLV-EXT-DATA:ephemeral": 0, "disk": 80}} {{(pid=101847) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 02:56:54.297936 dv-cinder-818037-9-iscsi devstack@n-api.service[101847]: INFO nova.api.openstack.requestlog [None req-378b7a7d-7153-4876-a199-23ed018bb034 admin admin] 10.222.0.18 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.103753 Dec 15 02:56:54.298679 dv-cinder-818037-9-iscsi devstack@n-api.service[101847]: [pid: 101847|app: 0|req: 15/31] 10.222.0.18 () {64 vars in 1282 bytes} [Wed Dec 15 02:56:54 2021] POST /compute/v2.1/flavors => generated 405 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Dec 15 02:56:54.310643 dv-cinder-818037-9-iscsi devstack@n-api.service[101848]: DEBUG nova.api.openstack.wsgi [None req-6b5449b9-d25e-4a2c-a042-1f3a8746917a admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=101848) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 02:56:54.334700 dv-cinder-818037-9-iscsi devstack@n-api.service[101848]: INFO nova.api.openstack.requestlog [None req-6b5449b9-d25e-4a2c-a042-1f3a8746917a admin admin] 10.222.0.18 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.027660 Dec 15 02:56:54.335896 dv-cinder-818037-9-iscsi devstack@n-api.service[101848]: [pid: 101848|app: 0|req: 17/32] 10.222.0.18 () {64 vars in 1332 bytes} [Wed Dec 15 02:56:54 2021] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 02:56:56.737436 dv-cinder-818037-9-iscsi devstack@n-api.service[101847]: DEBUG nova.api.openstack.wsgi [None req-378b7a7d-7153-4876-a199-23ed018bb034 admin admin] Calling method '>' {{(pid=101847) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 02:56:56.738486 dv-cinder-818037-9-iscsi devstack@n-api.service[101847]: INFO nova.api.openstack.requestlog [None req-378b7a7d-7153-4876-a199-23ed018bb034 admin admin] 10.222.0.18 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002028 Dec 15 02:56:56.738885 dv-cinder-818037-9-iscsi devstack@n-api.service[101847]: [pid: 101847|app: 0|req: 16/33] 10.222.0.18 () {54 vars in 930 bytes} [Wed Dec 15 02:56:56 2021] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 02:56:56.797332 dv-cinder-818037-9-iscsi devstack@n-api.service[101848]: DEBUG nova.api.openstack.wsgi [None req-982e4d41-d99b-48a7-8dbf-559ca6c6b5f4 admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 8, "name": "m1.xlarge", "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "disk": 160, "ram": 16384, "rxtx_factor": 1.0, "swap": 0, "id": "5"}} {{(pid=101848) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 02:56:56.818689 dv-cinder-818037-9-iscsi devstack@n-api.service[101848]: INFO nova.api.openstack.requestlog [None req-982e4d41-d99b-48a7-8dbf-559ca6c6b5f4 admin admin] 10.222.0.18 "POST /compute/v2.1/flavors" status: 200 len: 408 microversion: 2.61 time: 0.073436 Dec 15 02:56:56.819599 dv-cinder-818037-9-iscsi devstack@n-api.service[101848]: [pid: 101848|app: 0|req: 18/34] 10.222.0.18 () {64 vars in 1282 bytes} [Wed Dec 15 02:56:56 2021] POST /compute/v2.1/flavors => generated 408 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 02:56:56.832137 dv-cinder-818037-9-iscsi devstack@n-api.service[101847]: DEBUG nova.api.openstack.wsgi [None req-4c7463ab-43c1-45e4-bae7-3d6f0887db18 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=101847) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 02:56:56.856713 dv-cinder-818037-9-iscsi devstack@n-api.service[101847]: INFO nova.api.openstack.requestlog [None req-4c7463ab-43c1-45e4-bae7-3d6f0887db18 admin admin] 10.222.0.18 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.028667 Dec 15 02:56:56.857531 dv-cinder-818037-9-iscsi devstack@n-api.service[101847]: [pid: 101847|app: 0|req: 17/35] 10.222.0.18 () {64 vars in 1332 bytes} [Wed Dec 15 02:56:56 2021] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 02:57:17.600678 dv-cinder-818037-9-iscsi devstack@n-api.service[101848]: DEBUG nova.api.openstack.wsgi [None req-982e4d41-d99b-48a7-8dbf-559ca6c6b5f4 admin admin] Calling method '>' {{(pid=101848) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 02:57:17.601689 dv-cinder-818037-9-iscsi devstack@n-api.service[101848]: INFO nova.api.openstack.requestlog [None req-982e4d41-d99b-48a7-8dbf-559ca6c6b5f4 admin admin] 10.222.0.18 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001434 Dec 15 02:57:17.602118 dv-cinder-818037-9-iscsi devstack@n-api.service[101848]: [pid: 101848|app: 0|req: 19/36] 10.222.0.18 () {54 vars in 930 bytes} [Wed Dec 15 02:57:17 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 02:57:17.659978 dv-cinder-818037-9-iscsi devstack@n-api.service[101847]: DEBUG nova.api.openstack.wsgi [None req-4098baea-80b7-4e2c-b608-640cf9fa4591 admin admin] Calling method '>' {{(pid=101847) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 02:57:17.676928 dv-cinder-818037-9-iscsi devstack@n-api.service[101847]: INFO nova.api.openstack.requestlog [None req-4098baea-80b7-4e2c-b608-640cf9fa4591 admin admin] 10.222.0.18 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 4202 microversion: 2.61 time: 0.068416 Dec 15 02:57:17.677457 dv-cinder-818037-9-iscsi devstack@n-api.service[101847]: [pid: 101847|app: 0|req: 18/37] 10.222.0.18 () {60 vars in 1291 bytes} [Wed Dec 15 02:57:17 2021] GET /compute/v2.1/flavors/detail?is_public=True => generated 4202 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 02:57:19.247408 dv-cinder-818037-9-iscsi devstack@n-api.service[101848]: DEBUG nova.api.openstack.wsgi [None req-982e4d41-d99b-48a7-8dbf-559ca6c6b5f4 admin admin] Calling method '>' {{(pid=101848) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 02:57:19.248432 dv-cinder-818037-9-iscsi devstack@n-api.service[101848]: INFO nova.api.openstack.requestlog [None req-982e4d41-d99b-48a7-8dbf-559ca6c6b5f4 admin admin] 10.222.0.18 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001438 Dec 15 02:57:19.248825 dv-cinder-818037-9-iscsi devstack@n-api.service[101848]: [pid: 101848|app: 0|req: 20/38] 10.222.0.18 () {56 vars in 1074 bytes} [Wed Dec 15 02:57:19 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 02:57:19.436299 dv-cinder-818037-9-iscsi devstack@n-api.service[101847]: DEBUG nova.api.openstack.wsgi [None req-1dba867a-8c0e-4c74-b9b2-1799d761db4c admin admin] Calling method '>' {{(pid=101847) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 02:57:19.442283 dv-cinder-818037-9-iscsi devstack@n-api.service[101847]: INFO nova.api.openstack.wsgi [None req-1dba867a-8c0e-4c74-b9b2-1799d761db4c admin admin] HTTP exception thrown: Flavor 42 could not be found. Dec 15 02:57:19.442845 dv-cinder-818037-9-iscsi devstack@n-api.service[101847]: DEBUG nova.api.openstack.wsgi [None req-1dba867a-8c0e-4c74-b9b2-1799d761db4c admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=101847) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 15 02:57:19.443630 dv-cinder-818037-9-iscsi devstack@n-api.service[101847]: INFO nova.api.openstack.requestlog [None req-1dba867a-8c0e-4c74-b9b2-1799d761db4c admin admin] 10.222.0.18 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.056457 Dec 15 02:57:19.444123 dv-cinder-818037-9-iscsi devstack@n-api.service[101847]: [pid: 101847|app: 0|req: 19/39] 10.222.0.18 () {60 vars in 1190 bytes} [Wed Dec 15 02:57:19 2021] GET /compute/v2.1/flavors/42 => generated 75 bytes in 57 msecs (HTTP/1.1 404) 9 headers in 380 bytes (2 switches on core 0) Dec 15 02:57:19.453704 dv-cinder-818037-9-iscsi devstack@n-api.service[101848]: DEBUG nova.api.openstack.wsgi [None req-9585f8e8-5300-4d33-b0c1-45930b769539 admin admin] Calling method '>' {{(pid=101848) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 02:57:19.473621 dv-cinder-818037-9-iscsi devstack@n-api.service[101848]: INFO nova.api.openstack.requestlog [None req-9585f8e8-5300-4d33-b0c1-45930b769539 admin admin] 10.222.0.18 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.023323 Dec 15 02:57:19.474099 dv-cinder-818037-9-iscsi devstack@n-api.service[101848]: [pid: 101848|app: 0|req: 21/40] 10.222.0.18 () {60 vars in 1210 bytes} [Wed Dec 15 02:57:19 2021] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 24 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 02:57:19.483784 dv-cinder-818037-9-iscsi devstack@n-api.service[101847]: DEBUG nova.api.openstack.wsgi [None req-ce987f43-815d-4756-b515-8a272978bb75 admin admin] Calling method '>' {{(pid=101847) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 02:57:19.505189 dv-cinder-818037-9-iscsi devstack@n-api.service[101847]: INFO nova.api.openstack.requestlog [None req-ce987f43-815d-4756-b515-8a272978bb75 admin admin] 10.222.0.18 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.024810 Dec 15 02:57:19.505717 dv-cinder-818037-9-iscsi devstack@n-api.service[101847]: [pid: 101847|app: 0|req: 20/41] 10.222.0.18 () {60 vars in 1210 bytes} [Wed Dec 15 02:57:19 2021] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 26 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Dec 15 02:57:19.515020 dv-cinder-818037-9-iscsi devstack@n-api.service[101848]: DEBUG nova.api.openstack.wsgi [None req-f80a5b85-6020-4af3-9930-e1c08d3697bd admin admin] Calling method '>' {{(pid=101848) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 02:57:19.520229 dv-cinder-818037-9-iscsi devstack@n-api.service[101848]: INFO nova.api.openstack.wsgi [None req-f80a5b85-6020-4af3-9930-e1c08d3697bd admin admin] HTTP exception thrown: Flavor 42 could not be found. Dec 15 02:57:19.520786 dv-cinder-818037-9-iscsi devstack@n-api.service[101848]: DEBUG nova.api.openstack.wsgi [None req-f80a5b85-6020-4af3-9930-e1c08d3697bd admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=101848) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 15 02:57:19.521559 dv-cinder-818037-9-iscsi devstack@n-api.service[101848]: INFO nova.api.openstack.requestlog [None req-f80a5b85-6020-4af3-9930-e1c08d3697bd admin admin] 10.222.0.18 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.009961 Dec 15 02:57:19.522053 dv-cinder-818037-9-iscsi devstack@n-api.service[101848]: [pid: 101848|app: 0|req: 22/42] 10.222.0.18 () {60 vars in 1190 bytes} [Wed Dec 15 02:57:19 2021] GET /compute/v2.1/flavors/42 => generated 75 bytes in 11 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Dec 15 02:57:20.994963 dv-cinder-818037-9-iscsi devstack@n-api.service[101847]: DEBUG nova.api.openstack.wsgi [None req-ce987f43-815d-4756-b515-8a272978bb75 admin admin] Calling method '>' {{(pid=101847) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 02:57:20.995960 dv-cinder-818037-9-iscsi devstack@n-api.service[101847]: INFO nova.api.openstack.requestlog [None req-ce987f43-815d-4756-b515-8a272978bb75 admin admin] 10.222.0.18 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001456 Dec 15 02:57:20.996372 dv-cinder-818037-9-iscsi devstack@n-api.service[101847]: [pid: 101847|app: 0|req: 21/43] 10.222.0.18 () {56 vars in 1074 bytes} [Wed Dec 15 02:57:20 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 02:57:21.183373 dv-cinder-818037-9-iscsi devstack@n-api.service[101848]: DEBUG nova.api.openstack.wsgi [None req-d4e71f58-10dd-417a-a44c-2c288aad34d2 admin admin] Calling method '>' {{(pid=101848) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 02:57:21.188469 dv-cinder-818037-9-iscsi devstack@n-api.service[101848]: INFO nova.api.openstack.wsgi [None req-d4e71f58-10dd-417a-a44c-2c288aad34d2 admin admin] HTTP exception thrown: Flavor 84 could not be found. Dec 15 02:57:21.189560 dv-cinder-818037-9-iscsi devstack@n-api.service[101848]: DEBUG nova.api.openstack.wsgi [None req-d4e71f58-10dd-417a-a44c-2c288aad34d2 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=101848) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 15 02:57:21.190373 dv-cinder-818037-9-iscsi devstack@n-api.service[101848]: INFO nova.api.openstack.requestlog [None req-d4e71f58-10dd-417a-a44c-2c288aad34d2 admin admin] 10.222.0.18 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.057421 Dec 15 02:57:21.190878 dv-cinder-818037-9-iscsi devstack@n-api.service[101848]: [pid: 101848|app: 0|req: 23/44] 10.222.0.18 () {60 vars in 1190 bytes} [Wed Dec 15 02:57:21 2021] GET /compute/v2.1/flavors/84 => generated 75 bytes in 58 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Dec 15 02:57:21.200316 dv-cinder-818037-9-iscsi devstack@n-api.service[101847]: DEBUG nova.api.openstack.wsgi [None req-cabce02b-5a67-453d-8304-105c53ff9879 admin admin] Calling method '>' {{(pid=101847) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 02:57:21.214078 dv-cinder-818037-9-iscsi devstack@n-api.service[101847]: INFO nova.api.openstack.requestlog [None req-cabce02b-5a67-453d-8304-105c53ff9879 admin admin] 10.222.0.18 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.017200 Dec 15 02:57:21.214612 dv-cinder-818037-9-iscsi devstack@n-api.service[101847]: [pid: 101847|app: 0|req: 22/45] 10.222.0.18 () {60 vars in 1210 bytes} [Wed Dec 15 02:57:21 2021] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 18 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 02:57:21.224403 dv-cinder-818037-9-iscsi devstack@n-api.service[101848]: DEBUG nova.api.openstack.wsgi [None req-ed410a39-5240-4a95-8b19-97fed6769d9b admin admin] Calling method '>' {{(pid=101848) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 02:57:21.237508 dv-cinder-818037-9-iscsi devstack@n-api.service[101848]: INFO nova.api.openstack.requestlog [None req-ed410a39-5240-4a95-8b19-97fed6769d9b admin admin] 10.222.0.18 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.016535 Dec 15 02:57:21.238036 dv-cinder-818037-9-iscsi devstack@n-api.service[101848]: [pid: 101848|app: 0|req: 24/46] 10.222.0.18 () {60 vars in 1210 bytes} [Wed Dec 15 02:57:21 2021] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 18 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 02:57:21.247155 dv-cinder-818037-9-iscsi devstack@n-api.service[101847]: DEBUG nova.api.openstack.wsgi [None req-a6000ce8-712a-4715-876c-7bd171fb844b admin admin] Calling method '>' {{(pid=101847) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 02:57:21.252869 dv-cinder-818037-9-iscsi devstack@n-api.service[101847]: INFO nova.api.openstack.wsgi [None req-a6000ce8-712a-4715-876c-7bd171fb844b admin admin] HTTP exception thrown: Flavor 84 could not be found. Dec 15 02:57:21.253420 dv-cinder-818037-9-iscsi devstack@n-api.service[101847]: DEBUG nova.api.openstack.wsgi [None req-a6000ce8-712a-4715-876c-7bd171fb844b admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=101847) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 15 02:57:21.254226 dv-cinder-818037-9-iscsi devstack@n-api.service[101847]: INFO nova.api.openstack.requestlog [None req-a6000ce8-712a-4715-876c-7bd171fb844b admin admin] 10.222.0.18 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.010405 Dec 15 02:57:21.254696 dv-cinder-818037-9-iscsi devstack@n-api.service[101847]: [pid: 101847|app: 0|req: 23/47] 10.222.0.18 () {60 vars in 1190 bytes} [Wed Dec 15 02:57:21 2021] GET /compute/v2.1/flavors/84 => generated 75 bytes in 11 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Dec 15 02:57:22.725533 dv-cinder-818037-9-iscsi devstack@n-api.service[101848]: DEBUG nova.api.openstack.wsgi [None req-ed410a39-5240-4a95-8b19-97fed6769d9b admin admin] Calling method '>' {{(pid=101848) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 02:57:22.726604 dv-cinder-818037-9-iscsi devstack@n-api.service[101848]: INFO nova.api.openstack.requestlog [None req-ed410a39-5240-4a95-8b19-97fed6769d9b admin admin] 10.222.0.18 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001516 Dec 15 02:57:22.726995 dv-cinder-818037-9-iscsi devstack@n-api.service[101848]: [pid: 101848|app: 0|req: 25/48] 10.222.0.18 () {56 vars in 1074 bytes} [Wed Dec 15 02:57:22 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 02:57:22.915964 dv-cinder-818037-9-iscsi devstack@n-api.service[101847]: DEBUG nova.api.openstack.wsgi [None req-d75944fc-0307-4e2a-8409-7c4a34e40aa5 admin admin] Calling method '>' {{(pid=101847) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 02:57:22.921105 dv-cinder-818037-9-iscsi devstack@n-api.service[101847]: INFO nova.api.openstack.wsgi [None req-d75944fc-0307-4e2a-8409-7c4a34e40aa5 admin admin] HTTP exception thrown: Flavor 451 could not be found. Dec 15 02:57:22.921662 dv-cinder-818037-9-iscsi devstack@n-api.service[101847]: DEBUG nova.api.openstack.wsgi [None req-d75944fc-0307-4e2a-8409-7c4a34e40aa5 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=101847) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 15 02:57:22.922505 dv-cinder-818037-9-iscsi devstack@n-api.service[101847]: INFO nova.api.openstack.requestlog [None req-d75944fc-0307-4e2a-8409-7c4a34e40aa5 admin admin] 10.222.0.18 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.057788 Dec 15 02:57:22.923158 dv-cinder-818037-9-iscsi devstack@n-api.service[101847]: [pid: 101847|app: 0|req: 24/49] 10.222.0.18 () {60 vars in 1193 bytes} [Wed Dec 15 02:57:22 2021] GET /compute/v2.1/flavors/451 => generated 76 bytes in 59 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Dec 15 02:57:22.933202 dv-cinder-818037-9-iscsi devstack@n-api.service[101848]: DEBUG nova.api.openstack.wsgi [None req-6aaf86fc-f733-458f-9bb4-6ff07b8d1f44 admin admin] Calling method '>' {{(pid=101848) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 02:57:22.947261 dv-cinder-818037-9-iscsi devstack@n-api.service[101848]: INFO nova.api.openstack.requestlog [None req-6aaf86fc-f733-458f-9bb4-6ff07b8d1f44 admin admin] 10.222.0.18 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.017561 Dec 15 02:57:22.947720 dv-cinder-818037-9-iscsi devstack@n-api.service[101848]: [pid: 101848|app: 0|req: 26/50] 10.222.0.18 () {60 vars in 1210 bytes} [Wed Dec 15 02:57:22 2021] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 02:57:22.958881 dv-cinder-818037-9-iscsi devstack@n-api.service[101847]: DEBUG nova.api.openstack.wsgi [None req-e369cf4d-2570-4c54-87db-5d92833faaf2 admin admin] Calling method '>' {{(pid=101847) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 02:57:22.971399 dv-cinder-818037-9-iscsi devstack@n-api.service[101847]: INFO nova.api.openstack.requestlog [None req-e369cf4d-2570-4c54-87db-5d92833faaf2 admin admin] 10.222.0.18 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.017498 Dec 15 02:57:22.971908 dv-cinder-818037-9-iscsi devstack@n-api.service[101847]: [pid: 101847|app: 0|req: 25/51] 10.222.0.18 () {60 vars in 1210 bytes} [Wed Dec 15 02:57:22 2021] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 18 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Dec 15 02:57:22.981376 dv-cinder-818037-9-iscsi devstack@n-api.service[101848]: DEBUG nova.api.openstack.wsgi [None req-d5bfa5c9-7f02-4724-bed9-95df402a80bb admin admin] Calling method '>' {{(pid=101848) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 02:57:22.986947 dv-cinder-818037-9-iscsi devstack@n-api.service[101848]: INFO nova.api.openstack.wsgi [None req-d5bfa5c9-7f02-4724-bed9-95df402a80bb admin admin] HTTP exception thrown: Flavor 451 could not be found. Dec 15 02:57:22.987507 dv-cinder-818037-9-iscsi devstack@n-api.service[101848]: DEBUG nova.api.openstack.wsgi [None req-d5bfa5c9-7f02-4724-bed9-95df402a80bb admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=101848) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 15 02:57:22.988280 dv-cinder-818037-9-iscsi devstack@n-api.service[101848]: INFO nova.api.openstack.requestlog [None req-d5bfa5c9-7f02-4724-bed9-95df402a80bb admin admin] 10.222.0.18 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.010379 Dec 15 02:57:22.988765 dv-cinder-818037-9-iscsi devstack@n-api.service[101848]: [pid: 101848|app: 0|req: 27/52] 10.222.0.18 () {60 vars in 1193 bytes} [Wed Dec 15 02:57:22 2021] GET /compute/v2.1/flavors/451 => generated 76 bytes in 11 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Dec 15 02:57:24.466193 dv-cinder-818037-9-iscsi devstack@n-api.service[101847]: DEBUG nova.api.openstack.wsgi [None req-e369cf4d-2570-4c54-87db-5d92833faaf2 admin admin] Calling method '>' {{(pid=101847) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 02:57:24.467189 dv-cinder-818037-9-iscsi devstack@n-api.service[101847]: INFO nova.api.openstack.requestlog [None req-e369cf4d-2570-4c54-87db-5d92833faaf2 admin admin] 10.222.0.18 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001436 Dec 15 02:57:24.467573 dv-cinder-818037-9-iscsi devstack@n-api.service[101847]: [pid: 101847|app: 0|req: 26/53] 10.222.0.18 () {56 vars in 1074 bytes} [Wed Dec 15 02:57:24 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 02:57:24.655337 dv-cinder-818037-9-iscsi devstack@n-api.service[101848]: DEBUG nova.api.openstack.wsgi [None req-ad59cc51-fc45-426a-b495-613d51b56305 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.nano", "ram": 256, "vcpus": 1, "disk": 1, "id": "42", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=101848) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 02:57:24.674500 dv-cinder-818037-9-iscsi devstack@n-api.service[101848]: INFO nova.api.openstack.requestlog [None req-ad59cc51-fc45-426a-b495-613d51b56305 admin admin] 10.222.0.18 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.90 time: 0.070041 Dec 15 02:57:24.675025 dv-cinder-818037-9-iscsi devstack@n-api.service[101848]: [pid: 101848|app: 0|req: 28/54] 10.222.0.18 () {64 vars in 1235 bytes} [Wed Dec 15 02:57:24 2021] POST /compute/v2.1/flavors => generated 404 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 02:57:26.140807 dv-cinder-818037-9-iscsi devstack@n-api.service[101847]: DEBUG nova.api.openstack.wsgi [None req-e369cf4d-2570-4c54-87db-5d92833faaf2 admin admin] Calling method '>' {{(pid=101847) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 02:57:26.141794 dv-cinder-818037-9-iscsi devstack@n-api.service[101847]: INFO nova.api.openstack.requestlog [None req-e369cf4d-2570-4c54-87db-5d92833faaf2 admin admin] 10.222.0.18 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001395 Dec 15 02:57:26.142731 dv-cinder-818037-9-iscsi devstack@n-api.service[101847]: [pid: 101847|app: 0|req: 27/55] 10.222.0.18 () {56 vars in 1074 bytes} [Wed Dec 15 02:57:26 2021] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 02:57:26.328791 dv-cinder-818037-9-iscsi devstack@n-api.service[101848]: DEBUG nova.api.openstack.wsgi [None req-12312845-60ed-42f8-a3cb-37e9f1957abd admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.micro", "ram": 256, "vcpus": 1, "disk": 2, "id": "84", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=101848) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 02:57:26.345853 dv-cinder-818037-9-iscsi devstack@n-api.service[101848]: INFO nova.api.openstack.requestlog [None req-12312845-60ed-42f8-a3cb-37e9f1957abd admin admin] 10.222.0.18 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.90 time: 0.066590 Dec 15 02:57:26.346421 dv-cinder-818037-9-iscsi devstack@n-api.service[101848]: [pid: 101848|app: 0|req: 29/56] 10.222.0.18 () {64 vars in 1235 bytes} [Wed Dec 15 02:57:26 2021] POST /compute/v2.1/flavors => generated 405 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 02:57:27.838883 dv-cinder-818037-9-iscsi devstack@n-api.service[101847]: DEBUG nova.api.openstack.wsgi [None req-e369cf4d-2570-4c54-87db-5d92833faaf2 admin admin] Calling method '>' {{(pid=101847) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 02:57:27.839892 dv-cinder-818037-9-iscsi devstack@n-api.service[101847]: INFO nova.api.openstack.requestlog [None req-e369cf4d-2570-4c54-87db-5d92833faaf2 admin admin] 10.222.0.18 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001399 Dec 15 02:57:27.840282 dv-cinder-818037-9-iscsi devstack@n-api.service[101847]: [pid: 101847|app: 0|req: 28/57] 10.222.0.18 () {56 vars in 1074 bytes} [Wed Dec 15 02:57:27 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 02:57:28.032091 dv-cinder-818037-9-iscsi devstack@n-api.service[101848]: DEBUG nova.api.openstack.wsgi [None req-476ffcb1-7739-46cd-a130-e44c728d0123 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat", "ram": 512, "vcpus": 1, "disk": 1, "id": "451", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=101848) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 02:57:28.049117 dv-cinder-818037-9-iscsi devstack@n-api.service[101848]: INFO nova.api.openstack.requestlog [None req-476ffcb1-7739-46cd-a130-e44c728d0123 admin admin] 10.222.0.18 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.90 time: 0.068232 Dec 15 02:57:28.049735 dv-cinder-818037-9-iscsi devstack@n-api.service[101848]: [pid: 101848|app: 0|req: 30/58] 10.222.0.18 () {64 vars in 1235 bytes} [Wed Dec 15 02:57:27 2021] POST /compute/v2.1/flavors => generated 407 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 02:57:29.522445 dv-cinder-818037-9-iscsi devstack@n-api.service[101847]: DEBUG nova.api.openstack.wsgi [None req-e369cf4d-2570-4c54-87db-5d92833faaf2 admin admin] Calling method '>' {{(pid=101847) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 02:57:29.523454 dv-cinder-818037-9-iscsi devstack@n-api.service[101847]: INFO nova.api.openstack.requestlog [None req-e369cf4d-2570-4c54-87db-5d92833faaf2 admin admin] 10.222.0.18 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001472 Dec 15 02:57:29.523852 dv-cinder-818037-9-iscsi devstack@n-api.service[101847]: [pid: 101847|app: 0|req: 29/59] 10.222.0.18 () {56 vars in 1074 bytes} [Wed Dec 15 02:57:29 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 02:57:29.712888 dv-cinder-818037-9-iscsi devstack@n-api.service[101848]: DEBUG nova.api.openstack.wsgi [None req-4350a737-1663-4656-8b56-6abbb286b0b5 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat2", "ram": 1024, "vcpus": 1, "disk": 1, "id": "452", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=101848) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 02:57:29.730563 dv-cinder-818037-9-iscsi devstack@n-api.service[101848]: INFO nova.api.openstack.requestlog [None req-4350a737-1663-4656-8b56-6abbb286b0b5 admin admin] 10.222.0.18 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.90 time: 0.067962 Dec 15 02:57:29.731191 dv-cinder-818037-9-iscsi devstack@n-api.service[101848]: [pid: 101848|app: 0|req: 31/60] 10.222.0.18 () {64 vars in 1235 bytes} [Wed Dec 15 02:57:29 2021] POST /compute/v2.1/flavors => generated 409 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 02:57:31.192706 dv-cinder-818037-9-iscsi devstack@n-api.service[101847]: DEBUG nova.api.openstack.wsgi [None req-e369cf4d-2570-4c54-87db-5d92833faaf2 admin admin] Calling method '>' {{(pid=101847) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 02:57:31.193695 dv-cinder-818037-9-iscsi devstack@n-api.service[101847]: INFO nova.api.openstack.requestlog [None req-e369cf4d-2570-4c54-87db-5d92833faaf2 admin admin] 10.222.0.18 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001401 Dec 15 02:57:31.194115 dv-cinder-818037-9-iscsi devstack@n-api.service[101847]: [pid: 101847|app: 0|req: 30/61] 10.222.0.18 () {56 vars in 1074 bytes} [Wed Dec 15 02:57:31 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 02:57:31.381213 dv-cinder-818037-9-iscsi devstack@n-api.service[101848]: DEBUG nova.api.openstack.wsgi [None req-572f7cb3-a6a5-418c-b3e2-808a31b80266 admin admin] Calling method '>' {{(pid=101848) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 02:57:31.399767 dv-cinder-818037-9-iscsi devstack@n-api.service[101848]: INFO nova.api.openstack.requestlog [None req-572f7cb3-a6a5-418c-b3e2-808a31b80266 admin admin] 10.222.0.18 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.90 time: 0.069993 Dec 15 02:57:31.400294 dv-cinder-818037-9-iscsi devstack@n-api.service[101848]: [pid: 101848|app: 0|req: 32/62] 10.222.0.18 () {60 vars in 1202 bytes} [Wed Dec 15 02:57:31 2021] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 02:58:18.378211 dv-cinder-818037-9-iscsi devstack@n-api.service[101847]: DEBUG nova.api.openstack.wsgi [None req-e369cf4d-2570-4c54-87db-5d92833faaf2 admin admin] Calling method '>' {{(pid=101847) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 02:58:18.379242 dv-cinder-818037-9-iscsi devstack@n-api.service[101847]: INFO nova.api.openstack.requestlog [None req-e369cf4d-2570-4c54-87db-5d92833faaf2 admin admin] 10.222.0.18 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001539 Dec 15 02:58:18.379639 dv-cinder-818037-9-iscsi devstack@n-api.service[101847]: [pid: 101847|app: 0|req: 31/63] 10.222.0.18 () {54 vars in 930 bytes} [Wed Dec 15 02:58:18 2021] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 02:58:18.437091 dv-cinder-818037-9-iscsi devstack@n-api.service[101848]: DEBUG nova.api.openstack.wsgi [None req-15f611f8-09c3-4eb3-9f32-f429c38c029b admin admin] Calling method '>' {{(pid=101848) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 02:58:18.456257 dv-cinder-818037-9-iscsi devstack@n-api.service[101848]: INFO nova.api.openstack.requestlog [None req-15f611f8-09c3-4eb3-9f32-f429c38c029b admin admin] 10.222.0.18 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 5791 microversion: 2.61 time: 0.070194 Dec 15 02:58:18.456834 dv-cinder-818037-9-iscsi devstack@n-api.service[101848]: [pid: 101848|app: 0|req: 33/64] 10.222.0.18 () {60 vars in 1291 bytes} [Wed Dec 15 02:58:18 2021] GET /compute/v2.1/flavors/detail?is_public=True => generated 5791 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 02:58:18.478748 dv-cinder-818037-9-iscsi devstack@n-api.service[101847]: DEBUG nova.api.openstack.wsgi [None req-49bf1289-d0f5-4fda-89ec-fd8384c1e701 admin admin] Calling method '>' {{(pid=101847) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 02:58:18.486204 dv-cinder-818037-9-iscsi devstack@n-api.service[101847]: INFO nova.api.openstack.requestlog [None req-49bf1289-d0f5-4fda-89ec-fd8384c1e701 admin admin] 10.222.0.18 "GET /compute/v2.1/flavors/42/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.010940 Dec 15 02:58:18.486709 dv-cinder-818037-9-iscsi devstack@n-api.service[101847]: [pid: 101847|app: 0|req: 32/65] 10.222.0.18 () {60 vars in 1282 bytes} [Wed Dec 15 02:58:18 2021] GET /compute/v2.1/flavors/42/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 02:58:18.498042 dv-cinder-818037-9-iscsi devstack@n-api.service[101848]: DEBUG nova.api.openstack.wsgi [None req-bf913e5c-36f2-42de-876c-d4cff3fff06b admin admin] Calling method '>' {{(pid=101848) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 02:58:18.505583 dv-cinder-818037-9-iscsi devstack@n-api.service[101848]: INFO nova.api.openstack.requestlog [None req-bf913e5c-36f2-42de-876c-d4cff3fff06b admin admin] 10.222.0.18 "GET /compute/v2.1/flavors/451/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.010888 Dec 15 02:58:18.506111 dv-cinder-818037-9-iscsi devstack@n-api.service[101848]: [pid: 101848|app: 0|req: 34/66] 10.222.0.18 () {60 vars in 1285 bytes} [Wed Dec 15 02:58:18 2021] GET /compute/v2.1/flavors/451/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 02:58:18.517639 dv-cinder-818037-9-iscsi devstack@n-api.service[101847]: DEBUG nova.api.openstack.wsgi [None req-b13cc702-ae86-42cc-9d3f-a8103bb1cb1f admin admin] Calling method '>' {{(pid=101847) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 02:58:18.524865 dv-cinder-818037-9-iscsi devstack@n-api.service[101847]: INFO nova.api.openstack.requestlog [None req-b13cc702-ae86-42cc-9d3f-a8103bb1cb1f admin admin] 10.222.0.18 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011072 Dec 15 02:58:18.525370 dv-cinder-818037-9-iscsi devstack@n-api.service[101847]: [pid: 101847|app: 0|req: 33/67] 10.222.0.18 () {60 vars in 1285 bytes} [Wed Dec 15 02:58:18 2021] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 02:58:18.537092 dv-cinder-818037-9-iscsi devstack@n-api.service[101848]: DEBUG nova.api.openstack.wsgi [None req-9a263d1b-73b8-4ae9-9020-c9962d7fe3a8 admin admin] Calling method '>' {{(pid=101848) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 02:58:18.544321 dv-cinder-818037-9-iscsi devstack@n-api.service[101848]: INFO nova.api.openstack.requestlog [None req-9a263d1b-73b8-4ae9-9020-c9962d7fe3a8 admin admin] 10.222.0.18 "GET /compute/v2.1/flavors/84/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.010487 Dec 15 02:58:18.544820 dv-cinder-818037-9-iscsi devstack@n-api.service[101848]: [pid: 101848|app: 0|req: 35/68] 10.222.0.18 () {60 vars in 1282 bytes} [Wed Dec 15 02:58:18 2021] GET /compute/v2.1/flavors/84/os-extra_specs => generated 19 bytes in 11 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 02:59:46.210894 dv-cinder-818037-9-iscsi devstack@n-api.service[101847]: DEBUG nova.api.openstack.wsgi [None req-3e810215-ee59-43c9-bea3-db580058065a tempest-verify_tempest_config-476039915 tempest-verify_tempest_config-476039915-project] Calling method '>' {{(pid=101847) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 02:59:46.212891 dv-cinder-818037-9-iscsi devstack@n-api.service[101847]: INFO nova.api.openstack.requestlog [None req-3e810215-ee59-43c9-bea3-db580058065a tempest-verify_tempest_config-476039915 tempest-verify_tempest_config-476039915-project] 10.222.0.18 "GET /compute/v2.1/extensions" status: 200 len: 22700 microversion: 2.1 time: 0.105831 Dec 15 02:59:46.213422 dv-cinder-818037-9-iscsi devstack@n-api.service[101847]: [pid: 101847|app: 0|req: 34/69] 10.222.0.18 () {58 vars in 1133 bytes} [Wed Dec 15 02:59:46 2021] GET /compute/v2.1/extensions => generated 22700 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 03:01:12.512876 dv-cinder-818037-9-iscsi devstack@n-api.service[101848]: DEBUG nova.api.openstack.wsgi [None req-9a263d1b-73b8-4ae9-9020-c9962d7fe3a8 admin admin] Calling method '>' {{(pid=101848) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:01:12.513905 dv-cinder-818037-9-iscsi devstack@n-api.service[101848]: INFO nova.api.openstack.requestlog [None req-9a263d1b-73b8-4ae9-9020-c9962d7fe3a8 admin admin] 10.222.0.18 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001454 Dec 15 03:01:12.514599 dv-cinder-818037-9-iscsi devstack@n-api.service[101848]: [pid: 101848|app: 0|req: 36/70] 10.222.0.18 () {56 vars in 1074 bytes} [Wed Dec 15 03:01:12 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 03:01:12.760715 dv-cinder-818037-9-iscsi devstack@n-api.service[101847]: DEBUG nova.api.openstack.wsgi [None req-97fa2b12-b2cb-4859-b284-48dfcc4e42ae admin admin] Calling method '>' {{(pid=101847) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:01:12.761819 dv-cinder-818037-9-iscsi devstack@n-api.service[101847]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-services:list": "rule:system_reader_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 15 03:01:12.761819 dv-cinder-818037-9-iscsi devstack@n-api.service[101847]: warnings.warn(msg) Dec 15 03:01:12.763395 dv-cinder-818037-9-iscsi devstack@n-api.service[101847]: DEBUG oslo_concurrency.lockutils [None req-97fa2b12-b2cb-4859-b284-48dfcc4e42ae admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:01:12.763850 dv-cinder-818037-9-iscsi devstack@n-api.service[101847]: DEBUG oslo_concurrency.lockutils [None req-97fa2b12-b2cb-4859-b284-48dfcc4e42ae admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:01:12.764638 dv-cinder-818037-9-iscsi devstack@n-api.service[101847]: DEBUG oslo_concurrency.lockutils [None req-97fa2b12-b2cb-4859-b284-48dfcc4e42ae admin admin] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:01:12.765065 dv-cinder-818037-9-iscsi devstack@n-api.service[101847]: DEBUG oslo_concurrency.lockutils [None req-97fa2b12-b2cb-4859-b284-48dfcc4e42ae admin admin] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:01:12.797894 dv-cinder-818037-9-iscsi devstack@n-api.service[101847]: INFO nova.api.openstack.requestlog [None req-97fa2b12-b2cb-4859-b284-48dfcc4e42ae admin admin] 10.222.0.18 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.90 time: 0.145490 Dec 15 03:01:12.798463 dv-cinder-818037-9-iscsi devstack@n-api.service[101847]: [pid: 101847|app: 0|req: 35/71] 10.222.0.18 () {60 vars in 1193 bytes} [Wed Dec 15 03:01:12 2021] GET /compute/v2.1/os-services => generated 791 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Dec 15 03:01:14.277999 dv-cinder-818037-9-iscsi devstack@n-api.service[101848]: DEBUG nova.api.openstack.wsgi [None req-9a263d1b-73b8-4ae9-9020-c9962d7fe3a8 admin admin] Calling method '>' {{(pid=101848) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:01:14.279562 dv-cinder-818037-9-iscsi devstack@n-api.service[101848]: INFO nova.api.openstack.requestlog [None req-9a263d1b-73b8-4ae9-9020-c9962d7fe3a8 admin admin] 10.222.0.18 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001451 Dec 15 03:01:14.279955 dv-cinder-818037-9-iscsi devstack@n-api.service[101848]: [pid: 101848|app: 0|req: 37/72] 10.222.0.18 () {56 vars in 1074 bytes} [Wed Dec 15 03:01:14 2021] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 03:01:14.469432 dv-cinder-818037-9-iscsi devstack@n-api.service[101847]: DEBUG nova.api.openstack.wsgi [None req-63227d15-9ddb-4db4-8ef9-4593b9922e4c admin admin] Calling method '>' {{(pid=101847) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:01:14.470629 dv-cinder-818037-9-iscsi devstack@n-api.service[101847]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-services:list": "rule:system_reader_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 15 03:01:14.470629 dv-cinder-818037-9-iscsi devstack@n-api.service[101847]: warnings.warn(msg) Dec 15 03:01:14.472210 dv-cinder-818037-9-iscsi devstack@n-api.service[101847]: DEBUG oslo_concurrency.lockutils [None req-63227d15-9ddb-4db4-8ef9-4593b9922e4c admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:01:14.472658 dv-cinder-818037-9-iscsi devstack@n-api.service[101847]: DEBUG oslo_concurrency.lockutils [None req-63227d15-9ddb-4db4-8ef9-4593b9922e4c admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:01:14.473461 dv-cinder-818037-9-iscsi devstack@n-api.service[101847]: DEBUG oslo_concurrency.lockutils [None req-63227d15-9ddb-4db4-8ef9-4593b9922e4c admin admin] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:01:14.473918 dv-cinder-818037-9-iscsi devstack@n-api.service[101847]: DEBUG oslo_concurrency.lockutils [None req-63227d15-9ddb-4db4-8ef9-4593b9922e4c admin admin] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:01:14.492901 dv-cinder-818037-9-iscsi devstack@n-api.service[101847]: INFO nova.api.openstack.requestlog [None req-63227d15-9ddb-4db4-8ef9-4593b9922e4c admin admin] 10.222.0.18 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.90 time: 0.073582 Dec 15 03:01:14.493442 dv-cinder-818037-9-iscsi devstack@n-api.service[101847]: [pid: 101847|app: 0|req: 36/73] 10.222.0.18 () {60 vars in 1193 bytes} [Wed Dec 15 03:01:14 2021] GET /compute/v2.1/os-services => generated 791 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 03:01:26.424169 dv-cinder-818037-9-iscsi devstack@n-api.service[101848]: DEBUG nova.api.openstack.wsgi [None req-9a263d1b-73b8-4ae9-9020-c9962d7fe3a8 admin admin] Calling method '>' {{(pid=101848) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:01:26.425178 dv-cinder-818037-9-iscsi devstack@n-api.service[101848]: INFO nova.api.openstack.requestlog [None req-9a263d1b-73b8-4ae9-9020-c9962d7fe3a8 admin admin] 10.222.0.18 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001427 Dec 15 03:01:26.425574 dv-cinder-818037-9-iscsi devstack@n-api.service[101848]: [pid: 101848|app: 0|req: 38/74] 10.222.0.18 () {56 vars in 1074 bytes} [Wed Dec 15 03:01:26 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 03:01:26.617828 dv-cinder-818037-9-iscsi devstack@n-api.service[101847]: DEBUG nova.api.openstack.wsgi [None req-b8614a8c-3503-42cf-afab-23aa106a938c admin admin] Calling method '>' {{(pid=101847) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:01:26.619005 dv-cinder-818037-9-iscsi devstack@n-api.service[101847]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-services:list": "rule:system_reader_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 15 03:01:26.619005 dv-cinder-818037-9-iscsi devstack@n-api.service[101847]: warnings.warn(msg) Dec 15 03:01:26.620496 dv-cinder-818037-9-iscsi devstack@n-api.service[101847]: DEBUG oslo_concurrency.lockutils [None req-b8614a8c-3503-42cf-afab-23aa106a938c admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:01:26.620961 dv-cinder-818037-9-iscsi devstack@n-api.service[101847]: DEBUG oslo_concurrency.lockutils [None req-b8614a8c-3503-42cf-afab-23aa106a938c admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:01:26.621748 dv-cinder-818037-9-iscsi devstack@n-api.service[101847]: DEBUG oslo_concurrency.lockutils [None req-b8614a8c-3503-42cf-afab-23aa106a938c admin admin] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:01:26.622242 dv-cinder-818037-9-iscsi devstack@n-api.service[101847]: DEBUG oslo_concurrency.lockutils [None req-b8614a8c-3503-42cf-afab-23aa106a938c admin admin] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:01:26.646257 dv-cinder-818037-9-iscsi devstack@n-api.service[101847]: INFO nova.api.openstack.requestlog [None req-b8614a8c-3503-42cf-afab-23aa106a938c admin admin] 10.222.0.18 "GET /compute/v2.1/os-services" status: 200 len: 1011 microversion: 2.90 time: 0.078629 Dec 15 03:01:26.646792 dv-cinder-818037-9-iscsi devstack@n-api.service[101847]: [pid: 101847|app: 0|req: 37/75] 10.222.0.18 () {60 vars in 1193 bytes} [Wed Dec 15 03:01:26 2021] GET /compute/v2.1/os-services => generated 1011 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 03:01:28.115917 dv-cinder-818037-9-iscsi devstack@n-api.service[101848]: DEBUG nova.api.openstack.wsgi [None req-9a263d1b-73b8-4ae9-9020-c9962d7fe3a8 admin admin] Calling method '>' {{(pid=101848) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:01:28.116919 dv-cinder-818037-9-iscsi devstack@n-api.service[101848]: INFO nova.api.openstack.requestlog [None req-9a263d1b-73b8-4ae9-9020-c9962d7fe3a8 admin admin] 10.222.0.18 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001403 Dec 15 03:01:28.117313 dv-cinder-818037-9-iscsi devstack@n-api.service[101848]: [pid: 101848|app: 0|req: 39/76] 10.222.0.18 () {56 vars in 1074 bytes} [Wed Dec 15 03:01:28 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 03:01:28.307371 dv-cinder-818037-9-iscsi devstack@n-api.service[101847]: DEBUG nova.api.openstack.wsgi [None req-38c38447-bd32-4807-be86-169014bfa441 admin admin] Calling method '>' {{(pid=101847) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:01:28.308557 dv-cinder-818037-9-iscsi devstack@n-api.service[101847]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-services:list": "rule:system_reader_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 15 03:01:28.308557 dv-cinder-818037-9-iscsi devstack@n-api.service[101847]: warnings.warn(msg) Dec 15 03:01:28.310152 dv-cinder-818037-9-iscsi devstack@n-api.service[101847]: DEBUG oslo_concurrency.lockutils [None req-38c38447-bd32-4807-be86-169014bfa441 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:01:28.310598 dv-cinder-818037-9-iscsi devstack@n-api.service[101847]: DEBUG oslo_concurrency.lockutils [None req-38c38447-bd32-4807-be86-169014bfa441 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:01:28.311395 dv-cinder-818037-9-iscsi devstack@n-api.service[101847]: DEBUG oslo_concurrency.lockutils [None req-38c38447-bd32-4807-be86-169014bfa441 admin admin] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:01:28.311823 dv-cinder-818037-9-iscsi devstack@n-api.service[101847]: DEBUG oslo_concurrency.lockutils [None req-38c38447-bd32-4807-be86-169014bfa441 admin admin] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101847) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:01:28.332854 dv-cinder-818037-9-iscsi devstack@n-api.service[101847]: INFO nova.api.openstack.requestlog [None req-38c38447-bd32-4807-be86-169014bfa441 admin admin] 10.222.0.18 "GET /compute/v2.1/os-services" status: 200 len: 1035 microversion: 2.90 time: 0.076135 Dec 15 03:01:28.333327 dv-cinder-818037-9-iscsi devstack@n-api.service[101847]: [pid: 101847|app: 0|req: 38/77] 10.222.0.18 () {60 vars in 1193 bytes} [Wed Dec 15 03:01:28 2021] GET /compute/v2.1/os-services => generated 1035 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 03:02:24.857177 dv-cinder-818037-9-iscsi devstack@n-api.service[101796]: Wed Dec 15 03:02:24 2021 - graceful shutdown triggered... Dec 15 03:02:24.856922 dv-cinder-818037-9-iscsi systemd[1]: Stopping Devstack devstack@n-api.service... Dec 15 03:02:24.858224 dv-cinder-818037-9-iscsi devstack@n-api.service[101848]: Gracefully killing worker 2 (pid: 101848)... Dec 15 03:02:24.858802 dv-cinder-818037-9-iscsi devstack@n-api.service[101847]: Gracefully killing worker 1 (pid: 101847)... Dec 15 03:02:25.857928 dv-cinder-818037-9-iscsi devstack@n-api.service[101796]: worker 1 buried after 1 seconds Dec 15 03:02:25.858495 dv-cinder-818037-9-iscsi devstack@n-api.service[101796]: worker 2 buried after 1 seconds Dec 15 03:02:25.858495 dv-cinder-818037-9-iscsi devstack@n-api.service[101796]: goodbye to uWSGI. Dec 15 03:02:25.859975 dv-cinder-818037-9-iscsi systemd[1]: devstack@n-api.service: Succeeded. Dec 15 03:02:25.860527 dv-cinder-818037-9-iscsi systemd[1]: Stopped Devstack devstack@n-api.service. Dec 15 03:02:25.863401 dv-cinder-818037-9-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Dec 15 03:02:25.872239 dv-cinder-818037-9-iscsi devstack@n-api.service[116135]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Dec 15 03:02:25.875752 dv-cinder-818037-9-iscsi devstack@n-api.service[116135]: *** Starting uWSGI 2.0.18-debian (64bit) on [Wed Dec 15 03:02:25 2021] *** Dec 15 03:02:25.875918 dv-cinder-818037-9-iscsi devstack@n-api.service[116135]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Dec 15 03:02:25.876051 dv-cinder-818037-9-iscsi devstack@n-api.service[116135]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Dec 15 03:02:25.876163 dv-cinder-818037-9-iscsi devstack@n-api.service[116135]: nodename: dv-cinder-818037-9-iscsi Dec 15 03:02:25.876270 dv-cinder-818037-9-iscsi devstack@n-api.service[116135]: machine: x86_64 Dec 15 03:02:25.876378 dv-cinder-818037-9-iscsi devstack@n-api.service[116135]: clock source: unix Dec 15 03:02:25.876509 dv-cinder-818037-9-iscsi devstack@n-api.service[116135]: pcre jit disabled Dec 15 03:02:25.876509 dv-cinder-818037-9-iscsi devstack@n-api.service[116135]: detected number of CPU cores: 4 Dec 15 03:02:25.876509 dv-cinder-818037-9-iscsi devstack@n-api.service[116135]: current working directory: / Dec 15 03:02:25.876509 dv-cinder-818037-9-iscsi devstack@n-api.service[116135]: detected binary path: /usr/bin/uwsgi-core Dec 15 03:02:25.876509 dv-cinder-818037-9-iscsi devstack@n-api.service[116135]: your processes number limit is 47680 Dec 15 03:02:25.876509 dv-cinder-818037-9-iscsi devstack@n-api.service[116135]: your memory page size is 4096 bytes Dec 15 03:02:25.876509 dv-cinder-818037-9-iscsi devstack@n-api.service[116135]: detected max file descriptor number: 2048 Dec 15 03:02:25.876509 dv-cinder-818037-9-iscsi devstack@n-api.service[116135]: lock engine: pthread robust mutexes Dec 15 03:02:25.877056 dv-cinder-818037-9-iscsi devstack@n-api.service[116135]: thunder lock: enabled Dec 15 03:02:25.877056 dv-cinder-818037-9-iscsi devstack@n-api.service[116135]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Dec 15 03:02:25.877056 dv-cinder-818037-9-iscsi devstack@n-api.service[116135]: Python version: 3.8.10 (default, Sep 28 2021, 16:10:42) [GCC 9.3.0] Dec 15 03:02:25.924071 dv-cinder-818037-9-iscsi devstack@n-api.service[116135]: Python main interpreter initialized at 0x55ab7cac09c0 Dec 15 03:02:25.924071 dv-cinder-818037-9-iscsi devstack@n-api.service[116135]: python threads support enabled Dec 15 03:02:25.924071 dv-cinder-818037-9-iscsi devstack@n-api.service[116135]: your server socket listen backlog is limited to 100 connections Dec 15 03:02:25.924071 dv-cinder-818037-9-iscsi devstack@n-api.service[116135]: your mercy for graceful operations on workers is 90 seconds Dec 15 03:02:25.924527 dv-cinder-818037-9-iscsi devstack@n-api.service[116135]: mapped 403077 bytes (393 KB) for 2 cores Dec 15 03:02:25.924527 dv-cinder-818037-9-iscsi devstack@n-api.service[116135]: *** Operational MODE: preforking *** Dec 15 03:02:25.924790 dv-cinder-818037-9-iscsi devstack@n-api.service[116135]: *** uWSGI is running in multiple interpreter mode *** Dec 15 03:02:25.924790 dv-cinder-818037-9-iscsi devstack@n-api.service[116135]: spawned uWSGI master process (pid: 116135) Dec 15 03:02:25.924999 dv-cinder-818037-9-iscsi systemd[1]: Started Devstack devstack@n-api.service. Dec 15 03:02:25.925776 dv-cinder-818037-9-iscsi devstack@n-api.service[116135]: spawned uWSGI worker 1 (pid: 116156, cores: 1) Dec 15 03:02:25.927879 dv-cinder-818037-9-iscsi devstack@n-api.service[116135]: spawned uWSGI worker 2 (pid: 116157, cores: 1) Dec 15 03:02:25.927879 dv-cinder-818037-9-iscsi devstack@n-api.service[116135]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Dec 15 03:02:27.815734 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Dec 15 03:02:27.815734 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: from cryptography.utils import int_from_bytes Dec 15 03:02:27.816465 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Dec 15 03:02:27.816465 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: from cryptography.utils import int_from_bytes Dec 15 03:02:27.822735 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Dec 15 03:02:27.822735 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: from cryptography.utils import int_from_bytes Dec 15 03:02:27.823256 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Dec 15 03:02:27.823256 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: from cryptography.utils import int_from_bytes Dec 15 03:02:30.217586 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=116157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Dec 15 03:02:30.218226 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=116157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Dec 15 03:02:30.219001 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=116157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Dec 15 03:02:30.219286 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=116157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Dec 15 03:02:30.219549 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=116157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Dec 15 03:02:30.219949 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=116157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 03:02:30.220286 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=116157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 03:02:30.220617 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=116157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 03:02:30.220943 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=116157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 03:02:30.221296 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=116157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 03:02:30.221605 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=116157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 03:02:30.221934 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=116157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 03:02:30.222291 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=116157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 03:02:30.222626 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=116157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 03:02:30.222893 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=116157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 03:02:30.223215 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=116157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 03:02:30.223550 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-818037-9-iscsi {{(pid=116157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 03:02:30.223881 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=116157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 03:02:30.224196 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=116157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 03:02:30.224515 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=116157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 03:02:30.224840 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=116157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 03:02:30.225149 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=116157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 03:02:30.225481 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=116157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 03:02:30.225795 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=116157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 03:02:30.226327 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=116157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 03:02:30.227678 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=116157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 03:02:30.227678 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=116157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 03:02:30.227678 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=116157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 03:02:30.228056 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=116157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 03:02:30.228344 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=116157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 03:02:30.228664 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=116157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 03:02:30.231500 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=116157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 03:02:30.231500 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=116157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 03:02:30.231500 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=116157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 03:02:30.231500 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=116157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 03:02:30.231500 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-818037-9-iscsi {{(pid=116157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 03:02:30.231500 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=116157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 03:02:30.231500 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=116157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 03:02:30.231500 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=116157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 03:02:30.232158 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=116157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 03:02:30.232158 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=116157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 03:02:30.232318 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=116157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 03:02:30.232606 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=116157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 03:02:30.232952 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=116157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 03:02:30.233297 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=116157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 03:02:30.233606 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=116157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 03:02:30.233928 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=116157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 03:02:30.234692 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=116156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Dec 15 03:02:30.235330 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=116157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 03:02:30.235539 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=116156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Dec 15 03:02:30.235764 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=116157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 03:02:30.235981 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=116156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Dec 15 03:02:30.236195 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=116157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 03:02:30.236412 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=116156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Dec 15 03:02:30.236629 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=116157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 03:02:30.236836 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=116156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Dec 15 03:02:30.237150 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=116157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 03:02:30.237367 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=116156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 03:02:30.237580 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=116157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 03:02:30.237787 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=116156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 03:02:30.237953 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=116157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 03:02:30.238135 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=116156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 03:02:30.238283 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=116157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 03:02:30.238283 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=116157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 03:02:30.238555 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=116156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 03:02:30.238700 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=116157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 03:02:30.238840 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=116156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 03:02:30.238988 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=116157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 03:02:30.239133 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=116156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 03:02:30.239272 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=116157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 03:02:30.239421 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=116156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 03:02:30.239559 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=116157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 03:02:30.239722 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=116156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 03:02:30.239872 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=116157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 03:02:30.240016 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=116156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 03:02:30.240161 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=116157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 03:02:30.240309 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=116156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 03:02:30.240449 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=116157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 03:02:30.240602 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=116156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 03:02:30.240748 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=116157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 03:02:30.240893 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-818037-9-iscsi {{(pid=116156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 03:02:30.241047 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=116157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 03:02:30.241192 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=116156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 03:02:30.241339 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=116157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 03:02:30.241517 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=116156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 03:02:30.241668 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=116157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 03:02:30.241817 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=116156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 03:02:30.241967 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=116157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 03:02:30.242190 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=116156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 03:02:30.242331 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=116157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 03:02:30.242486 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=116156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 03:02:30.242630 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=116157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 03:02:30.242773 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=116156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 03:02:30.242919 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=116157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 03:02:30.243065 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=116156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 03:02:30.244052 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=116157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 03:02:30.244052 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=116157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 03:02:30.244359 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=116156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 03:02:30.244528 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=116157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 03:02:30.244675 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=116156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 03:02:30.244820 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=116157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 03:02:30.244971 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=116156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 03:02:30.245111 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=116157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 03:02:30.245256 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=116156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 03:02:30.245395 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=116157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 03:02:30.245534 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=116156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 03:02:30.245683 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.18 {{(pid=116157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 03:02:30.245830 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=116156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 03:02:30.245996 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.18 {{(pid=116157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 03:02:30.246143 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=116156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 03:02:30.246283 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=116157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 03:02:30.246435 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=116156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 03:02:30.246587 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=116157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 03:02:30.246733 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=116156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 03:02:30.246881 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=116157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 03:02:30.247020 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=116156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 03:02:30.247158 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=116157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 03:02:30.247296 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=116156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 03:02:30.247448 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=116157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 03:02:30.247587 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-818037-9-iscsi {{(pid=116156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 03:02:30.247741 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=116157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 03:02:30.247900 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=116156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 03:02:30.248049 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=116157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 03:02:30.248197 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=116156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 03:02:30.248343 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=116157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 03:02:30.248516 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=116156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 03:02:30.248751 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=116157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 03:02:30.249165 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=116156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 03:02:30.249321 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=116157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 03:02:30.249475 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=116156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 03:02:30.249670 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=116157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 03:02:30.249823 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=116156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 03:02:30.249963 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=116157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 03:02:30.249963 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=116157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 03:02:30.250295 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=116156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 03:02:30.250452 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=116157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 03:02:30.250601 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=116156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 03:02:30.250750 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=116157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 03:02:30.250902 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=116156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 03:02:30.251054 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=116157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 03:02:30.251205 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=116156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 03:02:30.251351 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=116157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 03:02:30.251490 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=116156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 03:02:30.251636 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=116157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 03:02:30.251775 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=116156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 03:02:30.251914 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=116157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 03:02:30.252074 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=116156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 03:02:30.252223 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=116157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 03:02:30.252369 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=116156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 03:02:30.252524 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=116157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 03:02:30.252675 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=116156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 03:02:30.252820 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=116157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 03:02:30.252974 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=116156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 03:02:30.253122 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=116157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 03:02:30.253261 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=116156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 03:02:30.253797 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=116157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 03:02:30.254247 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=116156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 03:02:30.254413 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=116157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 03:02:30.254555 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=116156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 03:02:30.254714 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=116157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 03:02:30.254862 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=116156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 03:02:30.255009 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=116157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 03:02:30.255155 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=116156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 03:02:30.255308 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=116157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 03:02:30.255455 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=116156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 03:02:30.255605 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=116157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 03:02:30.255756 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=116156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 03:02:30.255949 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=116157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 03:02:30.256101 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=116156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 03:02:30.256262 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=116157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 03:02:30.256404 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=116156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 03:02:30.256562 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=116157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 03:02:30.256703 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=116156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 03:02:30.256854 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=116157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 03:02:30.257035 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=116156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 03:02:30.257186 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=116157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 03:02:30.257341 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=116156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 03:02:30.257482 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=116157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 03:02:30.257627 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=116156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 03:02:30.257779 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=116157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 03:02:30.257925 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=116156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 03:02:30.258125 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=116157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 03:02:30.258271 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=116156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 03:02:30.258430 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=116157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 03:02:30.258570 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=116156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 03:02:30.258715 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=116157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 03:02:30.258856 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=116156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 03:02:30.258994 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=116157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 03:02:30.259140 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=116156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 03:02:30.259288 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=116157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 03:02:30.259428 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=116156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 03:02:30.259573 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=116157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 03:02:30.259719 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=116156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 03:02:30.259867 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=116157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 03:02:30.260015 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=116156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 03:02:30.260156 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=116157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 03:02:30.260325 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=116156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 03:02:30.260477 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=116157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 03:02:30.260628 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=116156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 03:02:30.260767 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=116157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 03:02:30.260919 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=116156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 03:02:30.261059 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=116157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 03:02:30.261206 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=116156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 03:02:30.261346 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=116157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 03:02:30.261484 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.18 {{(pid=116156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 03:02:30.261698 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=116157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 03:02:30.261846 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.18 {{(pid=116156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 03:02:30.262032 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=116157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 03:02:30.262189 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=116156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 03:02:30.262347 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=116157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 03:02:30.262493 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=116156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 03:02:30.262651 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=116157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 03:02:30.262791 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=116156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 03:02:30.262929 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=116157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 03:02:30.263075 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=116156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 03:02:30.263213 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=116157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 03:02:30.263357 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=116156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 03:02:30.263846 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=116157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 03:02:30.264740 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=116156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 03:02:30.264885 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=116157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 03:02:30.264975 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=116156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 03:02:30.265058 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=116157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 03:02:30.265138 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=116156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 03:02:30.265747 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=116157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 03:02:30.265827 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=116156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 03:02:30.265905 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=116157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 03:02:30.266009 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=116156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 03:02:30.266103 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=116157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 03:02:30.266200 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=116156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 03:02:30.266286 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=116157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 03:02:30.266376 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=116156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 03:02:30.266466 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=116157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 03:02:30.266558 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=116156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 03:02:30.266646 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=116157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 03:02:30.266737 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=116156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 03:02:30.266737 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=116156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 03:02:30.266895 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=116157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 03:02:30.266977 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=116156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 03:02:30.267065 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=116157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 03:02:30.267149 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=116156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 03:02:30.267243 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=116157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 03:02:30.267337 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=116156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 03:02:30.267419 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=116157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 03:02:30.267510 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=116156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 03:02:30.267598 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=116157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 03:02:30.267681 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=116156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 03:02:30.267774 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=116157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 03:02:30.267863 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=116156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 03:02:30.267944 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=116157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 03:02:30.268032 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=116156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 03:02:30.268123 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=116157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 03:02:30.268220 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=116156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 03:02:30.268310 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=116157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 03:02:30.268406 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=116156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 03:02:30.268495 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=116157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 03:02:30.268578 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=116156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 03:02:30.268578 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=116156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 03:02:30.268746 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=116157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 03:02:30.268834 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=116156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 03:02:30.268916 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=116157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 03:02:30.269005 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=116156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 03:02:30.269100 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=116157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 03:02:30.269196 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=116156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 03:02:30.269285 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=116157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 03:02:30.269368 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=116156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 03:02:30.269456 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=116157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 03:02:30.269596 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=116156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 03:02:30.269767 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=116157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 03:02:30.269925 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=116156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 03:02:30.270252 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=116157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 03:02:30.270447 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=116156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 03:02:30.270592 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=116157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 03:02:30.270742 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=116156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 03:02:30.270891 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=116157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 03:02:30.271044 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=116156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 03:02:30.271185 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=116157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 03:02:30.271330 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=116156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 03:02:30.271480 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=116157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 03:02:30.271627 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=116156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 03:02:30.271773 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=116157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 03:02:30.271919 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=116156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 03:02:30.272059 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=116157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 03:02:30.272204 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=116156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 03:02:30.272353 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=116157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 03:02:30.272494 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=116156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 03:02:30.272649 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=116157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 03:02:30.272795 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=116156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 03:02:30.272941 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=116157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 03:02:30.273090 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=116156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 03:02:30.273240 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=116157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 03:02:30.273379 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=116156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 03:02:30.273519 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=116157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 03:02:30.274020 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=116156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 03:02:30.274440 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=116157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 03:02:30.274607 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=116156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 03:02:30.274748 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=116157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 03:02:30.274888 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=116156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 03:02:30.275033 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=116157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 03:02:30.275188 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=116156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 03:02:30.275336 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=116157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 03:02:30.275497 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=116156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 03:02:30.275639 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=116157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 03:02:30.275786 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=116156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 03:02:30.275925 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=116157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 03:02:30.276074 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=116156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 03:02:30.276214 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=116157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 03:02:30.276360 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=116156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 03:02:30.276500 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=116157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 03:02:30.276647 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=116156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 03:02:30.276792 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=116157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 03:02:30.276938 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=116156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 03:02:30.277098 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=116157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 03:02:30.277246 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=116156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 03:02:30.277386 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=116157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 03:02:30.277531 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=116156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 03:02:30.277682 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=116157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 03:02:30.277834 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=116156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 03:02:30.278045 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=116157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 03:02:30.278205 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=116156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 03:02:30.278346 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=116157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 03:02:30.278484 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=116156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 03:02:30.278634 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=116157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 03:02:30.278774 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=116156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 03:02:30.278924 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=116157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 03:02:30.279077 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=116156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 03:02:30.279224 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=116157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 03:02:30.279369 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=116156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 03:02:30.279628 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=116157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 03:02:30.279800 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=116156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 03:02:30.279942 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=116157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 03:02:30.280090 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=116156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 03:02:30.280501 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=116157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 03:02:30.280655 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=116156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 03:02:30.280805 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=116157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 03:02:30.281592 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=116156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 03:02:30.281744 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=116157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 03:02:30.281907 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=116156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 03:02:30.282081 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=116157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 03:02:30.282224 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=116156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 03:02:30.282371 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=116157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 03:02:30.282518 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=116156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 03:02:30.282670 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=116157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 03:02:30.282820 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=116156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 03:02:30.282968 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=116157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 03:02:30.283114 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=116156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 03:02:30.283253 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=116157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 03:02:30.283399 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=116156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 03:02:30.283606 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=116157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 03:02:30.283774 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=116156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 03:02:30.284275 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=116157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 03:02:30.284630 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=116156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 03:02:30.284779 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=116157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 03:02:30.284919 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=116156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 03:02:30.285074 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=116157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 03:02:30.285222 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=116156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 03:02:30.285362 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=116157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 03:02:30.285500 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=116156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 03:02:30.285638 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=116157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 03:02:30.285777 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=116156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 03:02:30.285929 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=116157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 03:02:30.286116 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=116156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 03:02:30.286275 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=116157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 03:02:30.286421 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=116156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 03:02:30.286569 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=116157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 03:02:30.286716 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=116156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 03:02:30.286863 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=116157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 03:02:30.287003 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=116156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 03:02:30.287143 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=116157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 03:02:30.287283 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=116156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 03:02:30.287421 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=116157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 03:02:30.287573 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=116156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 03:02:30.287722 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=116157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 03:02:30.287861 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=116156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 03:02:30.288007 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=116157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 03:02:30.288166 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=116156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 03:02:30.288307 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=116157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 03:02:30.288454 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=116156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 03:02:30.288601 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=116157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 03:02:30.288747 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=116156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 03:02:30.288894 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=116157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 03:02:30.289041 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=116156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 03:02:30.289189 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=116157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 03:02:30.289337 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=116156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 03:02:30.289478 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=116157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 03:02:30.289616 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=116156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 03:02:30.289755 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=116157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 03:02:30.289755 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=116157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 03:02:30.290058 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=116156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 03:02:30.290213 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=116157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 03:02:30.290354 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=116156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 03:02:30.290499 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=116157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 03:02:30.290644 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=116156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 03:02:30.290790 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=116157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 03:02:30.290947 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=116156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 03:02:30.291087 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=116157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 03:02:30.291233 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=116156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 03:02:30.291373 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=116157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 03:02:30.291511 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=116156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 03:02:30.291650 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=116157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 03:02:30.291806 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=116156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 03:02:30.291953 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=116157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 03:02:30.292092 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=116156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 03:02:30.292238 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=116157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 03:02:30.292385 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=116156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 03:02:30.292531 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=116157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 03:02:30.292682 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=116156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 03:02:30.292823 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=116157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 03:02:30.292961 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=116156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 03:02:30.293099 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=116157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 03:02:30.293247 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=116156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 03:02:30.293400 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=116157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 03:02:30.293540 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=116156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 03:02:30.293688 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=116157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 03:02:30.293835 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=116156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 03:02:30.294213 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=116157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 03:02:30.294385 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=116156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 03:02:30.294761 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=116157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 03:02:30.294913 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=116156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 03:02:30.295054 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=116157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 03:02:30.295194 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=116156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 03:02:30.295333 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=116157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 03:02:30.295333 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=116157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 03:02:30.295652 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=116156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 03:02:30.295798 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=116157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 03:02:30.295936 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=116156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 03:02:30.296092 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=116157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 03:02:30.296239 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=116156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 03:02:30.296379 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=116157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 03:02:30.296531 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=116156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 03:02:30.296678 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=116157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 03:02:30.296823 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=116156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 03:02:30.296962 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=116157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 03:02:30.297151 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=116156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 03:02:30.297300 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=116157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 03:02:30.297446 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=116156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 03:02:30.297595 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=116157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 03:02:30.297734 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=116156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 03:02:30.297880 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=116157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 03:02:30.298047 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=116156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 03:02:30.298205 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=116157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 03:02:30.298353 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=116156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 03:02:30.298501 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=116157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 03:02:30.298648 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=116156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 03:02:30.298788 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=116157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 03:02:30.298926 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=116156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 03:02:30.299110 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=116157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 03:02:30.299253 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=116156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 03:02:30.299399 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=116157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 03:02:30.299538 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=116156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 03:02:30.299686 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=116157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 03:02:30.299826 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=116156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 03:02:30.299983 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=116157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 03:02:30.300130 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=116156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 03:02:30.300269 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=116157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 03:02:30.300408 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=116156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 03:02:30.300546 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=116157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 03:02:30.300693 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=116156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 03:02:30.300842 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=116157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 03:02:30.300988 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=116156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 03:02:30.301137 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=116157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 03:02:30.301301 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=116156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 03:02:30.302506 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=116157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 03:02:30.302723 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=116156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 03:02:30.302886 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=116157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 03:02:30.303037 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=116156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 03:02:30.303186 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=116157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 03:02:30.303326 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=116156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 03:02:30.303477 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=116157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 03:02:30.303626 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=116156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 03:02:30.303771 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=116157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 03:02:30.303912 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=116156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 03:02:30.304069 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=116157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 03:02:30.304308 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=116156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 03:02:30.304538 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=116157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 03:02:30.304902 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=116156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 03:02:30.305053 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=116157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 03:02:30.305212 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=116156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 03:02:30.305361 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=116157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 03:02:30.305500 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=116156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 03:02:30.305659 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=116157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 03:02:30.305800 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=116156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 03:02:30.305949 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=116157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 03:02:30.306130 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=116156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 03:02:30.306272 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=116157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 03:02:30.306410 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=116156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 03:02:30.306565 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=116157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 03:02:30.306565 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=116157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 03:02:30.306829 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=116156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 03:02:30.306974 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=116157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 03:02:30.307126 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=116156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 03:02:30.307274 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=116157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 03:02:30.307432 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=116156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 03:02:30.307573 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=116157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 03:02:30.307726 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=116156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 03:02:30.307726 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=116156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 03:02:30.308005 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=116157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 03:02:30.308153 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=116156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 03:02:30.308376 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=116157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 03:02:30.308535 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=116156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 03:02:30.308687 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=116157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 03:02:30.308835 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=116156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 03:02:30.308974 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=116157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 03:02:30.309131 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=116156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 03:02:30.309284 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=116157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 03:02:30.309432 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=116156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 03:02:30.309579 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=116157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 03:02:30.309732 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=116156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 03:02:30.309879 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=116157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 03:02:30.310090 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=116156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 03:02:30.310246 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=116157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 03:02:30.310394 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=116156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 03:02:30.310541 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=116157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 03:02:30.310687 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=116156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 03:02:30.310827 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=116157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 03:02:30.310990 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=116156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 03:02:30.311139 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=116157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 03:02:30.311280 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=116156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 03:02:30.311420 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=116157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 03:02:30.311566 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=116156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 03:02:30.311712 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=116157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 03:02:30.311712 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=116157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 03:02:30.311992 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=116156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 03:02:30.312131 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=116157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 03:02:30.312278 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=116156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 03:02:30.312424 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=116157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 03:02:30.312563 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=116156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 03:02:30.312711 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=116157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 03:02:30.312866 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=116156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 03:02:30.313006 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=116157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 03:02:30.313153 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=116156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 03:02:30.313300 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=116157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 03:02:30.313513 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=116156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 03:02:30.313655 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=116157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 03:02:30.313794 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=116156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 03:02:30.313940 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=116157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 03:02:30.314132 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=116156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 03:02:30.314132 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=116156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 03:02:30.314525 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=116157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 03:02:30.314740 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=116156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 03:02:30.315098 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=116157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 03:02:30.315262 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=116156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 03:02:30.315405 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=116157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 03:02:30.315543 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=116156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 03:02:30.315691 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=116157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 03:02:30.315838 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=116156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 03:02:30.315985 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=116157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 03:02:30.316124 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=116156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 03:02:30.316263 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=116157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 03:02:30.316263 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=116157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 03:02:30.316538 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=116156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 03:02:30.316678 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=116157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 03:02:30.316817 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=116156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 03:02:30.316963 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=116157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 03:02:30.317112 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=116156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 03:02:30.317261 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=116157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 03:02:30.317408 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=116156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 03:02:30.317555 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=116157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 03:02:30.317702 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=116156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 03:02:30.317842 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=116157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 03:02:30.318006 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=116156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 03:02:30.318168 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=116157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 03:02:30.318310 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=116156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 03:02:30.318449 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=116157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 03:02:30.318596 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=116156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 03:02:30.318736 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=116157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 03:02:30.318881 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=116156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 03:02:30.319039 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=116157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 03:02:30.319179 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=116156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 03:02:30.319318 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=116157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 03:02:30.319464 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=116156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 03:02:30.319613 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=116157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 03:02:30.319764 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=116156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 03:02:30.324257 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=116157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 03:02:30.325467 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=116156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 03:02:30.325642 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=116157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 03:02:30.325796 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=116156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 03:02:30.325944 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=116157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 03:02:30.326128 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=116156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 03:02:30.326286 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=116157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 03:02:30.326437 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=116156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 03:02:30.326593 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=116157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 03:02:30.326742 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=116156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 03:02:30.326883 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=116157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 03:02:30.327023 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=116156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 03:02:30.327170 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=116157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 03:02:30.327317 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=116156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 03:02:30.327470 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=116157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 03:02:30.327611 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=116156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 03:02:30.328267 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=116157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 03:02:30.328430 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=116156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 03:02:30.328584 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=116157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 03:02:30.328732 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=116156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 03:02:30.328891 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=116157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 03:02:30.329042 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=116156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 03:02:30.329183 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=116157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 03:02:30.329183 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=116157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 03:02:30.329456 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=116156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 03:02:30.329608 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=116157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 03:02:30.329761 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=116156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 03:02:30.329902 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=116157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 03:02:30.330064 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=116156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 03:02:30.330064 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=116156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 03:02:30.330352 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=116157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 03:02:30.330506 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=116156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 03:02:30.330646 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=116157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 03:02:30.330785 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=116156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 03:02:30.330924 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=116157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 03:02:30.331062 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=116156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 03:02:30.331208 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=116157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 03:02:30.331361 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=116156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 03:02:30.331508 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=116157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 03:02:30.331648 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=116156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 03:02:30.331794 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=116157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 03:02:30.331960 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=116156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 03:02:30.333213 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=116157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 03:02:30.333388 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=116156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 03:02:30.333540 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=116157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 03:02:30.333681 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=116156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 03:02:30.333830 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=116157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 03:02:30.333970 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=116156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 03:02:30.334239 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=116157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 03:02:30.334383 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=116156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 03:02:30.334530 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=116157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 03:02:30.334670 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=116156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 03:02:30.334818 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=116157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 03:02:30.335477 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=116156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 03:02:30.335641 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=116157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 03:02:30.335784 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=116156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 03:02:30.335937 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=116157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 03:02:30.336076 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=116156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 03:02:30.336215 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=116157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 03:02:30.336362 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=116156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 03:02:30.336678 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=116157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 03:02:30.336678 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=116157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 03:02:30.337003 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=116156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 03:02:30.337145 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=116157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 03:02:30.337310 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=116156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 03:02:30.337468 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=116157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 03:02:30.337565 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=116156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 03:02:30.337648 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=116157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 03:02:30.337736 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=116156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 03:02:30.337826 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=116157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 03:02:30.337909 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=116156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 03:02:30.338014 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=116157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 03:02:30.338111 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=116156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 03:02:30.338204 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=116157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 03:02:30.338295 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=116156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 03:02:30.338391 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=116157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 03:02:30.338475 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=116156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 03:02:30.338563 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=116157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 03:02:30.338659 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=116156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 03:02:30.338760 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=116157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 03:02:30.338856 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=116156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 03:02:30.338952 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=116157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 03:02:30.339042 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=116156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 03:02:30.339125 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=116157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 03:02:30.339206 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=116156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 03:02:30.339287 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=116157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 03:02:30.339376 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=116156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 03:02:30.339466 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=116157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 03:02:30.339556 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=116156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 03:02:30.339644 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=116157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 03:02:30.339726 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=116156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 03:02:30.339807 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=116157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 03:02:30.339902 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=116156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 03:02:30.339992 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=116157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 03:02:30.340074 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=116156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 03:02:30.340154 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=116157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 03:02:30.340235 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=116156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 03:02:30.340316 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=116157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 03:02:30.340405 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=116156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 03:02:30.340488 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=116157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 03:02:30.340488 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=116157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 03:02:30.340637 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=116156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 03:02:30.340718 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=116157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 03:02:30.340808 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=116156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 03:02:30.340890 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=116157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 03:02:30.340979 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=116156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 03:02:30.341061 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=116157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 03:02:30.341149 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=116156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 03:02:30.341231 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=116157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 03:02:30.341320 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=116156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 03:02:30.341402 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=116157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 03:02:30.341502 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=116156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 03:02:30.341589 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=116157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 03:02:30.341672 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=116156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 03:02:30.341763 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=116157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 03:02:30.341856 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=116156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 03:02:30.341946 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=116157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 03:02:30.342138 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=116156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 03:02:30.342241 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=116157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 03:02:30.342241 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=116157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 03:02:30.342408 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=116156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 03:02:30.342504 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=116157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 03:02:30.342588 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=116156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 03:02:30.342677 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=116157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 03:02:30.342760 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=116156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 03:02:30.342849 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=116157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 03:02:30.342937 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=116156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 03:02:30.343032 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=116157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 03:02:30.343122 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=116156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 03:02:30.343211 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=116157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 03:02:30.343294 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=116156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 03:02:30.343428 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=116157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 03:02:30.344077 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=116156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 03:02:30.344164 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=116157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 03:02:30.344164 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=116157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 03:02:30.344412 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=116156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 03:02:30.344538 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=116157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 03:02:30.344625 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=116156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 03:02:30.344764 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=116157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 03:02:30.344851 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=116156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 03:02:30.344934 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=116157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 03:02:30.345015 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=116156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 03:02:30.345174 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=116157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 03:02:30.345262 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=116156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 03:02:30.345356 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=116157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 03:02:30.345591 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=116156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 03:02:30.345690 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=116157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 03:02:30.345774 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=116156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 03:02:30.345863 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=116157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 03:02:30.345959 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=116156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 03:02:30.346105 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=116157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 03:02:30.346192 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=116156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 03:02:30.346275 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=116157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 03:02:30.346356 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=116156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 03:02:30.346437 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=116157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 03:02:30.346532 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=116156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 03:02:30.346623 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=116157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 03:02:30.346712 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=116156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 03:02:30.346795 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=116157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 03:02:30.346795 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=116157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 03:02:30.346944 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=116156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 03:02:30.347038 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=116157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 03:02:30.347131 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=116156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 03:02:30.347220 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=116157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 03:02:30.347303 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=116156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 03:02:30.347385 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=116157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 03:02:30.347465 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=116156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 03:02:30.347560 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=116157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 03:02:30.347649 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=116156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 03:02:30.347739 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=116157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 03:02:30.347821 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=116156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 03:02:30.347902 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=116157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 03:02:30.347990 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=116156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 03:02:30.348081 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=116157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 03:02:30.348170 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=116156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 03:02:30.348253 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=116157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 03:02:30.348341 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=116156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 03:02:30.348423 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=116157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 03:02:30.348517 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=116156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 03:02:30.348607 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=116157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 03:02:30.348698 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=116156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 03:02:30.348865 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=116157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 03:02:30.348966 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=116156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 03:02:30.349057 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=116157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 03:02:30.349141 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=116156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 03:02:30.349222 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=116157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 03:02:30.349303 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=116156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 03:02:30.349383 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=116157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 03:02:30.349474 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=116156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 03:02:30.349564 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=116157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 03:02:30.349646 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=116156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 03:02:30.349727 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=116157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 03:02:30.349815 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=116156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 03:02:30.349910 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=116157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 03:02:30.350041 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=116156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 03:02:30.350140 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=116157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 03:02:30.350336 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=116156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 03:02:30.350427 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=116157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 03:02:30.350646 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=116157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 03:02:30.350749 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=116156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 03:02:30.350956 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=116157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 03:02:30.351050 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=116156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 03:02:30.351284 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=116157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 03:02:30.351374 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=116156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 03:02:30.351599 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=116157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 03:02:30.351699 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=116156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 03:02:30.351907 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=116157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 03:02:30.351996 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=116156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 03:02:30.352219 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=116157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 03:02:30.352309 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=116156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 03:02:30.352525 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=116157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 03:02:30.352623 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=116156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 03:02:30.352872 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=116157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 03:02:30.352970 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=116156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 03:02:30.353180 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=116157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 03:02:30.353271 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=116156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 03:02:30.353490 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=116156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 03:02:30.353587 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=116157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 03:02:30.353802 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=116156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 03:02:30.353900 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=116157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 03:02:30.354150 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=116156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 03:02:30.354248 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=116157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 03:02:30.354470 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=116156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 03:02:30.354600 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=116157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 03:02:30.354783 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=116156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 03:02:30.354909 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=116157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 03:02:30.355100 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=116157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 03:02:30.355221 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=116156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 03:02:30.355420 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=116157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 03:02:30.355634 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=116156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 03:02:30.355776 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=116157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 03:02:30.355868 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=116156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 03:02:30.356037 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=116157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 03:02:30.356203 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=116156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 03:02:30.356360 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=116157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 03:02:30.356474 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=116156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 03:02:30.356679 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=116157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 03:02:30.356793 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=116156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 03:02:30.356988 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=116157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 03:02:30.357108 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=116156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 03:02:30.357296 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=116157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 03:02:30.357433 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=116156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 03:02:30.357623 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=116157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 03:02:30.357753 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=116156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 03:02:30.357941 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=116157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 03:02:30.358159 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=116156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 03:02:30.358266 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=116157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 03:02:30.358393 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=116156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 03:02:30.358595 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=116157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 03:02:30.358714 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=116156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 03:02:30.358924 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=116157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 03:02:30.359047 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=116156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 03:02:30.359275 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=116157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 03:02:30.359413 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=116156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 03:02:30.359582 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=116157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 03:02:30.359716 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=116156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 03:02:30.359897 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=116157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 03:02:30.360077 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=116156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 03:02:30.360195 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=116157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 03:02:30.360370 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=116156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 03:02:30.360498 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=116157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 03:02:30.360689 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=116156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 03:02:30.360827 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=116157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 03:02:30.360999 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=116156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 03:02:30.361153 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=116157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 03:02:30.361310 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=116156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 03:02:30.361509 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=116157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 03:02:30.361629 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=116156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 03:02:30.361752 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=116157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 03:02:30.361934 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=116156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 03:02:30.362076 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=116157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 03:02:30.362273 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=116156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 03:02:30.362392 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=116157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 03:02:30.362605 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=116156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 03:02:30.362737 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=116157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 03:02:30.362925 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=116156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 03:02:30.363044 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=116157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 03:02:30.363238 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=116156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 03:02:30.363357 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=116157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 03:02:30.363549 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=116157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 03:02:30.363674 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=116156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 03:02:30.363942 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=116157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 03:02:30.364094 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=116156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 03:02:30.364190 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=116157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 03:02:30.364485 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=116157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 03:02:30.364797 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=116157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 03:02:30.365113 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=116157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 03:02:30.365421 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=116157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 03:02:30.365568 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=116156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 03:02:30.365748 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=116157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 03:02:30.365897 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=116156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 03:02:30.366170 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=116156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 03:02:30.366522 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=116156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 03:02:30.366863 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=116156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 03:02:30.366954 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=116157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 03:02:30.367261 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=116156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 03:02:30.367424 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=116157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 03:02:30.367526 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=116156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 03:02:30.367765 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=116157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 03:02:30.367942 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=116156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 03:02:30.368099 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=116157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 03:02:30.368198 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=116156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 03:02:30.368422 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=116157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 03:02:30.368522 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=116156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 03:02:30.368753 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=116157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 03:02:30.368851 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=116156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 03:02:30.369083 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=116157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 03:02:30.369181 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=116156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 03:02:30.369416 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=116157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 03:02:30.369516 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=116156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 03:02:30.369745 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=116156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 03:02:30.369841 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=116157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 03:02:30.370085 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=116157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 03:02:30.370191 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=116156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 03:02:30.370404 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=116156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 03:02:30.370508 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=116157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 03:02:30.370740 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=116156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 03:02:30.370833 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=116157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 03:02:30.371064 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=116156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 03:02:30.371162 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=116157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 03:02:30.371382 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=116156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 03:02:30.371480 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=116157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 03:02:30.371702 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=116156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 03:02:30.371799 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=116157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 03:02:30.372017 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=116156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 03:02:30.372109 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=116157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 03:02:30.372348 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=116157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 03:02:30.372444 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=116156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 03:02:30.372677 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=116156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 03:02:30.372767 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=116157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 03:02:30.372988 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=116157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 03:02:30.373087 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=116156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 03:02:30.373302 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=116157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 03:02:30.373394 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=116156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 03:02:30.373614 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=116157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 03:02:30.373713 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=116156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 03:02:30.374237 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=116157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 03:02:30.374348 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=116156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 03:02:30.374553 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=116157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 03:02:30.374711 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=116156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 03:02:30.374972 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=116157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 03:02:30.375092 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=116156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 03:02:30.375246 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=116156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 03:02:30.375393 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=116157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 03:02:30.375565 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=116156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 03:02:30.375677 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=116157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 03:02:30.375891 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=116156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 03:02:30.375998 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=116157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 03:02:30.376218 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=116156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 03:02:30.376340 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=116157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 03:02:30.376541 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=116156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 03:02:30.376633 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=116157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 03:02:30.376857 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=116156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 03:02:30.376948 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=116157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 03:02:30.377169 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=116156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 03:02:30.377261 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=116157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 03:02:30.377501 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=116156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 03:02:30.377592 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=116157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 03:02:30.377823 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=116156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 03:02:30.377914 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=116157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 03:02:30.378172 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=116156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 03:02:30.378267 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=116157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 03:02:30.378506 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=116156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 03:02:30.378595 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=116157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 03:02:30.378824 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=116157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 03:02:30.378986 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=116156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 03:02:30.379156 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=116157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 03:02:30.379256 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=116156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 03:02:30.379467 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=116156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 03:02:30.379565 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=116157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 03:02:30.379785 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=116156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 03:02:30.379882 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=116157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 03:02:30.380103 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=116157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 03:02:30.380199 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=116156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 03:02:30.380415 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=116157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 03:02:30.380505 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=116156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 03:02:30.380732 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=116156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 03:02:30.380827 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=116157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 03:02:30.381050 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=116156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 03:02:30.381141 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=116157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 03:02:30.381508 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=116157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 03:02:30.381593 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=116156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 03:02:30.381676 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=116156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 03:02:30.381769 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=116157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 03:02:30.382003 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=116156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 03:02:30.382109 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=116157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 03:02:30.382326 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=116156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 03:02:30.382419 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=116157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 03:02:30.382647 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=116156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 03:02:30.382747 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=116157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 03:02:30.382961 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=116156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 03:02:30.383051 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=116157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 03:02:30.383281 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=116156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 03:02:30.383378 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=116157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 03:02:30.383600 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=116156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 03:02:30.383700 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=116157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 03:02:30.383914 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=116156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 03:02:30.384012 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=116157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 03:02:30.384251 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=116156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 03:02:30.384351 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=116157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 03:02:30.384562 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=116157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 03:02:30.384659 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=116156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 03:02:30.384874 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=116156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 03:02:30.385029 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=116157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 03:02:30.385212 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=116156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 03:02:30.385338 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=116157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 03:02:30.385503 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=116157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 03:02:30.385630 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=116156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 03:02:30.385821 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=116156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 03:02:30.385930 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=116157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 03:02:30.386163 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=116157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 03:02:30.386269 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=116156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 03:02:30.386483 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=116157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 03:02:30.386607 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=116156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 03:02:30.386795 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=116157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 03:02:30.386931 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=116156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 03:02:30.387134 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=116157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 03:02:30.387278 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=116156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 03:02:30.387448 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=116157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 03:02:30.387616 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=116156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 03:02:30.387766 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=116157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 03:02:30.387913 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=116156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 03:02:30.388058 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=116157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 03:02:30.388204 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=116156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 03:02:30.388342 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=116157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 03:02:30.388480 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=116156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 03:02:30.388669 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=116157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 03:02:30.388814 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=116156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 03:02:30.388960 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=116157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 03:02:30.389109 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=116156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 03:02:30.389252 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=116157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 03:02:30.389506 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=116156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 03:02:30.389654 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=116157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 03:02:30.389829 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=116156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 03:02:30.390077 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=116157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 03:02:30.390743 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=116156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 03:02:30.390882 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=116157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 03:02:30.391044 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=116156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 03:02:30.391194 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=116157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 03:02:30.391339 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=116157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 03:02:30.391481 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=116156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 03:02:30.391661 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=116156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 03:02:30.391805 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=116157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 03:02:30.391983 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=116156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 03:02:30.392130 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=116157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 03:02:30.392308 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=116157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 03:02:30.392528 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=116156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 03:02:30.392667 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=116156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 03:02:30.392809 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=116157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 03:02:30.392946 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=116156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 03:02:30.393085 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=116157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 03:02:30.393245 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=116156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 03:02:30.393383 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=116157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 03:02:30.393526 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=116156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 03:02:30.393664 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=116157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 03:02:30.393833 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=116156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 03:02:30.394202 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=116156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 03:02:30.394716 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=116156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 03:02:30.394962 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=116156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 03:02:30.395296 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=116156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 03:02:30.395876 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=116156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 03:02:30.396173 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=116156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 03:02:30.396552 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=116156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 03:02:30.396889 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=116156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 03:02:30.397489 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=116157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 03:02:30.397666 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=116156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 03:02:30.397666 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=116156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 03:02:30.397920 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=116156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 03:02:30.398274 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=116156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 03:02:30.398520 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=116157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 03:02:30.398612 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=116156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 03:02:30.398891 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=116157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 03:02:30.398980 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=116156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 03:02:30.399237 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=116156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 03:02:30.399335 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=116157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 03:02:30.399560 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=116156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 03:02:30.399650 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=116157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 03:02:30.399883 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=116156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 03:02:30.399974 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=116157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 03:02:30.400208 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=116156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 03:02:30.400355 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=116157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 03:02:30.400527 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=116156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 03:02:30.400656 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=116157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 03:02:30.400854 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=116157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 03:02:30.400978 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=116156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 03:02:30.401176 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=116156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 03:02:30.401293 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=116157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 03:02:30.401500 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=116157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 03:02:30.401624 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=116156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 03:02:30.401822 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=116157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 03:02:30.401913 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=116156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 03:02:30.402233 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=116157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 03:02:30.402326 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=116156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 03:02:30.402560 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=116157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 03:02:30.402652 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=116156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 03:02:30.402893 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=116156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 03:02:30.402996 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=116157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 03:02:30.403210 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=116157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 03:02:30.403300 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=116156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 03:02:30.403533 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=116156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 03:02:30.403622 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=116157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 03:02:30.403848 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=116156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 03:02:30.403948 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=116157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 03:02:30.404162 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=116157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 03:02:30.404254 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=116156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 03:02:30.404474 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=116156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 03:02:30.404564 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=116157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 03:02:30.404787 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=116157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 03:02:30.404884 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=116156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 03:02:30.405118 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=116156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 03:02:30.405207 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=116157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 03:02:30.405436 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=116156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 03:02:30.405564 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=116157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 03:02:30.405758 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=116156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 03:02:30.406526 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=116157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 03:02:30.406664 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=116156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 03:02:30.406778 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=116157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 03:02:30.406987 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=116156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 03:02:30.407143 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=116157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 03:02:30.407300 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=116156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 03:02:30.407402 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=116157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 03:02:30.407615 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=116156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 03:02:30.407715 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=116157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 03:02:30.407947 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=116156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 03:02:30.408045 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=116157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 03:02:30.408260 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=116156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 03:02:30.408364 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=116157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 03:02:30.408594 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=116157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 03:02:30.408705 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=116156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 03:02:30.408915 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=116156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 03:02:30.409027 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=116157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 03:02:30.409239 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=116157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 03:02:30.409347 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=116156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 03:02:30.409567 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=116156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 03:02:30.409673 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=116157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 03:02:30.409880 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=116156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 03:02:30.409999 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=116157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 03:02:30.410232 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=116157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 03:02:30.410342 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=116156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 03:02:30.410553 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=116157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 03:02:30.410655 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=116156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 03:02:30.410875 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=116156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 03:02:30.410965 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=116157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 03:02:30.411193 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=116156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 03:02:30.411293 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=116157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 03:02:30.411506 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=116156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 03:02:30.411597 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=116157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 03:02:30.411860 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=116156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 03:02:30.412074 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=116157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 03:02:30.412177 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=116156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 03:02:30.412416 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=116157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 03:02:30.412507 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=116156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 03:02:30.412741 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=116157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 03:02:30.412831 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=116156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 03:02:30.413065 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=116157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 03:02:30.413156 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=116156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 03:02:30.413388 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=116157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 03:02:30.413480 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=116156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 03:02:30.413712 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=116157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 03:02:30.413803 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=116156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 03:02:30.414058 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=116157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 03:02:30.414164 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=116156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 03:02:30.414383 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=116157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 03:02:30.414481 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=116156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 03:02:30.414703 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=116157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 03:02:30.414794 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=116156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 03:02:30.415027 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=116157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 03:02:30.415119 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=116156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 03:02:30.415348 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=116157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 03:02:30.415446 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=116156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 03:02:30.415670 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=116156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 03:02:30.415788 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=116157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 03:02:30.415988 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=116156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 03:02:30.416088 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=116157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 03:02:30.416300 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=116156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 03:02:30.416394 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=116157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 03:02:30.416611 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=116156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 03:02:30.416711 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=116157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 03:02:30.416927 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=116156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 03:02:30.417066 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=116157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 03:02:30.417246 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=116156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 03:02:30.417464 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=116157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 03:02:30.417613 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=116156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 03:02:30.417762 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=116157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 03:02:30.417899 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=116156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 03:02:30.418072 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=116157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 03:02:30.418208 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=116156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 03:02:30.418347 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=116157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 03:02:30.418497 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=116156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 03:02:30.418633 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=116157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 03:02:30.418800 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=116156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 03:02:30.418944 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=116157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 03:02:30.419105 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=116156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 03:02:30.419246 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=116157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 03:02:30.419423 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=116156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 03:02:30.419570 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=116157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 03:02:30.419734 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=116156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 03:02:30.419881 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=116157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 03:02:30.420049 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=116156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 03:02:30.420189 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=116157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 03:02:30.420359 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=116156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 03:02:30.420500 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=116157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 03:02:30.420711 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=116156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 03:02:30.420852 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=116157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 03:02:30.421024 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=116156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 03:02:30.421172 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=116157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 03:02:30.421366 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=116156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 03:02:30.421526 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=116157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 03:02:30.421727 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=116157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 03:02:30.421865 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=116156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 03:02:30.422073 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=116157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 03:02:30.422223 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=116156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 03:02:30.422400 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=116157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 03:02:30.422566 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=116156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 03:02:30.422835 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=116156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 03:02:30.422986 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=116157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 03:02:30.423126 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=116156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 03:02:30.423271 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=116157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 03:02:30.423417 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=116156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 03:02:30.423554 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=116157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 03:02:30.423715 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=116156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 03:02:30.423856 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=116157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 03:02:30.424002 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=116156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 03:02:30.424150 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=116157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 03:02:30.424286 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=116156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 03:02:30.424423 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=116157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 03:02:30.424584 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=116156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 03:02:30.424821 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=116157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 03:02:30.425040 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=116156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 03:02:30.425206 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=116157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 03:02:30.425347 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=116156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 03:02:30.425505 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=116157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 03:02:30.425752 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=116156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 03:02:30.426090 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=116157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 03:02:30.426254 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=116156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 03:02:30.426403 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=116157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 03:02:30.426552 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=116156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 03:02:30.426716 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=116157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 03:02:30.426928 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=116156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 03:02:30.427090 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=116157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 03:02:30.427413 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=116156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 03:02:30.427570 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=116157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 03:02:30.427714 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=116156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 03:02:30.427872 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=116157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 03:02:30.428030 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=116156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 03:02:30.428180 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=116157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 03:02:30.428321 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=116156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 03:02:30.428462 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=116157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 03:02:30.428609 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=116156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 03:02:30.428758 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=116157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 03:02:30.428758 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=116157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 03:02:30.429031 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=116156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 03:02:30.429031 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=116156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 03:02:30.429319 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=116157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 03:02:30.429459 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=116156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 03:02:30.429600 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=116157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 03:02:30.429600 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=116157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 03:02:30.429881 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=116156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 03:02:30.429881 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=116156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 03:02:30.430175 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=116157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 03:02:30.430281 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=116156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 03:02:30.430369 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=116157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 03:02:30.430462 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=116156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 03:02:30.430685 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=116157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 03:02:30.430787 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=116156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 03:02:30.431048 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=116157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 03:02:30.431140 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=116156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 03:02:30.431374 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=116157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 03:02:30.431475 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=116156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 03:02:30.431708 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=116157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 03:02:30.431807 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=116156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 03:02:30.432044 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=116157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 03:02:30.432144 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=116156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 03:02:30.432365 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=116156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 03:02:30.432513 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=116157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 03:02:30.432679 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=116157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 03:02:30.432769 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=116156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 03:02:30.433012 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=116157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 03:02:30.433104 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=116156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 03:02:30.433327 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=116157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 03:02:30.433418 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=116156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 03:02:30.433640 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=116157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 03:02:30.433731 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=116156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 03:02:30.433962 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=116156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 03:02:30.434157 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=116157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 03:02:30.434348 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=116157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 03:02:30.434443 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=116156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 03:02:30.434608 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=116157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 03:02:30.434712 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=116156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 03:02:30.434923 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=116157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 03:02:30.435016 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=116156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 03:02:30.435241 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=116156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 03:02:30.435333 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=116157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 03:02:30.435558 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=116157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 03:02:30.435648 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=116156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 03:02:30.435874 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=116157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 03:02:30.436011 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=116156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 03:02:30.436250 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=116156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 03:02:30.436351 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=116157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 03:02:30.436490 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=116157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 03:02:30.436581 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=116156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 03:02:30.436809 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=116156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 03:02:30.436932 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=116157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 03:02:30.437155 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=116157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 03:02:30.437250 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=116156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 03:02:30.437473 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=116157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 03:02:30.437578 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=116156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 03:02:30.437785 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=116157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 03:02:30.437894 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=116156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 03:02:30.438129 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=116157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 03:02:30.438225 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=116156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 03:02:30.438443 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=116157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 03:02:30.438557 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=116156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 03:02:30.438757 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=116157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 03:02:30.438862 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=116156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 03:02:30.439071 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=116157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 03:02:30.439166 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=116156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 03:02:30.439383 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=116157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 03:02:30.439603 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=116156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 03:02:30.439704 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=116157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 03:02:30.439928 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=116156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 03:02:30.440031 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=116157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 03:02:30.440272 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=116156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 03:02:30.440365 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=116157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 03:02:30.440600 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=116157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 03:02:30.440704 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=116156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 03:02:30.440922 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=116157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 03:02:30.441023 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=116156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 03:02:30.441237 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=116157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 03:02:30.441336 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=116156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 03:02:30.441556 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=116157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 03:02:30.441664 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=116156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 03:02:30.441866 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=116157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 03:02:30.441958 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=116156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 03:02:30.442218 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=116156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 03:02:30.442322 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=116157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 03:02:30.442526 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=116157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 03:02:30.442625 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=116156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 03:02:30.442838 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=116157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 03:02:30.442929 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=116156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 03:02:30.443156 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=116156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 03:02:30.443260 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=116157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 03:02:30.443471 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=116156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 03:02:30.443564 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=116157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 03:02:30.443801 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=116157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 03:02:30.443906 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=116156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 03:02:30.444119 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=116156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 03:02:30.444209 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=116157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 03:02:30.444434 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=116156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 03:02:30.444527 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=116157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 03:02:30.444769 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=116156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 03:02:30.444860 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=116157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 03:02:30.445089 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=116156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 03:02:30.445179 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=116157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 03:02:30.445628 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=116157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 03:02:30.445727 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=116156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 03:02:30.446002 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=116156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 03:02:30.446105 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=116157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 03:02:30.446334 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=116156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 03:02:30.446445 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=116157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 03:02:30.446670 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=116156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 03:02:30.446773 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=116157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 03:02:30.447005 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=116156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 03:02:30.447145 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=116157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 03:02:30.447331 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=116156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 03:02:30.447433 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=116157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 03:02:30.447650 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=116156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 03:02:30.447754 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=116157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 03:02:30.447968 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=116157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 03:02:30.448066 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=116156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 03:02:30.448282 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=116156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 03:02:30.448387 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=116157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 03:02:30.448596 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=116156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 03:02:30.448696 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=116157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 03:02:30.448914 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=116157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 03:02:30.449016 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=116156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 03:02:30.449230 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=116156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 03:02:30.449333 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=116157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 03:02:30.449546 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=116156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 03:02:30.449638 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=116157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 03:02:30.449860 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=116156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 03:02:30.449952 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=116157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 03:02:30.450204 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=116157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 03:02:30.450298 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=116156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 03:02:30.450522 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=116156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 03:02:30.450618 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=116157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 03:02:30.450836 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=116156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 03:02:30.450930 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=116157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 03:02:30.451151 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=116157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 03:02:30.451250 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=116156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 03:02:30.451462 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=116156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 03:02:30.451559 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=116157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 03:02:30.451800 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=116156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 03:02:30.451898 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=116157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 03:02:30.452116 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=116156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 03:02:30.452215 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=116157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 03:02:30.452432 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=116156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 03:02:30.452523 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=116157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 03:02:30.453261 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=116156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 03:02:30.453375 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=116157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 03:02:30.453587 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=116156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 03:02:30.453680 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=116157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 03:02:30.453901 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=116156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 03:02:30.454015 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=116157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 03:02:30.454240 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=116156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 03:02:30.454343 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=116157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 03:02:30.454561 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=116156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 03:02:30.454682 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=116157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 03:02:30.454885 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=116156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 03:02:30.454982 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=116157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 03:02:30.455205 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=116157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 03:02:30.455326 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=116156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 03:02:30.455515 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=116156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 03:02:30.455615 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=116157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 03:02:30.455834 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=116156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 03:02:30.455928 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=116157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 03:02:30.456148 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=116156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 03:02:30.456264 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=116157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 03:02:30.456473 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=116156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 03:02:30.456585 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=116157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 03:02:30.456786 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=116156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 03:02:30.456888 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=116157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 03:02:30.457125 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=116156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 03:02:30.457216 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=116157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 03:02:30.457422 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=116156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 03:02:30.457522 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=116157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 03:02:30.457755 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=116156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 03:02:30.457926 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=116157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 03:02:30.458127 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=116156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 03:02:30.458225 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=116157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 03:02:30.458397 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=116156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 03:02:30.458557 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=116157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 03:02:30.458717 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=116156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 03:02:30.458859 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=116157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 03:02:30.459029 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=116156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 03:02:30.459172 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=116157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 03:02:30.459363 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=116156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 03:02:30.459501 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=116157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 03:02:30.459684 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=116156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 03:02:30.459827 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=116157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 03:02:30.460004 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=116156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 03:02:30.460168 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=116157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 03:02:30.460358 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=116156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 03:02:30.460495 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=116157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 03:02:30.460684 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=116156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 03:02:30.460833 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=116157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 03:02:30.461019 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=116157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 03:02:30.461226 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=116156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 03:02:30.461368 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=116157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 03:02:30.461622 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=116156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 03:02:30.461770 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=116157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 03:02:30.461938 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=116157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 03:02:30.462065 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=116156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 03:02:30.462304 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=116157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 03:02:30.462408 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=116156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 03:02:30.462644 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=116157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 03:02:30.462736 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=116156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 03:02:30.462966 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=116157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 03:02:30.463060 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=116156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 03:02:30.463300 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=116157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 03:02:30.463401 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=116156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 03:02:30.463621 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=116157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 03:02:30.463723 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=116156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 03:02:30.463952 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=116156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 03:02:30.464047 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=116157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 03:02:30.464267 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=116157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 03:02:30.464365 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=116156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 03:02:30.464588 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=116156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 03:02:30.464691 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=116157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 03:02:30.464908 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=116156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 03:02:30.465001 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=116157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 03:02:30.465227 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=116157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 03:02:30.465323 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=116156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 03:02:30.465544 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=116157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 03:02:30.465730 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=116156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 03:02:30.465861 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=116156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 03:02:30.465960 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=116157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 03:02:30.466210 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=116156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 03:02:30.466322 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=116157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 03:02:30.466535 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=116156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 03:02:30.466648 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=116157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 03:02:30.466850 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=116157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 03:02:30.466950 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=116156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 03:02:30.467168 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=116157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 03:02:30.467260 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=116156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 03:02:30.467487 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=116157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 03:02:30.467587 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=116156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 03:02:30.467817 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=116157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 03:02:30.467929 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=116156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 03:02:30.468129 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=116157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 03:02:30.468221 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=116156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 03:02:30.469008 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=116156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 03:02:30.469127 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=116157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 03:02:30.469339 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=116156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 03:02:30.469438 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=116157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 03:02:30.469661 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=116156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 03:02:30.469753 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=116157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 03:02:30.470026 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=116156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 03:02:30.470135 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=116157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 03:02:30.470318 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=116156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 03:02:30.470422 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=116157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 03:02:30.470637 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=116156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 03:02:30.470746 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=116157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 03:02:30.470952 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=116157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 03:02:30.471043 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=116156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 03:02:30.471288 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=116157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 03:02:30.471380 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=116156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 03:02:30.471608 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=116157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 03:02:30.471715 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=116156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 03:02:30.471922 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=116156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 03:02:30.472032 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=116157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 03:02:30.472237 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=116157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 03:02:30.472353 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=116156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 03:02:30.472555 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=116157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 03:02:30.472682 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=116156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 03:02:30.472876 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=116157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 03:02:30.473011 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=116156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 03:02:30.473197 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=116157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 03:02:30.473341 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=116156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 03:02:30.473530 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=116157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 03:02:30.473664 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=116156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 03:02:30.473861 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=116157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 03:02:30.474016 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=116156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 03:02:30.474231 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=116157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 03:02:30.474334 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=116156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 03:02:30.474566 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=116157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 03:02:30.474675 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=116156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 03:02:30.474915 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=116157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 03:02:30.475025 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=116156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 03:02:30.475236 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=116157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 03:02:30.475346 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=116156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 03:02:30.475586 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=116157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 03:02:30.475687 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=116156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 03:02:30.475923 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=116157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 03:02:30.476025 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=116156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 03:02:30.476240 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=116157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 03:02:30.476336 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=116156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 03:02:30.476555 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=116157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 03:02:30.476656 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=116156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 03:02:30.476868 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=116157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 03:02:30.476976 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=116156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 03:02:30.477119 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=116157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Dec 15 03:02:30.477220 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=116156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 03:02:30.477473 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=116156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 03:02:30.477792 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=116156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 03:02:30.478164 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=116156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 03:02:30.478503 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=116156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 03:02:30.478824 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=116156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 03:02:30.479156 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=116156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 03:02:30.479476 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=116156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 03:02:30.479806 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=116156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 03:02:30.480126 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=116156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 03:02:30.480454 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=116156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 03:02:30.480783 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=116156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 03:02:30.481103 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=116156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 03:02:30.481421 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=116156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 03:02:30.481761 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=116156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 03:02:30.482103 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=116156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 03:02:30.482422 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=116156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 03:02:30.482741 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=116156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 03:02:30.483060 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=116156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 03:02:30.483377 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=116156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 03:02:30.483696 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=116156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 03:02:30.484077 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=116156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 03:02:30.484414 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=116156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 03:02:30.484735 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=116156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 03:02:30.485068 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=116156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 03:02:30.485393 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=116156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 03:02:30.485721 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=116156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 03:02:30.486066 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=116156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 03:02:30.486390 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=116156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 03:02:30.486726 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=116156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 03:02:30.487046 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=116156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 03:02:30.487368 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=116156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 03:02:30.487686 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=116156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 03:02:30.488002 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=116156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 03:02:30.488329 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=116156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 03:02:30.488648 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=116156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 03:02:30.488982 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=116156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 03:02:30.489315 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=116156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 03:02:30.489677 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=116156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 03:02:30.490028 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=116156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 03:02:30.490386 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=116156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 03:02:30.490709 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=116156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 03:02:30.491061 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=116156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 03:02:30.491397 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=116156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 03:02:30.491718 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=116156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 03:02:30.492039 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=116156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 03:02:30.492351 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=116156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 03:02:30.492600 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=116156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Dec 15 03:02:30.500120 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_db.sqlalchemy.engines [None req-9846d16e-3441-493d-aa45-42902bad958b None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=116157) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Dec 15 03:02:30.514940 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_db.sqlalchemy.engines [None req-c4637ab6-3ab1-447b-99ee-4bc1ba7b3ac8 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=116156) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Dec 15 03:02:30.566624 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.context [None req-9846d16e-3441-493d-aa45-42902bad958b None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),d853eee3-69a6-4e08-9a63-827acdfc7836(cell1) {{(pid=116157) load_cells /opt/stack/nova/nova/context.py:464}} Dec 15 03:02:30.570935 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-9846d16e-3441-493d-aa45-42902bad958b None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:02:30.572544 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-9846d16e-3441-493d-aa45-42902bad958b None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:02:30.573392 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-9846d16e-3441-493d-aa45-42902bad958b None None] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:02:30.575373 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-9846d16e-3441-493d-aa45-42902bad958b None None] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:02:30.581808 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.context [None req-c4637ab6-3ab1-447b-99ee-4bc1ba7b3ac8 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),d853eee3-69a6-4e08-9a63-827acdfc7836(cell1) {{(pid=116156) load_cells /opt/stack/nova/nova/context.py:464}} Dec 15 03:02:30.586269 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-c4637ab6-3ab1-447b-99ee-4bc1ba7b3ac8 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:02:30.587928 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-c4637ab6-3ab1-447b-99ee-4bc1ba7b3ac8 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:02:30.588826 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-c4637ab6-3ab1-447b-99ee-4bc1ba7b3ac8 None None] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:02:30.589621 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_db.sqlalchemy.engines [None req-9846d16e-3441-493d-aa45-42902bad958b None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=116157) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Dec 15 03:02:30.590498 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_db.sqlalchemy.engines [None req-9846d16e-3441-493d-aa45-42902bad958b None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=116157) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Dec 15 03:02:30.590921 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-c4637ab6-3ab1-447b-99ee-4bc1ba7b3ac8 None None] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:02:30.605030 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_db.sqlalchemy.engines [None req-c4637ab6-3ab1-447b-99ee-4bc1ba7b3ac8 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=116156) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Dec 15 03:02:30.605917 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_db.sqlalchemy.engines [None req-c4637ab6-3ab1-447b-99ee-4bc1ba7b3ac8 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=116156) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Dec 15 03:02:30.752023 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_db.sqlalchemy.engines [None req-9846d16e-3441-493d-aa45-42902bad958b None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=116157) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Dec 15 03:02:30.769827 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_db.sqlalchemy.engines [None req-c4637ab6-3ab1-447b-99ee-4bc1ba7b3ac8 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=116156) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Dec 15 03:02:31.080396 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: WARNING keystonemiddleware.auth_token [None req-9846d16e-3441-493d-aa45-42902bad958b None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Dec 15 03:02:31.088205 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: WARNING keystonemiddleware.auth_token [None req-9846d16e-3441-493d-aa45-42902bad958b None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Dec 15 03:02:31.094139 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: WARNING keystonemiddleware.auth_token [None req-c4637ab6-3ab1-447b-99ee-4bc1ba7b3ac8 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Dec 15 03:02:31.100892 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: WARNING keystonemiddleware.auth_token [None req-c4637ab6-3ab1-447b-99ee-4bc1ba7b3ac8 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Dec 15 03:02:31.434491 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: WARNING keystonemiddleware.auth_token [None req-9846d16e-3441-493d-aa45-42902bad958b None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Dec 15 03:02:31.439646 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: WARNING keystonemiddleware.auth_token [None req-9846d16e-3441-493d-aa45-42902bad958b None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Dec 15 03:02:31.443111 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: WARNING keystonemiddleware.auth_token [None req-c4637ab6-3ab1-447b-99ee-4bc1ba7b3ac8 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Dec 15 03:02:31.445165 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55ab7cac09c0 pid: 116157 (default app) Dec 15 03:02:31.448711 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: WARNING keystonemiddleware.auth_token [None req-c4637ab6-3ab1-447b-99ee-4bc1ba7b3ac8 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Dec 15 03:02:31.454043 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55ab7cac09c0 pid: 116156 (default app) Dec 15 03:03:06.047742 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi [None req-15325709-acb9-4b11-baab-b39768791224 tempest-VolumesTestJSON-1581840401 tempest-VolumesTestJSON-1581840401-project] Calling method '.version_select at 0x7f126b8ecb80>' {{(pid=116156) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:03:06.141409 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi [None req-7d9eadef-dc07-4b44-950c-dffcf042c8f5 tempest-VolumesGetTestJSON-2116174478 tempest-VolumesGetTestJSON-2116174478-project] Action: 'create', calling method: .version_select at 0x7f126b8a0e50>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-1881550181", "metadata": {"Type": "work"}}} {{(pid=116157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 03:03:07.234915 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: INFO nova.api.openstack.requestlog [None req-15325709-acb9-4b11-baab-b39768791224 tempest-VolumesTestJSON-1581840401 tempest-VolumesTestJSON-1581840401-project] 10.222.0.18 "GET /compute/v2.1/os-volumes/5965592d-0f96-4fc4-a9b7-e1c3a11c74b0" status: 200 len: 351 microversion: 2.1 time: 1.666157 Dec 15 03:03:07.237181 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: [pid: 116156|app: 0|req: 1/1] 10.222.0.18 () {58 vars in 1244 bytes} [Wed Dec 15 03:03:05 2021] GET /compute/v2.1/os-volumes/5965592d-0f96-4fc4-a9b7-e1c3a11c74b0 => generated 351 bytes in 1670 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 03:03:07.290205 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: INFO nova.api.openstack.requestlog [None req-7d9eadef-dc07-4b44-950c-dffcf042c8f5 tempest-VolumesGetTestJSON-2116174478 tempest-VolumesGetTestJSON-2116174478-project] 10.222.0.18 "POST /compute/v2.1/os-volumes" status: 200 len: 353 microversion: 2.1 time: 2.586040 Dec 15 03:03:07.298147 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: [pid: 116157|app: 0|req: 1/2] 10.222.0.18 () {60 vars in 1155 bytes} [Wed Dec 15 03:03:04 2021] POST /compute/v2.1/os-volumes => generated 353 bytes in 2589 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Dec 15 03:03:07.347895 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi [None req-63e89894-a8be-44c2-8444-9e87c7597b26 tempest-DeleteServersTestJSON-268050555 tempest-DeleteServersTestJSON-268050555-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-1441057600", "imageRef": "5195b034-9fa4-468b-a94d-ef3ee79ce449", "flavorRef": "452", "networks": [{"uuid": "b1ac7a19-9609-4a04-b0a2-4b6f60b19158"}]}} {{(pid=116156) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 03:03:07.520554 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.network.neutron [None req-63e89894-a8be-44c2-8444-9e87c7597b26 tempest-DeleteServersTestJSON-268050555 tempest-DeleteServersTestJSON-268050555-project] validate_networks() for [('b1ac7a19-9609-4a04-b0a2-4b6f60b19158', None, None, None, None, None)] {{(pid=116156) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Dec 15 03:03:07.614404 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi [None req-b82f0972-cda2-4f6f-ab54-7756d6cc9836 tempest-AttachVolumeNegativeTest-1640336653 tempest-AttachVolumeNegativeTest-1640336653-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1554245760", "imageRef": "5195b034-9fa4-468b-a94d-ef3ee79ce449", "flavorRef": "452", "networks": [{"uuid": "b0713a87-683c-42de-a9a0-98522d8ec589"}]}} {{(pid=116157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 03:03:07.801168 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.network.neutron [None req-b82f0972-cda2-4f6f-ab54-7756d6cc9836 tempest-AttachVolumeNegativeTest-1640336653 tempest-AttachVolumeNegativeTest-1640336653-project] validate_networks() for [('b0713a87-683c-42de-a9a0-98522d8ec589', None, None, None, None, None)] {{(pid=116157) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Dec 15 03:03:08.449689 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.virt.hardware [None req-63e89894-a8be-44c2-8444-9e87c7597b26 tempest-DeleteServersTestJSON-268050555 tempest-DeleteServersTestJSON-268050555-project] Flavor limits 0:0:0 {{(pid=116156) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Dec 15 03:03:08.450240 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.virt.hardware [None req-63e89894-a8be-44c2-8444-9e87c7597b26 tempest-DeleteServersTestJSON-268050555 tempest-DeleteServersTestJSON-268050555-project] Image limits 0:0:0 {{(pid=116156) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Dec 15 03:03:08.450711 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.virt.hardware [None req-63e89894-a8be-44c2-8444-9e87c7597b26 tempest-DeleteServersTestJSON-268050555 tempest-DeleteServersTestJSON-268050555-project] Flavor pref 0:0:0 {{(pid=116156) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Dec 15 03:03:08.451124 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.virt.hardware [None req-63e89894-a8be-44c2-8444-9e87c7597b26 tempest-DeleteServersTestJSON-268050555 tempest-DeleteServersTestJSON-268050555-project] Image pref 0:0:0 {{(pid=116156) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Dec 15 03:03:08.451604 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.virt.hardware [None req-63e89894-a8be-44c2-8444-9e87c7597b26 tempest-DeleteServersTestJSON-268050555 tempest-DeleteServersTestJSON-268050555-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116156) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Dec 15 03:03:08.469526 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-63e89894-a8be-44c2-8444-9e87c7597b26 tempest-DeleteServersTestJSON-268050555 tempest-DeleteServersTestJSON-268050555-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:03:08.470618 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-63e89894-a8be-44c2-8444-9e87c7597b26 tempest-DeleteServersTestJSON-268050555 tempest-DeleteServersTestJSON-268050555-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:03:08.472047 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-63e89894-a8be-44c2-8444-9e87c7597b26 tempest-DeleteServersTestJSON-268050555 tempest-DeleteServersTestJSON-268050555-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:03:08.473681 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-63e89894-a8be-44c2-8444-9e87c7597b26 tempest-DeleteServersTestJSON-268050555 tempest-DeleteServersTestJSON-268050555-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:03:08.522023 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.quota [None req-63e89894-a8be-44c2-8444-9e87c7597b26 tempest-DeleteServersTestJSON-268050555 tempest-DeleteServersTestJSON-268050555-project] Getting quotas for project bb933fa80ed94ce5b6828e48e86a21c7. Resources: {'cores', 'instances', 'ram'} {{(pid=116156) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 15 03:03:08.531311 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.quota [None req-63e89894-a8be-44c2-8444-9e87c7597b26 tempest-DeleteServersTestJSON-268050555 tempest-DeleteServersTestJSON-268050555-project] Getting quotas for user 28384f466c3541358ecea856650f008c and project bb933fa80ed94ce5b6828e48e86a21c7. Resources: {'cores', 'instances', 'ram'} {{(pid=116156) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 15 03:03:08.555055 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.compute.api [None req-63e89894-a8be-44c2-8444-9e87c7597b26 tempest-DeleteServersTestJSON-268050555 tempest-DeleteServersTestJSON-268050555-project] Going to run 1 instances... {{(pid=116156) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Dec 15 03:03:08.558281 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.compute.api [None req-63e89894-a8be-44c2-8444-9e87c7597b26 tempest-DeleteServersTestJSON-268050555 tempest-DeleteServersTestJSON-268050555-project] [instance: 5a01bf2d-c341-4af1-b2b2-e1f05e46705f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='5195b034-9fa4-468b-a94d-ef3ee79ce449',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=116156) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Dec 15 03:03:08.757909 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: INFO nova.api.openstack.requestlog [None req-63e89894-a8be-44c2-8444-9e87c7597b26 tempest-DeleteServersTestJSON-268050555 tempest-DeleteServersTestJSON-268050555-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.519504 Dec 15 03:03:08.765828 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: [pid: 116156|app: 0|req: 2/3] 10.222.0.18 () {60 vars in 1146 bytes} [Wed Dec 15 03:03:07 2021] POST /compute/v2.1/servers => generated 380 bytes in 1528 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Dec 15 03:03:08.781213 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi [None req-b5eabb9b-d2d5-46d9-9207-07322d0e15ea tempest-VolumesGetTestJSON-2116174478 tempest-VolumesGetTestJSON-2116174478-project] Calling method '.version_select at 0x7f126b67b820>' {{(pid=116156) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:03:08.965793 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: INFO nova.api.openstack.requestlog [None req-b5eabb9b-d2d5-46d9-9207-07322d0e15ea tempest-VolumesGetTestJSON-2116174478 tempest-VolumesGetTestJSON-2116174478-project] 10.222.0.18 "GET /compute/v2.1/os-volumes/2039cc45-a3e9-445b-b913-162010037ad5" status: 200 len: 354 microversion: 2.1 time: 0.198259 Dec 15 03:03:08.966566 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: [pid: 116156|app: 0|req: 3/4] 10.222.0.18 () {58 vars in 1244 bytes} [Wed Dec 15 03:03:08 2021] GET /compute/v2.1/os-volumes/2039cc45-a3e9-445b-b913-162010037ad5 => generated 354 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 03:03:08.972039 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi [None req-fd976cbb-c981-4b3b-8b33-e4378a87a29c tempest-DeleteServersTestJSON-268050555 tempest-DeleteServersTestJSON-268050555-project] Calling method '>' {{(pid=116156) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:03:08.973049 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.compute.api [None req-fd976cbb-c981-4b3b-8b33-e4378a87a29c tempest-DeleteServersTestJSON-268050555 tempest-DeleteServersTestJSON-268050555-project] [instance: 5a01bf2d-c341-4af1-b2b2-e1f05e46705f] Fetching instance by UUID {{(pid=116156) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:03:08.995755 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.virt.hardware [None req-b82f0972-cda2-4f6f-ab54-7756d6cc9836 tempest-AttachVolumeNegativeTest-1640336653 tempest-AttachVolumeNegativeTest-1640336653-project] Flavor limits 0:0:0 {{(pid=116157) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Dec 15 03:03:08.996815 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.virt.hardware [None req-b82f0972-cda2-4f6f-ab54-7756d6cc9836 tempest-AttachVolumeNegativeTest-1640336653 tempest-AttachVolumeNegativeTest-1640336653-project] Image limits 0:0:0 {{(pid=116157) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Dec 15 03:03:08.997474 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.virt.hardware [None req-b82f0972-cda2-4f6f-ab54-7756d6cc9836 tempest-AttachVolumeNegativeTest-1640336653 tempest-AttachVolumeNegativeTest-1640336653-project] Flavor pref 0:0:0 {{(pid=116157) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Dec 15 03:03:08.998447 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.virt.hardware [None req-b82f0972-cda2-4f6f-ab54-7756d6cc9836 tempest-AttachVolumeNegativeTest-1640336653 tempest-AttachVolumeNegativeTest-1640336653-project] Image pref 0:0:0 {{(pid=116157) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Dec 15 03:03:08.999066 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.virt.hardware [None req-b82f0972-cda2-4f6f-ab54-7756d6cc9836 tempest-AttachVolumeNegativeTest-1640336653 tempest-AttachVolumeNegativeTest-1640336653-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116157) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Dec 15 03:03:09.036529 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-b82f0972-cda2-4f6f-ab54-7756d6cc9836 tempest-AttachVolumeNegativeTest-1640336653 tempest-AttachVolumeNegativeTest-1640336653-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:03:09.036980 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-b82f0972-cda2-4f6f-ab54-7756d6cc9836 tempest-AttachVolumeNegativeTest-1640336653 tempest-AttachVolumeNegativeTest-1640336653-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:03:09.043504 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-b82f0972-cda2-4f6f-ab54-7756d6cc9836 tempest-AttachVolumeNegativeTest-1640336653 tempest-AttachVolumeNegativeTest-1640336653-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:03:09.044532 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-b82f0972-cda2-4f6f-ab54-7756d6cc9836 tempest-AttachVolumeNegativeTest-1640336653 tempest-AttachVolumeNegativeTest-1640336653-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:03:09.136206 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.quota [None req-b82f0972-cda2-4f6f-ab54-7756d6cc9836 tempest-AttachVolumeNegativeTest-1640336653 tempest-AttachVolumeNegativeTest-1640336653-project] Getting quotas for project 409b41637da94c469444954258444b4b. Resources: {'cores', 'instances', 'ram'} {{(pid=116157) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 15 03:03:09.157378 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.quota [None req-b82f0972-cda2-4f6f-ab54-7756d6cc9836 tempest-AttachVolumeNegativeTest-1640336653 tempest-AttachVolumeNegativeTest-1640336653-project] Getting quotas for user 35d37a3d8e504b8186182468b77dd114 and project 409b41637da94c469444954258444b4b. Resources: {'cores', 'instances', 'ram'} {{(pid=116157) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 15 03:03:09.187989 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.compute.api [None req-b82f0972-cda2-4f6f-ab54-7756d6cc9836 tempest-AttachVolumeNegativeTest-1640336653 tempest-AttachVolumeNegativeTest-1640336653-project] Going to run 1 instances... {{(pid=116157) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Dec 15 03:03:09.196145 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.policy [None req-fd976cbb-c981-4b3b-8b33-e4378a87a29c tempest-DeleteServersTestJSON-268050555 tempest-DeleteServersTestJSON-268050555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28384f466c3541358ecea856650f008c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb933fa80ed94ce5b6828e48e86a21c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116156) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:03:09.196329 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.compute.api [None req-b82f0972-cda2-4f6f-ab54-7756d6cc9836 tempest-AttachVolumeNegativeTest-1640336653 tempest-AttachVolumeNegativeTest-1640336653-project] [instance: 4923355f-95d6-443d-9487-574f56b87f66] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='5195b034-9fa4-468b-a94d-ef3ee79ce449',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=116157) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Dec 15 03:03:09.227469 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: INFO nova.api.openstack.requestlog [None req-fd976cbb-c981-4b3b-8b33-e4378a87a29c tempest-DeleteServersTestJSON-268050555 tempest-DeleteServersTestJSON-268050555-project] 10.222.0.18 "GET /compute/v2.1/servers/5a01bf2d-c341-4af1-b2b2-e1f05e46705f" status: 200 len: 1215 microversion: 2.1 time: 0.257502 Dec 15 03:03:09.242774 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: [pid: 116156|app: 0|req: 4/5] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 03:03:08 2021] GET /compute/v2.1/servers/5a01bf2d-c341-4af1-b2b2-e1f05e46705f => generated 1215 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 03:03:09.248979 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi [None req-93129cd4-e1d8-4bc7-8527-f6d9944eaf79 tempest-VolumesTestJSON-1581840401 tempest-VolumesTestJSON-1581840401-project] Calling method '.version_select at 0x7f126ae22ca0>' {{(pid=116156) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:03:09.399980 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: INFO nova.api.openstack.requestlog [None req-93129cd4-e1d8-4bc7-8527-f6d9944eaf79 tempest-VolumesTestJSON-1581840401 tempest-VolumesTestJSON-1581840401-project] 10.222.0.18 "GET /compute/v2.1/os-volumes/f66b68e7-7939-418a-8158-0b19716202db" status: 200 len: 351 microversion: 2.1 time: 0.164218 Dec 15 03:03:09.400561 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: [pid: 116156|app: 0|req: 5/6] 10.222.0.18 () {58 vars in 1244 bytes} [Wed Dec 15 03:03:09 2021] GET /compute/v2.1/os-volumes/f66b68e7-7939-418a-8158-0b19716202db => generated 351 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 03:03:09.405084 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi [None req-a95d1fcc-61cd-4af2-80a0-e3fb4607b31a tempest-VolumesGetTestJSON-2116174478 tempest-VolumesGetTestJSON-2116174478-project] Calling method '.version_select at 0x7f126b700160>' {{(pid=116156) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:03:09.469426 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: INFO nova.api.openstack.requestlog [None req-b82f0972-cda2-4f6f-ab54-7756d6cc9836 tempest-AttachVolumeNegativeTest-1640336653 tempest-AttachVolumeNegativeTest-1640336653-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.176485 Dec 15 03:03:09.472186 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: [pid: 116157|app: 0|req: 2/7] 10.222.0.18 () {60 vars in 1146 bytes} [Wed Dec 15 03:03:07 2021] POST /compute/v2.1/servers => generated 380 bytes in 2180 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Dec 15 03:03:09.485999 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi [None req-62401d67-ea7f-450d-b29e-4562bab7c672 tempest-AttachVolumeNegativeTest-1640336653 tempest-AttachVolumeNegativeTest-1640336653-project] Calling method '>' {{(pid=116157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:03:09.499283 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.compute.api [None req-62401d67-ea7f-450d-b29e-4562bab7c672 tempest-AttachVolumeNegativeTest-1640336653 tempest-AttachVolumeNegativeTest-1640336653-project] [instance: 4923355f-95d6-443d-9487-574f56b87f66] Fetching instance by UUID {{(pid=116157) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:03:09.890867 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: INFO nova.api.openstack.requestlog [None req-a95d1fcc-61cd-4af2-80a0-e3fb4607b31a tempest-VolumesGetTestJSON-2116174478 tempest-VolumesGetTestJSON-2116174478-project] 10.222.0.18 "GET /compute/v2.1/os-volumes/2039cc45-a3e9-445b-b913-162010037ad5" status: 200 len: 354 microversion: 2.1 time: 0.489267 Dec 15 03:03:09.891783 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: [pid: 116156|app: 0|req: 6/8] 10.222.0.18 () {58 vars in 1244 bytes} [Wed Dec 15 03:03:09 2021] GET /compute/v2.1/os-volumes/2039cc45-a3e9-445b-b913-162010037ad5 => generated 354 bytes in 490 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 03:03:09.911548 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi [None req-767292ee-7f08-4661-a5ff-bd2a7bcede33 tempest-VolumesGetTestJSON-2116174478 tempest-VolumesGetTestJSON-2116174478-project] Calling method '.version_select at 0x7f126ae2ef70>' {{(pid=116156) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:03:09.993683 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.policy [None req-62401d67-ea7f-450d-b29e-4562bab7c672 tempest-AttachVolumeNegativeTest-1640336653 tempest-AttachVolumeNegativeTest-1640336653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35d37a3d8e504b8186182468b77dd114', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '409b41637da94c469444954258444b4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116157) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:03:10.036951 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: INFO nova.api.openstack.requestlog [None req-62401d67-ea7f-450d-b29e-4562bab7c672 tempest-AttachVolumeNegativeTest-1640336653 tempest-AttachVolumeNegativeTest-1640336653-project] 10.222.0.18 "GET /compute/v2.1/servers/4923355f-95d6-443d-9487-574f56b87f66" status: 200 len: 1218 microversion: 2.1 time: 0.555255 Dec 15 03:03:10.048539 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: [pid: 116157|app: 0|req: 3/9] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 03:03:09 2021] GET /compute/v2.1/servers/4923355f-95d6-443d-9487-574f56b87f66 => generated 1218 bytes in 568 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 03:03:10.254569 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi [None req-8230bf67-7281-4366-9bf9-13e8baacca41 tempest-DeleteServersTestJSON-268050555 tempest-DeleteServersTestJSON-268050555-project] Calling method '>' {{(pid=116157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:03:10.255484 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.compute.api [None req-8230bf67-7281-4366-9bf9-13e8baacca41 tempest-DeleteServersTestJSON-268050555 tempest-DeleteServersTestJSON-268050555-project] [instance: 5a01bf2d-c341-4af1-b2b2-e1f05e46705f] Fetching instance by UUID {{(pid=116157) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:03:10.346220 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: INFO nova.api.openstack.requestlog [None req-767292ee-7f08-4661-a5ff-bd2a7bcede33 tempest-VolumesGetTestJSON-2116174478 tempest-VolumesGetTestJSON-2116174478-project] 10.222.0.18 "DELETE /compute/v2.1/os-volumes/2039cc45-a3e9-445b-b913-162010037ad5" status: 202 len: 0 microversion: 2.1 time: 0.438023 Dec 15 03:03:10.351250 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: [pid: 116156|app: 0|req: 7/10] 10.222.0.18 () {58 vars in 1247 bytes} [Wed Dec 15 03:03:09 2021] DELETE /compute/v2.1/os-volumes/2039cc45-a3e9-445b-b913-162010037ad5 => generated 0 bytes in 446 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Dec 15 03:03:10.357082 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi [None req-f5bdc420-4bd8-4d45-a901-fa16d2f6b1e9 tempest-VolumesGetTestJSON-2116174478 tempest-VolumesGetTestJSON-2116174478-project] Calling method '.version_select at 0x7f126ae22b80>' {{(pid=116156) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:03:10.379153 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.policy [None req-8230bf67-7281-4366-9bf9-13e8baacca41 tempest-DeleteServersTestJSON-268050555 tempest-DeleteServersTestJSON-268050555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28384f466c3541358ecea856650f008c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb933fa80ed94ce5b6828e48e86a21c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116157) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:03:10.394267 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: INFO nova.api.openstack.requestlog [None req-8230bf67-7281-4366-9bf9-13e8baacca41 tempest-DeleteServersTestJSON-268050555 tempest-DeleteServersTestJSON-268050555-project] 10.222.0.18 "GET /compute/v2.1/servers/5a01bf2d-c341-4af1-b2b2-e1f05e46705f" status: 200 len: 1215 microversion: 2.1 time: 0.146454 Dec 15 03:03:10.395741 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: [pid: 116157|app: 0|req: 4/11] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 03:03:10 2021] GET /compute/v2.1/servers/5a01bf2d-c341-4af1-b2b2-e1f05e46705f => generated 1215 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 03:03:10.557785 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: INFO nova.api.openstack.requestlog [None req-f5bdc420-4bd8-4d45-a901-fa16d2f6b1e9 tempest-VolumesGetTestJSON-2116174478 tempest-VolumesGetTestJSON-2116174478-project] 10.222.0.18 "GET /compute/v2.1/os-volumes/2039cc45-a3e9-445b-b913-162010037ad5" status: 200 len: 353 microversion: 2.1 time: 0.205227 Dec 15 03:03:10.562140 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: [pid: 116156|app: 0|req: 8/12] 10.222.0.18 () {58 vars in 1244 bytes} [Wed Dec 15 03:03:10 2021] GET /compute/v2.1/os-volumes/2039cc45-a3e9-445b-b913-162010037ad5 => generated 353 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 03:03:11.067037 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi [None req-c79ec627-09f8-417c-b5ce-78b1950261a5 tempest-AttachVolumeNegativeTest-1640336653 tempest-AttachVolumeNegativeTest-1640336653-project] Calling method '>' {{(pid=116157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:03:11.069371 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.compute.api [None req-c79ec627-09f8-417c-b5ce-78b1950261a5 tempest-AttachVolumeNegativeTest-1640336653 tempest-AttachVolumeNegativeTest-1640336653-project] [instance: 4923355f-95d6-443d-9487-574f56b87f66] Fetching instance by UUID {{(pid=116157) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:03:11.080589 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-c79ec627-09f8-417c-b5ce-78b1950261a5 tempest-AttachVolumeNegativeTest-1640336653 tempest-AttachVolumeNegativeTest-1640336653-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:03:11.082489 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-c79ec627-09f8-417c-b5ce-78b1950261a5 tempest-AttachVolumeNegativeTest-1640336653 tempest-AttachVolumeNegativeTest-1640336653-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:03:11.084708 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-c79ec627-09f8-417c-b5ce-78b1950261a5 tempest-AttachVolumeNegativeTest-1640336653 tempest-AttachVolumeNegativeTest-1640336653-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:03:11.087827 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-c79ec627-09f8-417c-b5ce-78b1950261a5 tempest-AttachVolumeNegativeTest-1640336653 tempest-AttachVolumeNegativeTest-1640336653-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:03:11.413687 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi [None req-e5d0173f-2b73-470e-afd3-0f621f6bc45e tempest-DeleteServersTestJSON-268050555 tempest-DeleteServersTestJSON-268050555-project] Calling method '>' {{(pid=116156) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:03:11.415544 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.compute.api [None req-e5d0173f-2b73-470e-afd3-0f621f6bc45e tempest-DeleteServersTestJSON-268050555 tempest-DeleteServersTestJSON-268050555-project] [instance: 5a01bf2d-c341-4af1-b2b2-e1f05e46705f] Fetching instance by UUID {{(pid=116156) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:03:11.429876 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-e5d0173f-2b73-470e-afd3-0f621f6bc45e tempest-DeleteServersTestJSON-268050555 tempest-DeleteServersTestJSON-268050555-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:03:11.430386 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-e5d0173f-2b73-470e-afd3-0f621f6bc45e tempest-DeleteServersTestJSON-268050555 tempest-DeleteServersTestJSON-268050555-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:03:11.431194 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-e5d0173f-2b73-470e-afd3-0f621f6bc45e tempest-DeleteServersTestJSON-268050555 tempest-DeleteServersTestJSON-268050555-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:03:11.431633 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-e5d0173f-2b73-470e-afd3-0f621f6bc45e tempest-DeleteServersTestJSON-268050555 tempest-DeleteServersTestJSON-268050555-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:03:11.629923 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.policy [None req-c79ec627-09f8-417c-b5ce-78b1950261a5 tempest-AttachVolumeNegativeTest-1640336653 tempest-AttachVolumeNegativeTest-1640336653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35d37a3d8e504b8186182468b77dd114', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '409b41637da94c469444954258444b4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116157) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:03:11.645888 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: INFO nova.api.openstack.requestlog [None req-c79ec627-09f8-417c-b5ce-78b1950261a5 tempest-AttachVolumeNegativeTest-1640336653 tempest-AttachVolumeNegativeTest-1640336653-project] 10.222.0.18 "GET /compute/v2.1/servers/4923355f-95d6-443d-9487-574f56b87f66" status: 200 len: 1222 microversion: 2.1 time: 0.590374 Dec 15 03:03:11.646491 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: [pid: 116157|app: 0|req: 5/13] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 03:03:11 2021] GET /compute/v2.1/servers/4923355f-95d6-443d-9487-574f56b87f66 => generated 1222 bytes in 596 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 03:03:11.659581 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.policy [None req-e5d0173f-2b73-470e-afd3-0f621f6bc45e tempest-DeleteServersTestJSON-268050555 tempest-DeleteServersTestJSON-268050555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28384f466c3541358ecea856650f008c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb933fa80ed94ce5b6828e48e86a21c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116156) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:03:11.676414 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi [None req-e693a9c6-8a52-4f0f-84eb-97605e89c74e tempest-VolumesGetTestJSON-2116174478 tempest-VolumesGetTestJSON-2116174478-project] Calling method '.version_select at 0x7f126a5c28b0>' {{(pid=116157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:03:11.680061 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: INFO nova.api.openstack.requestlog [None req-e5d0173f-2b73-470e-afd3-0f621f6bc45e tempest-DeleteServersTestJSON-268050555 tempest-DeleteServersTestJSON-268050555-project] 10.222.0.18 "GET /compute/v2.1/servers/5a01bf2d-c341-4af1-b2b2-e1f05e46705f" status: 200 len: 1211 microversion: 2.1 time: 0.266357 Dec 15 03:03:11.681548 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: [pid: 116156|app: 0|req: 9/14] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 03:03:11 2021] GET /compute/v2.1/servers/5a01bf2d-c341-4af1-b2b2-e1f05e46705f => generated 1211 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 03:03:11.686730 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi [None req-676c10a2-fb0d-41e8-a704-707dfefe804c tempest-VolumesTestJSON-1581840401 tempest-VolumesTestJSON-1581840401-project] Calling method '.version_select at 0x7f126a5bfaf0>' {{(pid=116156) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:03:12.021925 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: INFO nova.api.openstack.wsgi [None req-e693a9c6-8a52-4f0f-84eb-97605e89c74e tempest-VolumesGetTestJSON-2116174478 tempest-VolumesGetTestJSON-2116174478-project] HTTP exception thrown: Volume 2039cc45-a3e9-445b-b913-162010037ad5 could not be found. Dec 15 03:03:12.022664 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi [None req-e693a9c6-8a52-4f0f-84eb-97605e89c74e tempest-VolumesGetTestJSON-2116174478 tempest-VolumesGetTestJSON-2116174478-project] Returning 404 to user: Volume 2039cc45-a3e9-445b-b913-162010037ad5 could not be found. {{(pid=116157) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 15 03:03:12.023659 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: INFO nova.api.openstack.requestlog [None req-e693a9c6-8a52-4f0f-84eb-97605e89c74e tempest-VolumesGetTestJSON-2116174478 tempest-VolumesGetTestJSON-2116174478-project] 10.222.0.18 "GET /compute/v2.1/os-volumes/2039cc45-a3e9-445b-b913-162010037ad5" status: 404 len: 109 microversion: 2.1 time: 0.363923 Dec 15 03:03:12.027357 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: [pid: 116157|app: 0|req: 6/15] 10.222.0.18 () {58 vars in 1244 bytes} [Wed Dec 15 03:03:11 2021] GET /compute/v2.1/os-volumes/2039cc45-a3e9-445b-b913-162010037ad5 => generated 109 bytes in 377 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 15 03:03:12.082430 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: INFO nova.api.openstack.requestlog [None req-676c10a2-fb0d-41e8-a704-707dfefe804c tempest-VolumesTestJSON-1581840401 tempest-VolumesTestJSON-1581840401-project] 10.222.0.18 "GET /compute/v2.1/os-volumes/8b5b8b0b-8086-4a1e-89a0-78ea542088ec" status: 200 len: 350 microversion: 2.1 time: 0.398449 Dec 15 03:03:12.083052 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: [pid: 116156|app: 0|req: 10/16] 10.222.0.18 () {58 vars in 1244 bytes} [Wed Dec 15 03:03:11 2021] GET /compute/v2.1/os-volumes/8b5b8b0b-8086-4a1e-89a0-78ea542088ec => generated 350 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 03:03:12.099971 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi [None req-6bce6f14-32af-426a-bba7-24fcf7bcc468 tempest-VolumesTestJSON-1581840401 tempest-VolumesTestJSON-1581840401-project] Calling method '.version_select at 0x7f126a560550>' {{(pid=116156) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:03:12.285962 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: INFO nova.api.openstack.requestlog [None req-6bce6f14-32af-426a-bba7-24fcf7bcc468 tempest-VolumesTestJSON-1581840401 tempest-VolumesTestJSON-1581840401-project] 10.222.0.18 "GET /compute/v2.1/os-volumes" status: 200 len: 1035 microversion: 2.1 time: 0.190697 Dec 15 03:03:12.294870 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: [pid: 116156|app: 0|req: 11/17] 10.222.0.18 () {58 vars in 1133 bytes} [Wed Dec 15 03:03:12 2021] GET /compute/v2.1/os-volumes => generated 1035 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 03:03:12.301430 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi [None req-7733a5ff-9341-46b5-91e9-22f22743905b tempest-VolumesTestJSON-1581840401 tempest-VolumesTestJSON-1581840401-project] Calling method '.version_select at 0x7f126b715820>' {{(pid=116156) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:03:12.403310 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: INFO nova.api.openstack.requestlog [None req-7733a5ff-9341-46b5-91e9-22f22743905b tempest-VolumesTestJSON-1581840401 tempest-VolumesTestJSON-1581840401-project] 10.222.0.18 "GET /compute/v2.1/os-volumes?limit=2" status: 200 len: 694 microversion: 2.1 time: 0.106735 Dec 15 03:03:12.403882 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: [pid: 116156|app: 0|req: 12/18] 10.222.0.18 () {58 vars in 1148 bytes} [Wed Dec 15 03:03:12 2021] GET /compute/v2.1/os-volumes?limit=2 => generated 694 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 03:03:12.416257 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi [None req-30609dc4-1abc-4fe4-976d-eab8b8973de0 tempest-VolumesTestJSON-1581840401 tempest-VolumesTestJSON-1581840401-project] Calling method '.version_select at 0x7f126a560ca0>' {{(pid=116156) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:03:12.509308 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: INFO nova.api.openstack.requestlog [None req-30609dc4-1abc-4fe4-976d-eab8b8973de0 tempest-VolumesTestJSON-1581840401 tempest-VolumesTestJSON-1581840401-project] 10.222.0.18 "GET /compute/v2.1/os-volumes" status: 200 len: 1035 microversion: 2.1 time: 0.096687 Dec 15 03:03:12.509901 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: [pid: 116156|app: 0|req: 13/19] 10.222.0.18 () {58 vars in 1133 bytes} [Wed Dec 15 03:03:12 2021] GET /compute/v2.1/os-volumes => generated 1035 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 03:03:12.521008 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi [None req-2040317c-8e10-4e3e-a557-7f0a15b84e44 tempest-VolumesTestJSON-1581840401 tempest-VolumesTestJSON-1581840401-project] Calling method '.version_select at 0x7f126a570ee0>' {{(pid=116156) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:03:12.607360 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: INFO nova.api.openstack.requestlog [None req-2040317c-8e10-4e3e-a557-7f0a15b84e44 tempest-VolumesTestJSON-1581840401 tempest-VolumesTestJSON-1581840401-project] 10.222.0.18 "GET /compute/v2.1/os-volumes?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.089675 Dec 15 03:03:12.608475 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: [pid: 116156|app: 0|req: 14/20] 10.222.0.18 () {58 vars in 1166 bytes} [Wed Dec 15 03:03:12 2021] GET /compute/v2.1/os-volumes?offset=1&limit=1 => generated 354 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 03:03:12.626116 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi [None req-efa73457-2413-48a3-819e-c7476e392f5c tempest-ServerRescueNegativeTestJSON-2061875223 tempest-ServerRescueNegativeTestJSON-2061875223-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-401187303", "imageRef": "5195b034-9fa4-468b-a94d-ef3ee79ce449", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "e9340f0a-7b46-48b4-b2b0-b0c599dc80c3"}]}} {{(pid=116157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 03:03:12.629285 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi [None req-07105da8-5efe-455f-b78d-7d2641b991d1 tempest-VolumesTestJSON-1581840401 tempest-VolumesTestJSON-1581840401-project] Calling method '.version_select at 0x7f126a570310>' {{(pid=116156) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:03:12.708225 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.network.neutron [None req-efa73457-2413-48a3-819e-c7476e392f5c tempest-ServerRescueNegativeTestJSON-2061875223 tempest-ServerRescueNegativeTestJSON-2061875223-project] validate_networks() for [('e9340f0a-7b46-48b4-b2b0-b0c599dc80c3', None, None, None, None, None)] {{(pid=116157) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Dec 15 03:03:12.770290 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: INFO nova.api.openstack.requestlog [None req-07105da8-5efe-455f-b78d-7d2641b991d1 tempest-VolumesTestJSON-1581840401 tempest-VolumesTestJSON-1581840401-project] 10.222.0.18 "GET /compute/v2.1/os-volumes/detail?limit=2" status: 200 len: 694 microversion: 2.1 time: 0.152705 Dec 15 03:03:12.778553 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: [pid: 116156|app: 0|req: 15/21] 10.222.0.18 () {58 vars in 1169 bytes} [Wed Dec 15 03:03:12 2021] GET /compute/v2.1/os-volumes/detail?limit=2 => generated 694 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 03:03:12.783787 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi [None req-8979fb79-5b8c-4d58-a356-bffcba0cc856 tempest-AttachVolumeNegativeTest-1640336653 tempest-AttachVolumeNegativeTest-1640336653-project] Calling method '>' {{(pid=116156) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:03:12.784411 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.compute.api [None req-8979fb79-5b8c-4d58-a356-bffcba0cc856 tempest-AttachVolumeNegativeTest-1640336653 tempest-AttachVolumeNegativeTest-1640336653-project] [instance: 4923355f-95d6-443d-9487-574f56b87f66] Fetching instance by UUID {{(pid=116156) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:03:12.797116 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-8979fb79-5b8c-4d58-a356-bffcba0cc856 tempest-AttachVolumeNegativeTest-1640336653 tempest-AttachVolumeNegativeTest-1640336653-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:03:12.800135 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-8979fb79-5b8c-4d58-a356-bffcba0cc856 tempest-AttachVolumeNegativeTest-1640336653 tempest-AttachVolumeNegativeTest-1640336653-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:03:12.801205 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-8979fb79-5b8c-4d58-a356-bffcba0cc856 tempest-AttachVolumeNegativeTest-1640336653 tempest-AttachVolumeNegativeTest-1640336653-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:03:12.801657 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-8979fb79-5b8c-4d58-a356-bffcba0cc856 tempest-AttachVolumeNegativeTest-1640336653 tempest-AttachVolumeNegativeTest-1640336653-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:03:12.909148 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.policy [None req-8979fb79-5b8c-4d58-a356-bffcba0cc856 tempest-AttachVolumeNegativeTest-1640336653 tempest-AttachVolumeNegativeTest-1640336653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35d37a3d8e504b8186182468b77dd114', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '409b41637da94c469444954258444b4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116156) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:03:12.921308 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: INFO nova.api.openstack.requestlog [None req-8979fb79-5b8c-4d58-a356-bffcba0cc856 tempest-AttachVolumeNegativeTest-1640336653 tempest-AttachVolumeNegativeTest-1640336653-project] 10.222.0.18 "GET /compute/v2.1/servers/4923355f-95d6-443d-9487-574f56b87f66" status: 200 len: 1270 microversion: 2.1 time: 0.140285 Dec 15 03:03:12.922553 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: [pid: 116156|app: 0|req: 16/22] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 03:03:12 2021] GET /compute/v2.1/servers/4923355f-95d6-443d-9487-574f56b87f66 => generated 1270 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 03:03:12.932922 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi [None req-e2ea05ca-9fad-40d9-a3df-8051eb3e3ff8 tempest-DeleteServersTestJSON-268050555 tempest-DeleteServersTestJSON-268050555-project] Calling method '>' {{(pid=116156) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:03:12.934286 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.compute.api [None req-e2ea05ca-9fad-40d9-a3df-8051eb3e3ff8 tempest-DeleteServersTestJSON-268050555 tempest-DeleteServersTestJSON-268050555-project] [instance: 5a01bf2d-c341-4af1-b2b2-e1f05e46705f] Fetching instance by UUID {{(pid=116156) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:03:12.943603 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-e2ea05ca-9fad-40d9-a3df-8051eb3e3ff8 tempest-DeleteServersTestJSON-268050555 tempest-DeleteServersTestJSON-268050555-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:03:12.947363 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-e2ea05ca-9fad-40d9-a3df-8051eb3e3ff8 tempest-DeleteServersTestJSON-268050555 tempest-DeleteServersTestJSON-268050555-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:03:12.949270 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-e2ea05ca-9fad-40d9-a3df-8051eb3e3ff8 tempest-DeleteServersTestJSON-268050555 tempest-DeleteServersTestJSON-268050555-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:03:12.950593 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-e2ea05ca-9fad-40d9-a3df-8051eb3e3ff8 tempest-DeleteServersTestJSON-268050555 tempest-DeleteServersTestJSON-268050555-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:03:13.061347 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.policy [None req-e2ea05ca-9fad-40d9-a3df-8051eb3e3ff8 tempest-DeleteServersTestJSON-268050555 tempest-DeleteServersTestJSON-268050555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28384f466c3541358ecea856650f008c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb933fa80ed94ce5b6828e48e86a21c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116156) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:03:13.071028 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: INFO nova.api.openstack.requestlog [None req-e2ea05ca-9fad-40d9-a3df-8051eb3e3ff8 tempest-DeleteServersTestJSON-268050555 tempest-DeleteServersTestJSON-268050555-project] 10.222.0.18 "GET /compute/v2.1/servers/5a01bf2d-c341-4af1-b2b2-e1f05e46705f" status: 200 len: 1273 microversion: 2.1 time: 0.144167 Dec 15 03:03:13.074307 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: [pid: 116156|app: 0|req: 17/23] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 03:03:12 2021] GET /compute/v2.1/servers/5a01bf2d-c341-4af1-b2b2-e1f05e46705f => generated 1273 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 03:03:13.088673 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi [None req-3e8f1c6d-1f55-4a1c-b9df-23061257c54c tempest-VolumesTestJSON-1581840401 tempest-VolumesTestJSON-1581840401-project] Calling method '.version_select at 0x7f126a558ee0>' {{(pid=116156) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:03:13.257438 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: INFO nova.api.openstack.requestlog [None req-3e8f1c6d-1f55-4a1c-b9df-23061257c54c tempest-VolumesTestJSON-1581840401 tempest-VolumesTestJSON-1581840401-project] 10.222.0.18 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1035 microversion: 2.1 time: 0.181785 Dec 15 03:03:13.258710 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: [pid: 116156|app: 0|req: 18/24] 10.222.0.18 () {58 vars in 1154 bytes} [Wed Dec 15 03:03:13 2021] GET /compute/v2.1/os-volumes/detail => generated 1035 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 03:03:13.269932 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi [None req-fc28bcc4-489e-4997-8f61-6cf22b7d4dc0 tempest-VolumesTestJSON-1581840401 tempest-VolumesTestJSON-1581840401-project] Calling method '.version_select at 0x7f126a518820>' {{(pid=116156) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:03:13.384826 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: INFO nova.api.openstack.requestlog [None req-fc28bcc4-489e-4997-8f61-6cf22b7d4dc0 tempest-VolumesTestJSON-1581840401 tempest-VolumesTestJSON-1581840401-project] 10.222.0.18 "GET /compute/v2.1/os-volumes/detail?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.118617 Dec 15 03:03:13.385867 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: [pid: 116156|app: 0|req: 19/25] 10.222.0.18 () {58 vars in 1187 bytes} [Wed Dec 15 03:03:13 2021] GET /compute/v2.1/os-volumes/detail?offset=1&limit=1 => generated 354 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 15 03:03:13.399880 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi [None req-c2eaa59f-f203-4e22-b176-d02b24a4b021 tempest-VolumesTestJSON-1581840401 tempest-VolumesTestJSON-1581840401-project] Calling method '.version_select at 0x7f126a520a60>' {{(pid=116156) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:03:13.400376 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.virt.hardware [None req-efa73457-2413-48a3-819e-c7476e392f5c tempest-ServerRescueNegativeTestJSON-2061875223 tempest-ServerRescueNegativeTestJSON-2061875223-project] Flavor limits 0:0:0 {{(pid=116157) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Dec 15 03:03:13.401915 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.virt.hardware [None req-efa73457-2413-48a3-819e-c7476e392f5c tempest-ServerRescueNegativeTestJSON-2061875223 tempest-ServerRescueNegativeTestJSON-2061875223-project] Image limits 0:0:0 {{(pid=116157) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Dec 15 03:03:13.402479 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.virt.hardware [None req-efa73457-2413-48a3-819e-c7476e392f5c tempest-ServerRescueNegativeTestJSON-2061875223 tempest-ServerRescueNegativeTestJSON-2061875223-project] Flavor pref 0:0:0 {{(pid=116157) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Dec 15 03:03:13.402895 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.virt.hardware [None req-efa73457-2413-48a3-819e-c7476e392f5c tempest-ServerRescueNegativeTestJSON-2061875223 tempest-ServerRescueNegativeTestJSON-2061875223-project] Image pref 0:0:0 {{(pid=116157) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Dec 15 03:03:13.403314 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.virt.hardware [None req-efa73457-2413-48a3-819e-c7476e392f5c tempest-ServerRescueNegativeTestJSON-2061875223 tempest-ServerRescueNegativeTestJSON-2061875223-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116157) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Dec 15 03:03:13.416335 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-efa73457-2413-48a3-819e-c7476e392f5c tempest-ServerRescueNegativeTestJSON-2061875223 tempest-ServerRescueNegativeTestJSON-2061875223-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:03:13.417053 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-efa73457-2413-48a3-819e-c7476e392f5c tempest-ServerRescueNegativeTestJSON-2061875223 tempest-ServerRescueNegativeTestJSON-2061875223-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:03:13.418084 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-efa73457-2413-48a3-819e-c7476e392f5c tempest-ServerRescueNegativeTestJSON-2061875223 tempest-ServerRescueNegativeTestJSON-2061875223-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:03:13.418720 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-efa73457-2413-48a3-819e-c7476e392f5c tempest-ServerRescueNegativeTestJSON-2061875223 tempest-ServerRescueNegativeTestJSON-2061875223-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:03:13.439003 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.quota [None req-efa73457-2413-48a3-819e-c7476e392f5c tempest-ServerRescueNegativeTestJSON-2061875223 tempest-ServerRescueNegativeTestJSON-2061875223-project] Getting quotas for project f5e8a958d4bf43868502b13728b9583b. Resources: {'cores', 'instances', 'ram'} {{(pid=116157) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 15 03:03:13.443952 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.quota [None req-efa73457-2413-48a3-819e-c7476e392f5c tempest-ServerRescueNegativeTestJSON-2061875223 tempest-ServerRescueNegativeTestJSON-2061875223-project] Getting quotas for user 6ea02b6e8f1548a1bd78952cb7337403 and project f5e8a958d4bf43868502b13728b9583b. Resources: {'cores', 'instances', 'ram'} {{(pid=116157) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 15 03:03:13.456105 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.compute.api [None req-efa73457-2413-48a3-819e-c7476e392f5c tempest-ServerRescueNegativeTestJSON-2061875223 tempest-ServerRescueNegativeTestJSON-2061875223-project] Going to run 1 instances... {{(pid=116157) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Dec 15 03:03:13.459022 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.compute.api [None req-efa73457-2413-48a3-819e-c7476e392f5c tempest-ServerRescueNegativeTestJSON-2061875223 tempest-ServerRescueNegativeTestJSON-2061875223-project] [instance: 9bbb0abf-72a3-4fbc-8235-7a3ecfc8d006] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='5195b034-9fa4-468b-a94d-ef3ee79ce449',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=116157) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Dec 15 03:03:13.525147 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: INFO nova.api.openstack.requestlog [None req-efa73457-2413-48a3-819e-c7476e392f5c tempest-ServerRescueNegativeTestJSON-2061875223 tempest-ServerRescueNegativeTestJSON-2061875223-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 1.434319 Dec 15 03:03:13.527061 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: [pid: 116157|app: 0|req: 7/26] 10.222.0.18 () {60 vars in 1146 bytes} [Wed Dec 15 03:03:12 2021] POST /compute/v2.1/servers => generated 383 bytes in 1437 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Dec 15 03:03:13.538283 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi [None req-7e348bdf-9f52-4807-a22e-5ef80e98405a tempest-ServerRescueNegativeTestJSON-2061875223 tempest-ServerRescueNegativeTestJSON-2061875223-project] Calling method '>' {{(pid=116157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:03:13.539207 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.compute.api [None req-7e348bdf-9f52-4807-a22e-5ef80e98405a tempest-ServerRescueNegativeTestJSON-2061875223 tempest-ServerRescueNegativeTestJSON-2061875223-project] [instance: 9bbb0abf-72a3-4fbc-8235-7a3ecfc8d006] Fetching instance by UUID {{(pid=116157) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:03:13.566116 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: INFO nova.api.openstack.requestlog [None req-c2eaa59f-f203-4e22-b176-d02b24a4b021 tempest-VolumesTestJSON-1581840401 tempest-VolumesTestJSON-1581840401-project] 10.222.0.18 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1035 microversion: 2.1 time: 0.170665 Dec 15 03:03:13.567077 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: [pid: 116156|app: 0|req: 20/27] 10.222.0.18 () {58 vars in 1154 bytes} [Wed Dec 15 03:03:13 2021] GET /compute/v2.1/os-volumes/detail => generated 1035 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 03:03:13.700367 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.policy [None req-7e348bdf-9f52-4807-a22e-5ef80e98405a tempest-ServerRescueNegativeTestJSON-2061875223 tempest-ServerRescueNegativeTestJSON-2061875223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ea02b6e8f1548a1bd78952cb7337403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5e8a958d4bf43868502b13728b9583b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116157) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:03:13.707661 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: INFO nova.api.openstack.requestlog [None req-7e348bdf-9f52-4807-a22e-5ef80e98405a tempest-ServerRescueNegativeTestJSON-2061875223 tempest-ServerRescueNegativeTestJSON-2061875223-project] 10.222.0.18 "GET /compute/v2.1/servers/9bbb0abf-72a3-4fbc-8235-7a3ecfc8d006" status: 200 len: 1221 microversion: 2.1 time: 0.173797 Dec 15 03:03:13.712768 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: [pid: 116157|app: 0|req: 8/28] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 03:03:13 2021] GET /compute/v2.1/servers/9bbb0abf-72a3-4fbc-8235-7a3ecfc8d006 => generated 1221 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 03:03:13.908397 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi [None req-ef91a3ed-a29d-4108-8298-3c725358cc26 tempest-ServerRescueNegativeTestJSON-2061875223 tempest-ServerRescueNegativeTestJSON-2061875223-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-477207591", "imageRef": "5195b034-9fa4-468b-a94d-ef3ee79ce449", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "e9340f0a-7b46-48b4-b2b0-b0c599dc80c3"}]}} {{(pid=116156) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 03:03:13.938430 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi [None req-551e5f85-1981-4ef0-b1e9-e9f7fc0e5ee0 tempest-AttachVolumeNegativeTest-1640336653 tempest-AttachVolumeNegativeTest-1640336653-project] Calling method '>' {{(pid=116157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:03:13.939529 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.compute.api [None req-551e5f85-1981-4ef0-b1e9-e9f7fc0e5ee0 tempest-AttachVolumeNegativeTest-1640336653 tempest-AttachVolumeNegativeTest-1640336653-project] [instance: 4923355f-95d6-443d-9487-574f56b87f66] Fetching instance by UUID {{(pid=116157) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:03:13.949012 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-551e5f85-1981-4ef0-b1e9-e9f7fc0e5ee0 tempest-AttachVolumeNegativeTest-1640336653 tempest-AttachVolumeNegativeTest-1640336653-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:03:13.952111 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-551e5f85-1981-4ef0-b1e9-e9f7fc0e5ee0 tempest-AttachVolumeNegativeTest-1640336653 tempest-AttachVolumeNegativeTest-1640336653-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:03:13.952942 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-551e5f85-1981-4ef0-b1e9-e9f7fc0e5ee0 tempest-AttachVolumeNegativeTest-1640336653 tempest-AttachVolumeNegativeTest-1640336653-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:03:13.953396 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-551e5f85-1981-4ef0-b1e9-e9f7fc0e5ee0 tempest-AttachVolumeNegativeTest-1640336653 tempest-AttachVolumeNegativeTest-1640336653-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:03:13.988094 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.network.neutron [None req-ef91a3ed-a29d-4108-8298-3c725358cc26 tempest-ServerRescueNegativeTestJSON-2061875223 tempest-ServerRescueNegativeTestJSON-2061875223-project] validate_networks() for [('e9340f0a-7b46-48b4-b2b0-b0c599dc80c3', None, None, None, None, None)] {{(pid=116156) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Dec 15 03:03:14.204476 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.policy [None req-551e5f85-1981-4ef0-b1e9-e9f7fc0e5ee0 tempest-AttachVolumeNegativeTest-1640336653 tempest-AttachVolumeNegativeTest-1640336653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35d37a3d8e504b8186182468b77dd114', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '409b41637da94c469444954258444b4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116157) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:03:14.213811 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: INFO nova.api.openstack.requestlog [None req-551e5f85-1981-4ef0-b1e9-e9f7fc0e5ee0 tempest-AttachVolumeNegativeTest-1640336653 tempest-AttachVolumeNegativeTest-1640336653-project] 10.222.0.18 "GET /compute/v2.1/servers/4923355f-95d6-443d-9487-574f56b87f66" status: 200 len: 1270 microversion: 2.1 time: 0.278821 Dec 15 03:03:14.214607 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: [pid: 116157|app: 0|req: 9/29] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 03:03:13 2021] GET /compute/v2.1/servers/4923355f-95d6-443d-9487-574f56b87f66 => generated 1270 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 03:03:14.229274 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi [None req-0b874640-49c3-4786-9942-57a381df6b5b tempest-DeleteServersTestJSON-268050555 tempest-DeleteServersTestJSON-268050555-project] Calling method '>' {{(pid=116157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:03:14.230169 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.compute.api [None req-0b874640-49c3-4786-9942-57a381df6b5b tempest-DeleteServersTestJSON-268050555 tempest-DeleteServersTestJSON-268050555-project] [instance: 5a01bf2d-c341-4af1-b2b2-e1f05e46705f] Fetching instance by UUID {{(pid=116157) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:03:14.237069 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-0b874640-49c3-4786-9942-57a381df6b5b tempest-DeleteServersTestJSON-268050555 tempest-DeleteServersTestJSON-268050555-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:03:14.237850 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-0b874640-49c3-4786-9942-57a381df6b5b tempest-DeleteServersTestJSON-268050555 tempest-DeleteServersTestJSON-268050555-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:03:14.238924 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-0b874640-49c3-4786-9942-57a381df6b5b tempest-DeleteServersTestJSON-268050555 tempest-DeleteServersTestJSON-268050555-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:03:14.239602 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-0b874640-49c3-4786-9942-57a381df6b5b tempest-DeleteServersTestJSON-268050555 tempest-DeleteServersTestJSON-268050555-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:03:14.321323 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.policy [None req-0b874640-49c3-4786-9942-57a381df6b5b tempest-DeleteServersTestJSON-268050555 tempest-DeleteServersTestJSON-268050555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28384f466c3541358ecea856650f008c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb933fa80ed94ce5b6828e48e86a21c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116157) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:03:14.332376 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: INFO nova.api.openstack.requestlog [None req-0b874640-49c3-4786-9942-57a381df6b5b tempest-DeleteServersTestJSON-268050555 tempest-DeleteServersTestJSON-268050555-project] 10.222.0.18 "GET /compute/v2.1/servers/5a01bf2d-c341-4af1-b2b2-e1f05e46705f" status: 200 len: 1273 microversion: 2.1 time: 0.107683 Dec 15 03:03:14.334310 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: [pid: 116157|app: 0|req: 10/30] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 03:03:14 2021] GET /compute/v2.1/servers/5a01bf2d-c341-4af1-b2b2-e1f05e46705f => generated 1273 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 03:03:14.677506 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.virt.hardware [None req-ef91a3ed-a29d-4108-8298-3c725358cc26 tempest-ServerRescueNegativeTestJSON-2061875223 tempest-ServerRescueNegativeTestJSON-2061875223-project] Flavor limits 0:0:0 {{(pid=116156) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Dec 15 03:03:14.678023 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.virt.hardware [None req-ef91a3ed-a29d-4108-8298-3c725358cc26 tempest-ServerRescueNegativeTestJSON-2061875223 tempest-ServerRescueNegativeTestJSON-2061875223-project] Image limits 0:0:0 {{(pid=116156) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Dec 15 03:03:14.682771 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.virt.hardware [None req-ef91a3ed-a29d-4108-8298-3c725358cc26 tempest-ServerRescueNegativeTestJSON-2061875223 tempest-ServerRescueNegativeTestJSON-2061875223-project] Flavor pref 0:0:0 {{(pid=116156) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Dec 15 03:03:14.685120 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.virt.hardware [None req-ef91a3ed-a29d-4108-8298-3c725358cc26 tempest-ServerRescueNegativeTestJSON-2061875223 tempest-ServerRescueNegativeTestJSON-2061875223-project] Image pref 0:0:0 {{(pid=116156) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Dec 15 03:03:14.687095 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.virt.hardware [None req-ef91a3ed-a29d-4108-8298-3c725358cc26 tempest-ServerRescueNegativeTestJSON-2061875223 tempest-ServerRescueNegativeTestJSON-2061875223-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116156) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Dec 15 03:03:14.699721 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-ef91a3ed-a29d-4108-8298-3c725358cc26 tempest-ServerRescueNegativeTestJSON-2061875223 tempest-ServerRescueNegativeTestJSON-2061875223-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:03:14.700511 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-ef91a3ed-a29d-4108-8298-3c725358cc26 tempest-ServerRescueNegativeTestJSON-2061875223 tempest-ServerRescueNegativeTestJSON-2061875223-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:03:14.702645 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-ef91a3ed-a29d-4108-8298-3c725358cc26 tempest-ServerRescueNegativeTestJSON-2061875223 tempest-ServerRescueNegativeTestJSON-2061875223-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:03:14.703356 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-ef91a3ed-a29d-4108-8298-3c725358cc26 tempest-ServerRescueNegativeTestJSON-2061875223 tempest-ServerRescueNegativeTestJSON-2061875223-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:03:14.726434 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.quota [None req-ef91a3ed-a29d-4108-8298-3c725358cc26 tempest-ServerRescueNegativeTestJSON-2061875223 tempest-ServerRescueNegativeTestJSON-2061875223-project] Getting quotas for project f5e8a958d4bf43868502b13728b9583b. Resources: {'cores', 'instances', 'ram'} {{(pid=116156) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 15 03:03:14.733168 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.quota [None req-ef91a3ed-a29d-4108-8298-3c725358cc26 tempest-ServerRescueNegativeTestJSON-2061875223 tempest-ServerRescueNegativeTestJSON-2061875223-project] Getting quotas for user 6ea02b6e8f1548a1bd78952cb7337403 and project f5e8a958d4bf43868502b13728b9583b. Resources: {'cores', 'instances', 'ram'} {{(pid=116156) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 15 03:03:14.761911 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.compute.api [None req-ef91a3ed-a29d-4108-8298-3c725358cc26 tempest-ServerRescueNegativeTestJSON-2061875223 tempest-ServerRescueNegativeTestJSON-2061875223-project] Going to run 1 instances... {{(pid=116156) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Dec 15 03:03:14.769310 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.compute.api [None req-ef91a3ed-a29d-4108-8298-3c725358cc26 tempest-ServerRescueNegativeTestJSON-2061875223 tempest-ServerRescueNegativeTestJSON-2061875223-project] [instance: 2d20c8be-04a9-4c79-aa0a-138a79fe50cd] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='5195b034-9fa4-468b-a94d-ef3ee79ce449',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=116156) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Dec 15 03:03:14.855165 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: INFO nova.api.openstack.requestlog [None req-ef91a3ed-a29d-4108-8298-3c725358cc26 tempest-ServerRescueNegativeTestJSON-2061875223 tempest-ServerRescueNegativeTestJSON-2061875223-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 0.954203 Dec 15 03:03:14.863047 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: [pid: 116156|app: 0|req: 21/31] 10.222.0.18 () {60 vars in 1146 bytes} [Wed Dec 15 03:03:13 2021] POST /compute/v2.1/servers => generated 383 bytes in 963 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Dec 15 03:03:14.867433 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi [None req-72781065-0931-415c-8b43-3872a3152084 tempest-ServerRescueNegativeTestJSON-2061875223 tempest-ServerRescueNegativeTestJSON-2061875223-project] Calling method '>' {{(pid=116157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:03:14.868068 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.compute.api [None req-72781065-0931-415c-8b43-3872a3152084 tempest-ServerRescueNegativeTestJSON-2061875223 tempest-ServerRescueNegativeTestJSON-2061875223-project] [instance: 2d20c8be-04a9-4c79-aa0a-138a79fe50cd] Fetching instance by UUID {{(pid=116157) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:03:14.943555 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.policy [None req-72781065-0931-415c-8b43-3872a3152084 tempest-ServerRescueNegativeTestJSON-2061875223 tempest-ServerRescueNegativeTestJSON-2061875223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ea02b6e8f1548a1bd78952cb7337403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5e8a958d4bf43868502b13728b9583b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116157) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:03:14.952004 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: INFO nova.api.openstack.requestlog [None req-72781065-0931-415c-8b43-3872a3152084 tempest-ServerRescueNegativeTestJSON-2061875223 tempest-ServerRescueNegativeTestJSON-2061875223-project] 10.222.0.18 "GET /compute/v2.1/servers/2d20c8be-04a9-4c79-aa0a-138a79fe50cd" status: 200 len: 1221 microversion: 2.1 time: 0.088132 Dec 15 03:03:14.958613 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: [pid: 116157|app: 0|req: 11/32] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 03:03:14 2021] GET /compute/v2.1/servers/2d20c8be-04a9-4c79-aa0a-138a79fe50cd => generated 1221 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 03:03:15.230396 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi [None req-33be9cd5-112c-4000-882a-9827981534ed tempest-AttachVolumeNegativeTest-1640336653 tempest-AttachVolumeNegativeTest-1640336653-project] Calling method '>' {{(pid=116156) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:03:15.231310 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.compute.api [None req-33be9cd5-112c-4000-882a-9827981534ed tempest-AttachVolumeNegativeTest-1640336653 tempest-AttachVolumeNegativeTest-1640336653-project] [instance: 4923355f-95d6-443d-9487-574f56b87f66] Fetching instance by UUID {{(pid=116156) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:03:15.240180 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-33be9cd5-112c-4000-882a-9827981534ed tempest-AttachVolumeNegativeTest-1640336653 tempest-AttachVolumeNegativeTest-1640336653-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:03:15.240909 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-33be9cd5-112c-4000-882a-9827981534ed tempest-AttachVolumeNegativeTest-1640336653 tempest-AttachVolumeNegativeTest-1640336653-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:03:15.242757 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-33be9cd5-112c-4000-882a-9827981534ed tempest-AttachVolumeNegativeTest-1640336653 tempest-AttachVolumeNegativeTest-1640336653-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:03:15.244009 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-33be9cd5-112c-4000-882a-9827981534ed tempest-AttachVolumeNegativeTest-1640336653 tempest-AttachVolumeNegativeTest-1640336653-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:03:15.350656 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi [None req-d523a640-9494-4976-a2d8-4735c145958e tempest-DeleteServersTestJSON-268050555 tempest-DeleteServersTestJSON-268050555-project] Calling method '>' {{(pid=116157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:03:15.351280 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.compute.api [None req-d523a640-9494-4976-a2d8-4735c145958e tempest-DeleteServersTestJSON-268050555 tempest-DeleteServersTestJSON-268050555-project] [instance: 5a01bf2d-c341-4af1-b2b2-e1f05e46705f] Fetching instance by UUID {{(pid=116157) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:03:15.362095 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-d523a640-9494-4976-a2d8-4735c145958e tempest-DeleteServersTestJSON-268050555 tempest-DeleteServersTestJSON-268050555-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:03:15.362589 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-d523a640-9494-4976-a2d8-4735c145958e tempest-DeleteServersTestJSON-268050555 tempest-DeleteServersTestJSON-268050555-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:03:15.366277 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-d523a640-9494-4976-a2d8-4735c145958e tempest-DeleteServersTestJSON-268050555 tempest-DeleteServersTestJSON-268050555-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:03:15.366806 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-d523a640-9494-4976-a2d8-4735c145958e tempest-DeleteServersTestJSON-268050555 tempest-DeleteServersTestJSON-268050555-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:03:15.373974 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.policy [None req-33be9cd5-112c-4000-882a-9827981534ed tempest-AttachVolumeNegativeTest-1640336653 tempest-AttachVolumeNegativeTest-1640336653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35d37a3d8e504b8186182468b77dd114', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '409b41637da94c469444954258444b4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116156) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:03:15.396888 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: INFO nova.api.openstack.requestlog [None req-33be9cd5-112c-4000-882a-9827981534ed tempest-AttachVolumeNegativeTest-1640336653 tempest-AttachVolumeNegativeTest-1640336653-project] 10.222.0.18 "GET /compute/v2.1/servers/4923355f-95d6-443d-9487-574f56b87f66" status: 200 len: 1270 microversion: 2.1 time: 0.166100 Dec 15 03:03:15.415872 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: [pid: 116156|app: 0|req: 22/33] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 03:03:15 2021] GET /compute/v2.1/servers/4923355f-95d6-443d-9487-574f56b87f66 => generated 1270 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 03:03:15.534116 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.policy [None req-d523a640-9494-4976-a2d8-4735c145958e tempest-DeleteServersTestJSON-268050555 tempest-DeleteServersTestJSON-268050555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28384f466c3541358ecea856650f008c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb933fa80ed94ce5b6828e48e86a21c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116157) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:03:15.553147 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: INFO nova.api.openstack.requestlog [None req-d523a640-9494-4976-a2d8-4735c145958e tempest-DeleteServersTestJSON-268050555 tempest-DeleteServersTestJSON-268050555-project] 10.222.0.18 "GET /compute/v2.1/servers/5a01bf2d-c341-4af1-b2b2-e1f05e46705f" status: 200 len: 1273 microversion: 2.1 time: 0.204617 Dec 15 03:03:15.555216 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: [pid: 116157|app: 0|req: 12/34] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 03:03:15 2021] GET /compute/v2.1/servers/5a01bf2d-c341-4af1-b2b2-e1f05e46705f => generated 1273 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 03:03:15.972436 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi [None req-adc32f77-e541-436a-a9fe-030ce1e8a409 tempest-ServerRescueNegativeTestJSON-2061875223 tempest-ServerRescueNegativeTestJSON-2061875223-project] Calling method '>' {{(pid=116156) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:03:15.973039 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.compute.api [None req-adc32f77-e541-436a-a9fe-030ce1e8a409 tempest-ServerRescueNegativeTestJSON-2061875223 tempest-ServerRescueNegativeTestJSON-2061875223-project] [instance: 2d20c8be-04a9-4c79-aa0a-138a79fe50cd] Fetching instance by UUID {{(pid=116156) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:03:15.979279 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-adc32f77-e541-436a-a9fe-030ce1e8a409 tempest-ServerRescueNegativeTestJSON-2061875223 tempest-ServerRescueNegativeTestJSON-2061875223-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:03:15.980089 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-adc32f77-e541-436a-a9fe-030ce1e8a409 tempest-ServerRescueNegativeTestJSON-2061875223 tempest-ServerRescueNegativeTestJSON-2061875223-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:03:15.991020 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-adc32f77-e541-436a-a9fe-030ce1e8a409 tempest-ServerRescueNegativeTestJSON-2061875223 tempest-ServerRescueNegativeTestJSON-2061875223-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:03:15.991779 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-adc32f77-e541-436a-a9fe-030ce1e8a409 tempest-ServerRescueNegativeTestJSON-2061875223 tempest-ServerRescueNegativeTestJSON-2061875223-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:03:16.183875 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.policy [None req-adc32f77-e541-436a-a9fe-030ce1e8a409 tempest-ServerRescueNegativeTestJSON-2061875223 tempest-ServerRescueNegativeTestJSON-2061875223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ea02b6e8f1548a1bd78952cb7337403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5e8a958d4bf43868502b13728b9583b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116156) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:03:16.192564 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: INFO nova.api.openstack.requestlog [None req-adc32f77-e541-436a-a9fe-030ce1e8a409 tempest-ServerRescueNegativeTestJSON-2061875223 tempest-ServerRescueNegativeTestJSON-2061875223-project] 10.222.0.18 "GET /compute/v2.1/servers/2d20c8be-04a9-4c79-aa0a-138a79fe50cd" status: 200 len: 1217 microversion: 2.1 time: 0.226424 Dec 15 03:03:16.192942 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: [pid: 116156|app: 0|req: 23/35] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 03:03:15 2021] GET /compute/v2.1/servers/2d20c8be-04a9-4c79-aa0a-138a79fe50cd => generated 1217 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 03:03:16.419085 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi [None req-229df910-f5e2-4098-bb67-09d2e731c354 tempest-AttachVolumeNegativeTest-1640336653 tempest-AttachVolumeNegativeTest-1640336653-project] Calling method '>' {{(pid=116157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:03:16.419723 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.compute.api [None req-229df910-f5e2-4098-bb67-09d2e731c354 tempest-AttachVolumeNegativeTest-1640336653 tempest-AttachVolumeNegativeTest-1640336653-project] [instance: 4923355f-95d6-443d-9487-574f56b87f66] Fetching instance by UUID {{(pid=116157) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:03:16.435725 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-229df910-f5e2-4098-bb67-09d2e731c354 tempest-AttachVolumeNegativeTest-1640336653 tempest-AttachVolumeNegativeTest-1640336653-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:03:16.436193 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-229df910-f5e2-4098-bb67-09d2e731c354 tempest-AttachVolumeNegativeTest-1640336653 tempest-AttachVolumeNegativeTest-1640336653-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:03:16.437009 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-229df910-f5e2-4098-bb67-09d2e731c354 tempest-AttachVolumeNegativeTest-1640336653 tempest-AttachVolumeNegativeTest-1640336653-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:03:16.437456 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-229df910-f5e2-4098-bb67-09d2e731c354 tempest-AttachVolumeNegativeTest-1640336653 tempest-AttachVolumeNegativeTest-1640336653-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:03:16.572659 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi [None req-08f73cf4-81d8-4203-962f-dc267b8b92f4 tempest-DeleteServersTestJSON-268050555 tempest-DeleteServersTestJSON-268050555-project] Calling method '>' {{(pid=116156) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:03:16.573702 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.compute.api [None req-08f73cf4-81d8-4203-962f-dc267b8b92f4 tempest-DeleteServersTestJSON-268050555 tempest-DeleteServersTestJSON-268050555-project] [instance: 5a01bf2d-c341-4af1-b2b2-e1f05e46705f] Fetching instance by UUID {{(pid=116156) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:03:16.585035 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-08f73cf4-81d8-4203-962f-dc267b8b92f4 tempest-DeleteServersTestJSON-268050555 tempest-DeleteServersTestJSON-268050555-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:03:16.585705 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-08f73cf4-81d8-4203-962f-dc267b8b92f4 tempest-DeleteServersTestJSON-268050555 tempest-DeleteServersTestJSON-268050555-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:03:16.587069 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-08f73cf4-81d8-4203-962f-dc267b8b92f4 tempest-DeleteServersTestJSON-268050555 tempest-DeleteServersTestJSON-268050555-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:03:16.588858 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-08f73cf4-81d8-4203-962f-dc267b8b92f4 tempest-DeleteServersTestJSON-268050555 tempest-DeleteServersTestJSON-268050555-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:03:16.653471 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.policy [None req-229df910-f5e2-4098-bb67-09d2e731c354 tempest-AttachVolumeNegativeTest-1640336653 tempest-AttachVolumeNegativeTest-1640336653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35d37a3d8e504b8186182468b77dd114', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '409b41637da94c469444954258444b4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116157) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:03:16.662984 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: INFO nova.api.openstack.requestlog [None req-229df910-f5e2-4098-bb67-09d2e731c354 tempest-AttachVolumeNegativeTest-1640336653 tempest-AttachVolumeNegativeTest-1640336653-project] 10.222.0.18 "GET /compute/v2.1/servers/4923355f-95d6-443d-9487-574f56b87f66" status: 200 len: 1276 microversion: 2.1 time: 0.248837 Dec 15 03:03:16.664381 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: [pid: 116157|app: 0|req: 13/36] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 03:03:16 2021] GET /compute/v2.1/servers/4923355f-95d6-443d-9487-574f56b87f66 => generated 1276 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 03:03:17.213230 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi [None req-d697362a-3099-4168-87a3-41387d64d48e tempest-ServerRescueNegativeTestJSON-2061875223 tempest-ServerRescueNegativeTestJSON-2061875223-project] Calling method '>' {{(pid=116157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:03:17.213230 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.compute.api [None req-d697362a-3099-4168-87a3-41387d64d48e tempest-ServerRescueNegativeTestJSON-2061875223 tempest-ServerRescueNegativeTestJSON-2061875223-project] [instance: 2d20c8be-04a9-4c79-aa0a-138a79fe50cd] Fetching instance by UUID {{(pid=116157) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:03:17.227130 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-d697362a-3099-4168-87a3-41387d64d48e tempest-ServerRescueNegativeTestJSON-2061875223 tempest-ServerRescueNegativeTestJSON-2061875223-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:03:17.229773 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-d697362a-3099-4168-87a3-41387d64d48e tempest-ServerRescueNegativeTestJSON-2061875223 tempest-ServerRescueNegativeTestJSON-2061875223-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:03:17.231294 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-d697362a-3099-4168-87a3-41387d64d48e tempest-ServerRescueNegativeTestJSON-2061875223 tempest-ServerRescueNegativeTestJSON-2061875223-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:03:17.234373 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-d697362a-3099-4168-87a3-41387d64d48e tempest-ServerRescueNegativeTestJSON-2061875223 tempest-ServerRescueNegativeTestJSON-2061875223-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:03:17.739320 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.policy [None req-d697362a-3099-4168-87a3-41387d64d48e tempest-ServerRescueNegativeTestJSON-2061875223 tempest-ServerRescueNegativeTestJSON-2061875223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ea02b6e8f1548a1bd78952cb7337403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5e8a958d4bf43868502b13728b9583b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116157) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:03:17.747052 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: INFO nova.api.openstack.requestlog [None req-d697362a-3099-4168-87a3-41387d64d48e tempest-ServerRescueNegativeTestJSON-2061875223 tempest-ServerRescueNegativeTestJSON-2061875223-project] 10.222.0.18 "GET /compute/v2.1/servers/2d20c8be-04a9-4c79-aa0a-138a79fe50cd" status: 200 len: 1217 microversion: 2.1 time: 0.540919 Dec 15 03:03:17.752173 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: [pid: 116157|app: 0|req: 14/37] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 03:03:17 2021] GET /compute/v2.1/servers/2d20c8be-04a9-4c79-aa0a-138a79fe50cd => generated 1217 bytes in 547 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 03:03:17.777271 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi [None req-9df68101-c802-4671-9974-4babd3bb5f7b tempest-AttachVolumeNegativeTest-1640336653 tempest-AttachVolumeNegativeTest-1640336653-project] Calling method '>' {{(pid=116157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:03:17.780449 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.compute.api [None req-9df68101-c802-4671-9974-4babd3bb5f7b tempest-AttachVolumeNegativeTest-1640336653 tempest-AttachVolumeNegativeTest-1640336653-project] [instance: 4923355f-95d6-443d-9487-574f56b87f66] Fetching instance by UUID {{(pid=116157) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:03:17.794865 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-9df68101-c802-4671-9974-4babd3bb5f7b tempest-AttachVolumeNegativeTest-1640336653 tempest-AttachVolumeNegativeTest-1640336653-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:03:17.798727 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-9df68101-c802-4671-9974-4babd3bb5f7b tempest-AttachVolumeNegativeTest-1640336653 tempest-AttachVolumeNegativeTest-1640336653-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:03:17.799842 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-9df68101-c802-4671-9974-4babd3bb5f7b tempest-AttachVolumeNegativeTest-1640336653 tempest-AttachVolumeNegativeTest-1640336653-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:03:17.801485 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-9df68101-c802-4671-9974-4babd3bb5f7b tempest-AttachVolumeNegativeTest-1640336653 tempest-AttachVolumeNegativeTest-1640336653-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:03:17.920887 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.policy [None req-9df68101-c802-4671-9974-4babd3bb5f7b tempest-AttachVolumeNegativeTest-1640336653 tempest-AttachVolumeNegativeTest-1640336653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35d37a3d8e504b8186182468b77dd114', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '409b41637da94c469444954258444b4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116157) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:03:17.929822 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: INFO nova.api.openstack.requestlog [None req-9df68101-c802-4671-9974-4babd3bb5f7b tempest-AttachVolumeNegativeTest-1640336653 tempest-AttachVolumeNegativeTest-1640336653-project] 10.222.0.18 "GET /compute/v2.1/servers/4923355f-95d6-443d-9487-574f56b87f66" status: 200 len: 1276 microversion: 2.1 time: 0.165056 Dec 15 03:03:17.931889 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: [pid: 116157|app: 0|req: 15/38] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 03:03:17 2021] GET /compute/v2.1/servers/4923355f-95d6-443d-9487-574f56b87f66 => generated 1276 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 03:03:18.382997 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.policy [None req-08f73cf4-81d8-4203-962f-dc267b8b92f4 tempest-DeleteServersTestJSON-268050555 tempest-DeleteServersTestJSON-268050555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28384f466c3541358ecea856650f008c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb933fa80ed94ce5b6828e48e86a21c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116156) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:03:18.398761 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: INFO nova.api.openstack.requestlog [None req-08f73cf4-81d8-4203-962f-dc267b8b92f4 tempest-DeleteServersTestJSON-268050555 tempest-DeleteServersTestJSON-268050555-project] 10.222.0.18 "GET /compute/v2.1/servers/5a01bf2d-c341-4af1-b2b2-e1f05e46705f" status: 200 len: 1315 microversion: 2.1 time: 1.830683 Dec 15 03:03:18.409622 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: [pid: 116156|app: 0|req: 24/39] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 03:03:16 2021] GET /compute/v2.1/servers/5a01bf2d-c341-4af1-b2b2-e1f05e46705f => generated 1315 bytes in 1842 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 03:03:18.771241 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi [None req-afb1fd8d-c13f-48d3-987e-554d1e3f8ce6 tempest-ServerRescueNegativeTestJSON-2061875223 tempest-ServerRescueNegativeTestJSON-2061875223-project] Calling method '>' {{(pid=116157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:03:18.772602 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.compute.api [None req-afb1fd8d-c13f-48d3-987e-554d1e3f8ce6 tempest-ServerRescueNegativeTestJSON-2061875223 tempest-ServerRescueNegativeTestJSON-2061875223-project] [instance: 2d20c8be-04a9-4c79-aa0a-138a79fe50cd] Fetching instance by UUID {{(pid=116157) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:03:18.781460 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-afb1fd8d-c13f-48d3-987e-554d1e3f8ce6 tempest-ServerRescueNegativeTestJSON-2061875223 tempest-ServerRescueNegativeTestJSON-2061875223-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:03:18.795740 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-afb1fd8d-c13f-48d3-987e-554d1e3f8ce6 tempest-ServerRescueNegativeTestJSON-2061875223 tempest-ServerRescueNegativeTestJSON-2061875223-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:03:18.801227 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-afb1fd8d-c13f-48d3-987e-554d1e3f8ce6 tempest-ServerRescueNegativeTestJSON-2061875223 tempest-ServerRescueNegativeTestJSON-2061875223-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:03:18.805765 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-afb1fd8d-c13f-48d3-987e-554d1e3f8ce6 tempest-ServerRescueNegativeTestJSON-2061875223 tempest-ServerRescueNegativeTestJSON-2061875223-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:03:18.948600 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi [None req-fbf37c83-71bb-46d2-967d-2e1c60484e5c tempest-AttachVolumeNegativeTest-1640336653 tempest-AttachVolumeNegativeTest-1640336653-project] Calling method '>' {{(pid=116156) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:03:18.949317 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.compute.api [None req-fbf37c83-71bb-46d2-967d-2e1c60484e5c tempest-AttachVolumeNegativeTest-1640336653 tempest-AttachVolumeNegativeTest-1640336653-project] [instance: 4923355f-95d6-443d-9487-574f56b87f66] Fetching instance by UUID {{(pid=116156) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:03:18.961228 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-fbf37c83-71bb-46d2-967d-2e1c60484e5c tempest-AttachVolumeNegativeTest-1640336653 tempest-AttachVolumeNegativeTest-1640336653-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:03:18.961719 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-fbf37c83-71bb-46d2-967d-2e1c60484e5c tempest-AttachVolumeNegativeTest-1640336653 tempest-AttachVolumeNegativeTest-1640336653-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:03:18.962576 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-fbf37c83-71bb-46d2-967d-2e1c60484e5c tempest-AttachVolumeNegativeTest-1640336653 tempest-AttachVolumeNegativeTest-1640336653-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:03:18.962771 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.policy [None req-afb1fd8d-c13f-48d3-987e-554d1e3f8ce6 tempest-ServerRescueNegativeTestJSON-2061875223 tempest-ServerRescueNegativeTestJSON-2061875223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ea02b6e8f1548a1bd78952cb7337403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5e8a958d4bf43868502b13728b9583b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116157) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:03:18.963022 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-fbf37c83-71bb-46d2-967d-2e1c60484e5c tempest-AttachVolumeNegativeTest-1640336653 tempest-AttachVolumeNegativeTest-1640336653-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:03:18.972665 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: INFO nova.api.openstack.requestlog [None req-afb1fd8d-c13f-48d3-987e-554d1e3f8ce6 tempest-ServerRescueNegativeTestJSON-2061875223 tempest-ServerRescueNegativeTestJSON-2061875223-project] 10.222.0.18 "GET /compute/v2.1/servers/2d20c8be-04a9-4c79-aa0a-138a79fe50cd" status: 200 len: 1281 microversion: 2.1 time: 0.207562 Dec 15 03:03:18.986363 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: [pid: 116157|app: 0|req: 16/40] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 03:03:18 2021] GET /compute/v2.1/servers/2d20c8be-04a9-4c79-aa0a-138a79fe50cd => generated 1281 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 03:03:19.288645 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.policy [None req-fbf37c83-71bb-46d2-967d-2e1c60484e5c tempest-AttachVolumeNegativeTest-1640336653 tempest-AttachVolumeNegativeTest-1640336653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35d37a3d8e504b8186182468b77dd114', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '409b41637da94c469444954258444b4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116156) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:03:19.296437 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: INFO nova.api.openstack.requestlog [None req-fbf37c83-71bb-46d2-967d-2e1c60484e5c tempest-AttachVolumeNegativeTest-1640336653 tempest-AttachVolumeNegativeTest-1640336653-project] 10.222.0.18 "GET /compute/v2.1/servers/4923355f-95d6-443d-9487-574f56b87f66" status: 200 len: 1318 microversion: 2.1 time: 0.351598 Dec 15 03:03:19.297925 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: [pid: 116156|app: 0|req: 25/41] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 03:03:18 2021] GET /compute/v2.1/servers/4923355f-95d6-443d-9487-574f56b87f66 => generated 1318 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 03:03:19.417305 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi [None req-dffafdbc-9d56-4009-aada-f1cc0da46042 tempest-DeleteServersTestJSON-268050555 tempest-DeleteServersTestJSON-268050555-project] Calling method '>' {{(pid=116157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:03:19.417934 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.compute.api [None req-dffafdbc-9d56-4009-aada-f1cc0da46042 tempest-DeleteServersTestJSON-268050555 tempest-DeleteServersTestJSON-268050555-project] [instance: 5a01bf2d-c341-4af1-b2b2-e1f05e46705f] Fetching instance by UUID {{(pid=116157) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:03:19.425715 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-dffafdbc-9d56-4009-aada-f1cc0da46042 tempest-DeleteServersTestJSON-268050555 tempest-DeleteServersTestJSON-268050555-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:03:19.426200 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-dffafdbc-9d56-4009-aada-f1cc0da46042 tempest-DeleteServersTestJSON-268050555 tempest-DeleteServersTestJSON-268050555-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:03:19.427982 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-dffafdbc-9d56-4009-aada-f1cc0da46042 tempest-DeleteServersTestJSON-268050555 tempest-DeleteServersTestJSON-268050555-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:03:19.428449 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-dffafdbc-9d56-4009-aada-f1cc0da46042 tempest-DeleteServersTestJSON-268050555 tempest-DeleteServersTestJSON-268050555-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:03:19.734922 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.policy [None req-dffafdbc-9d56-4009-aada-f1cc0da46042 tempest-DeleteServersTestJSON-268050555 tempest-DeleteServersTestJSON-268050555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28384f466c3541358ecea856650f008c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb933fa80ed94ce5b6828e48e86a21c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116157) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:03:19.755763 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: INFO nova.api.openstack.requestlog [None req-dffafdbc-9d56-4009-aada-f1cc0da46042 tempest-DeleteServersTestJSON-268050555 tempest-DeleteServersTestJSON-268050555-project] 10.222.0.18 "GET /compute/v2.1/servers/5a01bf2d-c341-4af1-b2b2-e1f05e46705f" status: 200 len: 1315 microversion: 2.1 time: 0.342669 Dec 15 03:03:19.756366 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: [pid: 116157|app: 0|req: 17/42] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 03:03:19 2021] GET /compute/v2.1/servers/5a01bf2d-c341-4af1-b2b2-e1f05e46705f => generated 1315 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 03:03:19.995046 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi [None req-5009d63b-2e58-479f-a3b6-d4741240b20a tempest-ServerRescueNegativeTestJSON-2061875223 tempest-ServerRescueNegativeTestJSON-2061875223-project] Calling method '>' {{(pid=116156) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:03:19.995685 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.compute.api [None req-5009d63b-2e58-479f-a3b6-d4741240b20a tempest-ServerRescueNegativeTestJSON-2061875223 tempest-ServerRescueNegativeTestJSON-2061875223-project] [instance: 2d20c8be-04a9-4c79-aa0a-138a79fe50cd] Fetching instance by UUID {{(pid=116156) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:03:20.003434 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-5009d63b-2e58-479f-a3b6-d4741240b20a tempest-ServerRescueNegativeTestJSON-2061875223 tempest-ServerRescueNegativeTestJSON-2061875223-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:03:20.004226 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-5009d63b-2e58-479f-a3b6-d4741240b20a tempest-ServerRescueNegativeTestJSON-2061875223 tempest-ServerRescueNegativeTestJSON-2061875223-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:03:20.005234 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-5009d63b-2e58-479f-a3b6-d4741240b20a tempest-ServerRescueNegativeTestJSON-2061875223 tempest-ServerRescueNegativeTestJSON-2061875223-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:03:20.005887 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-5009d63b-2e58-479f-a3b6-d4741240b20a tempest-ServerRescueNegativeTestJSON-2061875223 tempest-ServerRescueNegativeTestJSON-2061875223-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:03:20.113280 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.policy [None req-5009d63b-2e58-479f-a3b6-d4741240b20a tempest-ServerRescueNegativeTestJSON-2061875223 tempest-ServerRescueNegativeTestJSON-2061875223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ea02b6e8f1548a1bd78952cb7337403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5e8a958d4bf43868502b13728b9583b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116156) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:03:20.120426 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: INFO nova.api.openstack.requestlog [None req-5009d63b-2e58-479f-a3b6-d4741240b20a tempest-ServerRescueNegativeTestJSON-2061875223 tempest-ServerRescueNegativeTestJSON-2061875223-project] 10.222.0.18 "GET /compute/v2.1/servers/2d20c8be-04a9-4c79-aa0a-138a79fe50cd" status: 200 len: 1281 microversion: 2.1 time: 0.128997 Dec 15 03:03:20.144585 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: [pid: 116156|app: 0|req: 26/43] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 03:03:19 2021] GET /compute/v2.1/servers/2d20c8be-04a9-4c79-aa0a-138a79fe50cd => generated 1281 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 03:03:20.312840 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi [None req-ef005e14-631c-40cb-88e6-061bbc45fd2e tempest-AttachVolumeNegativeTest-1640336653 tempest-AttachVolumeNegativeTest-1640336653-project] Calling method '>' {{(pid=116157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:03:20.314212 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.compute.api [None req-ef005e14-631c-40cb-88e6-061bbc45fd2e tempest-AttachVolumeNegativeTest-1640336653 tempest-AttachVolumeNegativeTest-1640336653-project] [instance: 4923355f-95d6-443d-9487-574f56b87f66] Fetching instance by UUID {{(pid=116157) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:03:20.323913 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-ef005e14-631c-40cb-88e6-061bbc45fd2e tempest-AttachVolumeNegativeTest-1640336653 tempest-AttachVolumeNegativeTest-1640336653-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:03:20.328099 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-ef005e14-631c-40cb-88e6-061bbc45fd2e tempest-AttachVolumeNegativeTest-1640336653 tempest-AttachVolumeNegativeTest-1640336653-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:03:20.333501 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-ef005e14-631c-40cb-88e6-061bbc45fd2e tempest-AttachVolumeNegativeTest-1640336653 tempest-AttachVolumeNegativeTest-1640336653-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:03:20.335113 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-ef005e14-631c-40cb-88e6-061bbc45fd2e tempest-AttachVolumeNegativeTest-1640336653 tempest-AttachVolumeNegativeTest-1640336653-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:03:20.715942 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.policy [None req-ef005e14-631c-40cb-88e6-061bbc45fd2e tempest-AttachVolumeNegativeTest-1640336653 tempest-AttachVolumeNegativeTest-1640336653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35d37a3d8e504b8186182468b77dd114', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '409b41637da94c469444954258444b4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116157) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:03:20.728418 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: INFO nova.api.openstack.requestlog [None req-ef005e14-631c-40cb-88e6-061bbc45fd2e tempest-AttachVolumeNegativeTest-1640336653 tempest-AttachVolumeNegativeTest-1640336653-project] 10.222.0.18 "GET /compute/v2.1/servers/4923355f-95d6-443d-9487-574f56b87f66" status: 200 len: 1318 microversion: 2.1 time: 0.418747 Dec 15 03:03:20.731748 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: [pid: 116157|app: 0|req: 18/44] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 03:03:20 2021] GET /compute/v2.1/servers/4923355f-95d6-443d-9487-574f56b87f66 => generated 1318 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 03:03:20.790970 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi [None req-9898ef58-da01-47a6-9c0a-9107fb3d3c6d tempest-DeleteServersTestJSON-268050555 tempest-DeleteServersTestJSON-268050555-project] Calling method '>' {{(pid=116156) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:03:20.791721 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.compute.api [None req-9898ef58-da01-47a6-9c0a-9107fb3d3c6d tempest-DeleteServersTestJSON-268050555 tempest-DeleteServersTestJSON-268050555-project] [instance: 5a01bf2d-c341-4af1-b2b2-e1f05e46705f] Fetching instance by UUID {{(pid=116156) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:03:20.809624 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-9898ef58-da01-47a6-9c0a-9107fb3d3c6d tempest-DeleteServersTestJSON-268050555 tempest-DeleteServersTestJSON-268050555-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:03:20.810165 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-9898ef58-da01-47a6-9c0a-9107fb3d3c6d tempest-DeleteServersTestJSON-268050555 tempest-DeleteServersTestJSON-268050555-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:03:20.816418 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-9898ef58-da01-47a6-9c0a-9107fb3d3c6d tempest-DeleteServersTestJSON-268050555 tempest-DeleteServersTestJSON-268050555-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:03:20.818027 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-9898ef58-da01-47a6-9c0a-9107fb3d3c6d tempest-DeleteServersTestJSON-268050555 tempest-DeleteServersTestJSON-268050555-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:03:21.125996 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.policy [None req-9898ef58-da01-47a6-9c0a-9107fb3d3c6d tempest-DeleteServersTestJSON-268050555 tempest-DeleteServersTestJSON-268050555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28384f466c3541358ecea856650f008c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb933fa80ed94ce5b6828e48e86a21c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116156) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:03:21.134422 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: INFO nova.api.openstack.requestlog [None req-9898ef58-da01-47a6-9c0a-9107fb3d3c6d tempest-DeleteServersTestJSON-268050555 tempest-DeleteServersTestJSON-268050555-project] 10.222.0.18 "GET /compute/v2.1/servers/5a01bf2d-c341-4af1-b2b2-e1f05e46705f" status: 200 len: 1315 microversion: 2.1 time: 0.364657 Dec 15 03:03:21.135008 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: [pid: 116156|app: 0|req: 27/45] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 03:03:20 2021] GET /compute/v2.1/servers/5a01bf2d-c341-4af1-b2b2-e1f05e46705f => generated 1315 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 03:03:21.152410 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi [None req-b7be49e6-4862-47ef-8d66-dc7caa67ccba tempest-ServerRescueNegativeTestJSON-2061875223 tempest-ServerRescueNegativeTestJSON-2061875223-project] Calling method '>' {{(pid=116157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:03:21.153023 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.compute.api [None req-b7be49e6-4862-47ef-8d66-dc7caa67ccba tempest-ServerRescueNegativeTestJSON-2061875223 tempest-ServerRescueNegativeTestJSON-2061875223-project] [instance: 2d20c8be-04a9-4c79-aa0a-138a79fe50cd] Fetching instance by UUID {{(pid=116157) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:03:21.169155 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-b7be49e6-4862-47ef-8d66-dc7caa67ccba tempest-ServerRescueNegativeTestJSON-2061875223 tempest-ServerRescueNegativeTestJSON-2061875223-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:03:21.172751 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-b7be49e6-4862-47ef-8d66-dc7caa67ccba tempest-ServerRescueNegativeTestJSON-2061875223 tempest-ServerRescueNegativeTestJSON-2061875223-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:03:21.173767 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-b7be49e6-4862-47ef-8d66-dc7caa67ccba tempest-ServerRescueNegativeTestJSON-2061875223 tempest-ServerRescueNegativeTestJSON-2061875223-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:03:21.178947 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-b7be49e6-4862-47ef-8d66-dc7caa67ccba tempest-ServerRescueNegativeTestJSON-2061875223 tempest-ServerRescueNegativeTestJSON-2061875223-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:03:21.277591 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.policy [None req-b7be49e6-4862-47ef-8d66-dc7caa67ccba tempest-ServerRescueNegativeTestJSON-2061875223 tempest-ServerRescueNegativeTestJSON-2061875223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ea02b6e8f1548a1bd78952cb7337403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5e8a958d4bf43868502b13728b9583b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116157) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:03:21.290873 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: INFO nova.api.openstack.requestlog [None req-b7be49e6-4862-47ef-8d66-dc7caa67ccba tempest-ServerRescueNegativeTestJSON-2061875223 tempest-ServerRescueNegativeTestJSON-2061875223-project] 10.222.0.18 "GET /compute/v2.1/servers/2d20c8be-04a9-4c79-aa0a-138a79fe50cd" status: 200 len: 1281 microversion: 2.1 time: 0.141941 Dec 15 03:03:21.292282 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: [pid: 116157|app: 0|req: 19/46] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 03:03:21 2021] GET /compute/v2.1/servers/2d20c8be-04a9-4c79-aa0a-138a79fe50cd => generated 1281 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 03:03:21.747465 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi [None req-b1accf79-439f-46a7-9214-b146e6f92223 tempest-AttachVolumeNegativeTest-1640336653 tempest-AttachVolumeNegativeTest-1640336653-project] Calling method '>' {{(pid=116156) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:03:21.748638 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.compute.api [None req-b1accf79-439f-46a7-9214-b146e6f92223 tempest-AttachVolumeNegativeTest-1640336653 tempest-AttachVolumeNegativeTest-1640336653-project] [instance: 4923355f-95d6-443d-9487-574f56b87f66] Fetching instance by UUID {{(pid=116156) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:03:21.766753 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-b1accf79-439f-46a7-9214-b146e6f92223 tempest-AttachVolumeNegativeTest-1640336653 tempest-AttachVolumeNegativeTest-1640336653-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:03:21.767219 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-b1accf79-439f-46a7-9214-b146e6f92223 tempest-AttachVolumeNegativeTest-1640336653 tempest-AttachVolumeNegativeTest-1640336653-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:03:21.768140 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-b1accf79-439f-46a7-9214-b146e6f92223 tempest-AttachVolumeNegativeTest-1640336653 tempest-AttachVolumeNegativeTest-1640336653-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:03:21.768649 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-b1accf79-439f-46a7-9214-b146e6f92223 tempest-AttachVolumeNegativeTest-1640336653 tempest-AttachVolumeNegativeTest-1640336653-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:03:22.086417 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.policy [None req-b1accf79-439f-46a7-9214-b146e6f92223 tempest-AttachVolumeNegativeTest-1640336653 tempest-AttachVolumeNegativeTest-1640336653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35d37a3d8e504b8186182468b77dd114', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '409b41637da94c469444954258444b4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116156) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:03:22.093754 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: INFO nova.api.openstack.requestlog [None req-b1accf79-439f-46a7-9214-b146e6f92223 tempest-AttachVolumeNegativeTest-1640336653 tempest-AttachVolumeNegativeTest-1640336653-project] 10.222.0.18 "GET /compute/v2.1/servers/4923355f-95d6-443d-9487-574f56b87f66" status: 200 len: 1318 microversion: 2.1 time: 0.349787 Dec 15 03:03:22.110075 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: [pid: 116156|app: 0|req: 28/47] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 03:03:21 2021] GET /compute/v2.1/servers/4923355f-95d6-443d-9487-574f56b87f66 => generated 1318 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 03:03:22.154686 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi [None req-6bc66a0c-e69f-42bc-af2b-46b6e4a20cb0 tempest-DeleteServersTestJSON-268050555 tempest-DeleteServersTestJSON-268050555-project] Calling method '>' {{(pid=116157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:03:22.155523 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.compute.api [None req-6bc66a0c-e69f-42bc-af2b-46b6e4a20cb0 tempest-DeleteServersTestJSON-268050555 tempest-DeleteServersTestJSON-268050555-project] [instance: 5a01bf2d-c341-4af1-b2b2-e1f05e46705f] Fetching instance by UUID {{(pid=116157) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:03:22.167434 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-6bc66a0c-e69f-42bc-af2b-46b6e4a20cb0 tempest-DeleteServersTestJSON-268050555 tempest-DeleteServersTestJSON-268050555-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:03:22.172875 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-6bc66a0c-e69f-42bc-af2b-46b6e4a20cb0 tempest-DeleteServersTestJSON-268050555 tempest-DeleteServersTestJSON-268050555-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:03:22.174043 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-6bc66a0c-e69f-42bc-af2b-46b6e4a20cb0 tempest-DeleteServersTestJSON-268050555 tempest-DeleteServersTestJSON-268050555-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:03:22.174966 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-6bc66a0c-e69f-42bc-af2b-46b6e4a20cb0 tempest-DeleteServersTestJSON-268050555 tempest-DeleteServersTestJSON-268050555-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:03:22.310214 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi [None req-3c9cf0ec-bf90-4dbe-85ef-a09b0fe6b937 tempest-ServerRescueNegativeTestJSON-2061875223 tempest-ServerRescueNegativeTestJSON-2061875223-project] Calling method '>' {{(pid=116156) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:03:22.312166 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.compute.api [None req-3c9cf0ec-bf90-4dbe-85ef-a09b0fe6b937 tempest-ServerRescueNegativeTestJSON-2061875223 tempest-ServerRescueNegativeTestJSON-2061875223-project] [instance: 2d20c8be-04a9-4c79-aa0a-138a79fe50cd] Fetching instance by UUID {{(pid=116156) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:03:22.329315 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-3c9cf0ec-bf90-4dbe-85ef-a09b0fe6b937 tempest-ServerRescueNegativeTestJSON-2061875223 tempest-ServerRescueNegativeTestJSON-2061875223-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:03:22.329315 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-3c9cf0ec-bf90-4dbe-85ef-a09b0fe6b937 tempest-ServerRescueNegativeTestJSON-2061875223 tempest-ServerRescueNegativeTestJSON-2061875223-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:03:22.329315 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-3c9cf0ec-bf90-4dbe-85ef-a09b0fe6b937 tempest-ServerRescueNegativeTestJSON-2061875223 tempest-ServerRescueNegativeTestJSON-2061875223-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:03:22.331454 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-3c9cf0ec-bf90-4dbe-85ef-a09b0fe6b937 tempest-ServerRescueNegativeTestJSON-2061875223 tempest-ServerRescueNegativeTestJSON-2061875223-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:03:22.492585 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.policy [None req-6bc66a0c-e69f-42bc-af2b-46b6e4a20cb0 tempest-DeleteServersTestJSON-268050555 tempest-DeleteServersTestJSON-268050555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28384f466c3541358ecea856650f008c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb933fa80ed94ce5b6828e48e86a21c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116157) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:03:22.500571 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: INFO nova.api.openstack.requestlog [None req-6bc66a0c-e69f-42bc-af2b-46b6e4a20cb0 tempest-DeleteServersTestJSON-268050555 tempest-DeleteServersTestJSON-268050555-project] 10.222.0.18 "GET /compute/v2.1/servers/5a01bf2d-c341-4af1-b2b2-e1f05e46705f" status: 200 len: 1315 microversion: 2.1 time: 0.349974 Dec 15 03:03:22.510476 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: [pid: 116157|app: 0|req: 20/48] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 03:03:22 2021] GET /compute/v2.1/servers/5a01bf2d-c341-4af1-b2b2-e1f05e46705f => generated 1315 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 03:03:22.718596 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.policy [None req-3c9cf0ec-bf90-4dbe-85ef-a09b0fe6b937 tempest-ServerRescueNegativeTestJSON-2061875223 tempest-ServerRescueNegativeTestJSON-2061875223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ea02b6e8f1548a1bd78952cb7337403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5e8a958d4bf43868502b13728b9583b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116156) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:03:22.728771 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: INFO nova.api.openstack.requestlog [None req-3c9cf0ec-bf90-4dbe-85ef-a09b0fe6b937 tempest-ServerRescueNegativeTestJSON-2061875223 tempest-ServerRescueNegativeTestJSON-2061875223-project] 10.222.0.18 "GET /compute/v2.1/servers/2d20c8be-04a9-4c79-aa0a-138a79fe50cd" status: 200 len: 1281 microversion: 2.1 time: 0.423290 Dec 15 03:03:22.735965 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: [pid: 116156|app: 0|req: 29/49] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 03:03:22 2021] GET /compute/v2.1/servers/2d20c8be-04a9-4c79-aa0a-138a79fe50cd => generated 1281 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 03:03:23.110885 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi [None req-c0ac6242-5e37-4568-9b97-4c3b8e9f7795 tempest-AttachVolumeNegativeTest-1640336653 tempest-AttachVolumeNegativeTest-1640336653-project] Calling method '>' {{(pid=116157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:03:23.111884 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.compute.api [None req-c0ac6242-5e37-4568-9b97-4c3b8e9f7795 tempest-AttachVolumeNegativeTest-1640336653 tempest-AttachVolumeNegativeTest-1640336653-project] [instance: 4923355f-95d6-443d-9487-574f56b87f66] Fetching instance by UUID {{(pid=116157) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:03:23.118113 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-c0ac6242-5e37-4568-9b97-4c3b8e9f7795 tempest-AttachVolumeNegativeTest-1640336653 tempest-AttachVolumeNegativeTest-1640336653-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:03:23.118884 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-c0ac6242-5e37-4568-9b97-4c3b8e9f7795 tempest-AttachVolumeNegativeTest-1640336653 tempest-AttachVolumeNegativeTest-1640336653-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:03:23.119923 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-c0ac6242-5e37-4568-9b97-4c3b8e9f7795 tempest-AttachVolumeNegativeTest-1640336653 tempest-AttachVolumeNegativeTest-1640336653-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:03:23.120590 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-c0ac6242-5e37-4568-9b97-4c3b8e9f7795 tempest-AttachVolumeNegativeTest-1640336653 tempest-AttachVolumeNegativeTest-1640336653-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:03:23.327746 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.policy [None req-c0ac6242-5e37-4568-9b97-4c3b8e9f7795 tempest-AttachVolumeNegativeTest-1640336653 tempest-AttachVolumeNegativeTest-1640336653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35d37a3d8e504b8186182468b77dd114', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '409b41637da94c469444954258444b4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116157) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:03:23.340623 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: INFO nova.api.openstack.requestlog [None req-c0ac6242-5e37-4568-9b97-4c3b8e9f7795 tempest-AttachVolumeNegativeTest-1640336653 tempest-AttachVolumeNegativeTest-1640336653-project] 10.222.0.18 "GET /compute/v2.1/servers/4923355f-95d6-443d-9487-574f56b87f66" status: 200 len: 1318 microversion: 2.1 time: 0.231823 Dec 15 03:03:23.342422 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: [pid: 116157|app: 0|req: 21/50] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 03:03:23 2021] GET /compute/v2.1/servers/4923355f-95d6-443d-9487-574f56b87f66 => generated 1318 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 03:03:23.527851 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi [None req-b4723573-36d0-41be-9887-b588a1bf38b0 tempest-DeleteServersTestJSON-268050555 tempest-DeleteServersTestJSON-268050555-project] Calling method '>' {{(pid=116156) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:03:23.528461 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.compute.api [None req-b4723573-36d0-41be-9887-b588a1bf38b0 tempest-DeleteServersTestJSON-268050555 tempest-DeleteServersTestJSON-268050555-project] [instance: 5a01bf2d-c341-4af1-b2b2-e1f05e46705f] Fetching instance by UUID {{(pid=116156) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:03:23.541021 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-b4723573-36d0-41be-9887-b588a1bf38b0 tempest-DeleteServersTestJSON-268050555 tempest-DeleteServersTestJSON-268050555-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:03:23.543419 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-b4723573-36d0-41be-9887-b588a1bf38b0 tempest-DeleteServersTestJSON-268050555 tempest-DeleteServersTestJSON-268050555-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:03:23.543737 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-b4723573-36d0-41be-9887-b588a1bf38b0 tempest-DeleteServersTestJSON-268050555 tempest-DeleteServersTestJSON-268050555-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:03:23.544238 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-b4723573-36d0-41be-9887-b588a1bf38b0 tempest-DeleteServersTestJSON-268050555 tempest-DeleteServersTestJSON-268050555-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:03:23.753230 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi [None req-9847d9c5-e4bd-49e2-bcde-d36cedc49eb9 tempest-ServerRescueNegativeTestJSON-2061875223 tempest-ServerRescueNegativeTestJSON-2061875223-project] Calling method '>' {{(pid=116157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:03:23.754217 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.compute.api [None req-9847d9c5-e4bd-49e2-bcde-d36cedc49eb9 tempest-ServerRescueNegativeTestJSON-2061875223 tempest-ServerRescueNegativeTestJSON-2061875223-project] [instance: 2d20c8be-04a9-4c79-aa0a-138a79fe50cd] Fetching instance by UUID {{(pid=116157) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:03:23.761122 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-9847d9c5-e4bd-49e2-bcde-d36cedc49eb9 tempest-ServerRescueNegativeTestJSON-2061875223 tempest-ServerRescueNegativeTestJSON-2061875223-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:03:23.763031 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-9847d9c5-e4bd-49e2-bcde-d36cedc49eb9 tempest-ServerRescueNegativeTestJSON-2061875223 tempest-ServerRescueNegativeTestJSON-2061875223-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:03:23.767132 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-9847d9c5-e4bd-49e2-bcde-d36cedc49eb9 tempest-ServerRescueNegativeTestJSON-2061875223 tempest-ServerRescueNegativeTestJSON-2061875223-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:03:23.767981 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-9847d9c5-e4bd-49e2-bcde-d36cedc49eb9 tempest-ServerRescueNegativeTestJSON-2061875223 tempest-ServerRescueNegativeTestJSON-2061875223-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:03:23.843279 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.policy [None req-b4723573-36d0-41be-9887-b588a1bf38b0 tempest-DeleteServersTestJSON-268050555 tempest-DeleteServersTestJSON-268050555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28384f466c3541358ecea856650f008c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb933fa80ed94ce5b6828e48e86a21c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116156) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:03:23.876905 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: INFO nova.api.openstack.requestlog [None req-b4723573-36d0-41be-9887-b588a1bf38b0 tempest-DeleteServersTestJSON-268050555 tempest-DeleteServersTestJSON-268050555-project] 10.222.0.18 "GET /compute/v2.1/servers/5a01bf2d-c341-4af1-b2b2-e1f05e46705f" status: 200 len: 1315 microversion: 2.1 time: 0.348740 Dec 15 03:03:23.883751 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: [pid: 116156|app: 0|req: 30/51] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 03:03:23 2021] GET /compute/v2.1/servers/5a01bf2d-c341-4af1-b2b2-e1f05e46705f => generated 1315 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 03:03:23.959056 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.policy [None req-9847d9c5-e4bd-49e2-bcde-d36cedc49eb9 tempest-ServerRescueNegativeTestJSON-2061875223 tempest-ServerRescueNegativeTestJSON-2061875223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ea02b6e8f1548a1bd78952cb7337403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5e8a958d4bf43868502b13728b9583b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116157) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:03:23.971213 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: INFO nova.api.openstack.requestlog [None req-9847d9c5-e4bd-49e2-bcde-d36cedc49eb9 tempest-ServerRescueNegativeTestJSON-2061875223 tempest-ServerRescueNegativeTestJSON-2061875223-project] 10.222.0.18 "GET /compute/v2.1/servers/2d20c8be-04a9-4c79-aa0a-138a79fe50cd" status: 200 len: 1281 microversion: 2.1 time: 0.221514 Dec 15 03:03:23.973876 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: [pid: 116157|app: 0|req: 22/52] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 03:03:23 2021] GET /compute/v2.1/servers/2d20c8be-04a9-4c79-aa0a-138a79fe50cd => generated 1281 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 03:03:24.359802 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi [None req-d05559bd-f6ab-40ae-b825-a9863818cd22 tempest-AttachVolumeNegativeTest-1640336653 tempest-AttachVolumeNegativeTest-1640336653-project] Calling method '>' {{(pid=116156) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:03:24.360447 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.compute.api [None req-d05559bd-f6ab-40ae-b825-a9863818cd22 tempest-AttachVolumeNegativeTest-1640336653 tempest-AttachVolumeNegativeTest-1640336653-project] [instance: 4923355f-95d6-443d-9487-574f56b87f66] Fetching instance by UUID {{(pid=116156) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:03:24.375452 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-d05559bd-f6ab-40ae-b825-a9863818cd22 tempest-AttachVolumeNegativeTest-1640336653 tempest-AttachVolumeNegativeTest-1640336653-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:03:24.375934 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-d05559bd-f6ab-40ae-b825-a9863818cd22 tempest-AttachVolumeNegativeTest-1640336653 tempest-AttachVolumeNegativeTest-1640336653-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:03:24.376764 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-d05559bd-f6ab-40ae-b825-a9863818cd22 tempest-AttachVolumeNegativeTest-1640336653 tempest-AttachVolumeNegativeTest-1640336653-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:03:24.377868 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-d05559bd-f6ab-40ae-b825-a9863818cd22 tempest-AttachVolumeNegativeTest-1640336653 tempest-AttachVolumeNegativeTest-1640336653-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:03:24.808354 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.policy [None req-d05559bd-f6ab-40ae-b825-a9863818cd22 tempest-AttachVolumeNegativeTest-1640336653 tempest-AttachVolumeNegativeTest-1640336653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35d37a3d8e504b8186182468b77dd114', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '409b41637da94c469444954258444b4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116156) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:03:24.824734 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: INFO nova.api.openstack.requestlog [None req-d05559bd-f6ab-40ae-b825-a9863818cd22 tempest-AttachVolumeNegativeTest-1640336653 tempest-AttachVolumeNegativeTest-1640336653-project] 10.222.0.18 "GET /compute/v2.1/servers/4923355f-95d6-443d-9487-574f56b87f66" status: 200 len: 1318 microversion: 2.1 time: 0.463534 Dec 15 03:03:24.828809 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: [pid: 116156|app: 0|req: 31/53] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 03:03:24 2021] GET /compute/v2.1/servers/4923355f-95d6-443d-9487-574f56b87f66 => generated 1318 bytes in 474 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 03:03:24.909295 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi [None req-e8fc7b68-f9e7-4b7d-b3f9-c23a6e649e05 tempest-DeleteServersTestJSON-268050555 tempest-DeleteServersTestJSON-268050555-project] Calling method '>' {{(pid=116157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:03:24.912052 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.compute.api [None req-e8fc7b68-f9e7-4b7d-b3f9-c23a6e649e05 tempest-DeleteServersTestJSON-268050555 tempest-DeleteServersTestJSON-268050555-project] [instance: 5a01bf2d-c341-4af1-b2b2-e1f05e46705f] Fetching instance by UUID {{(pid=116157) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:03:24.919828 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-e8fc7b68-f9e7-4b7d-b3f9-c23a6e649e05 tempest-DeleteServersTestJSON-268050555 tempest-DeleteServersTestJSON-268050555-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:03:24.921300 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-e8fc7b68-f9e7-4b7d-b3f9-c23a6e649e05 tempest-DeleteServersTestJSON-268050555 tempest-DeleteServersTestJSON-268050555-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:03:24.922390 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-e8fc7b68-f9e7-4b7d-b3f9-c23a6e649e05 tempest-DeleteServersTestJSON-268050555 tempest-DeleteServersTestJSON-268050555-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:03:24.923022 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-e8fc7b68-f9e7-4b7d-b3f9-c23a6e649e05 tempest-DeleteServersTestJSON-268050555 tempest-DeleteServersTestJSON-268050555-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:03:24.996890 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi [None req-4ac7302d-a496-44ff-aa81-6162d793c1cc tempest-ServerRescueNegativeTestJSON-2061875223 tempest-ServerRescueNegativeTestJSON-2061875223-project] Calling method '>' {{(pid=116156) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:03:24.997585 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.compute.api [None req-4ac7302d-a496-44ff-aa81-6162d793c1cc tempest-ServerRescueNegativeTestJSON-2061875223 tempest-ServerRescueNegativeTestJSON-2061875223-project] [instance: 2d20c8be-04a9-4c79-aa0a-138a79fe50cd] Fetching instance by UUID {{(pid=116156) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:03:25.012329 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-4ac7302d-a496-44ff-aa81-6162d793c1cc tempest-ServerRescueNegativeTestJSON-2061875223 tempest-ServerRescueNegativeTestJSON-2061875223-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:03:25.012856 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-4ac7302d-a496-44ff-aa81-6162d793c1cc tempest-ServerRescueNegativeTestJSON-2061875223 tempest-ServerRescueNegativeTestJSON-2061875223-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:03:25.014239 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-4ac7302d-a496-44ff-aa81-6162d793c1cc tempest-ServerRescueNegativeTestJSON-2061875223 tempest-ServerRescueNegativeTestJSON-2061875223-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:03:25.015220 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-4ac7302d-a496-44ff-aa81-6162d793c1cc tempest-ServerRescueNegativeTestJSON-2061875223 tempest-ServerRescueNegativeTestJSON-2061875223-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:03:25.147013 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.policy [None req-4ac7302d-a496-44ff-aa81-6162d793c1cc tempest-ServerRescueNegativeTestJSON-2061875223 tempest-ServerRescueNegativeTestJSON-2061875223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ea02b6e8f1548a1bd78952cb7337403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5e8a958d4bf43868502b13728b9583b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116156) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:03:25.156085 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: INFO nova.api.openstack.requestlog [None req-4ac7302d-a496-44ff-aa81-6162d793c1cc tempest-ServerRescueNegativeTestJSON-2061875223 tempest-ServerRescueNegativeTestJSON-2061875223-project] 10.222.0.18 "GET /compute/v2.1/servers/2d20c8be-04a9-4c79-aa0a-138a79fe50cd" status: 200 len: 1281 microversion: 2.1 time: 0.168181 Dec 15 03:03:25.156662 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: [pid: 116156|app: 0|req: 32/54] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 03:03:24 2021] GET /compute/v2.1/servers/2d20c8be-04a9-4c79-aa0a-138a79fe50cd => generated 1281 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 03:03:25.173052 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.policy [None req-e8fc7b68-f9e7-4b7d-b3f9-c23a6e649e05 tempest-DeleteServersTestJSON-268050555 tempest-DeleteServersTestJSON-268050555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28384f466c3541358ecea856650f008c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb933fa80ed94ce5b6828e48e86a21c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116157) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:03:25.183395 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: INFO nova.api.openstack.requestlog [None req-e8fc7b68-f9e7-4b7d-b3f9-c23a6e649e05 tempest-DeleteServersTestJSON-268050555 tempest-DeleteServersTestJSON-268050555-project] 10.222.0.18 "GET /compute/v2.1/servers/5a01bf2d-c341-4af1-b2b2-e1f05e46705f" status: 200 len: 1315 microversion: 2.1 time: 0.277338 Dec 15 03:03:25.184239 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: [pid: 116157|app: 0|req: 23/55] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 03:03:24 2021] GET /compute/v2.1/servers/5a01bf2d-c341-4af1-b2b2-e1f05e46705f => generated 1315 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 03:03:25.846252 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi [None req-8e6e289d-c68b-4e58-8622-ca58d3554946 tempest-AttachVolumeNegativeTest-1640336653 tempest-AttachVolumeNegativeTest-1640336653-project] Calling method '>' {{(pid=116156) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:03:25.846879 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.compute.api [None req-8e6e289d-c68b-4e58-8622-ca58d3554946 tempest-AttachVolumeNegativeTest-1640336653 tempest-AttachVolumeNegativeTest-1640336653-project] [instance: 4923355f-95d6-443d-9487-574f56b87f66] Fetching instance by UUID {{(pid=116156) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:03:25.858854 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-8e6e289d-c68b-4e58-8622-ca58d3554946 tempest-AttachVolumeNegativeTest-1640336653 tempest-AttachVolumeNegativeTest-1640336653-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:03:25.860387 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-8e6e289d-c68b-4e58-8622-ca58d3554946 tempest-AttachVolumeNegativeTest-1640336653 tempest-AttachVolumeNegativeTest-1640336653-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:03:25.865820 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-8e6e289d-c68b-4e58-8622-ca58d3554946 tempest-AttachVolumeNegativeTest-1640336653 tempest-AttachVolumeNegativeTest-1640336653-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:03:25.866679 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-8e6e289d-c68b-4e58-8622-ca58d3554946 tempest-AttachVolumeNegativeTest-1640336653 tempest-AttachVolumeNegativeTest-1640336653-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:03:26.179332 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi [None req-78e9a481-0027-4e4a-b96e-2fee28d6bd4b tempest-ServerRescueNegativeTestJSON-2061875223 tempest-ServerRescueNegativeTestJSON-2061875223-project] Calling method '>' {{(pid=116157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:03:26.180089 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.compute.api [None req-78e9a481-0027-4e4a-b96e-2fee28d6bd4b tempest-ServerRescueNegativeTestJSON-2061875223 tempest-ServerRescueNegativeTestJSON-2061875223-project] [instance: 2d20c8be-04a9-4c79-aa0a-138a79fe50cd] Fetching instance by UUID {{(pid=116157) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:03:26.190538 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-78e9a481-0027-4e4a-b96e-2fee28d6bd4b tempest-ServerRescueNegativeTestJSON-2061875223 tempest-ServerRescueNegativeTestJSON-2061875223-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:03:26.195192 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-78e9a481-0027-4e4a-b96e-2fee28d6bd4b tempest-ServerRescueNegativeTestJSON-2061875223 tempest-ServerRescueNegativeTestJSON-2061875223-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:03:26.203131 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-78e9a481-0027-4e4a-b96e-2fee28d6bd4b tempest-ServerRescueNegativeTestJSON-2061875223 tempest-ServerRescueNegativeTestJSON-2061875223-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:03:26.204880 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-78e9a481-0027-4e4a-b96e-2fee28d6bd4b tempest-ServerRescueNegativeTestJSON-2061875223 tempest-ServerRescueNegativeTestJSON-2061875223-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:03:26.262899 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.policy [None req-8e6e289d-c68b-4e58-8622-ca58d3554946 tempest-AttachVolumeNegativeTest-1640336653 tempest-AttachVolumeNegativeTest-1640336653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35d37a3d8e504b8186182468b77dd114', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '409b41637da94c469444954258444b4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116156) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:03:26.271721 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: INFO nova.api.openstack.requestlog [None req-8e6e289d-c68b-4e58-8622-ca58d3554946 tempest-AttachVolumeNegativeTest-1640336653 tempest-AttachVolumeNegativeTest-1640336653-project] 10.222.0.18 "GET /compute/v2.1/servers/4923355f-95d6-443d-9487-574f56b87f66" status: 200 len: 1318 microversion: 2.1 time: 0.430551 Dec 15 03:03:26.272308 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: [pid: 116156|app: 0|req: 33/56] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 03:03:25 2021] GET /compute/v2.1/servers/4923355f-95d6-443d-9487-574f56b87f66 => generated 1318 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 03:03:26.286921 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi [None req-484df766-2a03-49e4-addf-925011e29728 tempest-DeleteServersTestJSON-268050555 tempest-DeleteServersTestJSON-268050555-project] Calling method '>' {{(pid=116156) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:03:26.287900 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.compute.api [None req-484df766-2a03-49e4-addf-925011e29728 tempest-DeleteServersTestJSON-268050555 tempest-DeleteServersTestJSON-268050555-project] [instance: 5a01bf2d-c341-4af1-b2b2-e1f05e46705f] Fetching instance by UUID {{(pid=116156) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:03:26.316042 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-484df766-2a03-49e4-addf-925011e29728 tempest-DeleteServersTestJSON-268050555 tempest-DeleteServersTestJSON-268050555-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:03:26.316497 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-484df766-2a03-49e4-addf-925011e29728 tempest-DeleteServersTestJSON-268050555 tempest-DeleteServersTestJSON-268050555-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:03:26.318481 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-484df766-2a03-49e4-addf-925011e29728 tempest-DeleteServersTestJSON-268050555 tempest-DeleteServersTestJSON-268050555-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:03:26.330215 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-484df766-2a03-49e4-addf-925011e29728 tempest-DeleteServersTestJSON-268050555 tempest-DeleteServersTestJSON-268050555-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:03:26.398310 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.policy [None req-78e9a481-0027-4e4a-b96e-2fee28d6bd4b tempest-ServerRescueNegativeTestJSON-2061875223 tempest-ServerRescueNegativeTestJSON-2061875223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ea02b6e8f1548a1bd78952cb7337403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5e8a958d4bf43868502b13728b9583b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116157) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:03:26.412436 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: INFO nova.api.openstack.requestlog [None req-78e9a481-0027-4e4a-b96e-2fee28d6bd4b tempest-ServerRescueNegativeTestJSON-2061875223 tempest-ServerRescueNegativeTestJSON-2061875223-project] 10.222.0.18 "GET /compute/v2.1/servers/2d20c8be-04a9-4c79-aa0a-138a79fe50cd" status: 200 len: 1281 microversion: 2.1 time: 0.235835 Dec 15 03:03:26.414689 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: [pid: 116157|app: 0|req: 24/57] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 03:03:26 2021] GET /compute/v2.1/servers/2d20c8be-04a9-4c79-aa0a-138a79fe50cd => generated 1281 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 03:03:26.845208 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.policy [None req-484df766-2a03-49e4-addf-925011e29728 tempest-DeleteServersTestJSON-268050555 tempest-DeleteServersTestJSON-268050555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28384f466c3541358ecea856650f008c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb933fa80ed94ce5b6828e48e86a21c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116156) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:03:26.853547 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: INFO nova.api.openstack.requestlog [None req-484df766-2a03-49e4-addf-925011e29728 tempest-DeleteServersTestJSON-268050555 tempest-DeleteServersTestJSON-268050555-project] 10.222.0.18 "GET /compute/v2.1/servers/5a01bf2d-c341-4af1-b2b2-e1f05e46705f" status: 200 len: 1315 microversion: 2.1 time: 0.575834 Dec 15 03:03:26.871185 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: [pid: 116156|app: 0|req: 34/58] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 03:03:26 2021] GET /compute/v2.1/servers/5a01bf2d-c341-4af1-b2b2-e1f05e46705f => generated 1315 bytes in 594 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 03:03:27.288951 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi [None req-327f4789-a8d7-4d1f-b407-3fc0477207d6 tempest-AttachVolumeNegativeTest-1640336653 tempest-AttachVolumeNegativeTest-1640336653-project] Calling method '>' {{(pid=116157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:03:27.289678 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.compute.api [None req-327f4789-a8d7-4d1f-b407-3fc0477207d6 tempest-AttachVolumeNegativeTest-1640336653 tempest-AttachVolumeNegativeTest-1640336653-project] [instance: 4923355f-95d6-443d-9487-574f56b87f66] Fetching instance by UUID {{(pid=116157) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:03:27.303669 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-327f4789-a8d7-4d1f-b407-3fc0477207d6 tempest-AttachVolumeNegativeTest-1640336653 tempest-AttachVolumeNegativeTest-1640336653-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:03:27.314160 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-327f4789-a8d7-4d1f-b407-3fc0477207d6 tempest-AttachVolumeNegativeTest-1640336653 tempest-AttachVolumeNegativeTest-1640336653-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:03:27.315161 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-327f4789-a8d7-4d1f-b407-3fc0477207d6 tempest-AttachVolumeNegativeTest-1640336653 tempest-AttachVolumeNegativeTest-1640336653-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:03:27.317554 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-327f4789-a8d7-4d1f-b407-3fc0477207d6 tempest-AttachVolumeNegativeTest-1640336653 tempest-AttachVolumeNegativeTest-1640336653-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:03:27.434940 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi [None req-5e416f0b-86c0-4c38-8d41-5b17529d49e7 tempest-ServerRescueNegativeTestJSON-2061875223 tempest-ServerRescueNegativeTestJSON-2061875223-project] Calling method '>' {{(pid=116156) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:03:27.435836 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.compute.api [None req-5e416f0b-86c0-4c38-8d41-5b17529d49e7 tempest-ServerRescueNegativeTestJSON-2061875223 tempest-ServerRescueNegativeTestJSON-2061875223-project] [instance: 2d20c8be-04a9-4c79-aa0a-138a79fe50cd] Fetching instance by UUID {{(pid=116156) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:03:27.444019 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-5e416f0b-86c0-4c38-8d41-5b17529d49e7 tempest-ServerRescueNegativeTestJSON-2061875223 tempest-ServerRescueNegativeTestJSON-2061875223-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:03:27.446743 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-5e416f0b-86c0-4c38-8d41-5b17529d49e7 tempest-ServerRescueNegativeTestJSON-2061875223 tempest-ServerRescueNegativeTestJSON-2061875223-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:03:27.450711 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-5e416f0b-86c0-4c38-8d41-5b17529d49e7 tempest-ServerRescueNegativeTestJSON-2061875223 tempest-ServerRescueNegativeTestJSON-2061875223-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:03:27.452969 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-5e416f0b-86c0-4c38-8d41-5b17529d49e7 tempest-ServerRescueNegativeTestJSON-2061875223 tempest-ServerRescueNegativeTestJSON-2061875223-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:03:27.709847 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.policy [None req-5e416f0b-86c0-4c38-8d41-5b17529d49e7 tempest-ServerRescueNegativeTestJSON-2061875223 tempest-ServerRescueNegativeTestJSON-2061875223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ea02b6e8f1548a1bd78952cb7337403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5e8a958d4bf43868502b13728b9583b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116156) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:03:27.721674 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: INFO nova.api.openstack.requestlog [None req-5e416f0b-86c0-4c38-8d41-5b17529d49e7 tempest-ServerRescueNegativeTestJSON-2061875223 tempest-ServerRescueNegativeTestJSON-2061875223-project] 10.222.0.18 "GET /compute/v2.1/servers/2d20c8be-04a9-4c79-aa0a-138a79fe50cd" status: 200 len: 1279 microversion: 2.1 time: 0.292866 Dec 15 03:03:27.725126 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: [pid: 116156|app: 0|req: 35/59] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 03:03:27 2021] GET /compute/v2.1/servers/2d20c8be-04a9-4c79-aa0a-138a79fe50cd => generated 1279 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 03:03:27.874363 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi [None req-bff011b3-5ce8-42c1-b3d5-18ade8c96c78 tempest-DeleteServersTestJSON-268050555 tempest-DeleteServersTestJSON-268050555-project] Calling method '>' {{(pid=116156) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:03:27.875891 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.compute.api [None req-bff011b3-5ce8-42c1-b3d5-18ade8c96c78 tempest-DeleteServersTestJSON-268050555 tempest-DeleteServersTestJSON-268050555-project] [instance: 5a01bf2d-c341-4af1-b2b2-e1f05e46705f] Fetching instance by UUID {{(pid=116156) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:03:27.882834 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-bff011b3-5ce8-42c1-b3d5-18ade8c96c78 tempest-DeleteServersTestJSON-268050555 tempest-DeleteServersTestJSON-268050555-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:03:27.883347 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-bff011b3-5ce8-42c1-b3d5-18ade8c96c78 tempest-DeleteServersTestJSON-268050555 tempest-DeleteServersTestJSON-268050555-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:03:27.884417 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-bff011b3-5ce8-42c1-b3d5-18ade8c96c78 tempest-DeleteServersTestJSON-268050555 tempest-DeleteServersTestJSON-268050555-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:03:27.885046 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-bff011b3-5ce8-42c1-b3d5-18ade8c96c78 tempest-DeleteServersTestJSON-268050555 tempest-DeleteServersTestJSON-268050555-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:03:28.013037 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.policy [None req-327f4789-a8d7-4d1f-b407-3fc0477207d6 tempest-AttachVolumeNegativeTest-1640336653 tempest-AttachVolumeNegativeTest-1640336653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35d37a3d8e504b8186182468b77dd114', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '409b41637da94c469444954258444b4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116157) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:03:28.021354 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: INFO nova.api.openstack.requestlog [None req-327f4789-a8d7-4d1f-b407-3fc0477207d6 tempest-AttachVolumeNegativeTest-1640336653 tempest-AttachVolumeNegativeTest-1640336653-project] 10.222.0.18 "GET /compute/v2.1/servers/4923355f-95d6-443d-9487-574f56b87f66" status: 200 len: 1318 microversion: 2.1 time: 0.736451 Dec 15 03:03:28.024538 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: [pid: 116157|app: 0|req: 25/60] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 03:03:27 2021] GET /compute/v2.1/servers/4923355f-95d6-443d-9487-574f56b87f66 => generated 1318 bytes in 740 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 03:03:28.371661 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.policy [None req-bff011b3-5ce8-42c1-b3d5-18ade8c96c78 tempest-DeleteServersTestJSON-268050555 tempest-DeleteServersTestJSON-268050555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28384f466c3541358ecea856650f008c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb933fa80ed94ce5b6828e48e86a21c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116156) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:03:28.381191 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: INFO nova.api.openstack.requestlog [None req-bff011b3-5ce8-42c1-b3d5-18ade8c96c78 tempest-DeleteServersTestJSON-268050555 tempest-DeleteServersTestJSON-268050555-project] 10.222.0.18 "GET /compute/v2.1/servers/5a01bf2d-c341-4af1-b2b2-e1f05e46705f" status: 200 len: 1315 microversion: 2.1 time: 0.511131 Dec 15 03:03:28.391989 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: [pid: 116156|app: 0|req: 36/61] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 03:03:27 2021] GET /compute/v2.1/servers/5a01bf2d-c341-4af1-b2b2-e1f05e46705f => generated 1315 bytes in 522 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 03:03:28.740694 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi [None req-d6d6610d-9b79-4532-a65c-701a20c65688 tempest-ServerRescueNegativeTestJSON-2061875223 tempest-ServerRescueNegativeTestJSON-2061875223-project] Calling method '>' {{(pid=116157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:03:28.740694 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.compute.api [None req-d6d6610d-9b79-4532-a65c-701a20c65688 tempest-ServerRescueNegativeTestJSON-2061875223 tempest-ServerRescueNegativeTestJSON-2061875223-project] [instance: 2d20c8be-04a9-4c79-aa0a-138a79fe50cd] Fetching instance by UUID {{(pid=116157) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:03:28.754720 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-d6d6610d-9b79-4532-a65c-701a20c65688 tempest-ServerRescueNegativeTestJSON-2061875223 tempest-ServerRescueNegativeTestJSON-2061875223-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:03:28.755376 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-d6d6610d-9b79-4532-a65c-701a20c65688 tempest-ServerRescueNegativeTestJSON-2061875223 tempest-ServerRescueNegativeTestJSON-2061875223-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:03:28.756340 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-d6d6610d-9b79-4532-a65c-701a20c65688 tempest-ServerRescueNegativeTestJSON-2061875223 tempest-ServerRescueNegativeTestJSON-2061875223-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:03:28.756924 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-d6d6610d-9b79-4532-a65c-701a20c65688 tempest-ServerRescueNegativeTestJSON-2061875223 tempest-ServerRescueNegativeTestJSON-2061875223-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:03:28.901182 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.policy [None req-d6d6610d-9b79-4532-a65c-701a20c65688 tempest-ServerRescueNegativeTestJSON-2061875223 tempest-ServerRescueNegativeTestJSON-2061875223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ea02b6e8f1548a1bd78952cb7337403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5e8a958d4bf43868502b13728b9583b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116157) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:03:28.909037 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: INFO nova.api.openstack.requestlog [None req-d6d6610d-9b79-4532-a65c-701a20c65688 tempest-ServerRescueNegativeTestJSON-2061875223 tempest-ServerRescueNegativeTestJSON-2061875223-project] 10.222.0.18 "GET /compute/v2.1/servers/2d20c8be-04a9-4c79-aa0a-138a79fe50cd" status: 200 len: 1279 microversion: 2.1 time: 0.172398 Dec 15 03:03:28.909638 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: [pid: 116157|app: 0|req: 26/62] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 03:03:28 2021] GET /compute/v2.1/servers/2d20c8be-04a9-4c79-aa0a-138a79fe50cd => generated 1279 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 03:03:29.039948 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi [None req-3522b8b5-549c-4437-ab8d-1f7607651120 tempest-AttachVolumeNegativeTest-1640336653 tempest-AttachVolumeNegativeTest-1640336653-project] Calling method '>' {{(pid=116156) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:03:29.041226 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.compute.api [None req-3522b8b5-549c-4437-ab8d-1f7607651120 tempest-AttachVolumeNegativeTest-1640336653 tempest-AttachVolumeNegativeTest-1640336653-project] [instance: 4923355f-95d6-443d-9487-574f56b87f66] Fetching instance by UUID {{(pid=116156) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:03:29.047499 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-3522b8b5-549c-4437-ab8d-1f7607651120 tempest-AttachVolumeNegativeTest-1640336653 tempest-AttachVolumeNegativeTest-1640336653-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:03:29.048179 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-3522b8b5-549c-4437-ab8d-1f7607651120 tempest-AttachVolumeNegativeTest-1640336653 tempest-AttachVolumeNegativeTest-1640336653-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:03:29.049172 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-3522b8b5-549c-4437-ab8d-1f7607651120 tempest-AttachVolumeNegativeTest-1640336653 tempest-AttachVolumeNegativeTest-1640336653-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:03:29.050274 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-3522b8b5-549c-4437-ab8d-1f7607651120 tempest-AttachVolumeNegativeTest-1640336653 tempest-AttachVolumeNegativeTest-1640336653-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:03:29.404755 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi [None req-a7196b88-cbfe-43d3-88a5-66a2bd06913d tempest-DeleteServersTestJSON-268050555 tempest-DeleteServersTestJSON-268050555-project] Calling method '>' {{(pid=116157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:03:29.406836 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.compute.api [None req-a7196b88-cbfe-43d3-88a5-66a2bd06913d tempest-DeleteServersTestJSON-268050555 tempest-DeleteServersTestJSON-268050555-project] [instance: 5a01bf2d-c341-4af1-b2b2-e1f05e46705f] Fetching instance by UUID {{(pid=116157) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:03:29.431681 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-a7196b88-cbfe-43d3-88a5-66a2bd06913d tempest-DeleteServersTestJSON-268050555 tempest-DeleteServersTestJSON-268050555-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:03:29.433435 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-a7196b88-cbfe-43d3-88a5-66a2bd06913d tempest-DeleteServersTestJSON-268050555 tempest-DeleteServersTestJSON-268050555-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:03:29.434649 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-a7196b88-cbfe-43d3-88a5-66a2bd06913d tempest-DeleteServersTestJSON-268050555 tempest-DeleteServersTestJSON-268050555-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:03:29.442068 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.policy [None req-3522b8b5-549c-4437-ab8d-1f7607651120 tempest-AttachVolumeNegativeTest-1640336653 tempest-AttachVolumeNegativeTest-1640336653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35d37a3d8e504b8186182468b77dd114', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '409b41637da94c469444954258444b4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116156) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:03:29.449738 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-a7196b88-cbfe-43d3-88a5-66a2bd06913d tempest-DeleteServersTestJSON-268050555 tempest-DeleteServersTestJSON-268050555-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:03:29.469199 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: INFO nova.api.openstack.requestlog [None req-3522b8b5-549c-4437-ab8d-1f7607651120 tempest-AttachVolumeNegativeTest-1640336653 tempest-AttachVolumeNegativeTest-1640336653-project] 10.222.0.18 "GET /compute/v2.1/servers/4923355f-95d6-443d-9487-574f56b87f66" status: 200 len: 1318 microversion: 2.1 time: 0.432667 Dec 15 03:03:29.473613 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: [pid: 116156|app: 0|req: 37/63] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 03:03:29 2021] GET /compute/v2.1/servers/4923355f-95d6-443d-9487-574f56b87f66 => generated 1318 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 03:03:29.738917 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi [req-fa544ee5-6766-4d54-a590-f6203ebfc2c0 req-839dc905-2bfe-479c-89d0-4aa1058a1a0d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4923355f-95d6-443d-9487-574f56b87f66", "tag": "a334403e-b33f-4832-89e4-ad890500445a"}]} {{(pid=116156) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 03:03:29.741901 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 15 03:03:29.741901 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: warnings.warn(msg) Dec 15 03:03:29.769595 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [req-fa544ee5-6766-4d54-a590-f6203ebfc2c0 req-839dc905-2bfe-479c-89d0-4aa1058a1a0d service nova] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:03:29.770750 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [req-fa544ee5-6766-4d54-a590-f6203ebfc2c0 req-839dc905-2bfe-479c-89d0-4aa1058a1a0d service nova] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:03:29.794258 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: INFO nova.api.openstack.compute.server_external_events [req-fa544ee5-6766-4d54-a590-f6203ebfc2c0 req-839dc905-2bfe-479c-89d0-4aa1058a1a0d service nova] Creating event network-changed:a334403e-b33f-4832-89e4-ad890500445a for instance 4923355f-95d6-443d-9487-574f56b87f66 on hv-cinder-81803 Dec 15 03:03:29.795336 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [req-fa544ee5-6766-4d54-a590-f6203ebfc2c0 req-839dc905-2bfe-479c-89d0-4aa1058a1a0d service nova] Acquired lock "compute-rpcapi-router" {{(pid=116156) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Dec 15 03:03:29.796791 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-256c1542-e946-4c31-87b9-dd45659277a5 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:03:29.797205 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-256c1542-e946-4c31-87b9-dd45659277a5 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:03:29.798511 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-256c1542-e946-4c31-87b9-dd45659277a5 None None] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:03:29.798964 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-256c1542-e946-4c31-87b9-dd45659277a5 None None] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:03:29.812626 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: INFO nova.compute.rpcapi [None req-256c1542-e946-4c31-87b9-dd45659277a5 None None] Automatically selected compute RPC version 6.0 from minimum service version 60 Dec 15 03:03:29.813654 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-256c1542-e946-4c31-87b9-dd45659277a5 None None] Releasing lock "compute-rpcapi-router" {{(pid=116156) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Dec 15 03:03:29.844331 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: INFO nova.api.openstack.requestlog [None req-256c1542-e946-4c31-87b9-dd45659277a5 None None] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.267522 Dec 15 03:03:29.844944 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: [pid: 116156|app: 0|req: 38/64] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Dec 15 03:03:29 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 03:03:30.022137 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi [req-a223d12d-3de3-4bfe-8413-dd3123517c51 req-aebb5f10-f455-4617-bcb1-3d125a992577 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5a01bf2d-c341-4af1-b2b2-e1f05e46705f", "tag": "fe412742-6f13-4058-be01-92b028115500"}]} {{(pid=116156) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 03:03:30.031583 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.policy [None req-a7196b88-cbfe-43d3-88a5-66a2bd06913d tempest-DeleteServersTestJSON-268050555 tempest-DeleteServersTestJSON-268050555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28384f466c3541358ecea856650f008c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb933fa80ed94ce5b6828e48e86a21c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116157) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:03:30.032180 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 15 03:03:30.032180 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: warnings.warn(msg) Dec 15 03:03:30.040296 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: INFO nova.api.openstack.requestlog [None req-a7196b88-cbfe-43d3-88a5-66a2bd06913d tempest-DeleteServersTestJSON-268050555 tempest-DeleteServersTestJSON-268050555-project] 10.222.0.18 "GET /compute/v2.1/servers/5a01bf2d-c341-4af1-b2b2-e1f05e46705f" status: 200 len: 1315 microversion: 2.1 time: 0.644302 Dec 15 03:03:30.042927 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: [pid: 116157|app: 0|req: 27/65] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 03:03:29 2021] GET /compute/v2.1/servers/5a01bf2d-c341-4af1-b2b2-e1f05e46705f => generated 1315 bytes in 648 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 03:03:30.053237 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi [None req-55677d60-5804-4543-902f-6f36b1e42c08 tempest-ServerRescueNegativeTestJSON-2061875223 tempest-ServerRescueNegativeTestJSON-2061875223-project] Calling method '>' {{(pid=116157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:03:30.053884 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.compute.api [None req-55677d60-5804-4543-902f-6f36b1e42c08 tempest-ServerRescueNegativeTestJSON-2061875223 tempest-ServerRescueNegativeTestJSON-2061875223-project] [instance: 2d20c8be-04a9-4c79-aa0a-138a79fe50cd] Fetching instance by UUID {{(pid=116157) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:03:30.055046 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [req-a223d12d-3de3-4bfe-8413-dd3123517c51 req-aebb5f10-f455-4617-bcb1-3d125a992577 service nova] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:03:30.057013 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [req-a223d12d-3de3-4bfe-8413-dd3123517c51 req-aebb5f10-f455-4617-bcb1-3d125a992577 service nova] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:03:30.062843 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-55677d60-5804-4543-902f-6f36b1e42c08 tempest-ServerRescueNegativeTestJSON-2061875223 tempest-ServerRescueNegativeTestJSON-2061875223-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:03:30.063992 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-55677d60-5804-4543-902f-6f36b1e42c08 tempest-ServerRescueNegativeTestJSON-2061875223 tempest-ServerRescueNegativeTestJSON-2061875223-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:03:30.066436 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-55677d60-5804-4543-902f-6f36b1e42c08 tempest-ServerRescueNegativeTestJSON-2061875223 tempest-ServerRescueNegativeTestJSON-2061875223-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:03:30.068108 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-55677d60-5804-4543-902f-6f36b1e42c08 tempest-ServerRescueNegativeTestJSON-2061875223 tempest-ServerRescueNegativeTestJSON-2061875223-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:03:30.074547 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: INFO nova.api.openstack.compute.server_external_events [req-a223d12d-3de3-4bfe-8413-dd3123517c51 req-aebb5f10-f455-4617-bcb1-3d125a992577 service nova] Creating event network-changed:fe412742-6f13-4058-be01-92b028115500 for instance 5a01bf2d-c341-4af1-b2b2-e1f05e46705f on hv-cinder-81803 Dec 15 03:03:30.080019 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: INFO nova.api.openstack.requestlog [req-a223d12d-3de3-4bfe-8413-dd3123517c51 req-aebb5f10-f455-4617-bcb1-3d125a992577 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.233189 Dec 15 03:03:30.097361 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: [pid: 116156|app: 0|req: 39/66] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Dec 15 03:03:29 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 03:03:30.490055 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi [None req-9d2103dd-7339-46f9-8843-e35487e2fe6e tempest-AttachVolumeNegativeTest-1640336653 tempest-AttachVolumeNegativeTest-1640336653-project] Calling method '>' {{(pid=116156) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:03:30.491059 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.compute.api [None req-9d2103dd-7339-46f9-8843-e35487e2fe6e tempest-AttachVolumeNegativeTest-1640336653 tempest-AttachVolumeNegativeTest-1640336653-project] [instance: 4923355f-95d6-443d-9487-574f56b87f66] Fetching instance by UUID {{(pid=116156) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:03:30.498435 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-9d2103dd-7339-46f9-8843-e35487e2fe6e tempest-AttachVolumeNegativeTest-1640336653 tempest-AttachVolumeNegativeTest-1640336653-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:03:30.499400 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-9d2103dd-7339-46f9-8843-e35487e2fe6e tempest-AttachVolumeNegativeTest-1640336653 tempest-AttachVolumeNegativeTest-1640336653-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:03:30.500417 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-9d2103dd-7339-46f9-8843-e35487e2fe6e tempest-AttachVolumeNegativeTest-1640336653 tempest-AttachVolumeNegativeTest-1640336653-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:03:30.501108 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-9d2103dd-7339-46f9-8843-e35487e2fe6e tempest-AttachVolumeNegativeTest-1640336653 tempest-AttachVolumeNegativeTest-1640336653-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:03:30.661655 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.policy [None req-55677d60-5804-4543-902f-6f36b1e42c08 tempest-ServerRescueNegativeTestJSON-2061875223 tempest-ServerRescueNegativeTestJSON-2061875223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ea02b6e8f1548a1bd78952cb7337403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5e8a958d4bf43868502b13728b9583b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116157) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:03:30.671382 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: INFO nova.api.openstack.requestlog [None req-55677d60-5804-4543-902f-6f36b1e42c08 tempest-ServerRescueNegativeTestJSON-2061875223 tempest-ServerRescueNegativeTestJSON-2061875223-project] 10.222.0.18 "GET /compute/v2.1/servers/2d20c8be-04a9-4c79-aa0a-138a79fe50cd" status: 200 len: 1321 microversion: 2.1 time: 0.627167 Dec 15 03:03:30.674047 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: [pid: 116157|app: 0|req: 28/67] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 03:03:30 2021] GET /compute/v2.1/servers/2d20c8be-04a9-4c79-aa0a-138a79fe50cd => generated 1321 bytes in 629 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 03:03:31.059356 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi [None req-29d4a4c4-c909-4ce9-a040-8cc2789cb0f6 tempest-DeleteServersTestJSON-268050555 tempest-DeleteServersTestJSON-268050555-project] Calling method '>' {{(pid=116157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:03:31.061751 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.compute.api [None req-29d4a4c4-c909-4ce9-a040-8cc2789cb0f6 tempest-DeleteServersTestJSON-268050555 tempest-DeleteServersTestJSON-268050555-project] [instance: 5a01bf2d-c341-4af1-b2b2-e1f05e46705f] Fetching instance by UUID {{(pid=116157) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:03:31.077009 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-29d4a4c4-c909-4ce9-a040-8cc2789cb0f6 tempest-DeleteServersTestJSON-268050555 tempest-DeleteServersTestJSON-268050555-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:03:31.079290 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-29d4a4c4-c909-4ce9-a040-8cc2789cb0f6 tempest-DeleteServersTestJSON-268050555 tempest-DeleteServersTestJSON-268050555-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:03:31.082320 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-29d4a4c4-c909-4ce9-a040-8cc2789cb0f6 tempest-DeleteServersTestJSON-268050555 tempest-DeleteServersTestJSON-268050555-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:03:31.083441 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-29d4a4c4-c909-4ce9-a040-8cc2789cb0f6 tempest-DeleteServersTestJSON-268050555 tempest-DeleteServersTestJSON-268050555-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:03:31.490687 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.policy [None req-9d2103dd-7339-46f9-8843-e35487e2fe6e tempest-AttachVolumeNegativeTest-1640336653 tempest-AttachVolumeNegativeTest-1640336653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35d37a3d8e504b8186182468b77dd114', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '409b41637da94c469444954258444b4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116156) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:03:31.499958 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: INFO nova.api.openstack.requestlog [None req-9d2103dd-7339-46f9-8843-e35487e2fe6e tempest-AttachVolumeNegativeTest-1640336653 tempest-AttachVolumeNegativeTest-1640336653-project] 10.222.0.18 "GET /compute/v2.1/servers/4923355f-95d6-443d-9487-574f56b87f66" status: 200 len: 1318 microversion: 2.1 time: 1.013910 Dec 15 03:03:31.514363 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: [pid: 116156|app: 0|req: 40/68] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 03:03:30 2021] GET /compute/v2.1/servers/4923355f-95d6-443d-9487-574f56b87f66 => generated 1318 bytes in 1029 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 03:03:31.689606 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi [None req-cfe34399-5618-460c-8ae0-d2ac373145d8 tempest-ServerRescueNegativeTestJSON-2061875223 tempest-ServerRescueNegativeTestJSON-2061875223-project] Calling method '>' {{(pid=116156) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:03:31.691555 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.compute.api [None req-cfe34399-5618-460c-8ae0-d2ac373145d8 tempest-ServerRescueNegativeTestJSON-2061875223 tempest-ServerRescueNegativeTestJSON-2061875223-project] [instance: 2d20c8be-04a9-4c79-aa0a-138a79fe50cd] Fetching instance by UUID {{(pid=116156) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:03:31.701944 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-cfe34399-5618-460c-8ae0-d2ac373145d8 tempest-ServerRescueNegativeTestJSON-2061875223 tempest-ServerRescueNegativeTestJSON-2061875223-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:03:31.703719 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-cfe34399-5618-460c-8ae0-d2ac373145d8 tempest-ServerRescueNegativeTestJSON-2061875223 tempest-ServerRescueNegativeTestJSON-2061875223-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:03:31.704827 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-cfe34399-5618-460c-8ae0-d2ac373145d8 tempest-ServerRescueNegativeTestJSON-2061875223 tempest-ServerRescueNegativeTestJSON-2061875223-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:03:31.706772 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-cfe34399-5618-460c-8ae0-d2ac373145d8 tempest-ServerRescueNegativeTestJSON-2061875223 tempest-ServerRescueNegativeTestJSON-2061875223-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:03:31.719835 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.policy [None req-29d4a4c4-c909-4ce9-a040-8cc2789cb0f6 tempest-DeleteServersTestJSON-268050555 tempest-DeleteServersTestJSON-268050555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28384f466c3541358ecea856650f008c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb933fa80ed94ce5b6828e48e86a21c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116157) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:03:31.731310 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: INFO nova.api.openstack.requestlog [None req-29d4a4c4-c909-4ce9-a040-8cc2789cb0f6 tempest-DeleteServersTestJSON-268050555 tempest-DeleteServersTestJSON-268050555-project] 10.222.0.18 "GET /compute/v2.1/servers/5a01bf2d-c341-4af1-b2b2-e1f05e46705f" status: 200 len: 1315 microversion: 2.1 time: 0.676023 Dec 15 03:03:31.733067 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: [pid: 116157|app: 0|req: 29/69] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 03:03:31 2021] GET /compute/v2.1/servers/5a01bf2d-c341-4af1-b2b2-e1f05e46705f => generated 1315 bytes in 678 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 03:03:31.908404 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi [req-86174d4b-bc90-4f47-889d-2ce3ad46daac req-bbf2344a-9596-422e-ae5a-dfdf5abc04de service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9bbb0abf-72a3-4fbc-8235-7a3ecfc8d006", "tag": "7b1a4626-5ae6-4522-8d7b-19824de5f496"}]} {{(pid=116157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 03:03:31.911176 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 15 03:03:31.911176 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: warnings.warn(msg) Dec 15 03:03:31.934527 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [req-86174d4b-bc90-4f47-889d-2ce3ad46daac req-bbf2344a-9596-422e-ae5a-dfdf5abc04de service nova] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:03:31.936189 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [req-86174d4b-bc90-4f47-889d-2ce3ad46daac req-bbf2344a-9596-422e-ae5a-dfdf5abc04de service nova] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:03:31.993042 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: INFO nova.api.openstack.compute.server_external_events [req-86174d4b-bc90-4f47-889d-2ce3ad46daac req-bbf2344a-9596-422e-ae5a-dfdf5abc04de service nova] Creating event network-changed:7b1a4626-5ae6-4522-8d7b-19824de5f496 for instance 9bbb0abf-72a3-4fbc-8235-7a3ecfc8d006 on hv-cinder-81803 Dec 15 03:03:31.993042 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [req-86174d4b-bc90-4f47-889d-2ce3ad46daac req-bbf2344a-9596-422e-ae5a-dfdf5abc04de service nova] Acquired lock "compute-rpcapi-router" {{(pid=116157) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Dec 15 03:03:31.993042 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-f9f72c78-aa36-4e66-84b2-7529b6c8db1c None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:03:31.993500 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-f9f72c78-aa36-4e66-84b2-7529b6c8db1c None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:03:31.995524 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-f9f72c78-aa36-4e66-84b2-7529b6c8db1c None None] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:03:31.995524 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-f9f72c78-aa36-4e66-84b2-7529b6c8db1c None None] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:03:32.016216 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: INFO nova.compute.rpcapi [None req-f9f72c78-aa36-4e66-84b2-7529b6c8db1c None None] Automatically selected compute RPC version 6.0 from minimum service version 60 Dec 15 03:03:32.017114 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-f9f72c78-aa36-4e66-84b2-7529b6c8db1c None None] Releasing lock "compute-rpcapi-router" {{(pid=116157) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Dec 15 03:03:32.093693 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: INFO nova.api.openstack.requestlog [None req-f9f72c78-aa36-4e66-84b2-7529b6c8db1c None None] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.189085 Dec 15 03:03:32.094608 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: [pid: 116157|app: 0|req: 30/70] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Dec 15 03:03:31 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 15 03:03:32.332040 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.policy [None req-cfe34399-5618-460c-8ae0-d2ac373145d8 tempest-ServerRescueNegativeTestJSON-2061875223 tempest-ServerRescueNegativeTestJSON-2061875223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ea02b6e8f1548a1bd78952cb7337403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5e8a958d4bf43868502b13728b9583b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116156) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:03:32.339936 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: INFO nova.api.openstack.requestlog [None req-cfe34399-5618-460c-8ae0-d2ac373145d8 tempest-ServerRescueNegativeTestJSON-2061875223 tempest-ServerRescueNegativeTestJSON-2061875223-project] 10.222.0.18 "GET /compute/v2.1/servers/2d20c8be-04a9-4c79-aa0a-138a79fe50cd" status: 200 len: 1321 microversion: 2.1 time: 0.655293 Dec 15 03:03:32.341071 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: [pid: 116156|app: 0|req: 41/71] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 03:03:31 2021] GET /compute/v2.1/servers/2d20c8be-04a9-4c79-aa0a-138a79fe50cd => generated 1321 bytes in 657 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 03:03:32.355404 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi [req-66f5698f-fcd8-46f8-ad46-786a24dba6d3 req-a4389b1d-3e22-49d3-99d7-038ac46ef647 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2d20c8be-04a9-4c79-aa0a-138a79fe50cd", "tag": "6a22ab04-9553-401b-9bbb-1e4693ade51b"}]} {{(pid=116157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 03:03:32.357662 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 15 03:03:32.357662 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: warnings.warn(msg) Dec 15 03:03:32.377793 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [req-66f5698f-fcd8-46f8-ad46-786a24dba6d3 req-a4389b1d-3e22-49d3-99d7-038ac46ef647 service nova] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:03:32.380437 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [req-66f5698f-fcd8-46f8-ad46-786a24dba6d3 req-a4389b1d-3e22-49d3-99d7-038ac46ef647 service nova] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:03:32.399944 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: INFO nova.api.openstack.compute.server_external_events [req-66f5698f-fcd8-46f8-ad46-786a24dba6d3 req-a4389b1d-3e22-49d3-99d7-038ac46ef647 service nova] Creating event network-changed:6a22ab04-9553-401b-9bbb-1e4693ade51b for instance 2d20c8be-04a9-4c79-aa0a-138a79fe50cd on hv-cinder-81803 Dec 15 03:03:32.411180 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: INFO nova.api.openstack.requestlog [req-66f5698f-fcd8-46f8-ad46-786a24dba6d3 req-a4389b1d-3e22-49d3-99d7-038ac46ef647 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.058872 Dec 15 03:03:32.412139 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: [pid: 116157|app: 0|req: 31/72] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Dec 15 03:03:32 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 03:03:32.520510 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi [None req-590f48f9-a198-491c-ae99-390856898785 tempest-AttachVolumeNegativeTest-1640336653 tempest-AttachVolumeNegativeTest-1640336653-project] Calling method '>' {{(pid=116156) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:03:32.521259 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.compute.api [None req-590f48f9-a198-491c-ae99-390856898785 tempest-AttachVolumeNegativeTest-1640336653 tempest-AttachVolumeNegativeTest-1640336653-project] [instance: 4923355f-95d6-443d-9487-574f56b87f66] Fetching instance by UUID {{(pid=116156) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:03:32.530594 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-590f48f9-a198-491c-ae99-390856898785 tempest-AttachVolumeNegativeTest-1640336653 tempest-AttachVolumeNegativeTest-1640336653-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:03:32.531678 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-590f48f9-a198-491c-ae99-390856898785 tempest-AttachVolumeNegativeTest-1640336653 tempest-AttachVolumeNegativeTest-1640336653-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:03:32.534511 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-590f48f9-a198-491c-ae99-390856898785 tempest-AttachVolumeNegativeTest-1640336653 tempest-AttachVolumeNegativeTest-1640336653-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:03:32.535243 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-590f48f9-a198-491c-ae99-390856898785 tempest-AttachVolumeNegativeTest-1640336653 tempest-AttachVolumeNegativeTest-1640336653-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:03:32.750183 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi [None req-b020c689-b06c-4637-9286-9993273022e3 tempest-DeleteServersTestJSON-268050555 tempest-DeleteServersTestJSON-268050555-project] Calling method '>' {{(pid=116157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:03:32.750879 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.compute.api [None req-b020c689-b06c-4637-9286-9993273022e3 tempest-DeleteServersTestJSON-268050555 tempest-DeleteServersTestJSON-268050555-project] [instance: 5a01bf2d-c341-4af1-b2b2-e1f05e46705f] Fetching instance by UUID {{(pid=116157) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:03:32.760737 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-b020c689-b06c-4637-9286-9993273022e3 tempest-DeleteServersTestJSON-268050555 tempest-DeleteServersTestJSON-268050555-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:03:32.761186 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-b020c689-b06c-4637-9286-9993273022e3 tempest-DeleteServersTestJSON-268050555 tempest-DeleteServersTestJSON-268050555-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:03:32.761992 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-b020c689-b06c-4637-9286-9993273022e3 tempest-DeleteServersTestJSON-268050555 tempest-DeleteServersTestJSON-268050555-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:03:32.765358 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-b020c689-b06c-4637-9286-9993273022e3 tempest-DeleteServersTestJSON-268050555 tempest-DeleteServersTestJSON-268050555-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:03:32.791594 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.policy [None req-590f48f9-a198-491c-ae99-390856898785 tempest-AttachVolumeNegativeTest-1640336653 tempest-AttachVolumeNegativeTest-1640336653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35d37a3d8e504b8186182468b77dd114', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '409b41637da94c469444954258444b4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116156) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:03:32.802300 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: INFO nova.api.openstack.requestlog [None req-590f48f9-a198-491c-ae99-390856898785 tempest-AttachVolumeNegativeTest-1640336653 tempest-AttachVolumeNegativeTest-1640336653-project] 10.222.0.18 "GET /compute/v2.1/servers/4923355f-95d6-443d-9487-574f56b87f66" status: 200 len: 1318 microversion: 2.1 time: 0.285921 Dec 15 03:03:32.805557 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: [pid: 116156|app: 0|req: 42/73] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 03:03:32 2021] GET /compute/v2.1/servers/4923355f-95d6-443d-9487-574f56b87f66 => generated 1318 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 03:03:32.932634 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.policy [None req-b020c689-b06c-4637-9286-9993273022e3 tempest-DeleteServersTestJSON-268050555 tempest-DeleteServersTestJSON-268050555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28384f466c3541358ecea856650f008c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb933fa80ed94ce5b6828e48e86a21c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116157) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:03:32.941223 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: INFO nova.api.openstack.requestlog [None req-b020c689-b06c-4637-9286-9993273022e3 tempest-DeleteServersTestJSON-268050555 tempest-DeleteServersTestJSON-268050555-project] 10.222.0.18 "GET /compute/v2.1/servers/5a01bf2d-c341-4af1-b2b2-e1f05e46705f" status: 200 len: 1315 microversion: 2.1 time: 0.195702 Dec 15 03:03:32.952804 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: [pid: 116157|app: 0|req: 32/74] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 03:03:32 2021] GET /compute/v2.1/servers/5a01bf2d-c341-4af1-b2b2-e1f05e46705f => generated 1315 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 03:03:33.359375 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi [None req-7cfca50e-e5c3-42ae-b681-c00c2e23f201 tempest-ServerRescueNegativeTestJSON-2061875223 tempest-ServerRescueNegativeTestJSON-2061875223-project] Calling method '>' {{(pid=116156) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:03:33.360197 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.compute.api [None req-7cfca50e-e5c3-42ae-b681-c00c2e23f201 tempest-ServerRescueNegativeTestJSON-2061875223 tempest-ServerRescueNegativeTestJSON-2061875223-project] [instance: 2d20c8be-04a9-4c79-aa0a-138a79fe50cd] Fetching instance by UUID {{(pid=116156) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:03:33.368827 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-7cfca50e-e5c3-42ae-b681-c00c2e23f201 tempest-ServerRescueNegativeTestJSON-2061875223 tempest-ServerRescueNegativeTestJSON-2061875223-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:03:33.368827 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-7cfca50e-e5c3-42ae-b681-c00c2e23f201 tempest-ServerRescueNegativeTestJSON-2061875223 tempest-ServerRescueNegativeTestJSON-2061875223-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:03:33.369715 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-7cfca50e-e5c3-42ae-b681-c00c2e23f201 tempest-ServerRescueNegativeTestJSON-2061875223 tempest-ServerRescueNegativeTestJSON-2061875223-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:03:33.370235 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-7cfca50e-e5c3-42ae-b681-c00c2e23f201 tempest-ServerRescueNegativeTestJSON-2061875223 tempest-ServerRescueNegativeTestJSON-2061875223-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:03:33.555868 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.policy [None req-7cfca50e-e5c3-42ae-b681-c00c2e23f201 tempest-ServerRescueNegativeTestJSON-2061875223 tempest-ServerRescueNegativeTestJSON-2061875223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ea02b6e8f1548a1bd78952cb7337403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5e8a958d4bf43868502b13728b9583b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116156) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:03:33.563283 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: INFO nova.api.openstack.requestlog [None req-7cfca50e-e5c3-42ae-b681-c00c2e23f201 tempest-ServerRescueNegativeTestJSON-2061875223 tempest-ServerRescueNegativeTestJSON-2061875223-project] 10.222.0.18 "GET /compute/v2.1/servers/2d20c8be-04a9-4c79-aa0a-138a79fe50cd" status: 200 len: 1321 microversion: 2.1 time: 0.209671 Dec 15 03:03:33.564110 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: [pid: 116156|app: 0|req: 43/75] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 03:03:33 2021] GET /compute/v2.1/servers/2d20c8be-04a9-4c79-aa0a-138a79fe50cd => generated 1321 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 03:03:33.822245 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi [None req-bd4f7fdd-55f2-46d1-85c1-bee5f42b43a2 tempest-AttachVolumeNegativeTest-1640336653 tempest-AttachVolumeNegativeTest-1640336653-project] Calling method '>' {{(pid=116157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:03:33.822871 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.compute.api [None req-bd4f7fdd-55f2-46d1-85c1-bee5f42b43a2 tempest-AttachVolumeNegativeTest-1640336653 tempest-AttachVolumeNegativeTest-1640336653-project] [instance: 4923355f-95d6-443d-9487-574f56b87f66] Fetching instance by UUID {{(pid=116157) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:03:33.829787 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-bd4f7fdd-55f2-46d1-85c1-bee5f42b43a2 tempest-AttachVolumeNegativeTest-1640336653 tempest-AttachVolumeNegativeTest-1640336653-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:03:33.830203 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-bd4f7fdd-55f2-46d1-85c1-bee5f42b43a2 tempest-AttachVolumeNegativeTest-1640336653 tempest-AttachVolumeNegativeTest-1640336653-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:03:33.831175 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-bd4f7fdd-55f2-46d1-85c1-bee5f42b43a2 tempest-AttachVolumeNegativeTest-1640336653 tempest-AttachVolumeNegativeTest-1640336653-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:03:33.831888 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-bd4f7fdd-55f2-46d1-85c1-bee5f42b43a2 tempest-AttachVolumeNegativeTest-1640336653 tempest-AttachVolumeNegativeTest-1640336653-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:03:33.959992 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi [None req-6969aa9d-7613-492f-9b5c-991b27261ff6 tempest-DeleteServersTestJSON-268050555 tempest-DeleteServersTestJSON-268050555-project] Calling method '>' {{(pid=116156) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:03:33.961258 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.compute.api [None req-6969aa9d-7613-492f-9b5c-991b27261ff6 tempest-DeleteServersTestJSON-268050555 tempest-DeleteServersTestJSON-268050555-project] [instance: 5a01bf2d-c341-4af1-b2b2-e1f05e46705f] Fetching instance by UUID {{(pid=116156) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:03:33.969933 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-6969aa9d-7613-492f-9b5c-991b27261ff6 tempest-DeleteServersTestJSON-268050555 tempest-DeleteServersTestJSON-268050555-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:03:33.971255 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-6969aa9d-7613-492f-9b5c-991b27261ff6 tempest-DeleteServersTestJSON-268050555 tempest-DeleteServersTestJSON-268050555-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:03:33.972268 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-6969aa9d-7613-492f-9b5c-991b27261ff6 tempest-DeleteServersTestJSON-268050555 tempest-DeleteServersTestJSON-268050555-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:03:33.972996 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-6969aa9d-7613-492f-9b5c-991b27261ff6 tempest-DeleteServersTestJSON-268050555 tempest-DeleteServersTestJSON-268050555-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:03:34.155867 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.policy [None req-6969aa9d-7613-492f-9b5c-991b27261ff6 tempest-DeleteServersTestJSON-268050555 tempest-DeleteServersTestJSON-268050555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28384f466c3541358ecea856650f008c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb933fa80ed94ce5b6828e48e86a21c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116156) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:03:34.166626 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: INFO nova.api.openstack.requestlog [None req-6969aa9d-7613-492f-9b5c-991b27261ff6 tempest-DeleteServersTestJSON-268050555 tempest-DeleteServersTestJSON-268050555-project] 10.222.0.18 "GET /compute/v2.1/servers/5a01bf2d-c341-4af1-b2b2-e1f05e46705f" status: 200 len: 1315 microversion: 2.1 time: 0.212023 Dec 15 03:03:34.167719 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: [pid: 116156|app: 0|req: 44/76] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 03:03:33 2021] GET /compute/v2.1/servers/5a01bf2d-c341-4af1-b2b2-e1f05e46705f => generated 1315 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 03:03:34.224138 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.policy [None req-bd4f7fdd-55f2-46d1-85c1-bee5f42b43a2 tempest-AttachVolumeNegativeTest-1640336653 tempest-AttachVolumeNegativeTest-1640336653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35d37a3d8e504b8186182468b77dd114', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '409b41637da94c469444954258444b4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116157) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:03:34.233855 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: INFO nova.api.openstack.requestlog [None req-bd4f7fdd-55f2-46d1-85c1-bee5f42b43a2 tempest-AttachVolumeNegativeTest-1640336653 tempest-AttachVolumeNegativeTest-1640336653-project] 10.222.0.18 "GET /compute/v2.1/servers/4923355f-95d6-443d-9487-574f56b87f66" status: 200 len: 1318 microversion: 2.1 time: 0.414882 Dec 15 03:03:34.234972 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: [pid: 116157|app: 0|req: 33/77] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 03:03:33 2021] GET /compute/v2.1/servers/4923355f-95d6-443d-9487-574f56b87f66 => generated 1318 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 03:03:34.579977 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi [None req-d16b4eeb-5123-4bd4-9d71-983a006a5153 tempest-ServerRescueNegativeTestJSON-2061875223 tempest-ServerRescueNegativeTestJSON-2061875223-project] Calling method '>' {{(pid=116156) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:03:34.580603 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.compute.api [None req-d16b4eeb-5123-4bd4-9d71-983a006a5153 tempest-ServerRescueNegativeTestJSON-2061875223 tempest-ServerRescueNegativeTestJSON-2061875223-project] [instance: 2d20c8be-04a9-4c79-aa0a-138a79fe50cd] Fetching instance by UUID {{(pid=116156) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:03:34.587591 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-d16b4eeb-5123-4bd4-9d71-983a006a5153 tempest-ServerRescueNegativeTestJSON-2061875223 tempest-ServerRescueNegativeTestJSON-2061875223-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:03:34.588860 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-d16b4eeb-5123-4bd4-9d71-983a006a5153 tempest-ServerRescueNegativeTestJSON-2061875223 tempest-ServerRescueNegativeTestJSON-2061875223-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:03:34.599473 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-d16b4eeb-5123-4bd4-9d71-983a006a5153 tempest-ServerRescueNegativeTestJSON-2061875223 tempest-ServerRescueNegativeTestJSON-2061875223-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:03:34.600668 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-d16b4eeb-5123-4bd4-9d71-983a006a5153 tempest-ServerRescueNegativeTestJSON-2061875223 tempest-ServerRescueNegativeTestJSON-2061875223-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:03:34.751400 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.policy [None req-d16b4eeb-5123-4bd4-9d71-983a006a5153 tempest-ServerRescueNegativeTestJSON-2061875223 tempest-ServerRescueNegativeTestJSON-2061875223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ea02b6e8f1548a1bd78952cb7337403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5e8a958d4bf43868502b13728b9583b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116156) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:03:34.762241 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: INFO nova.api.openstack.requestlog [None req-d16b4eeb-5123-4bd4-9d71-983a006a5153 tempest-ServerRescueNegativeTestJSON-2061875223 tempest-ServerRescueNegativeTestJSON-2061875223-project] 10.222.0.18 "GET /compute/v2.1/servers/2d20c8be-04a9-4c79-aa0a-138a79fe50cd" status: 200 len: 1321 microversion: 2.1 time: 0.185703 Dec 15 03:03:34.762883 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: [pid: 116156|app: 0|req: 45/78] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 03:03:34 2021] GET /compute/v2.1/servers/2d20c8be-04a9-4c79-aa0a-138a79fe50cd => generated 1321 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 03:03:35.184713 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi [None req-9597970b-6cfa-4521-b1cc-4e4417adacc7 tempest-DeleteServersTestJSON-268050555 tempest-DeleteServersTestJSON-268050555-project] Calling method '>' {{(pid=116157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:03:35.186609 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.compute.api [None req-9597970b-6cfa-4521-b1cc-4e4417adacc7 tempest-DeleteServersTestJSON-268050555 tempest-DeleteServersTestJSON-268050555-project] [instance: 5a01bf2d-c341-4af1-b2b2-e1f05e46705f] Fetching instance by UUID {{(pid=116157) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:03:35.194152 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-9597970b-6cfa-4521-b1cc-4e4417adacc7 tempest-DeleteServersTestJSON-268050555 tempest-DeleteServersTestJSON-268050555-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:03:35.194714 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-9597970b-6cfa-4521-b1cc-4e4417adacc7 tempest-DeleteServersTestJSON-268050555 tempest-DeleteServersTestJSON-268050555-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:03:35.196401 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-9597970b-6cfa-4521-b1cc-4e4417adacc7 tempest-DeleteServersTestJSON-268050555 tempest-DeleteServersTestJSON-268050555-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:03:35.197056 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-9597970b-6cfa-4521-b1cc-4e4417adacc7 tempest-DeleteServersTestJSON-268050555 tempest-DeleteServersTestJSON-268050555-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:03:35.252688 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi [None req-2d523601-4eb5-48bc-b989-72efe3d68453 tempest-AttachVolumeNegativeTest-1640336653 tempest-AttachVolumeNegativeTest-1640336653-project] Calling method '>' {{(pid=116156) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:03:35.253293 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.compute.api [None req-2d523601-4eb5-48bc-b989-72efe3d68453 tempest-AttachVolumeNegativeTest-1640336653 tempest-AttachVolumeNegativeTest-1640336653-project] [instance: 4923355f-95d6-443d-9487-574f56b87f66] Fetching instance by UUID {{(pid=116156) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:03:35.262458 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-2d523601-4eb5-48bc-b989-72efe3d68453 tempest-AttachVolumeNegativeTest-1640336653 tempest-AttachVolumeNegativeTest-1640336653-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:03:35.263800 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-2d523601-4eb5-48bc-b989-72efe3d68453 tempest-AttachVolumeNegativeTest-1640336653 tempest-AttachVolumeNegativeTest-1640336653-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:03:35.265960 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-2d523601-4eb5-48bc-b989-72efe3d68453 tempest-AttachVolumeNegativeTest-1640336653 tempest-AttachVolumeNegativeTest-1640336653-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:03:35.266863 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-2d523601-4eb5-48bc-b989-72efe3d68453 tempest-AttachVolumeNegativeTest-1640336653 tempest-AttachVolumeNegativeTest-1640336653-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:03:35.392014 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.policy [None req-9597970b-6cfa-4521-b1cc-4e4417adacc7 tempest-DeleteServersTestJSON-268050555 tempest-DeleteServersTestJSON-268050555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28384f466c3541358ecea856650f008c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb933fa80ed94ce5b6828e48e86a21c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116157) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:03:35.399747 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: INFO nova.api.openstack.requestlog [None req-9597970b-6cfa-4521-b1cc-4e4417adacc7 tempest-DeleteServersTestJSON-268050555 tempest-DeleteServersTestJSON-268050555-project] 10.222.0.18 "GET /compute/v2.1/servers/5a01bf2d-c341-4af1-b2b2-e1f05e46705f" status: 200 len: 1315 microversion: 2.1 time: 0.218907 Dec 15 03:03:35.400332 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: [pid: 116157|app: 0|req: 34/79] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 03:03:35 2021] GET /compute/v2.1/servers/5a01bf2d-c341-4af1-b2b2-e1f05e46705f => generated 1315 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 03:03:35.714592 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.policy [None req-2d523601-4eb5-48bc-b989-72efe3d68453 tempest-AttachVolumeNegativeTest-1640336653 tempest-AttachVolumeNegativeTest-1640336653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35d37a3d8e504b8186182468b77dd114', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '409b41637da94c469444954258444b4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116156) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:03:35.721952 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: INFO nova.api.openstack.requestlog [None req-2d523601-4eb5-48bc-b989-72efe3d68453 tempest-AttachVolumeNegativeTest-1640336653 tempest-AttachVolumeNegativeTest-1640336653-project] 10.222.0.18 "GET /compute/v2.1/servers/4923355f-95d6-443d-9487-574f56b87f66" status: 200 len: 1318 microversion: 2.1 time: 0.473119 Dec 15 03:03:35.722520 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: [pid: 116156|app: 0|req: 46/80] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 03:03:35 2021] GET /compute/v2.1/servers/4923355f-95d6-443d-9487-574f56b87f66 => generated 1318 bytes in 475 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 03:03:35.779320 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi [None req-212b16a0-c60a-4da8-b50d-1c5877dc619f tempest-ServerRescueNegativeTestJSON-2061875223 tempest-ServerRescueNegativeTestJSON-2061875223-project] Calling method '>' {{(pid=116157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:03:35.779935 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.compute.api [None req-212b16a0-c60a-4da8-b50d-1c5877dc619f tempest-ServerRescueNegativeTestJSON-2061875223 tempest-ServerRescueNegativeTestJSON-2061875223-project] [instance: 2d20c8be-04a9-4c79-aa0a-138a79fe50cd] Fetching instance by UUID {{(pid=116157) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:03:35.788063 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-212b16a0-c60a-4da8-b50d-1c5877dc619f tempest-ServerRescueNegativeTestJSON-2061875223 tempest-ServerRescueNegativeTestJSON-2061875223-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:03:35.788533 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-212b16a0-c60a-4da8-b50d-1c5877dc619f tempest-ServerRescueNegativeTestJSON-2061875223 tempest-ServerRescueNegativeTestJSON-2061875223-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:03:35.795627 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-212b16a0-c60a-4da8-b50d-1c5877dc619f tempest-ServerRescueNegativeTestJSON-2061875223 tempest-ServerRescueNegativeTestJSON-2061875223-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:03:35.796988 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-212b16a0-c60a-4da8-b50d-1c5877dc619f tempest-ServerRescueNegativeTestJSON-2061875223 tempest-ServerRescueNegativeTestJSON-2061875223-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:03:36.001457 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.policy [None req-212b16a0-c60a-4da8-b50d-1c5877dc619f tempest-ServerRescueNegativeTestJSON-2061875223 tempest-ServerRescueNegativeTestJSON-2061875223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ea02b6e8f1548a1bd78952cb7337403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5e8a958d4bf43868502b13728b9583b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116157) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:03:36.009151 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: INFO nova.api.openstack.requestlog [None req-212b16a0-c60a-4da8-b50d-1c5877dc619f tempest-ServerRescueNegativeTestJSON-2061875223 tempest-ServerRescueNegativeTestJSON-2061875223-project] 10.222.0.18 "GET /compute/v2.1/servers/2d20c8be-04a9-4c79-aa0a-138a79fe50cd" status: 200 len: 1321 microversion: 2.1 time: 0.233415 Dec 15 03:03:36.009744 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: [pid: 116157|app: 0|req: 35/81] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 03:03:35 2021] GET /compute/v2.1/servers/2d20c8be-04a9-4c79-aa0a-138a79fe50cd => generated 1321 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 03:03:36.417385 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi [None req-af42f917-0717-46cf-887b-2c96e3af33d8 tempest-DeleteServersTestJSON-268050555 tempest-DeleteServersTestJSON-268050555-project] Calling method '>' {{(pid=116156) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:03:36.418001 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.compute.api [None req-af42f917-0717-46cf-887b-2c96e3af33d8 tempest-DeleteServersTestJSON-268050555 tempest-DeleteServersTestJSON-268050555-project] [instance: 5a01bf2d-c341-4af1-b2b2-e1f05e46705f] Fetching instance by UUID {{(pid=116156) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:03:36.423834 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-af42f917-0717-46cf-887b-2c96e3af33d8 tempest-DeleteServersTestJSON-268050555 tempest-DeleteServersTestJSON-268050555-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:03:36.424457 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-af42f917-0717-46cf-887b-2c96e3af33d8 tempest-DeleteServersTestJSON-268050555 tempest-DeleteServersTestJSON-268050555-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:03:36.425235 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-af42f917-0717-46cf-887b-2c96e3af33d8 tempest-DeleteServersTestJSON-268050555 tempest-DeleteServersTestJSON-268050555-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:03:36.425666 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-af42f917-0717-46cf-887b-2c96e3af33d8 tempest-DeleteServersTestJSON-268050555 tempest-DeleteServersTestJSON-268050555-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:03:36.586829 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.policy [None req-af42f917-0717-46cf-887b-2c96e3af33d8 tempest-DeleteServersTestJSON-268050555 tempest-DeleteServersTestJSON-268050555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28384f466c3541358ecea856650f008c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb933fa80ed94ce5b6828e48e86a21c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116156) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:03:36.596706 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: INFO nova.api.openstack.requestlog [None req-af42f917-0717-46cf-887b-2c96e3af33d8 tempest-DeleteServersTestJSON-268050555 tempest-DeleteServersTestJSON-268050555-project] 10.222.0.18 "GET /compute/v2.1/servers/5a01bf2d-c341-4af1-b2b2-e1f05e46705f" status: 200 len: 1315 microversion: 2.1 time: 0.182141 Dec 15 03:03:36.598155 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: [pid: 116156|app: 0|req: 47/82] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 03:03:36 2021] GET /compute/v2.1/servers/5a01bf2d-c341-4af1-b2b2-e1f05e46705f => generated 1315 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 03:03:36.738351 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi [None req-dbbae918-793e-45c2-bf39-1f33bc0446a4 tempest-AttachVolumeNegativeTest-1640336653 tempest-AttachVolumeNegativeTest-1640336653-project] Calling method '>' {{(pid=116157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:03:36.739585 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.compute.api [None req-dbbae918-793e-45c2-bf39-1f33bc0446a4 tempest-AttachVolumeNegativeTest-1640336653 tempest-AttachVolumeNegativeTest-1640336653-project] [instance: 4923355f-95d6-443d-9487-574f56b87f66] Fetching instance by UUID {{(pid=116157) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:03:36.746591 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-dbbae918-793e-45c2-bf39-1f33bc0446a4 tempest-AttachVolumeNegativeTest-1640336653 tempest-AttachVolumeNegativeTest-1640336653-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:03:36.748147 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-dbbae918-793e-45c2-bf39-1f33bc0446a4 tempest-AttachVolumeNegativeTest-1640336653 tempest-AttachVolumeNegativeTest-1640336653-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:03:36.749160 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-dbbae918-793e-45c2-bf39-1f33bc0446a4 tempest-AttachVolumeNegativeTest-1640336653 tempest-AttachVolumeNegativeTest-1640336653-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:03:36.749820 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-dbbae918-793e-45c2-bf39-1f33bc0446a4 tempest-AttachVolumeNegativeTest-1640336653 tempest-AttachVolumeNegativeTest-1640336653-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:03:36.976825 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.policy [None req-dbbae918-793e-45c2-bf39-1f33bc0446a4 tempest-AttachVolumeNegativeTest-1640336653 tempest-AttachVolumeNegativeTest-1640336653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35d37a3d8e504b8186182468b77dd114', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '409b41637da94c469444954258444b4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116157) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:03:36.988732 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: INFO nova.api.openstack.requestlog [None req-dbbae918-793e-45c2-bf39-1f33bc0446a4 tempest-AttachVolumeNegativeTest-1640336653 tempest-AttachVolumeNegativeTest-1640336653-project] 10.222.0.18 "GET /compute/v2.1/servers/4923355f-95d6-443d-9487-574f56b87f66" status: 200 len: 1318 microversion: 2.1 time: 0.252799 Dec 15 03:03:37.001161 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: [pid: 116157|app: 0|req: 36/83] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 03:03:36 2021] GET /compute/v2.1/servers/4923355f-95d6-443d-9487-574f56b87f66 => generated 1318 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 03:03:37.026602 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi [None req-d295e697-48f5-4d16-a12d-38ea058f769c tempest-ServerRescueNegativeTestJSON-2061875223 tempest-ServerRescueNegativeTestJSON-2061875223-project] Calling method '>' {{(pid=116156) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:03:37.027381 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.compute.api [None req-d295e697-48f5-4d16-a12d-38ea058f769c tempest-ServerRescueNegativeTestJSON-2061875223 tempest-ServerRescueNegativeTestJSON-2061875223-project] [instance: 2d20c8be-04a9-4c79-aa0a-138a79fe50cd] Fetching instance by UUID {{(pid=116156) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:03:37.035484 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-d295e697-48f5-4d16-a12d-38ea058f769c tempest-ServerRescueNegativeTestJSON-2061875223 tempest-ServerRescueNegativeTestJSON-2061875223-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:03:37.036309 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-d295e697-48f5-4d16-a12d-38ea058f769c tempest-ServerRescueNegativeTestJSON-2061875223 tempest-ServerRescueNegativeTestJSON-2061875223-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:03:37.037379 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-d295e697-48f5-4d16-a12d-38ea058f769c tempest-ServerRescueNegativeTestJSON-2061875223 tempest-ServerRescueNegativeTestJSON-2061875223-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:03:37.038207 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-d295e697-48f5-4d16-a12d-38ea058f769c tempest-ServerRescueNegativeTestJSON-2061875223 tempest-ServerRescueNegativeTestJSON-2061875223-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:03:37.204448 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.policy [None req-d295e697-48f5-4d16-a12d-38ea058f769c tempest-ServerRescueNegativeTestJSON-2061875223 tempest-ServerRescueNegativeTestJSON-2061875223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ea02b6e8f1548a1bd78952cb7337403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5e8a958d4bf43868502b13728b9583b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116156) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:03:37.214518 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: INFO nova.api.openstack.requestlog [None req-d295e697-48f5-4d16-a12d-38ea058f769c tempest-ServerRescueNegativeTestJSON-2061875223 tempest-ServerRescueNegativeTestJSON-2061875223-project] 10.222.0.18 "GET /compute/v2.1/servers/2d20c8be-04a9-4c79-aa0a-138a79fe50cd" status: 200 len: 1321 microversion: 2.1 time: 0.192226 Dec 15 03:03:37.215426 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: [pid: 116156|app: 0|req: 48/84] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 03:03:37 2021] GET /compute/v2.1/servers/2d20c8be-04a9-4c79-aa0a-138a79fe50cd => generated 1321 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 03:03:37.614027 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi [None req-0e46cc75-00b2-4e2c-8291-a1404c935b76 tempest-DeleteServersTestJSON-268050555 tempest-DeleteServersTestJSON-268050555-project] Calling method '>' {{(pid=116157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:03:37.614635 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.compute.api [None req-0e46cc75-00b2-4e2c-8291-a1404c935b76 tempest-DeleteServersTestJSON-268050555 tempest-DeleteServersTestJSON-268050555-project] [instance: 5a01bf2d-c341-4af1-b2b2-e1f05e46705f] Fetching instance by UUID {{(pid=116157) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:03:37.620845 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-0e46cc75-00b2-4e2c-8291-a1404c935b76 tempest-DeleteServersTestJSON-268050555 tempest-DeleteServersTestJSON-268050555-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:03:37.621711 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-0e46cc75-00b2-4e2c-8291-a1404c935b76 tempest-DeleteServersTestJSON-268050555 tempest-DeleteServersTestJSON-268050555-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:03:37.622572 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-0e46cc75-00b2-4e2c-8291-a1404c935b76 tempest-DeleteServersTestJSON-268050555 tempest-DeleteServersTestJSON-268050555-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:03:37.623533 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-0e46cc75-00b2-4e2c-8291-a1404c935b76 tempest-DeleteServersTestJSON-268050555 tempest-DeleteServersTestJSON-268050555-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:03:37.807849 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.policy [None req-0e46cc75-00b2-4e2c-8291-a1404c935b76 tempest-DeleteServersTestJSON-268050555 tempest-DeleteServersTestJSON-268050555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28384f466c3541358ecea856650f008c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb933fa80ed94ce5b6828e48e86a21c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116157) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:03:37.821681 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: INFO nova.api.openstack.requestlog [None req-0e46cc75-00b2-4e2c-8291-a1404c935b76 tempest-DeleteServersTestJSON-268050555 tempest-DeleteServersTestJSON-268050555-project] 10.222.0.18 "GET /compute/v2.1/servers/5a01bf2d-c341-4af1-b2b2-e1f05e46705f" status: 200 len: 1315 microversion: 2.1 time: 0.211197 Dec 15 03:03:37.822344 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: [pid: 116157|app: 0|req: 37/85] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 03:03:37 2021] GET /compute/v2.1/servers/5a01bf2d-c341-4af1-b2b2-e1f05e46705f => generated 1315 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 03:03:38.006876 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi [None req-239617df-36ad-4956-99c4-6bc5e1c6160b tempest-AttachVolumeNegativeTest-1640336653 tempest-AttachVolumeNegativeTest-1640336653-project] Calling method '>' {{(pid=116156) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:03:38.007964 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.compute.api [None req-239617df-36ad-4956-99c4-6bc5e1c6160b tempest-AttachVolumeNegativeTest-1640336653 tempest-AttachVolumeNegativeTest-1640336653-project] [instance: 4923355f-95d6-443d-9487-574f56b87f66] Fetching instance by UUID {{(pid=116156) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:03:38.015911 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-239617df-36ad-4956-99c4-6bc5e1c6160b tempest-AttachVolumeNegativeTest-1640336653 tempest-AttachVolumeNegativeTest-1640336653-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:03:38.016429 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-239617df-36ad-4956-99c4-6bc5e1c6160b tempest-AttachVolumeNegativeTest-1640336653 tempest-AttachVolumeNegativeTest-1640336653-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:03:38.017632 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-239617df-36ad-4956-99c4-6bc5e1c6160b tempest-AttachVolumeNegativeTest-1640336653 tempest-AttachVolumeNegativeTest-1640336653-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:03:38.018319 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-239617df-36ad-4956-99c4-6bc5e1c6160b tempest-AttachVolumeNegativeTest-1640336653 tempest-AttachVolumeNegativeTest-1640336653-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:03:38.184526 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.policy [None req-239617df-36ad-4956-99c4-6bc5e1c6160b tempest-AttachVolumeNegativeTest-1640336653 tempest-AttachVolumeNegativeTest-1640336653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35d37a3d8e504b8186182468b77dd114', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '409b41637da94c469444954258444b4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116156) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:03:38.193188 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: INFO nova.api.openstack.requestlog [None req-239617df-36ad-4956-99c4-6bc5e1c6160b tempest-AttachVolumeNegativeTest-1640336653 tempest-AttachVolumeNegativeTest-1640336653-project] 10.222.0.18 "GET /compute/v2.1/servers/4923355f-95d6-443d-9487-574f56b87f66" status: 200 len: 1318 microversion: 2.1 time: 0.190289 Dec 15 03:03:38.194339 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: [pid: 116156|app: 0|req: 49/86] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 03:03:38 2021] GET /compute/v2.1/servers/4923355f-95d6-443d-9487-574f56b87f66 => generated 1318 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 03:03:38.230298 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi [None req-c9f03088-99df-4208-8f6d-703381a662bd tempest-ServerRescueNegativeTestJSON-2061875223 tempest-ServerRescueNegativeTestJSON-2061875223-project] Calling method '>' {{(pid=116157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:03:38.231149 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.compute.api [None req-c9f03088-99df-4208-8f6d-703381a662bd tempest-ServerRescueNegativeTestJSON-2061875223 tempest-ServerRescueNegativeTestJSON-2061875223-project] [instance: 2d20c8be-04a9-4c79-aa0a-138a79fe50cd] Fetching instance by UUID {{(pid=116157) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:03:38.239394 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-c9f03088-99df-4208-8f6d-703381a662bd tempest-ServerRescueNegativeTestJSON-2061875223 tempest-ServerRescueNegativeTestJSON-2061875223-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:03:38.239847 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-c9f03088-99df-4208-8f6d-703381a662bd tempest-ServerRescueNegativeTestJSON-2061875223 tempest-ServerRescueNegativeTestJSON-2061875223-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:03:38.240678 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-c9f03088-99df-4208-8f6d-703381a662bd tempest-ServerRescueNegativeTestJSON-2061875223 tempest-ServerRescueNegativeTestJSON-2061875223-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:03:38.241052 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-c9f03088-99df-4208-8f6d-703381a662bd tempest-ServerRescueNegativeTestJSON-2061875223 tempest-ServerRescueNegativeTestJSON-2061875223-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:03:38.424899 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.policy [None req-c9f03088-99df-4208-8f6d-703381a662bd tempest-ServerRescueNegativeTestJSON-2061875223 tempest-ServerRescueNegativeTestJSON-2061875223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ea02b6e8f1548a1bd78952cb7337403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5e8a958d4bf43868502b13728b9583b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116157) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:03:38.448237 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: INFO nova.api.openstack.requestlog [None req-c9f03088-99df-4208-8f6d-703381a662bd tempest-ServerRescueNegativeTestJSON-2061875223 tempest-ServerRescueNegativeTestJSON-2061875223-project] 10.222.0.18 "GET /compute/v2.1/servers/2d20c8be-04a9-4c79-aa0a-138a79fe50cd" status: 200 len: 1321 microversion: 2.1 time: 0.221336 Dec 15 03:03:38.450082 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: [pid: 116157|app: 0|req: 38/87] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 03:03:38 2021] GET /compute/v2.1/servers/2d20c8be-04a9-4c79-aa0a-138a79fe50cd => generated 1321 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 03:03:38.839228 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi [None req-2d415293-11f9-4ea9-aabc-3c4e2f62b87f tempest-DeleteServersTestJSON-268050555 tempest-DeleteServersTestJSON-268050555-project] Calling method '>' {{(pid=116156) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:03:38.840177 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.compute.api [None req-2d415293-11f9-4ea9-aabc-3c4e2f62b87f tempest-DeleteServersTestJSON-268050555 tempest-DeleteServersTestJSON-268050555-project] [instance: 5a01bf2d-c341-4af1-b2b2-e1f05e46705f] Fetching instance by UUID {{(pid=116156) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:03:38.847765 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-2d415293-11f9-4ea9-aabc-3c4e2f62b87f tempest-DeleteServersTestJSON-268050555 tempest-DeleteServersTestJSON-268050555-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:03:38.848716 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-2d415293-11f9-4ea9-aabc-3c4e2f62b87f tempest-DeleteServersTestJSON-268050555 tempest-DeleteServersTestJSON-268050555-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:03:38.849932 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-2d415293-11f9-4ea9-aabc-3c4e2f62b87f tempest-DeleteServersTestJSON-268050555 tempest-DeleteServersTestJSON-268050555-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:03:38.850547 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-2d415293-11f9-4ea9-aabc-3c4e2f62b87f tempest-DeleteServersTestJSON-268050555 tempest-DeleteServersTestJSON-268050555-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:03:39.025852 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.policy [None req-2d415293-11f9-4ea9-aabc-3c4e2f62b87f tempest-DeleteServersTestJSON-268050555 tempest-DeleteServersTestJSON-268050555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28384f466c3541358ecea856650f008c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb933fa80ed94ce5b6828e48e86a21c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116156) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:03:39.034824 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: INFO nova.api.openstack.requestlog [None req-2d415293-11f9-4ea9-aabc-3c4e2f62b87f tempest-DeleteServersTestJSON-268050555 tempest-DeleteServersTestJSON-268050555-project] 10.222.0.18 "GET /compute/v2.1/servers/5a01bf2d-c341-4af1-b2b2-e1f05e46705f" status: 200 len: 1315 microversion: 2.1 time: 0.199801 Dec 15 03:03:39.036295 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: [pid: 116156|app: 0|req: 50/88] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 03:03:38 2021] GET /compute/v2.1/servers/5a01bf2d-c341-4af1-b2b2-e1f05e46705f => generated 1315 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 03:03:39.212254 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi [None req-635e37ea-79b2-40ed-a43d-15b18eed7b3c tempest-AttachVolumeNegativeTest-1640336653 tempest-AttachVolumeNegativeTest-1640336653-project] Calling method '>' {{(pid=116157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:03:39.212855 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.compute.api [None req-635e37ea-79b2-40ed-a43d-15b18eed7b3c tempest-AttachVolumeNegativeTest-1640336653 tempest-AttachVolumeNegativeTest-1640336653-project] [instance: 4923355f-95d6-443d-9487-574f56b87f66] Fetching instance by UUID {{(pid=116157) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:03:39.218861 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-635e37ea-79b2-40ed-a43d-15b18eed7b3c tempest-AttachVolumeNegativeTest-1640336653 tempest-AttachVolumeNegativeTest-1640336653-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:03:39.219305 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-635e37ea-79b2-40ed-a43d-15b18eed7b3c tempest-AttachVolumeNegativeTest-1640336653 tempest-AttachVolumeNegativeTest-1640336653-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:03:39.220078 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-635e37ea-79b2-40ed-a43d-15b18eed7b3c tempest-AttachVolumeNegativeTest-1640336653 tempest-AttachVolumeNegativeTest-1640336653-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:03:39.220511 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-635e37ea-79b2-40ed-a43d-15b18eed7b3c tempest-AttachVolumeNegativeTest-1640336653 tempest-AttachVolumeNegativeTest-1640336653-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:03:39.347762 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.policy [None req-635e37ea-79b2-40ed-a43d-15b18eed7b3c tempest-AttachVolumeNegativeTest-1640336653 tempest-AttachVolumeNegativeTest-1640336653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35d37a3d8e504b8186182468b77dd114', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '409b41637da94c469444954258444b4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116157) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:03:39.354763 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: INFO nova.api.openstack.requestlog [None req-635e37ea-79b2-40ed-a43d-15b18eed7b3c tempest-AttachVolumeNegativeTest-1640336653 tempest-AttachVolumeNegativeTest-1640336653-project] 10.222.0.18 "GET /compute/v2.1/servers/4923355f-95d6-443d-9487-574f56b87f66" status: 200 len: 1318 microversion: 2.1 time: 0.146178 Dec 15 03:03:39.355315 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: [pid: 116157|app: 0|req: 39/89] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 03:03:39 2021] GET /compute/v2.1/servers/4923355f-95d6-443d-9487-574f56b87f66 => generated 1318 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 03:03:39.464672 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi [None req-f0b40b9e-f96e-47e5-bb37-4eaddd7e23d7 tempest-ServerRescueNegativeTestJSON-2061875223 tempest-ServerRescueNegativeTestJSON-2061875223-project] Calling method '>' {{(pid=116156) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:03:39.465280 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.compute.api [None req-f0b40b9e-f96e-47e5-bb37-4eaddd7e23d7 tempest-ServerRescueNegativeTestJSON-2061875223 tempest-ServerRescueNegativeTestJSON-2061875223-project] [instance: 2d20c8be-04a9-4c79-aa0a-138a79fe50cd] Fetching instance by UUID {{(pid=116156) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:03:39.471685 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-f0b40b9e-f96e-47e5-bb37-4eaddd7e23d7 tempest-ServerRescueNegativeTestJSON-2061875223 tempest-ServerRescueNegativeTestJSON-2061875223-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:03:39.471685 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-f0b40b9e-f96e-47e5-bb37-4eaddd7e23d7 tempest-ServerRescueNegativeTestJSON-2061875223 tempest-ServerRescueNegativeTestJSON-2061875223-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:03:39.472460 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-f0b40b9e-f96e-47e5-bb37-4eaddd7e23d7 tempest-ServerRescueNegativeTestJSON-2061875223 tempest-ServerRescueNegativeTestJSON-2061875223-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:03:39.472898 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-f0b40b9e-f96e-47e5-bb37-4eaddd7e23d7 tempest-ServerRescueNegativeTestJSON-2061875223 tempest-ServerRescueNegativeTestJSON-2061875223-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:03:39.601210 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.policy [None req-f0b40b9e-f96e-47e5-bb37-4eaddd7e23d7 tempest-ServerRescueNegativeTestJSON-2061875223 tempest-ServerRescueNegativeTestJSON-2061875223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ea02b6e8f1548a1bd78952cb7337403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5e8a958d4bf43868502b13728b9583b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116156) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:03:39.614232 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: INFO nova.api.openstack.requestlog [None req-f0b40b9e-f96e-47e5-bb37-4eaddd7e23d7 tempest-ServerRescueNegativeTestJSON-2061875223 tempest-ServerRescueNegativeTestJSON-2061875223-project] 10.222.0.18 "GET /compute/v2.1/servers/2d20c8be-04a9-4c79-aa0a-138a79fe50cd" status: 200 len: 1321 microversion: 2.1 time: 0.152976 Dec 15 03:03:39.614984 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: [pid: 116156|app: 0|req: 51/90] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 03:03:39 2021] GET /compute/v2.1/servers/2d20c8be-04a9-4c79-aa0a-138a79fe50cd => generated 1321 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 03:03:40.053278 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi [None req-3d190956-e929-47c3-8015-87b348b9c4a7 tempest-DeleteServersTestJSON-268050555 tempest-DeleteServersTestJSON-268050555-project] Calling method '>' {{(pid=116157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:03:40.053887 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.compute.api [None req-3d190956-e929-47c3-8015-87b348b9c4a7 tempest-DeleteServersTestJSON-268050555 tempest-DeleteServersTestJSON-268050555-project] [instance: 5a01bf2d-c341-4af1-b2b2-e1f05e46705f] Fetching instance by UUID {{(pid=116157) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:03:40.059632 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-3d190956-e929-47c3-8015-87b348b9c4a7 tempest-DeleteServersTestJSON-268050555 tempest-DeleteServersTestJSON-268050555-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:03:40.060082 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-3d190956-e929-47c3-8015-87b348b9c4a7 tempest-DeleteServersTestJSON-268050555 tempest-DeleteServersTestJSON-268050555-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:03:40.060858 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-3d190956-e929-47c3-8015-87b348b9c4a7 tempest-DeleteServersTestJSON-268050555 tempest-DeleteServersTestJSON-268050555-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:03:40.061296 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-3d190956-e929-47c3-8015-87b348b9c4a7 tempest-DeleteServersTestJSON-268050555 tempest-DeleteServersTestJSON-268050555-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:03:40.184847 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.policy [None req-3d190956-e929-47c3-8015-87b348b9c4a7 tempest-DeleteServersTestJSON-268050555 tempest-DeleteServersTestJSON-268050555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28384f466c3541358ecea856650f008c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb933fa80ed94ce5b6828e48e86a21c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116157) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:03:40.191860 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: INFO nova.api.openstack.requestlog [None req-3d190956-e929-47c3-8015-87b348b9c4a7 tempest-DeleteServersTestJSON-268050555 tempest-DeleteServersTestJSON-268050555-project] 10.222.0.18 "GET /compute/v2.1/servers/5a01bf2d-c341-4af1-b2b2-e1f05e46705f" status: 200 len: 1315 microversion: 2.1 time: 0.142195 Dec 15 03:03:40.192418 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: [pid: 116157|app: 0|req: 40/91] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 03:03:40 2021] GET /compute/v2.1/servers/5a01bf2d-c341-4af1-b2b2-e1f05e46705f => generated 1315 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 03:03:40.371506 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi [None req-a7e8946b-4f44-4b2f-9170-6e6d83df06f2 tempest-AttachVolumeNegativeTest-1640336653 tempest-AttachVolumeNegativeTest-1640336653-project] Calling method '>' {{(pid=116156) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:03:40.372111 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.compute.api [None req-a7e8946b-4f44-4b2f-9170-6e6d83df06f2 tempest-AttachVolumeNegativeTest-1640336653 tempest-AttachVolumeNegativeTest-1640336653-project] [instance: 4923355f-95d6-443d-9487-574f56b87f66] Fetching instance by UUID {{(pid=116156) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:03:40.378272 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-a7e8946b-4f44-4b2f-9170-6e6d83df06f2 tempest-AttachVolumeNegativeTest-1640336653 tempest-AttachVolumeNegativeTest-1640336653-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:03:40.378725 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-a7e8946b-4f44-4b2f-9170-6e6d83df06f2 tempest-AttachVolumeNegativeTest-1640336653 tempest-AttachVolumeNegativeTest-1640336653-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:03:40.379498 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-a7e8946b-4f44-4b2f-9170-6e6d83df06f2 tempest-AttachVolumeNegativeTest-1640336653 tempest-AttachVolumeNegativeTest-1640336653-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:03:40.379933 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-a7e8946b-4f44-4b2f-9170-6e6d83df06f2 tempest-AttachVolumeNegativeTest-1640336653 tempest-AttachVolumeNegativeTest-1640336653-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:03:40.509899 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.policy [None req-a7e8946b-4f44-4b2f-9170-6e6d83df06f2 tempest-AttachVolumeNegativeTest-1640336653 tempest-AttachVolumeNegativeTest-1640336653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35d37a3d8e504b8186182468b77dd114', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '409b41637da94c469444954258444b4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116156) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:03:40.518825 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: INFO nova.api.openstack.requestlog [None req-a7e8946b-4f44-4b2f-9170-6e6d83df06f2 tempest-AttachVolumeNegativeTest-1640336653 tempest-AttachVolumeNegativeTest-1640336653-project] 10.222.0.18 "GET /compute/v2.1/servers/4923355f-95d6-443d-9487-574f56b87f66" status: 200 len: 1318 microversion: 2.1 time: 0.150943 Dec 15 03:03:40.519377 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: [pid: 116156|app: 0|req: 52/92] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 03:03:40 2021] GET /compute/v2.1/servers/4923355f-95d6-443d-9487-574f56b87f66 => generated 1318 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 03:03:40.631389 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi [None req-162b229d-1fae-4a86-9665-06f2dfcdb72e tempest-ServerRescueNegativeTestJSON-2061875223 tempest-ServerRescueNegativeTestJSON-2061875223-project] Calling method '>' {{(pid=116157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:03:40.631999 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.compute.api [None req-162b229d-1fae-4a86-9665-06f2dfcdb72e tempest-ServerRescueNegativeTestJSON-2061875223 tempest-ServerRescueNegativeTestJSON-2061875223-project] [instance: 2d20c8be-04a9-4c79-aa0a-138a79fe50cd] Fetching instance by UUID {{(pid=116157) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:03:40.637802 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-162b229d-1fae-4a86-9665-06f2dfcdb72e tempest-ServerRescueNegativeTestJSON-2061875223 tempest-ServerRescueNegativeTestJSON-2061875223-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:03:40.639023 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-162b229d-1fae-4a86-9665-06f2dfcdb72e tempest-ServerRescueNegativeTestJSON-2061875223 tempest-ServerRescueNegativeTestJSON-2061875223-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:03:40.639804 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-162b229d-1fae-4a86-9665-06f2dfcdb72e tempest-ServerRescueNegativeTestJSON-2061875223 tempest-ServerRescueNegativeTestJSON-2061875223-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:03:40.640242 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-162b229d-1fae-4a86-9665-06f2dfcdb72e tempest-ServerRescueNegativeTestJSON-2061875223 tempest-ServerRescueNegativeTestJSON-2061875223-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:03:40.767039 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.policy [None req-162b229d-1fae-4a86-9665-06f2dfcdb72e tempest-ServerRescueNegativeTestJSON-2061875223 tempest-ServerRescueNegativeTestJSON-2061875223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ea02b6e8f1548a1bd78952cb7337403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5e8a958d4bf43868502b13728b9583b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116157) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:03:40.774103 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: INFO nova.api.openstack.requestlog [None req-162b229d-1fae-4a86-9665-06f2dfcdb72e tempest-ServerRescueNegativeTestJSON-2061875223 tempest-ServerRescueNegativeTestJSON-2061875223-project] 10.222.0.18 "GET /compute/v2.1/servers/2d20c8be-04a9-4c79-aa0a-138a79fe50cd" status: 200 len: 1321 microversion: 2.1 time: 0.146267 Dec 15 03:03:40.774662 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: [pid: 116157|app: 0|req: 41/93] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 03:03:40 2021] GET /compute/v2.1/servers/2d20c8be-04a9-4c79-aa0a-138a79fe50cd => generated 1321 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 03:03:41.208263 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi [None req-90e11ce2-3da5-4c8b-bf58-a43cf734fc4b tempest-DeleteServersTestJSON-268050555 tempest-DeleteServersTestJSON-268050555-project] Calling method '>' {{(pid=116156) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:03:41.208980 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.compute.api [None req-90e11ce2-3da5-4c8b-bf58-a43cf734fc4b tempest-DeleteServersTestJSON-268050555 tempest-DeleteServersTestJSON-268050555-project] [instance: 5a01bf2d-c341-4af1-b2b2-e1f05e46705f] Fetching instance by UUID {{(pid=116156) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:03:41.214944 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-90e11ce2-3da5-4c8b-bf58-a43cf734fc4b tempest-DeleteServersTestJSON-268050555 tempest-DeleteServersTestJSON-268050555-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:03:41.215400 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-90e11ce2-3da5-4c8b-bf58-a43cf734fc4b tempest-DeleteServersTestJSON-268050555 tempest-DeleteServersTestJSON-268050555-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:03:41.216680 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-90e11ce2-3da5-4c8b-bf58-a43cf734fc4b tempest-DeleteServersTestJSON-268050555 tempest-DeleteServersTestJSON-268050555-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:03:41.217115 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-90e11ce2-3da5-4c8b-bf58-a43cf734fc4b tempest-DeleteServersTestJSON-268050555 tempest-DeleteServersTestJSON-268050555-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:03:41.340492 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.policy [None req-90e11ce2-3da5-4c8b-bf58-a43cf734fc4b tempest-DeleteServersTestJSON-268050555 tempest-DeleteServersTestJSON-268050555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28384f466c3541358ecea856650f008c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb933fa80ed94ce5b6828e48e86a21c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116156) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:03:41.348062 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: INFO nova.api.openstack.requestlog [None req-90e11ce2-3da5-4c8b-bf58-a43cf734fc4b tempest-DeleteServersTestJSON-268050555 tempest-DeleteServersTestJSON-268050555-project] 10.222.0.18 "GET /compute/v2.1/servers/5a01bf2d-c341-4af1-b2b2-e1f05e46705f" status: 200 len: 1315 microversion: 2.1 time: 0.143408 Dec 15 03:03:41.348625 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: [pid: 116156|app: 0|req: 53/94] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 03:03:41 2021] GET /compute/v2.1/servers/5a01bf2d-c341-4af1-b2b2-e1f05e46705f => generated 1315 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 03:03:41.535441 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi [None req-f9320f97-b0ba-43a9-941b-fe4c95061d44 tempest-AttachVolumeNegativeTest-1640336653 tempest-AttachVolumeNegativeTest-1640336653-project] Calling method '>' {{(pid=116157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:03:41.536148 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.compute.api [None req-f9320f97-b0ba-43a9-941b-fe4c95061d44 tempest-AttachVolumeNegativeTest-1640336653 tempest-AttachVolumeNegativeTest-1640336653-project] [instance: 4923355f-95d6-443d-9487-574f56b87f66] Fetching instance by UUID {{(pid=116157) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:03:41.541812 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-f9320f97-b0ba-43a9-941b-fe4c95061d44 tempest-AttachVolumeNegativeTest-1640336653 tempest-AttachVolumeNegativeTest-1640336653-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:03:41.542431 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-f9320f97-b0ba-43a9-941b-fe4c95061d44 tempest-AttachVolumeNegativeTest-1640336653 tempest-AttachVolumeNegativeTest-1640336653-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:03:41.543141 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-f9320f97-b0ba-43a9-941b-fe4c95061d44 tempest-AttachVolumeNegativeTest-1640336653 tempest-AttachVolumeNegativeTest-1640336653-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:03:41.543576 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-f9320f97-b0ba-43a9-941b-fe4c95061d44 tempest-AttachVolumeNegativeTest-1640336653 tempest-AttachVolumeNegativeTest-1640336653-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:03:41.666943 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.policy [None req-f9320f97-b0ba-43a9-941b-fe4c95061d44 tempest-AttachVolumeNegativeTest-1640336653 tempest-AttachVolumeNegativeTest-1640336653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35d37a3d8e504b8186182468b77dd114', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '409b41637da94c469444954258444b4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116157) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:03:41.674240 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: INFO nova.api.openstack.requestlog [None req-f9320f97-b0ba-43a9-941b-fe4c95061d44 tempest-AttachVolumeNegativeTest-1640336653 tempest-AttachVolumeNegativeTest-1640336653-project] 10.222.0.18 "GET /compute/v2.1/servers/4923355f-95d6-443d-9487-574f56b87f66" status: 200 len: 1318 microversion: 2.1 time: 0.142369 Dec 15 03:03:41.674808 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: [pid: 116157|app: 0|req: 42/95] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 03:03:41 2021] GET /compute/v2.1/servers/4923355f-95d6-443d-9487-574f56b87f66 => generated 1318 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 03:03:41.791403 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi [None req-3b9cbbd0-dfff-41d4-8f37-ddb43250e010 tempest-ServerRescueNegativeTestJSON-2061875223 tempest-ServerRescueNegativeTestJSON-2061875223-project] Calling method '>' {{(pid=116156) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:03:41.792011 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.compute.api [None req-3b9cbbd0-dfff-41d4-8f37-ddb43250e010 tempest-ServerRescueNegativeTestJSON-2061875223 tempest-ServerRescueNegativeTestJSON-2061875223-project] [instance: 2d20c8be-04a9-4c79-aa0a-138a79fe50cd] Fetching instance by UUID {{(pid=116156) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:03:41.797857 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-3b9cbbd0-dfff-41d4-8f37-ddb43250e010 tempest-ServerRescueNegativeTestJSON-2061875223 tempest-ServerRescueNegativeTestJSON-2061875223-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:03:41.798372 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-3b9cbbd0-dfff-41d4-8f37-ddb43250e010 tempest-ServerRescueNegativeTestJSON-2061875223 tempest-ServerRescueNegativeTestJSON-2061875223-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:03:41.799215 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-3b9cbbd0-dfff-41d4-8f37-ddb43250e010 tempest-ServerRescueNegativeTestJSON-2061875223 tempest-ServerRescueNegativeTestJSON-2061875223-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:03:41.799662 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-3b9cbbd0-dfff-41d4-8f37-ddb43250e010 tempest-ServerRescueNegativeTestJSON-2061875223 tempest-ServerRescueNegativeTestJSON-2061875223-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:03:41.931063 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.policy [None req-3b9cbbd0-dfff-41d4-8f37-ddb43250e010 tempest-ServerRescueNegativeTestJSON-2061875223 tempest-ServerRescueNegativeTestJSON-2061875223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ea02b6e8f1548a1bd78952cb7337403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5e8a958d4bf43868502b13728b9583b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116156) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:03:41.939471 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: INFO nova.api.openstack.requestlog [None req-3b9cbbd0-dfff-41d4-8f37-ddb43250e010 tempest-ServerRescueNegativeTestJSON-2061875223 tempest-ServerRescueNegativeTestJSON-2061875223-project] 10.222.0.18 "GET /compute/v2.1/servers/2d20c8be-04a9-4c79-aa0a-138a79fe50cd" status: 200 len: 1321 microversion: 2.1 time: 0.152089 Dec 15 03:03:41.940623 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: [pid: 116156|app: 0|req: 54/96] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 03:03:41 2021] GET /compute/v2.1/servers/2d20c8be-04a9-4c79-aa0a-138a79fe50cd => generated 1321 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 03:03:42.365313 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi [None req-c750cd26-f6a9-4bfc-b0ac-730da56b714d tempest-DeleteServersTestJSON-268050555 tempest-DeleteServersTestJSON-268050555-project] Calling method '>' {{(pid=116157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:03:42.365917 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.compute.api [None req-c750cd26-f6a9-4bfc-b0ac-730da56b714d tempest-DeleteServersTestJSON-268050555 tempest-DeleteServersTestJSON-268050555-project] [instance: 5a01bf2d-c341-4af1-b2b2-e1f05e46705f] Fetching instance by UUID {{(pid=116157) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:03:42.371536 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-c750cd26-f6a9-4bfc-b0ac-730da56b714d tempest-DeleteServersTestJSON-268050555 tempest-DeleteServersTestJSON-268050555-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:03:42.371980 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-c750cd26-f6a9-4bfc-b0ac-730da56b714d tempest-DeleteServersTestJSON-268050555 tempest-DeleteServersTestJSON-268050555-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:03:42.372998 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-c750cd26-f6a9-4bfc-b0ac-730da56b714d tempest-DeleteServersTestJSON-268050555 tempest-DeleteServersTestJSON-268050555-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:03:42.373428 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-c750cd26-f6a9-4bfc-b0ac-730da56b714d tempest-DeleteServersTestJSON-268050555 tempest-DeleteServersTestJSON-268050555-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:03:42.502805 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.policy [None req-c750cd26-f6a9-4bfc-b0ac-730da56b714d tempest-DeleteServersTestJSON-268050555 tempest-DeleteServersTestJSON-268050555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28384f466c3541358ecea856650f008c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb933fa80ed94ce5b6828e48e86a21c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116157) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:03:42.509816 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: INFO nova.api.openstack.requestlog [None req-c750cd26-f6a9-4bfc-b0ac-730da56b714d tempest-DeleteServersTestJSON-268050555 tempest-DeleteServersTestJSON-268050555-project] 10.222.0.18 "GET /compute/v2.1/servers/5a01bf2d-c341-4af1-b2b2-e1f05e46705f" status: 200 len: 1315 microversion: 2.1 time: 0.148054 Dec 15 03:03:42.510407 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: [pid: 116157|app: 0|req: 43/97] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 03:03:42 2021] GET /compute/v2.1/servers/5a01bf2d-c341-4af1-b2b2-e1f05e46705f => generated 1315 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 03:03:42.690630 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi [None req-8e7402d1-c710-4742-bd65-5e6e8a99fd53 tempest-AttachVolumeNegativeTest-1640336653 tempest-AttachVolumeNegativeTest-1640336653-project] Calling method '>' {{(pid=116156) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:03:42.691235 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.compute.api [None req-8e7402d1-c710-4742-bd65-5e6e8a99fd53 tempest-AttachVolumeNegativeTest-1640336653 tempest-AttachVolumeNegativeTest-1640336653-project] [instance: 4923355f-95d6-443d-9487-574f56b87f66] Fetching instance by UUID {{(pid=116156) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:03:42.697042 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-8e7402d1-c710-4742-bd65-5e6e8a99fd53 tempest-AttachVolumeNegativeTest-1640336653 tempest-AttachVolumeNegativeTest-1640336653-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:03:42.697495 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-8e7402d1-c710-4742-bd65-5e6e8a99fd53 tempest-AttachVolumeNegativeTest-1640336653 tempest-AttachVolumeNegativeTest-1640336653-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:03:42.698300 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-8e7402d1-c710-4742-bd65-5e6e8a99fd53 tempest-AttachVolumeNegativeTest-1640336653 tempest-AttachVolumeNegativeTest-1640336653-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:03:42.698731 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-8e7402d1-c710-4742-bd65-5e6e8a99fd53 tempest-AttachVolumeNegativeTest-1640336653 tempest-AttachVolumeNegativeTest-1640336653-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:03:42.826875 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.policy [None req-8e7402d1-c710-4742-bd65-5e6e8a99fd53 tempest-AttachVolumeNegativeTest-1640336653 tempest-AttachVolumeNegativeTest-1640336653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35d37a3d8e504b8186182468b77dd114', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '409b41637da94c469444954258444b4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116156) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:03:42.834316 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: INFO nova.api.openstack.requestlog [None req-8e7402d1-c710-4742-bd65-5e6e8a99fd53 tempest-AttachVolumeNegativeTest-1640336653 tempest-AttachVolumeNegativeTest-1640336653-project] 10.222.0.18 "GET /compute/v2.1/servers/4923355f-95d6-443d-9487-574f56b87f66" status: 200 len: 1318 microversion: 2.1 time: 0.147215 Dec 15 03:03:42.834819 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: [pid: 116156|app: 0|req: 55/98] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 03:03:42 2021] GET /compute/v2.1/servers/4923355f-95d6-443d-9487-574f56b87f66 => generated 1318 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 03:03:42.956234 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi [None req-874e5a66-af11-4773-aea3-b722b3b088db tempest-ServerRescueNegativeTestJSON-2061875223 tempest-ServerRescueNegativeTestJSON-2061875223-project] Calling method '>' {{(pid=116157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:03:42.956842 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.compute.api [None req-874e5a66-af11-4773-aea3-b722b3b088db tempest-ServerRescueNegativeTestJSON-2061875223 tempest-ServerRescueNegativeTestJSON-2061875223-project] [instance: 2d20c8be-04a9-4c79-aa0a-138a79fe50cd] Fetching instance by UUID {{(pid=116157) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:03:42.962595 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-874e5a66-af11-4773-aea3-b722b3b088db tempest-ServerRescueNegativeTestJSON-2061875223 tempest-ServerRescueNegativeTestJSON-2061875223-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:03:42.963048 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-874e5a66-af11-4773-aea3-b722b3b088db tempest-ServerRescueNegativeTestJSON-2061875223 tempest-ServerRescueNegativeTestJSON-2061875223-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:03:42.963853 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-874e5a66-af11-4773-aea3-b722b3b088db tempest-ServerRescueNegativeTestJSON-2061875223 tempest-ServerRescueNegativeTestJSON-2061875223-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:03:42.964291 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-874e5a66-af11-4773-aea3-b722b3b088db tempest-ServerRescueNegativeTestJSON-2061875223 tempest-ServerRescueNegativeTestJSON-2061875223-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:03:43.095490 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.policy [None req-874e5a66-af11-4773-aea3-b722b3b088db tempest-ServerRescueNegativeTestJSON-2061875223 tempest-ServerRescueNegativeTestJSON-2061875223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ea02b6e8f1548a1bd78952cb7337403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5e8a958d4bf43868502b13728b9583b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116157) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:03:43.102590 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: INFO nova.api.openstack.requestlog [None req-874e5a66-af11-4773-aea3-b722b3b088db tempest-ServerRescueNegativeTestJSON-2061875223 tempest-ServerRescueNegativeTestJSON-2061875223-project] 10.222.0.18 "GET /compute/v2.1/servers/2d20c8be-04a9-4c79-aa0a-138a79fe50cd" status: 200 len: 1321 microversion: 2.1 time: 0.149948 Dec 15 03:03:43.103156 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: [pid: 116157|app: 0|req: 44/99] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 03:03:42 2021] GET /compute/v2.1/servers/2d20c8be-04a9-4c79-aa0a-138a79fe50cd => generated 1321 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 03:03:43.525900 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi [None req-d44e7117-717f-42b3-b262-becc91c51d03 tempest-DeleteServersTestJSON-268050555 tempest-DeleteServersTestJSON-268050555-project] Calling method '>' {{(pid=116156) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:03:43.526491 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.compute.api [None req-d44e7117-717f-42b3-b262-becc91c51d03 tempest-DeleteServersTestJSON-268050555 tempest-DeleteServersTestJSON-268050555-project] [instance: 5a01bf2d-c341-4af1-b2b2-e1f05e46705f] Fetching instance by UUID {{(pid=116156) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:03:43.532335 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-d44e7117-717f-42b3-b262-becc91c51d03 tempest-DeleteServersTestJSON-268050555 tempest-DeleteServersTestJSON-268050555-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:03:43.532791 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-d44e7117-717f-42b3-b262-becc91c51d03 tempest-DeleteServersTestJSON-268050555 tempest-DeleteServersTestJSON-268050555-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:03:43.533580 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-d44e7117-717f-42b3-b262-becc91c51d03 tempest-DeleteServersTestJSON-268050555 tempest-DeleteServersTestJSON-268050555-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:03:43.534044 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-d44e7117-717f-42b3-b262-becc91c51d03 tempest-DeleteServersTestJSON-268050555 tempest-DeleteServersTestJSON-268050555-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:03:43.660294 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.policy [None req-d44e7117-717f-42b3-b262-becc91c51d03 tempest-DeleteServersTestJSON-268050555 tempest-DeleteServersTestJSON-268050555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28384f466c3541358ecea856650f008c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb933fa80ed94ce5b6828e48e86a21c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116156) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:03:43.667318 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: INFO nova.api.openstack.requestlog [None req-d44e7117-717f-42b3-b262-becc91c51d03 tempest-DeleteServersTestJSON-268050555 tempest-DeleteServersTestJSON-268050555-project] 10.222.0.18 "GET /compute/v2.1/servers/5a01bf2d-c341-4af1-b2b2-e1f05e46705f" status: 200 len: 1315 microversion: 2.1 time: 0.145118 Dec 15 03:03:43.667908 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: [pid: 116156|app: 0|req: 56/100] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 03:03:43 2021] GET /compute/v2.1/servers/5a01bf2d-c341-4af1-b2b2-e1f05e46705f => generated 1315 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 03:03:43.851190 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi [None req-8c895d4a-3c2d-4b86-b1d1-adffac9904da tempest-AttachVolumeNegativeTest-1640336653 tempest-AttachVolumeNegativeTest-1640336653-project] Calling method '>' {{(pid=116157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:03:43.851796 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.compute.api [None req-8c895d4a-3c2d-4b86-b1d1-adffac9904da tempest-AttachVolumeNegativeTest-1640336653 tempest-AttachVolumeNegativeTest-1640336653-project] [instance: 4923355f-95d6-443d-9487-574f56b87f66] Fetching instance by UUID {{(pid=116157) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:03:43.857625 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-8c895d4a-3c2d-4b86-b1d1-adffac9904da tempest-AttachVolumeNegativeTest-1640336653 tempest-AttachVolumeNegativeTest-1640336653-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:03:43.858093 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-8c895d4a-3c2d-4b86-b1d1-adffac9904da tempest-AttachVolumeNegativeTest-1640336653 tempest-AttachVolumeNegativeTest-1640336653-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:03:43.859390 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-8c895d4a-3c2d-4b86-b1d1-adffac9904da tempest-AttachVolumeNegativeTest-1640336653 tempest-AttachVolumeNegativeTest-1640336653-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:03:43.859792 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-8c895d4a-3c2d-4b86-b1d1-adffac9904da tempest-AttachVolumeNegativeTest-1640336653 tempest-AttachVolumeNegativeTest-1640336653-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:03:43.987532 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.policy [None req-8c895d4a-3c2d-4b86-b1d1-adffac9904da tempest-AttachVolumeNegativeTest-1640336653 tempest-AttachVolumeNegativeTest-1640336653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35d37a3d8e504b8186182468b77dd114', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '409b41637da94c469444954258444b4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116157) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:03:43.994562 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: INFO nova.api.openstack.requestlog [None req-8c895d4a-3c2d-4b86-b1d1-adffac9904da tempest-AttachVolumeNegativeTest-1640336653 tempest-AttachVolumeNegativeTest-1640336653-project] 10.222.0.18 "GET /compute/v2.1/servers/4923355f-95d6-443d-9487-574f56b87f66" status: 200 len: 1318 microversion: 2.1 time: 0.146924 Dec 15 03:03:43.995128 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: [pid: 116157|app: 0|req: 45/101] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 03:03:43 2021] GET /compute/v2.1/servers/4923355f-95d6-443d-9487-574f56b87f66 => generated 1318 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 03:03:44.118769 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi [None req-969517c5-bdc0-4612-ba81-e59959fc3698 tempest-ServerRescueNegativeTestJSON-2061875223 tempest-ServerRescueNegativeTestJSON-2061875223-project] Calling method '>' {{(pid=116156) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:03:44.119299 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.compute.api [None req-969517c5-bdc0-4612-ba81-e59959fc3698 tempest-ServerRescueNegativeTestJSON-2061875223 tempest-ServerRescueNegativeTestJSON-2061875223-project] [instance: 2d20c8be-04a9-4c79-aa0a-138a79fe50cd] Fetching instance by UUID {{(pid=116156) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:03:44.125357 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-969517c5-bdc0-4612-ba81-e59959fc3698 tempest-ServerRescueNegativeTestJSON-2061875223 tempest-ServerRescueNegativeTestJSON-2061875223-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:03:44.125806 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-969517c5-bdc0-4612-ba81-e59959fc3698 tempest-ServerRescueNegativeTestJSON-2061875223 tempest-ServerRescueNegativeTestJSON-2061875223-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:03:44.126600 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-969517c5-bdc0-4612-ba81-e59959fc3698 tempest-ServerRescueNegativeTestJSON-2061875223 tempest-ServerRescueNegativeTestJSON-2061875223-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:03:44.127032 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-969517c5-bdc0-4612-ba81-e59959fc3698 tempest-ServerRescueNegativeTestJSON-2061875223 tempest-ServerRescueNegativeTestJSON-2061875223-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:03:44.260270 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.policy [None req-969517c5-bdc0-4612-ba81-e59959fc3698 tempest-ServerRescueNegativeTestJSON-2061875223 tempest-ServerRescueNegativeTestJSON-2061875223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ea02b6e8f1548a1bd78952cb7337403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5e8a958d4bf43868502b13728b9583b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116156) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:03:44.267409 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: INFO nova.api.openstack.requestlog [None req-969517c5-bdc0-4612-ba81-e59959fc3698 tempest-ServerRescueNegativeTestJSON-2061875223 tempest-ServerRescueNegativeTestJSON-2061875223-project] 10.222.0.18 "GET /compute/v2.1/servers/2d20c8be-04a9-4c79-aa0a-138a79fe50cd" status: 200 len: 1321 microversion: 2.1 time: 0.152274 Dec 15 03:03:44.267972 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: [pid: 116156|app: 0|req: 57/102] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 03:03:44 2021] GET /compute/v2.1/servers/2d20c8be-04a9-4c79-aa0a-138a79fe50cd => generated 1321 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 03:03:44.683937 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi [None req-580fce18-37e2-4ab6-814c-23e4697949f5 tempest-DeleteServersTestJSON-268050555 tempest-DeleteServersTestJSON-268050555-project] Calling method '>' {{(pid=116157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:03:44.684547 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.compute.api [None req-580fce18-37e2-4ab6-814c-23e4697949f5 tempest-DeleteServersTestJSON-268050555 tempest-DeleteServersTestJSON-268050555-project] [instance: 5a01bf2d-c341-4af1-b2b2-e1f05e46705f] Fetching instance by UUID {{(pid=116157) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:03:44.690264 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-580fce18-37e2-4ab6-814c-23e4697949f5 tempest-DeleteServersTestJSON-268050555 tempest-DeleteServersTestJSON-268050555-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:03:44.690721 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-580fce18-37e2-4ab6-814c-23e4697949f5 tempest-DeleteServersTestJSON-268050555 tempest-DeleteServersTestJSON-268050555-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:03:44.691493 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-580fce18-37e2-4ab6-814c-23e4697949f5 tempest-DeleteServersTestJSON-268050555 tempest-DeleteServersTestJSON-268050555-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:03:44.691927 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-580fce18-37e2-4ab6-814c-23e4697949f5 tempest-DeleteServersTestJSON-268050555 tempest-DeleteServersTestJSON-268050555-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:03:44.817067 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.policy [None req-580fce18-37e2-4ab6-814c-23e4697949f5 tempest-DeleteServersTestJSON-268050555 tempest-DeleteServersTestJSON-268050555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28384f466c3541358ecea856650f008c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb933fa80ed94ce5b6828e48e86a21c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116157) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:03:44.824144 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: INFO nova.api.openstack.requestlog [None req-580fce18-37e2-4ab6-814c-23e4697949f5 tempest-DeleteServersTestJSON-268050555 tempest-DeleteServersTestJSON-268050555-project] 10.222.0.18 "GET /compute/v2.1/servers/5a01bf2d-c341-4af1-b2b2-e1f05e46705f" status: 200 len: 1315 microversion: 2.1 time: 0.143759 Dec 15 03:03:44.824705 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: [pid: 116157|app: 0|req: 46/103] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 03:03:44 2021] GET /compute/v2.1/servers/5a01bf2d-c341-4af1-b2b2-e1f05e46705f => generated 1315 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 03:03:45.012237 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi [None req-1dacd1df-e1f0-49fd-a128-926d7ea75fb2 tempest-AttachVolumeNegativeTest-1640336653 tempest-AttachVolumeNegativeTest-1640336653-project] Calling method '>' {{(pid=116156) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:03:45.012778 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.compute.api [None req-1dacd1df-e1f0-49fd-a128-926d7ea75fb2 tempest-AttachVolumeNegativeTest-1640336653 tempest-AttachVolumeNegativeTest-1640336653-project] [instance: 4923355f-95d6-443d-9487-574f56b87f66] Fetching instance by UUID {{(pid=116156) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:03:45.019183 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-1dacd1df-e1f0-49fd-a128-926d7ea75fb2 tempest-AttachVolumeNegativeTest-1640336653 tempest-AttachVolumeNegativeTest-1640336653-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:03:45.019631 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-1dacd1df-e1f0-49fd-a128-926d7ea75fb2 tempest-AttachVolumeNegativeTest-1640336653 tempest-AttachVolumeNegativeTest-1640336653-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:03:45.020404 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-1dacd1df-e1f0-49fd-a128-926d7ea75fb2 tempest-AttachVolumeNegativeTest-1640336653 tempest-AttachVolumeNegativeTest-1640336653-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:03:45.020839 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-1dacd1df-e1f0-49fd-a128-926d7ea75fb2 tempest-AttachVolumeNegativeTest-1640336653 tempest-AttachVolumeNegativeTest-1640336653-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:03:45.154528 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.policy [None req-1dacd1df-e1f0-49fd-a128-926d7ea75fb2 tempest-AttachVolumeNegativeTest-1640336653 tempest-AttachVolumeNegativeTest-1640336653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35d37a3d8e504b8186182468b77dd114', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '409b41637da94c469444954258444b4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116156) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:03:45.162628 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: INFO nova.api.openstack.requestlog [None req-1dacd1df-e1f0-49fd-a128-926d7ea75fb2 tempest-AttachVolumeNegativeTest-1640336653 tempest-AttachVolumeNegativeTest-1640336653-project] 10.222.0.18 "GET /compute/v2.1/servers/4923355f-95d6-443d-9487-574f56b87f66" status: 200 len: 1318 microversion: 2.1 time: 0.154035 Dec 15 03:03:45.163206 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: [pid: 116156|app: 0|req: 58/104] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 03:03:45 2021] GET /compute/v2.1/servers/4923355f-95d6-443d-9487-574f56b87f66 => generated 1318 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 03:03:45.284970 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi [None req-7dd6fc2d-e9dc-4604-ba38-6b10a49176f5 tempest-ServerRescueNegativeTestJSON-2061875223 tempest-ServerRescueNegativeTestJSON-2061875223-project] Calling method '>' {{(pid=116157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:03:45.285505 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.compute.api [None req-7dd6fc2d-e9dc-4604-ba38-6b10a49176f5 tempest-ServerRescueNegativeTestJSON-2061875223 tempest-ServerRescueNegativeTestJSON-2061875223-project] [instance: 2d20c8be-04a9-4c79-aa0a-138a79fe50cd] Fetching instance by UUID {{(pid=116157) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:03:45.291626 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-7dd6fc2d-e9dc-4604-ba38-6b10a49176f5 tempest-ServerRescueNegativeTestJSON-2061875223 tempest-ServerRescueNegativeTestJSON-2061875223-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:03:45.292094 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-7dd6fc2d-e9dc-4604-ba38-6b10a49176f5 tempest-ServerRescueNegativeTestJSON-2061875223 tempest-ServerRescueNegativeTestJSON-2061875223-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:03:45.292889 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-7dd6fc2d-e9dc-4604-ba38-6b10a49176f5 tempest-ServerRescueNegativeTestJSON-2061875223 tempest-ServerRescueNegativeTestJSON-2061875223-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:03:45.301582 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-7dd6fc2d-e9dc-4604-ba38-6b10a49176f5 tempest-ServerRescueNegativeTestJSON-2061875223 tempest-ServerRescueNegativeTestJSON-2061875223-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:03:45.439288 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.policy [None req-7dd6fc2d-e9dc-4604-ba38-6b10a49176f5 tempest-ServerRescueNegativeTestJSON-2061875223 tempest-ServerRescueNegativeTestJSON-2061875223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ea02b6e8f1548a1bd78952cb7337403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5e8a958d4bf43868502b13728b9583b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116157) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:03:45.446779 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: INFO nova.api.openstack.requestlog [None req-7dd6fc2d-e9dc-4604-ba38-6b10a49176f5 tempest-ServerRescueNegativeTestJSON-2061875223 tempest-ServerRescueNegativeTestJSON-2061875223-project] 10.222.0.18 "GET /compute/v2.1/servers/2d20c8be-04a9-4c79-aa0a-138a79fe50cd" status: 200 len: 1321 microversion: 2.1 time: 0.166362 Dec 15 03:03:45.447335 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: [pid: 116157|app: 0|req: 47/105] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 03:03:45 2021] GET /compute/v2.1/servers/2d20c8be-04a9-4c79-aa0a-138a79fe50cd => generated 1321 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 03:03:45.840542 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi [None req-6990bb24-daeb-425f-b3ab-8bee2494d68d tempest-DeleteServersTestJSON-268050555 tempest-DeleteServersTestJSON-268050555-project] Calling method '>' {{(pid=116156) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:03:45.841404 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.compute.api [None req-6990bb24-daeb-425f-b3ab-8bee2494d68d tempest-DeleteServersTestJSON-268050555 tempest-DeleteServersTestJSON-268050555-project] [instance: 5a01bf2d-c341-4af1-b2b2-e1f05e46705f] Fetching instance by UUID {{(pid=116156) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:03:45.849622 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-6990bb24-daeb-425f-b3ab-8bee2494d68d tempest-DeleteServersTestJSON-268050555 tempest-DeleteServersTestJSON-268050555-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:03:45.852241 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-6990bb24-daeb-425f-b3ab-8bee2494d68d tempest-DeleteServersTestJSON-268050555 tempest-DeleteServersTestJSON-268050555-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:03:45.853293 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-6990bb24-daeb-425f-b3ab-8bee2494d68d tempest-DeleteServersTestJSON-268050555 tempest-DeleteServersTestJSON-268050555-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:03:45.854002 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-6990bb24-daeb-425f-b3ab-8bee2494d68d tempest-DeleteServersTestJSON-268050555 tempest-DeleteServersTestJSON-268050555-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:03:46.027670 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.policy [None req-6990bb24-daeb-425f-b3ab-8bee2494d68d tempest-DeleteServersTestJSON-268050555 tempest-DeleteServersTestJSON-268050555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28384f466c3541358ecea856650f008c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb933fa80ed94ce5b6828e48e86a21c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116156) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:03:46.036109 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: INFO nova.api.openstack.requestlog [None req-6990bb24-daeb-425f-b3ab-8bee2494d68d tempest-DeleteServersTestJSON-268050555 tempest-DeleteServersTestJSON-268050555-project] 10.222.0.18 "GET /compute/v2.1/servers/5a01bf2d-c341-4af1-b2b2-e1f05e46705f" status: 200 len: 1315 microversion: 2.1 time: 0.199239 Dec 15 03:03:46.036762 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: [pid: 116156|app: 0|req: 59/106] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 03:03:45 2021] GET /compute/v2.1/servers/5a01bf2d-c341-4af1-b2b2-e1f05e46705f => generated 1315 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 03:03:46.179252 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi [None req-713d4ce6-cb6f-482a-853c-6e7e54ab2a23 tempest-AttachVolumeNegativeTest-1640336653 tempest-AttachVolumeNegativeTest-1640336653-project] Calling method '>' {{(pid=116157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:03:46.179881 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.compute.api [None req-713d4ce6-cb6f-482a-853c-6e7e54ab2a23 tempest-AttachVolumeNegativeTest-1640336653 tempest-AttachVolumeNegativeTest-1640336653-project] [instance: 4923355f-95d6-443d-9487-574f56b87f66] Fetching instance by UUID {{(pid=116157) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:03:46.186474 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-713d4ce6-cb6f-482a-853c-6e7e54ab2a23 tempest-AttachVolumeNegativeTest-1640336653 tempest-AttachVolumeNegativeTest-1640336653-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:03:46.186927 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-713d4ce6-cb6f-482a-853c-6e7e54ab2a23 tempest-AttachVolumeNegativeTest-1640336653 tempest-AttachVolumeNegativeTest-1640336653-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:03:46.187735 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-713d4ce6-cb6f-482a-853c-6e7e54ab2a23 tempest-AttachVolumeNegativeTest-1640336653 tempest-AttachVolumeNegativeTest-1640336653-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:03:46.188235 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-713d4ce6-cb6f-482a-853c-6e7e54ab2a23 tempest-AttachVolumeNegativeTest-1640336653 tempest-AttachVolumeNegativeTest-1640336653-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:03:46.463516 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi [None req-5da48180-5091-4e37-94e2-a929607492aa tempest-ServerRescueNegativeTestJSON-2061875223 tempest-ServerRescueNegativeTestJSON-2061875223-project] Calling method '>' {{(pid=116156) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:03:46.464258 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.compute.api [None req-5da48180-5091-4e37-94e2-a929607492aa tempest-ServerRescueNegativeTestJSON-2061875223 tempest-ServerRescueNegativeTestJSON-2061875223-project] [instance: 2d20c8be-04a9-4c79-aa0a-138a79fe50cd] Fetching instance by UUID {{(pid=116156) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:03:46.470629 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-5da48180-5091-4e37-94e2-a929607492aa tempest-ServerRescueNegativeTestJSON-2061875223 tempest-ServerRescueNegativeTestJSON-2061875223-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:03:46.471328 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-5da48180-5091-4e37-94e2-a929607492aa tempest-ServerRescueNegativeTestJSON-2061875223 tempest-ServerRescueNegativeTestJSON-2061875223-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:03:46.472336 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-5da48180-5091-4e37-94e2-a929607492aa tempest-ServerRescueNegativeTestJSON-2061875223 tempest-ServerRescueNegativeTestJSON-2061875223-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:03:46.472968 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-5da48180-5091-4e37-94e2-a929607492aa tempest-ServerRescueNegativeTestJSON-2061875223 tempest-ServerRescueNegativeTestJSON-2061875223-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:03:46.526618 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.policy [None req-713d4ce6-cb6f-482a-853c-6e7e54ab2a23 tempest-AttachVolumeNegativeTest-1640336653 tempest-AttachVolumeNegativeTest-1640336653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35d37a3d8e504b8186182468b77dd114', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '409b41637da94c469444954258444b4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116157) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:03:46.535185 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: INFO nova.api.openstack.requestlog [None req-713d4ce6-cb6f-482a-853c-6e7e54ab2a23 tempest-AttachVolumeNegativeTest-1640336653 tempest-AttachVolumeNegativeTest-1640336653-project] 10.222.0.18 "GET /compute/v2.1/servers/4923355f-95d6-443d-9487-574f56b87f66" status: 200 len: 1318 microversion: 2.1 time: 0.359544 Dec 15 03:03:46.537916 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: [pid: 116157|app: 0|req: 48/107] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 03:03:46 2021] GET /compute/v2.1/servers/4923355f-95d6-443d-9487-574f56b87f66 => generated 1318 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 03:03:46.665721 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.policy [None req-5da48180-5091-4e37-94e2-a929607492aa tempest-ServerRescueNegativeTestJSON-2061875223 tempest-ServerRescueNegativeTestJSON-2061875223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ea02b6e8f1548a1bd78952cb7337403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5e8a958d4bf43868502b13728b9583b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116156) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:03:46.674027 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: INFO nova.api.openstack.requestlog [None req-5da48180-5091-4e37-94e2-a929607492aa tempest-ServerRescueNegativeTestJSON-2061875223 tempest-ServerRescueNegativeTestJSON-2061875223-project] 10.222.0.18 "GET /compute/v2.1/servers/2d20c8be-04a9-4c79-aa0a-138a79fe50cd" status: 200 len: 1321 microversion: 2.1 time: 0.214027 Dec 15 03:03:46.689333 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi [req-da0d992d-81fd-4c77-8d81-970da0922e32 req-f636d591-851e-4bde-80c7-2ce4e695f4a0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4923355f-95d6-443d-9487-574f56b87f66", "name": "network-vif-plugged", "status": "completed", "tag": "a334403e-b33f-4832-89e4-ad890500445a"}]} {{(pid=116157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 03:03:46.691955 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 15 03:03:46.691955 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: warnings.warn(msg) Dec 15 03:03:46.697380 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: [pid: 116156|app: 0|req: 60/108] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 03:03:46 2021] GET /compute/v2.1/servers/2d20c8be-04a9-4c79-aa0a-138a79fe50cd => generated 1321 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 03:03:46.702957 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [req-da0d992d-81fd-4c77-8d81-970da0922e32 req-f636d591-851e-4bde-80c7-2ce4e695f4a0 service nova] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:03:46.703668 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [req-da0d992d-81fd-4c77-8d81-970da0922e32 req-f636d591-851e-4bde-80c7-2ce4e695f4a0 service nova] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:03:46.716252 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: INFO nova.api.openstack.compute.server_external_events [req-da0d992d-81fd-4c77-8d81-970da0922e32 req-f636d591-851e-4bde-80c7-2ce4e695f4a0 service nova] Creating event network-vif-plugged:a334403e-b33f-4832-89e4-ad890500445a for instance 4923355f-95d6-443d-9487-574f56b87f66 on hv-cinder-81803 Dec 15 03:03:46.723228 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: INFO nova.api.openstack.requestlog [req-da0d992d-81fd-4c77-8d81-970da0922e32 req-f636d591-851e-4bde-80c7-2ce4e695f4a0 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.160398 Dec 15 03:03:46.724361 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: [pid: 116157|app: 0|req: 49/109] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Dec 15 03:03:46 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 15 03:03:47.052731 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi [None req-10ae2c78-13eb-4a00-92f2-ab321a6f5d7a tempest-DeleteServersTestJSON-268050555 tempest-DeleteServersTestJSON-268050555-project] Calling method '>' {{(pid=116156) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:03:47.053359 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.compute.api [None req-10ae2c78-13eb-4a00-92f2-ab321a6f5d7a tempest-DeleteServersTestJSON-268050555 tempest-DeleteServersTestJSON-268050555-project] [instance: 5a01bf2d-c341-4af1-b2b2-e1f05e46705f] Fetching instance by UUID {{(pid=116156) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:03:47.059161 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-10ae2c78-13eb-4a00-92f2-ab321a6f5d7a tempest-DeleteServersTestJSON-268050555 tempest-DeleteServersTestJSON-268050555-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:03:47.059615 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-10ae2c78-13eb-4a00-92f2-ab321a6f5d7a tempest-DeleteServersTestJSON-268050555 tempest-DeleteServersTestJSON-268050555-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:03:47.060390 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-10ae2c78-13eb-4a00-92f2-ab321a6f5d7a tempest-DeleteServersTestJSON-268050555 tempest-DeleteServersTestJSON-268050555-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:03:47.060825 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-10ae2c78-13eb-4a00-92f2-ab321a6f5d7a tempest-DeleteServersTestJSON-268050555 tempest-DeleteServersTestJSON-268050555-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:03:47.187206 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.policy [None req-10ae2c78-13eb-4a00-92f2-ab321a6f5d7a tempest-DeleteServersTestJSON-268050555 tempest-DeleteServersTestJSON-268050555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28384f466c3541358ecea856650f008c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb933fa80ed94ce5b6828e48e86a21c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116156) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:03:47.195480 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: INFO nova.api.openstack.requestlog [None req-10ae2c78-13eb-4a00-92f2-ab321a6f5d7a tempest-DeleteServersTestJSON-268050555 tempest-DeleteServersTestJSON-268050555-project] 10.222.0.18 "GET /compute/v2.1/servers/5a01bf2d-c341-4af1-b2b2-e1f05e46705f" status: 200 len: 1315 microversion: 2.1 time: 0.146184 Dec 15 03:03:47.195957 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: [pid: 116156|app: 0|req: 61/110] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 03:03:47 2021] GET /compute/v2.1/servers/5a01bf2d-c341-4af1-b2b2-e1f05e46705f => generated 1315 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 03:03:47.552432 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi [None req-42a9f39d-8b41-44a8-9c5e-963c9cd22e76 tempest-AttachVolumeNegativeTest-1640336653 tempest-AttachVolumeNegativeTest-1640336653-project] Calling method '>' {{(pid=116157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:03:47.553120 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.compute.api [None req-42a9f39d-8b41-44a8-9c5e-963c9cd22e76 tempest-AttachVolumeNegativeTest-1640336653 tempest-AttachVolumeNegativeTest-1640336653-project] [instance: 4923355f-95d6-443d-9487-574f56b87f66] Fetching instance by UUID {{(pid=116157) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:03:47.559092 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-42a9f39d-8b41-44a8-9c5e-963c9cd22e76 tempest-AttachVolumeNegativeTest-1640336653 tempest-AttachVolumeNegativeTest-1640336653-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:03:47.559541 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-42a9f39d-8b41-44a8-9c5e-963c9cd22e76 tempest-AttachVolumeNegativeTest-1640336653 tempest-AttachVolumeNegativeTest-1640336653-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:03:47.560302 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-42a9f39d-8b41-44a8-9c5e-963c9cd22e76 tempest-AttachVolumeNegativeTest-1640336653 tempest-AttachVolumeNegativeTest-1640336653-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:03:47.560732 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-42a9f39d-8b41-44a8-9c5e-963c9cd22e76 tempest-AttachVolumeNegativeTest-1640336653 tempest-AttachVolumeNegativeTest-1640336653-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:03:47.685266 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.policy [None req-42a9f39d-8b41-44a8-9c5e-963c9cd22e76 tempest-AttachVolumeNegativeTest-1640336653 tempest-AttachVolumeNegativeTest-1640336653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35d37a3d8e504b8186182468b77dd114', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '409b41637da94c469444954258444b4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116157) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:03:47.690628 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi [None req-237fb3e5-35a3-46d9-98f3-3921b6da9304 tempest-ServerRescueNegativeTestJSON-2061875223 tempest-ServerRescueNegativeTestJSON-2061875223-project] Calling method '>' {{(pid=116156) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:03:47.691242 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.compute.api [None req-237fb3e5-35a3-46d9-98f3-3921b6da9304 tempest-ServerRescueNegativeTestJSON-2061875223 tempest-ServerRescueNegativeTestJSON-2061875223-project] [instance: 2d20c8be-04a9-4c79-aa0a-138a79fe50cd] Fetching instance by UUID {{(pid=116156) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:03:47.693121 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: INFO nova.api.openstack.requestlog [None req-42a9f39d-8b41-44a8-9c5e-963c9cd22e76 tempest-AttachVolumeNegativeTest-1640336653 tempest-AttachVolumeNegativeTest-1640336653-project] 10.222.0.18 "GET /compute/v2.1/servers/4923355f-95d6-443d-9487-574f56b87f66" status: 200 len: 1318 microversion: 2.1 time: 0.144643 Dec 15 03:03:47.696614 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: [pid: 116157|app: 0|req: 50/111] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 03:03:47 2021] GET /compute/v2.1/servers/4923355f-95d6-443d-9487-574f56b87f66 => generated 1318 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 03:03:47.697132 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-237fb3e5-35a3-46d9-98f3-3921b6da9304 tempest-ServerRescueNegativeTestJSON-2061875223 tempest-ServerRescueNegativeTestJSON-2061875223-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:03:47.697585 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-237fb3e5-35a3-46d9-98f3-3921b6da9304 tempest-ServerRescueNegativeTestJSON-2061875223 tempest-ServerRescueNegativeTestJSON-2061875223-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:03:47.698394 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-237fb3e5-35a3-46d9-98f3-3921b6da9304 tempest-ServerRescueNegativeTestJSON-2061875223 tempest-ServerRescueNegativeTestJSON-2061875223-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:03:47.698832 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-237fb3e5-35a3-46d9-98f3-3921b6da9304 tempest-ServerRescueNegativeTestJSON-2061875223 tempest-ServerRescueNegativeTestJSON-2061875223-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:03:47.828043 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.policy [None req-237fb3e5-35a3-46d9-98f3-3921b6da9304 tempest-ServerRescueNegativeTestJSON-2061875223 tempest-ServerRescueNegativeTestJSON-2061875223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ea02b6e8f1548a1bd78952cb7337403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5e8a958d4bf43868502b13728b9583b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116156) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:03:47.835191 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: INFO nova.api.openstack.requestlog [None req-237fb3e5-35a3-46d9-98f3-3921b6da9304 tempest-ServerRescueNegativeTestJSON-2061875223 tempest-ServerRescueNegativeTestJSON-2061875223-project] 10.222.0.18 "GET /compute/v2.1/servers/2d20c8be-04a9-4c79-aa0a-138a79fe50cd" status: 200 len: 1321 microversion: 2.1 time: 0.148820 Dec 15 03:03:47.835752 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: [pid: 116156|app: 0|req: 62/112] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 03:03:47 2021] GET /compute/v2.1/servers/2d20c8be-04a9-4c79-aa0a-138a79fe50cd => generated 1321 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 03:03:48.212382 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi [None req-8035f2f3-1a34-4622-9dbd-f3e709dd8b4a tempest-DeleteServersTestJSON-268050555 tempest-DeleteServersTestJSON-268050555-project] Calling method '>' {{(pid=116157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:03:48.212946 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.compute.api [None req-8035f2f3-1a34-4622-9dbd-f3e709dd8b4a tempest-DeleteServersTestJSON-268050555 tempest-DeleteServersTestJSON-268050555-project] [instance: 5a01bf2d-c341-4af1-b2b2-e1f05e46705f] Fetching instance by UUID {{(pid=116157) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:03:48.218745 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-8035f2f3-1a34-4622-9dbd-f3e709dd8b4a tempest-DeleteServersTestJSON-268050555 tempest-DeleteServersTestJSON-268050555-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:03:48.220034 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-8035f2f3-1a34-4622-9dbd-f3e709dd8b4a tempest-DeleteServersTestJSON-268050555 tempest-DeleteServersTestJSON-268050555-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:03:48.220675 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-8035f2f3-1a34-4622-9dbd-f3e709dd8b4a tempest-DeleteServersTestJSON-268050555 tempest-DeleteServersTestJSON-268050555-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:03:48.221156 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-8035f2f3-1a34-4622-9dbd-f3e709dd8b4a tempest-DeleteServersTestJSON-268050555 tempest-DeleteServersTestJSON-268050555-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:03:48.347698 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.policy [None req-8035f2f3-1a34-4622-9dbd-f3e709dd8b4a tempest-DeleteServersTestJSON-268050555 tempest-DeleteServersTestJSON-268050555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28384f466c3541358ecea856650f008c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb933fa80ed94ce5b6828e48e86a21c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116157) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:03:48.354759 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: INFO nova.api.openstack.requestlog [None req-8035f2f3-1a34-4622-9dbd-f3e709dd8b4a tempest-DeleteServersTestJSON-268050555 tempest-DeleteServersTestJSON-268050555-project] 10.222.0.18 "GET /compute/v2.1/servers/5a01bf2d-c341-4af1-b2b2-e1f05e46705f" status: 200 len: 1315 microversion: 2.1 time: 0.146011 Dec 15 03:03:48.355304 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: [pid: 116157|app: 0|req: 51/113] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 03:03:48 2021] GET /compute/v2.1/servers/5a01bf2d-c341-4af1-b2b2-e1f05e46705f => generated 1315 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 03:03:48.709395 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi [None req-08abe4b5-5a59-4d37-b32b-1dd57cf780a9 tempest-AttachVolumeNegativeTest-1640336653 tempest-AttachVolumeNegativeTest-1640336653-project] Calling method '>' {{(pid=116156) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:03:48.710034 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.compute.api [None req-08abe4b5-5a59-4d37-b32b-1dd57cf780a9 tempest-AttachVolumeNegativeTest-1640336653 tempest-AttachVolumeNegativeTest-1640336653-project] [instance: 4923355f-95d6-443d-9487-574f56b87f66] Fetching instance by UUID {{(pid=116156) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:03:48.715843 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-08abe4b5-5a59-4d37-b32b-1dd57cf780a9 tempest-AttachVolumeNegativeTest-1640336653 tempest-AttachVolumeNegativeTest-1640336653-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:03:48.716290 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-08abe4b5-5a59-4d37-b32b-1dd57cf780a9 tempest-AttachVolumeNegativeTest-1640336653 tempest-AttachVolumeNegativeTest-1640336653-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:03:48.717064 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-08abe4b5-5a59-4d37-b32b-1dd57cf780a9 tempest-AttachVolumeNegativeTest-1640336653 tempest-AttachVolumeNegativeTest-1640336653-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:03:48.717500 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-08abe4b5-5a59-4d37-b32b-1dd57cf780a9 tempest-AttachVolumeNegativeTest-1640336653 tempest-AttachVolumeNegativeTest-1640336653-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:03:48.741720 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi [req-18a6c8d9-787f-46c8-b8e6-7ea197a36291 req-b8db3d0c-460d-4328-aa3a-e294dba94b5f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5a01bf2d-c341-4af1-b2b2-e1f05e46705f", "name": "network-vif-plugged", "status": "completed", "tag": "fe412742-6f13-4058-be01-92b028115500"}]} {{(pid=116157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 03:03:48.743313 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 15 03:03:48.743313 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: warnings.warn(msg) Dec 15 03:03:48.750979 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [req-18a6c8d9-787f-46c8-b8e6-7ea197a36291 req-b8db3d0c-460d-4328-aa3a-e294dba94b5f service nova] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:03:48.751421 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [req-18a6c8d9-787f-46c8-b8e6-7ea197a36291 req-b8db3d0c-460d-4328-aa3a-e294dba94b5f service nova] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:03:48.762082 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: INFO nova.api.openstack.compute.server_external_events [req-18a6c8d9-787f-46c8-b8e6-7ea197a36291 req-b8db3d0c-460d-4328-aa3a-e294dba94b5f service nova] Creating event network-vif-plugged:fe412742-6f13-4058-be01-92b028115500 for instance 5a01bf2d-c341-4af1-b2b2-e1f05e46705f on hv-cinder-81803 Dec 15 03:03:48.767539 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: INFO nova.api.openstack.requestlog [req-18a6c8d9-787f-46c8-b8e6-7ea197a36291 req-b8db3d0c-460d-4328-aa3a-e294dba94b5f service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029335 Dec 15 03:03:48.768121 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: [pid: 116157|app: 0|req: 52/114] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Dec 15 03:03:48 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 15 03:03:48.843662 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.policy [None req-08abe4b5-5a59-4d37-b32b-1dd57cf780a9 tempest-AttachVolumeNegativeTest-1640336653 tempest-AttachVolumeNegativeTest-1640336653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35d37a3d8e504b8186182468b77dd114', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '409b41637da94c469444954258444b4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116156) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:03:48.850875 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: INFO nova.api.openstack.requestlog [None req-08abe4b5-5a59-4d37-b32b-1dd57cf780a9 tempest-AttachVolumeNegativeTest-1640336653 tempest-AttachVolumeNegativeTest-1640336653-project] 10.222.0.18 "GET /compute/v2.1/servers/4923355f-95d6-443d-9487-574f56b87f66" status: 200 len: 1318 microversion: 2.1 time: 0.145019 Dec 15 03:03:48.851371 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: [pid: 116156|app: 0|req: 63/115] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 03:03:48 2021] GET /compute/v2.1/servers/4923355f-95d6-443d-9487-574f56b87f66 => generated 1318 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 03:03:48.852648 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi [None req-db1e52f0-290c-4a0f-8656-c17a81582a33 tempest-ServerRescueNegativeTestJSON-2061875223 tempest-ServerRescueNegativeTestJSON-2061875223-project] Calling method '>' {{(pid=116157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:03:48.853352 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.compute.api [None req-db1e52f0-290c-4a0f-8656-c17a81582a33 tempest-ServerRescueNegativeTestJSON-2061875223 tempest-ServerRescueNegativeTestJSON-2061875223-project] [instance: 2d20c8be-04a9-4c79-aa0a-138a79fe50cd] Fetching instance by UUID {{(pid=116157) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:03:48.859409 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-db1e52f0-290c-4a0f-8656-c17a81582a33 tempest-ServerRescueNegativeTestJSON-2061875223 tempest-ServerRescueNegativeTestJSON-2061875223-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:03:48.859875 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-db1e52f0-290c-4a0f-8656-c17a81582a33 tempest-ServerRescueNegativeTestJSON-2061875223 tempest-ServerRescueNegativeTestJSON-2061875223-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:03:48.860657 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-db1e52f0-290c-4a0f-8656-c17a81582a33 tempest-ServerRescueNegativeTestJSON-2061875223 tempest-ServerRescueNegativeTestJSON-2061875223-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:03:48.861091 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-db1e52f0-290c-4a0f-8656-c17a81582a33 tempest-ServerRescueNegativeTestJSON-2061875223 tempest-ServerRescueNegativeTestJSON-2061875223-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:03:48.989176 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.policy [None req-db1e52f0-290c-4a0f-8656-c17a81582a33 tempest-ServerRescueNegativeTestJSON-2061875223 tempest-ServerRescueNegativeTestJSON-2061875223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ea02b6e8f1548a1bd78952cb7337403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5e8a958d4bf43868502b13728b9583b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116157) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:03:48.996398 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: INFO nova.api.openstack.requestlog [None req-db1e52f0-290c-4a0f-8656-c17a81582a33 tempest-ServerRescueNegativeTestJSON-2061875223 tempest-ServerRescueNegativeTestJSON-2061875223-project] 10.222.0.18 "GET /compute/v2.1/servers/2d20c8be-04a9-4c79-aa0a-138a79fe50cd" status: 200 len: 1321 microversion: 2.1 time: 0.147707 Dec 15 03:03:48.996942 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: [pid: 116157|app: 0|req: 53/116] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 03:03:48 2021] GET /compute/v2.1/servers/2d20c8be-04a9-4c79-aa0a-138a79fe50cd => generated 1321 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 03:03:49.371529 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi [None req-d852e32b-12a0-483d-8349-63a11d3d520e tempest-DeleteServersTestJSON-268050555 tempest-DeleteServersTestJSON-268050555-project] Calling method '>' {{(pid=116156) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:03:49.372138 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.compute.api [None req-d852e32b-12a0-483d-8349-63a11d3d520e tempest-DeleteServersTestJSON-268050555 tempest-DeleteServersTestJSON-268050555-project] [instance: 5a01bf2d-c341-4af1-b2b2-e1f05e46705f] Fetching instance by UUID {{(pid=116156) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:03:49.378308 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-d852e32b-12a0-483d-8349-63a11d3d520e tempest-DeleteServersTestJSON-268050555 tempest-DeleteServersTestJSON-268050555-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:03:49.378757 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-d852e32b-12a0-483d-8349-63a11d3d520e tempest-DeleteServersTestJSON-268050555 tempest-DeleteServersTestJSON-268050555-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:03:49.379533 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-d852e32b-12a0-483d-8349-63a11d3d520e tempest-DeleteServersTestJSON-268050555 tempest-DeleteServersTestJSON-268050555-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:03:49.379962 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-d852e32b-12a0-483d-8349-63a11d3d520e tempest-DeleteServersTestJSON-268050555 tempest-DeleteServersTestJSON-268050555-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:03:49.585628 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.policy [None req-d852e32b-12a0-483d-8349-63a11d3d520e tempest-DeleteServersTestJSON-268050555 tempest-DeleteServersTestJSON-268050555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28384f466c3541358ecea856650f008c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb933fa80ed94ce5b6828e48e86a21c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116156) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:03:49.593031 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: INFO nova.api.openstack.requestlog [None req-d852e32b-12a0-483d-8349-63a11d3d520e tempest-DeleteServersTestJSON-268050555 tempest-DeleteServersTestJSON-268050555-project] 10.222.0.18 "GET /compute/v2.1/servers/5a01bf2d-c341-4af1-b2b2-e1f05e46705f" status: 200 len: 1315 microversion: 2.1 time: 0.225236 Dec 15 03:03:49.593594 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: [pid: 116156|app: 0|req: 64/117] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 03:03:49 2021] GET /compute/v2.1/servers/5a01bf2d-c341-4af1-b2b2-e1f05e46705f => generated 1315 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 03:03:49.867496 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi [None req-a60592b9-4a39-4f88-a62f-2c8ac3322a2b tempest-AttachVolumeNegativeTest-1640336653 tempest-AttachVolumeNegativeTest-1640336653-project] Calling method '>' {{(pid=116157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:03:49.868165 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.compute.api [None req-a60592b9-4a39-4f88-a62f-2c8ac3322a2b tempest-AttachVolumeNegativeTest-1640336653 tempest-AttachVolumeNegativeTest-1640336653-project] [instance: 4923355f-95d6-443d-9487-574f56b87f66] Fetching instance by UUID {{(pid=116157) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:03:49.874063 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-a60592b9-4a39-4f88-a62f-2c8ac3322a2b tempest-AttachVolumeNegativeTest-1640336653 tempest-AttachVolumeNegativeTest-1640336653-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:03:49.874522 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-a60592b9-4a39-4f88-a62f-2c8ac3322a2b tempest-AttachVolumeNegativeTest-1640336653 tempest-AttachVolumeNegativeTest-1640336653-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:03:49.875293 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-a60592b9-4a39-4f88-a62f-2c8ac3322a2b tempest-AttachVolumeNegativeTest-1640336653 tempest-AttachVolumeNegativeTest-1640336653-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:03:49.875717 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-a60592b9-4a39-4f88-a62f-2c8ac3322a2b tempest-AttachVolumeNegativeTest-1640336653 tempest-AttachVolumeNegativeTest-1640336653-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:03:50.008291 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.policy [None req-a60592b9-4a39-4f88-a62f-2c8ac3322a2b tempest-AttachVolumeNegativeTest-1640336653 tempest-AttachVolumeNegativeTest-1640336653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35d37a3d8e504b8186182468b77dd114', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '409b41637da94c469444954258444b4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116157) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:03:50.013631 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi [None req-8d27e19f-feb6-432b-a758-d27ea7e3b946 tempest-ServerRescueNegativeTestJSON-2061875223 tempest-ServerRescueNegativeTestJSON-2061875223-project] Calling method '>' {{(pid=116156) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:03:50.014328 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.compute.api [None req-8d27e19f-feb6-432b-a758-d27ea7e3b946 tempest-ServerRescueNegativeTestJSON-2061875223 tempest-ServerRescueNegativeTestJSON-2061875223-project] [instance: 2d20c8be-04a9-4c79-aa0a-138a79fe50cd] Fetching instance by UUID {{(pid=116156) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:03:50.021037 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-8d27e19f-feb6-432b-a758-d27ea7e3b946 tempest-ServerRescueNegativeTestJSON-2061875223 tempest-ServerRescueNegativeTestJSON-2061875223-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:03:50.021912 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-8d27e19f-feb6-432b-a758-d27ea7e3b946 tempest-ServerRescueNegativeTestJSON-2061875223 tempest-ServerRescueNegativeTestJSON-2061875223-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:03:50.023130 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-8d27e19f-feb6-432b-a758-d27ea7e3b946 tempest-ServerRescueNegativeTestJSON-2061875223 tempest-ServerRescueNegativeTestJSON-2061875223-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:03:50.023706 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-8d27e19f-feb6-432b-a758-d27ea7e3b946 tempest-ServerRescueNegativeTestJSON-2061875223 tempest-ServerRescueNegativeTestJSON-2061875223-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:03:50.024288 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: INFO nova.api.openstack.requestlog [None req-a60592b9-4a39-4f88-a62f-2c8ac3322a2b tempest-AttachVolumeNegativeTest-1640336653 tempest-AttachVolumeNegativeTest-1640336653-project] 10.222.0.18 "GET /compute/v2.1/servers/4923355f-95d6-443d-9487-574f56b87f66" status: 200 len: 1318 microversion: 2.1 time: 0.159955 Dec 15 03:03:50.035484 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: [pid: 116157|app: 0|req: 54/118] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 03:03:49 2021] GET /compute/v2.1/servers/4923355f-95d6-443d-9487-574f56b87f66 => generated 1318 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 03:03:50.172968 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.policy [None req-8d27e19f-feb6-432b-a758-d27ea7e3b946 tempest-ServerRescueNegativeTestJSON-2061875223 tempest-ServerRescueNegativeTestJSON-2061875223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ea02b6e8f1548a1bd78952cb7337403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5e8a958d4bf43868502b13728b9583b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116156) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:03:50.180847 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: INFO nova.api.openstack.requestlog [None req-8d27e19f-feb6-432b-a758-d27ea7e3b946 tempest-ServerRescueNegativeTestJSON-2061875223 tempest-ServerRescueNegativeTestJSON-2061875223-project] 10.222.0.18 "GET /compute/v2.1/servers/2d20c8be-04a9-4c79-aa0a-138a79fe50cd" status: 200 len: 1321 microversion: 2.1 time: 0.170964 Dec 15 03:03:50.181625 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: [pid: 116156|app: 0|req: 65/119] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 03:03:50 2021] GET /compute/v2.1/servers/2d20c8be-04a9-4c79-aa0a-138a79fe50cd => generated 1321 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 03:03:50.611629 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi [None req-674d5a6d-f2b5-4e56-92d5-b3453e0544d2 tempest-DeleteServersTestJSON-268050555 tempest-DeleteServersTestJSON-268050555-project] Calling method '>' {{(pid=116157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:03:50.612243 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.compute.api [None req-674d5a6d-f2b5-4e56-92d5-b3453e0544d2 tempest-DeleteServersTestJSON-268050555 tempest-DeleteServersTestJSON-268050555-project] [instance: 5a01bf2d-c341-4af1-b2b2-e1f05e46705f] Fetching instance by UUID {{(pid=116157) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:03:50.618172 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-674d5a6d-f2b5-4e56-92d5-b3453e0544d2 tempest-DeleteServersTestJSON-268050555 tempest-DeleteServersTestJSON-268050555-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:03:50.618630 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-674d5a6d-f2b5-4e56-92d5-b3453e0544d2 tempest-DeleteServersTestJSON-268050555 tempest-DeleteServersTestJSON-268050555-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:03:50.619417 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-674d5a6d-f2b5-4e56-92d5-b3453e0544d2 tempest-DeleteServersTestJSON-268050555 tempest-DeleteServersTestJSON-268050555-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:03:50.619850 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-674d5a6d-f2b5-4e56-92d5-b3453e0544d2 tempest-DeleteServersTestJSON-268050555 tempest-DeleteServersTestJSON-268050555-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:03:50.768923 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.policy [None req-674d5a6d-f2b5-4e56-92d5-b3453e0544d2 tempest-DeleteServersTestJSON-268050555 tempest-DeleteServersTestJSON-268050555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28384f466c3541358ecea856650f008c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb933fa80ed94ce5b6828e48e86a21c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116157) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:03:50.776499 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: INFO nova.api.openstack.requestlog [None req-674d5a6d-f2b5-4e56-92d5-b3453e0544d2 tempest-DeleteServersTestJSON-268050555 tempest-DeleteServersTestJSON-268050555-project] 10.222.0.18 "GET /compute/v2.1/servers/5a01bf2d-c341-4af1-b2b2-e1f05e46705f" status: 200 len: 1315 microversion: 2.1 time: 0.169613 Dec 15 03:03:50.777062 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: [pid: 116157|app: 0|req: 55/120] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 03:03:50 2021] GET /compute/v2.1/servers/5a01bf2d-c341-4af1-b2b2-e1f05e46705f => generated 1315 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 03:03:51.040955 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi [None req-e8349a82-1601-4c28-9c7d-5b01ad8ad374 tempest-AttachVolumeNegativeTest-1640336653 tempest-AttachVolumeNegativeTest-1640336653-project] Calling method '>' {{(pid=116156) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:03:51.041466 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.compute.api [None req-e8349a82-1601-4c28-9c7d-5b01ad8ad374 tempest-AttachVolumeNegativeTest-1640336653 tempest-AttachVolumeNegativeTest-1640336653-project] [instance: 4923355f-95d6-443d-9487-574f56b87f66] Fetching instance by UUID {{(pid=116156) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:03:51.047912 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-e8349a82-1601-4c28-9c7d-5b01ad8ad374 tempest-AttachVolumeNegativeTest-1640336653 tempest-AttachVolumeNegativeTest-1640336653-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:03:51.048371 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-e8349a82-1601-4c28-9c7d-5b01ad8ad374 tempest-AttachVolumeNegativeTest-1640336653 tempest-AttachVolumeNegativeTest-1640336653-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:03:51.049146 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-e8349a82-1601-4c28-9c7d-5b01ad8ad374 tempest-AttachVolumeNegativeTest-1640336653 tempest-AttachVolumeNegativeTest-1640336653-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:03:51.049579 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-e8349a82-1601-4c28-9c7d-5b01ad8ad374 tempest-AttachVolumeNegativeTest-1640336653 tempest-AttachVolumeNegativeTest-1640336653-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:03:51.179491 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.policy [None req-e8349a82-1601-4c28-9c7d-5b01ad8ad374 tempest-AttachVolumeNegativeTest-1640336653 tempest-AttachVolumeNegativeTest-1640336653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35d37a3d8e504b8186182468b77dd114', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '409b41637da94c469444954258444b4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116156) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:03:51.187004 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: INFO nova.api.openstack.requestlog [None req-e8349a82-1601-4c28-9c7d-5b01ad8ad374 tempest-AttachVolumeNegativeTest-1640336653 tempest-AttachVolumeNegativeTest-1640336653-project] 10.222.0.18 "GET /compute/v2.1/servers/4923355f-95d6-443d-9487-574f56b87f66" status: 200 len: 1318 microversion: 2.1 time: 0.149733 Dec 15 03:03:51.187580 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: [pid: 116156|app: 0|req: 66/121] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 03:03:51 2021] GET /compute/v2.1/servers/4923355f-95d6-443d-9487-574f56b87f66 => generated 1318 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 03:03:51.201389 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi [None req-c4d56c7f-ad46-40f3-ab68-4d46d8fd567c tempest-ServerRescueNegativeTestJSON-2061875223 tempest-ServerRescueNegativeTestJSON-2061875223-project] Calling method '>' {{(pid=116157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:03:51.202016 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.compute.api [None req-c4d56c7f-ad46-40f3-ab68-4d46d8fd567c tempest-ServerRescueNegativeTestJSON-2061875223 tempest-ServerRescueNegativeTestJSON-2061875223-project] [instance: 2d20c8be-04a9-4c79-aa0a-138a79fe50cd] Fetching instance by UUID {{(pid=116157) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:03:51.209287 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-c4d56c7f-ad46-40f3-ab68-4d46d8fd567c tempest-ServerRescueNegativeTestJSON-2061875223 tempest-ServerRescueNegativeTestJSON-2061875223-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:03:51.209731 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-c4d56c7f-ad46-40f3-ab68-4d46d8fd567c tempest-ServerRescueNegativeTestJSON-2061875223 tempest-ServerRescueNegativeTestJSON-2061875223-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:03:51.210707 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-c4d56c7f-ad46-40f3-ab68-4d46d8fd567c tempest-ServerRescueNegativeTestJSON-2061875223 tempest-ServerRescueNegativeTestJSON-2061875223-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:03:51.211570 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-c4d56c7f-ad46-40f3-ab68-4d46d8fd567c tempest-ServerRescueNegativeTestJSON-2061875223 tempest-ServerRescueNegativeTestJSON-2061875223-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:03:51.365029 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.policy [None req-c4d56c7f-ad46-40f3-ab68-4d46d8fd567c tempest-ServerRescueNegativeTestJSON-2061875223 tempest-ServerRescueNegativeTestJSON-2061875223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ea02b6e8f1548a1bd78952cb7337403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5e8a958d4bf43868502b13728b9583b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116157) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:03:51.372199 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: INFO nova.api.openstack.requestlog [None req-c4d56c7f-ad46-40f3-ab68-4d46d8fd567c tempest-ServerRescueNegativeTestJSON-2061875223 tempest-ServerRescueNegativeTestJSON-2061875223-project] 10.222.0.18 "GET /compute/v2.1/servers/2d20c8be-04a9-4c79-aa0a-138a79fe50cd" status: 200 len: 1321 microversion: 2.1 time: 0.174488 Dec 15 03:03:51.373022 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: [pid: 116157|app: 0|req: 56/122] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 03:03:51 2021] GET /compute/v2.1/servers/2d20c8be-04a9-4c79-aa0a-138a79fe50cd => generated 1321 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 03:03:51.793204 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi [None req-47380df7-c102-446f-adb6-c010e05e5a9a tempest-DeleteServersTestJSON-268050555 tempest-DeleteServersTestJSON-268050555-project] Calling method '>' {{(pid=116156) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:03:51.793803 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.compute.api [None req-47380df7-c102-446f-adb6-c010e05e5a9a tempest-DeleteServersTestJSON-268050555 tempest-DeleteServersTestJSON-268050555-project] [instance: 5a01bf2d-c341-4af1-b2b2-e1f05e46705f] Fetching instance by UUID {{(pid=116156) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:03:51.799536 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-47380df7-c102-446f-adb6-c010e05e5a9a tempest-DeleteServersTestJSON-268050555 tempest-DeleteServersTestJSON-268050555-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:03:51.799986 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-47380df7-c102-446f-adb6-c010e05e5a9a tempest-DeleteServersTestJSON-268050555 tempest-DeleteServersTestJSON-268050555-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:03:51.800755 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-47380df7-c102-446f-adb6-c010e05e5a9a tempest-DeleteServersTestJSON-268050555 tempest-DeleteServersTestJSON-268050555-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:03:51.801188 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-47380df7-c102-446f-adb6-c010e05e5a9a tempest-DeleteServersTestJSON-268050555 tempest-DeleteServersTestJSON-268050555-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:03:51.934686 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.policy [None req-47380df7-c102-446f-adb6-c010e05e5a9a tempest-DeleteServersTestJSON-268050555 tempest-DeleteServersTestJSON-268050555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28384f466c3541358ecea856650f008c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb933fa80ed94ce5b6828e48e86a21c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116156) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:03:51.942236 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: INFO nova.api.openstack.requestlog [None req-47380df7-c102-446f-adb6-c010e05e5a9a tempest-DeleteServersTestJSON-268050555 tempest-DeleteServersTestJSON-268050555-project] 10.222.0.18 "GET /compute/v2.1/servers/5a01bf2d-c341-4af1-b2b2-e1f05e46705f" status: 200 len: 1315 microversion: 2.1 time: 0.152603 Dec 15 03:03:51.942796 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: [pid: 116156|app: 0|req: 67/123] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 03:03:51 2021] GET /compute/v2.1/servers/5a01bf2d-c341-4af1-b2b2-e1f05e46705f => generated 1315 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 03:03:52.203749 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi [None req-d5b1117a-4a36-4e5b-a7a8-11c61d7870e8 tempest-AttachVolumeNegativeTest-1640336653 tempest-AttachVolumeNegativeTest-1640336653-project] Calling method '>' {{(pid=116157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:03:52.204278 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.compute.api [None req-d5b1117a-4a36-4e5b-a7a8-11c61d7870e8 tempest-AttachVolumeNegativeTest-1640336653 tempest-AttachVolumeNegativeTest-1640336653-project] [instance: 4923355f-95d6-443d-9487-574f56b87f66] Fetching instance by UUID {{(pid=116157) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:03:52.210200 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-d5b1117a-4a36-4e5b-a7a8-11c61d7870e8 tempest-AttachVolumeNegativeTest-1640336653 tempest-AttachVolumeNegativeTest-1640336653-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:03:52.210651 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-d5b1117a-4a36-4e5b-a7a8-11c61d7870e8 tempest-AttachVolumeNegativeTest-1640336653 tempest-AttachVolumeNegativeTest-1640336653-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:03:52.211437 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-d5b1117a-4a36-4e5b-a7a8-11c61d7870e8 tempest-AttachVolumeNegativeTest-1640336653 tempest-AttachVolumeNegativeTest-1640336653-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:03:52.211875 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-d5b1117a-4a36-4e5b-a7a8-11c61d7870e8 tempest-AttachVolumeNegativeTest-1640336653 tempest-AttachVolumeNegativeTest-1640336653-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:03:52.340226 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.policy [None req-d5b1117a-4a36-4e5b-a7a8-11c61d7870e8 tempest-AttachVolumeNegativeTest-1640336653 tempest-AttachVolumeNegativeTest-1640336653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35d37a3d8e504b8186182468b77dd114', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '409b41637da94c469444954258444b4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116157) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:03:52.347923 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: INFO nova.api.openstack.requestlog [None req-d5b1117a-4a36-4e5b-a7a8-11c61d7870e8 tempest-AttachVolumeNegativeTest-1640336653 tempest-AttachVolumeNegativeTest-1640336653-project] 10.222.0.18 "GET /compute/v2.1/servers/4923355f-95d6-443d-9487-574f56b87f66" status: 200 len: 1318 microversion: 2.1 time: 0.147928 Dec 15 03:03:52.348486 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: [pid: 116157|app: 0|req: 57/124] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 03:03:52 2021] GET /compute/v2.1/servers/4923355f-95d6-443d-9487-574f56b87f66 => generated 1318 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 03:03:52.388352 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi [None req-7594ecbd-360b-404b-9976-a02c440124ee tempest-ServerRescueNegativeTestJSON-2061875223 tempest-ServerRescueNegativeTestJSON-2061875223-project] Calling method '>' {{(pid=116156) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:03:52.388956 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.compute.api [None req-7594ecbd-360b-404b-9976-a02c440124ee tempest-ServerRescueNegativeTestJSON-2061875223 tempest-ServerRescueNegativeTestJSON-2061875223-project] [instance: 2d20c8be-04a9-4c79-aa0a-138a79fe50cd] Fetching instance by UUID {{(pid=116156) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:03:52.394709 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-7594ecbd-360b-404b-9976-a02c440124ee tempest-ServerRescueNegativeTestJSON-2061875223 tempest-ServerRescueNegativeTestJSON-2061875223-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:03:52.395153 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-7594ecbd-360b-404b-9976-a02c440124ee tempest-ServerRescueNegativeTestJSON-2061875223 tempest-ServerRescueNegativeTestJSON-2061875223-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:03:52.395917 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-7594ecbd-360b-404b-9976-a02c440124ee tempest-ServerRescueNegativeTestJSON-2061875223 tempest-ServerRescueNegativeTestJSON-2061875223-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:03:52.396342 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-7594ecbd-360b-404b-9976-a02c440124ee tempest-ServerRescueNegativeTestJSON-2061875223 tempest-ServerRescueNegativeTestJSON-2061875223-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:03:52.523810 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.policy [None req-7594ecbd-360b-404b-9976-a02c440124ee tempest-ServerRescueNegativeTestJSON-2061875223 tempest-ServerRescueNegativeTestJSON-2061875223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ea02b6e8f1548a1bd78952cb7337403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5e8a958d4bf43868502b13728b9583b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116156) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:03:52.530862 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: INFO nova.api.openstack.requestlog [None req-7594ecbd-360b-404b-9976-a02c440124ee tempest-ServerRescueNegativeTestJSON-2061875223 tempest-ServerRescueNegativeTestJSON-2061875223-project] 10.222.0.18 "GET /compute/v2.1/servers/2d20c8be-04a9-4c79-aa0a-138a79fe50cd" status: 200 len: 1321 microversion: 2.1 time: 0.146043 Dec 15 03:03:52.531924 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: [pid: 116156|app: 0|req: 68/125] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 03:03:52 2021] GET /compute/v2.1/servers/2d20c8be-04a9-4c79-aa0a-138a79fe50cd => generated 1321 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 03:03:52.666220 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi [req-c98c514a-6e78-4404-9218-47573851771d req-50601fcf-5670-4276-afd6-210c65658760 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2d20c8be-04a9-4c79-aa0a-138a79fe50cd", "name": "network-vif-plugged", "status": "completed", "tag": "6a22ab04-9553-401b-9bbb-1e4693ade51b"}]} {{(pid=116157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 03:03:52.667909 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 15 03:03:52.667909 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: warnings.warn(msg) Dec 15 03:03:52.676519 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [req-c98c514a-6e78-4404-9218-47573851771d req-50601fcf-5670-4276-afd6-210c65658760 service nova] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:03:52.677270 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [req-c98c514a-6e78-4404-9218-47573851771d req-50601fcf-5670-4276-afd6-210c65658760 service nova] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:03:52.688176 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: INFO nova.api.openstack.compute.server_external_events [req-c98c514a-6e78-4404-9218-47573851771d req-50601fcf-5670-4276-afd6-210c65658760 service nova] Creating event network-vif-plugged:6a22ab04-9553-401b-9bbb-1e4693ade51b for instance 2d20c8be-04a9-4c79-aa0a-138a79fe50cd on hv-cinder-81803 Dec 15 03:03:52.693149 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: INFO nova.api.openstack.requestlog [req-c98c514a-6e78-4404-9218-47573851771d req-50601fcf-5670-4276-afd6-210c65658760 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030525 Dec 15 03:03:52.693727 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: [pid: 116157|app: 0|req: 58/126] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Dec 15 03:03:52 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 03:03:52.959505 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi [None req-c7bd510e-2682-4f2b-8566-dbdcab4915e0 tempest-DeleteServersTestJSON-268050555 tempest-DeleteServersTestJSON-268050555-project] Calling method '>' {{(pid=116156) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:03:52.960120 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.compute.api [None req-c7bd510e-2682-4f2b-8566-dbdcab4915e0 tempest-DeleteServersTestJSON-268050555 tempest-DeleteServersTestJSON-268050555-project] [instance: 5a01bf2d-c341-4af1-b2b2-e1f05e46705f] Fetching instance by UUID {{(pid=116156) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:03:52.965849 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-c7bd510e-2682-4f2b-8566-dbdcab4915e0 tempest-DeleteServersTestJSON-268050555 tempest-DeleteServersTestJSON-268050555-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:03:52.966339 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-c7bd510e-2682-4f2b-8566-dbdcab4915e0 tempest-DeleteServersTestJSON-268050555 tempest-DeleteServersTestJSON-268050555-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:03:52.967115 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-c7bd510e-2682-4f2b-8566-dbdcab4915e0 tempest-DeleteServersTestJSON-268050555 tempest-DeleteServersTestJSON-268050555-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:03:52.967549 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-c7bd510e-2682-4f2b-8566-dbdcab4915e0 tempest-DeleteServersTestJSON-268050555 tempest-DeleteServersTestJSON-268050555-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:03:53.097269 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.policy [None req-c7bd510e-2682-4f2b-8566-dbdcab4915e0 tempest-DeleteServersTestJSON-268050555 tempest-DeleteServersTestJSON-268050555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28384f466c3541358ecea856650f008c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb933fa80ed94ce5b6828e48e86a21c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116156) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:03:53.104438 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: INFO nova.api.openstack.requestlog [None req-c7bd510e-2682-4f2b-8566-dbdcab4915e0 tempest-DeleteServersTestJSON-268050555 tempest-DeleteServersTestJSON-268050555-project] 10.222.0.18 "GET /compute/v2.1/servers/5a01bf2d-c341-4af1-b2b2-e1f05e46705f" status: 200 len: 1315 microversion: 2.1 time: 0.148677 Dec 15 03:03:53.105001 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: [pid: 116156|app: 0|req: 69/127] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 03:03:52 2021] GET /compute/v2.1/servers/5a01bf2d-c341-4af1-b2b2-e1f05e46705f => generated 1315 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 03:03:53.364948 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi [None req-1d568d03-ef3e-4d7b-9fc5-158ccfe012e4 tempest-AttachVolumeNegativeTest-1640336653 tempest-AttachVolumeNegativeTest-1640336653-project] Calling method '>' {{(pid=116157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:03:53.365621 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.compute.api [None req-1d568d03-ef3e-4d7b-9fc5-158ccfe012e4 tempest-AttachVolumeNegativeTest-1640336653 tempest-AttachVolumeNegativeTest-1640336653-project] [instance: 4923355f-95d6-443d-9487-574f56b87f66] Fetching instance by UUID {{(pid=116157) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:03:53.371776 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-1d568d03-ef3e-4d7b-9fc5-158ccfe012e4 tempest-AttachVolumeNegativeTest-1640336653 tempest-AttachVolumeNegativeTest-1640336653-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:03:53.372305 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-1d568d03-ef3e-4d7b-9fc5-158ccfe012e4 tempest-AttachVolumeNegativeTest-1640336653 tempest-AttachVolumeNegativeTest-1640336653-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:03:53.373260 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-1d568d03-ef3e-4d7b-9fc5-158ccfe012e4 tempest-AttachVolumeNegativeTest-1640336653 tempest-AttachVolumeNegativeTest-1640336653-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:03:53.373699 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-1d568d03-ef3e-4d7b-9fc5-158ccfe012e4 tempest-AttachVolumeNegativeTest-1640336653 tempest-AttachVolumeNegativeTest-1640336653-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:03:53.502028 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.policy [None req-1d568d03-ef3e-4d7b-9fc5-158ccfe012e4 tempest-AttachVolumeNegativeTest-1640336653 tempest-AttachVolumeNegativeTest-1640336653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35d37a3d8e504b8186182468b77dd114', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '409b41637da94c469444954258444b4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116157) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:03:53.509348 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: INFO nova.api.openstack.requestlog [None req-1d568d03-ef3e-4d7b-9fc5-158ccfe012e4 tempest-AttachVolumeNegativeTest-1640336653 tempest-AttachVolumeNegativeTest-1640336653-project] 10.222.0.18 "GET /compute/v2.1/servers/4923355f-95d6-443d-9487-574f56b87f66" status: 200 len: 1318 microversion: 2.1 time: 0.148443 Dec 15 03:03:53.509911 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: [pid: 116157|app: 0|req: 59/128] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 03:03:53 2021] GET /compute/v2.1/servers/4923355f-95d6-443d-9487-574f56b87f66 => generated 1318 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 03:03:53.548288 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi [None req-0c685f37-332d-4bc5-b148-65250dd75b80 tempest-ServerRescueNegativeTestJSON-2061875223 tempest-ServerRescueNegativeTestJSON-2061875223-project] Calling method '>' {{(pid=116156) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:03:53.548939 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.compute.api [None req-0c685f37-332d-4bc5-b148-65250dd75b80 tempest-ServerRescueNegativeTestJSON-2061875223 tempest-ServerRescueNegativeTestJSON-2061875223-project] [instance: 2d20c8be-04a9-4c79-aa0a-138a79fe50cd] Fetching instance by UUID {{(pid=116156) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:03:53.554840 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-0c685f37-332d-4bc5-b148-65250dd75b80 tempest-ServerRescueNegativeTestJSON-2061875223 tempest-ServerRescueNegativeTestJSON-2061875223-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:03:53.555297 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-0c685f37-332d-4bc5-b148-65250dd75b80 tempest-ServerRescueNegativeTestJSON-2061875223 tempest-ServerRescueNegativeTestJSON-2061875223-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:03:53.556079 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-0c685f37-332d-4bc5-b148-65250dd75b80 tempest-ServerRescueNegativeTestJSON-2061875223 tempest-ServerRescueNegativeTestJSON-2061875223-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:03:53.556541 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-0c685f37-332d-4bc5-b148-65250dd75b80 tempest-ServerRescueNegativeTestJSON-2061875223 tempest-ServerRescueNegativeTestJSON-2061875223-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:03:53.689707 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.policy [None req-0c685f37-332d-4bc5-b148-65250dd75b80 tempest-ServerRescueNegativeTestJSON-2061875223 tempest-ServerRescueNegativeTestJSON-2061875223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ea02b6e8f1548a1bd78952cb7337403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5e8a958d4bf43868502b13728b9583b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116156) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:03:53.696992 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: INFO nova.api.openstack.requestlog [None req-0c685f37-332d-4bc5-b148-65250dd75b80 tempest-ServerRescueNegativeTestJSON-2061875223 tempest-ServerRescueNegativeTestJSON-2061875223-project] 10.222.0.18 "GET /compute/v2.1/servers/2d20c8be-04a9-4c79-aa0a-138a79fe50cd" status: 200 len: 1321 microversion: 2.1 time: 0.152837 Dec 15 03:03:53.697554 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: [pid: 116156|app: 0|req: 70/129] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 03:03:53 2021] GET /compute/v2.1/servers/2d20c8be-04a9-4c79-aa0a-138a79fe50cd => generated 1321 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 03:03:54.121375 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi [None req-792dba1e-7293-48b4-b50f-91d80e97ec29 tempest-DeleteServersTestJSON-268050555 tempest-DeleteServersTestJSON-268050555-project] Calling method '>' {{(pid=116157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:03:54.122033 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.compute.api [None req-792dba1e-7293-48b4-b50f-91d80e97ec29 tempest-DeleteServersTestJSON-268050555 tempest-DeleteServersTestJSON-268050555-project] [instance: 5a01bf2d-c341-4af1-b2b2-e1f05e46705f] Fetching instance by UUID {{(pid=116157) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:03:54.128164 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-792dba1e-7293-48b4-b50f-91d80e97ec29 tempest-DeleteServersTestJSON-268050555 tempest-DeleteServersTestJSON-268050555-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:03:54.128614 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-792dba1e-7293-48b4-b50f-91d80e97ec29 tempest-DeleteServersTestJSON-268050555 tempest-DeleteServersTestJSON-268050555-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:03:54.129387 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-792dba1e-7293-48b4-b50f-91d80e97ec29 tempest-DeleteServersTestJSON-268050555 tempest-DeleteServersTestJSON-268050555-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:03:54.129818 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-792dba1e-7293-48b4-b50f-91d80e97ec29 tempest-DeleteServersTestJSON-268050555 tempest-DeleteServersTestJSON-268050555-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:03:54.259903 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.policy [None req-792dba1e-7293-48b4-b50f-91d80e97ec29 tempest-DeleteServersTestJSON-268050555 tempest-DeleteServersTestJSON-268050555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28384f466c3541358ecea856650f008c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb933fa80ed94ce5b6828e48e86a21c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116157) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:03:54.268762 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: INFO nova.api.openstack.requestlog [None req-792dba1e-7293-48b4-b50f-91d80e97ec29 tempest-DeleteServersTestJSON-268050555 tempest-DeleteServersTestJSON-268050555-project] 10.222.0.18 "GET /compute/v2.1/servers/5a01bf2d-c341-4af1-b2b2-e1f05e46705f" status: 200 len: 1315 microversion: 2.1 time: 0.150923 Dec 15 03:03:54.269255 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: [pid: 116157|app: 0|req: 60/130] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 03:03:54 2021] GET /compute/v2.1/servers/5a01bf2d-c341-4af1-b2b2-e1f05e46705f => generated 1315 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 03:03:54.526318 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi [None req-57872956-e314-464c-8044-b675860bfeb2 tempest-AttachVolumeNegativeTest-1640336653 tempest-AttachVolumeNegativeTest-1640336653-project] Calling method '>' {{(pid=116156) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:03:54.526943 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.compute.api [None req-57872956-e314-464c-8044-b675860bfeb2 tempest-AttachVolumeNegativeTest-1640336653 tempest-AttachVolumeNegativeTest-1640336653-project] [instance: 4923355f-95d6-443d-9487-574f56b87f66] Fetching instance by UUID {{(pid=116156) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:03:54.533149 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-57872956-e314-464c-8044-b675860bfeb2 tempest-AttachVolumeNegativeTest-1640336653 tempest-AttachVolumeNegativeTest-1640336653-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:03:54.533593 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-57872956-e314-464c-8044-b675860bfeb2 tempest-AttachVolumeNegativeTest-1640336653 tempest-AttachVolumeNegativeTest-1640336653-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:03:54.534398 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-57872956-e314-464c-8044-b675860bfeb2 tempest-AttachVolumeNegativeTest-1640336653 tempest-AttachVolumeNegativeTest-1640336653-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:03:54.534827 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-57872956-e314-464c-8044-b675860bfeb2 tempest-AttachVolumeNegativeTest-1640336653 tempest-AttachVolumeNegativeTest-1640336653-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:03:54.685958 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.policy [None req-57872956-e314-464c-8044-b675860bfeb2 tempest-AttachVolumeNegativeTest-1640336653 tempest-AttachVolumeNegativeTest-1640336653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35d37a3d8e504b8186182468b77dd114', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '409b41637da94c469444954258444b4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116156) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:03:54.695318 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: INFO nova.api.openstack.requestlog [None req-57872956-e314-464c-8044-b675860bfeb2 tempest-AttachVolumeNegativeTest-1640336653 tempest-AttachVolumeNegativeTest-1640336653-project] 10.222.0.18 "GET /compute/v2.1/servers/4923355f-95d6-443d-9487-574f56b87f66" status: 200 len: 1318 microversion: 2.1 time: 0.172654 Dec 15 03:03:54.696821 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: [pid: 116156|app: 0|req: 71/131] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 03:03:54 2021] GET /compute/v2.1/servers/4923355f-95d6-443d-9487-574f56b87f66 => generated 1318 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 03:03:54.713469 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi [req-e2dd96b9-adb4-4ece-a3e1-415550fd0aae req-bd46a861-6ca0-479a-a566-52666514e8f9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9bbb0abf-72a3-4fbc-8235-7a3ecfc8d006", "name": "network-vif-plugged", "status": "completed", "tag": "7b1a4626-5ae6-4522-8d7b-19824de5f496"}]} {{(pid=116157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 03:03:54.715066 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 15 03:03:54.715066 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: warnings.warn(msg) Dec 15 03:03:54.723766 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [req-e2dd96b9-adb4-4ece-a3e1-415550fd0aae req-bd46a861-6ca0-479a-a566-52666514e8f9 service nova] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:03:54.724760 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [req-e2dd96b9-adb4-4ece-a3e1-415550fd0aae req-bd46a861-6ca0-479a-a566-52666514e8f9 service nova] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:03:54.739489 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi [None req-ffca1240-5345-48f3-ba7f-51128188053c tempest-ServerRescueNegativeTestJSON-2061875223 tempest-ServerRescueNegativeTestJSON-2061875223-project] Calling method '>' {{(pid=116156) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:03:54.739489 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.compute.api [None req-ffca1240-5345-48f3-ba7f-51128188053c tempest-ServerRescueNegativeTestJSON-2061875223 tempest-ServerRescueNegativeTestJSON-2061875223-project] [instance: 2d20c8be-04a9-4c79-aa0a-138a79fe50cd] Fetching instance by UUID {{(pid=116156) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:03:54.749570 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: INFO nova.api.openstack.compute.server_external_events [req-e2dd96b9-adb4-4ece-a3e1-415550fd0aae req-bd46a861-6ca0-479a-a566-52666514e8f9 service nova] Creating event network-vif-plugged:7b1a4626-5ae6-4522-8d7b-19824de5f496 for instance 9bbb0abf-72a3-4fbc-8235-7a3ecfc8d006 on hv-cinder-81803 Dec 15 03:03:54.756048 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-ffca1240-5345-48f3-ba7f-51128188053c tempest-ServerRescueNegativeTestJSON-2061875223 tempest-ServerRescueNegativeTestJSON-2061875223-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:03:54.757017 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-ffca1240-5345-48f3-ba7f-51128188053c tempest-ServerRescueNegativeTestJSON-2061875223 tempest-ServerRescueNegativeTestJSON-2061875223-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:03:54.758100 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-ffca1240-5345-48f3-ba7f-51128188053c tempest-ServerRescueNegativeTestJSON-2061875223 tempest-ServerRescueNegativeTestJSON-2061875223-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:03:54.758789 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-ffca1240-5345-48f3-ba7f-51128188053c tempest-ServerRescueNegativeTestJSON-2061875223 tempest-ServerRescueNegativeTestJSON-2061875223-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:03:54.762083 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: INFO nova.api.openstack.requestlog [req-e2dd96b9-adb4-4ece-a3e1-415550fd0aae req-bd46a861-6ca0-479a-a566-52666514e8f9 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.053881 Dec 15 03:03:54.763030 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: [pid: 116157|app: 0|req: 61/132] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Dec 15 03:03:54 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 03:03:54.942423 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.policy [None req-ffca1240-5345-48f3-ba7f-51128188053c tempest-ServerRescueNegativeTestJSON-2061875223 tempest-ServerRescueNegativeTestJSON-2061875223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ea02b6e8f1548a1bd78952cb7337403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5e8a958d4bf43868502b13728b9583b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116156) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:03:54.952365 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: INFO nova.api.openstack.requestlog [None req-ffca1240-5345-48f3-ba7f-51128188053c tempest-ServerRescueNegativeTestJSON-2061875223 tempest-ServerRescueNegativeTestJSON-2061875223-project] 10.222.0.18 "GET /compute/v2.1/servers/2d20c8be-04a9-4c79-aa0a-138a79fe50cd" status: 200 len: 1321 microversion: 2.1 time: 0.232409 Dec 15 03:03:54.953603 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: [pid: 116156|app: 0|req: 72/133] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 03:03:54 2021] GET /compute/v2.1/servers/2d20c8be-04a9-4c79-aa0a-138a79fe50cd => generated 1321 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 03:03:55.285872 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi [None req-dd8aebfa-b7db-413a-8e97-6ec641897861 tempest-DeleteServersTestJSON-268050555 tempest-DeleteServersTestJSON-268050555-project] Calling method '>' {{(pid=116157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:03:55.286596 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.compute.api [None req-dd8aebfa-b7db-413a-8e97-6ec641897861 tempest-DeleteServersTestJSON-268050555 tempest-DeleteServersTestJSON-268050555-project] [instance: 5a01bf2d-c341-4af1-b2b2-e1f05e46705f] Fetching instance by UUID {{(pid=116157) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:03:55.292820 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-dd8aebfa-b7db-413a-8e97-6ec641897861 tempest-DeleteServersTestJSON-268050555 tempest-DeleteServersTestJSON-268050555-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:03:55.293365 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-dd8aebfa-b7db-413a-8e97-6ec641897861 tempest-DeleteServersTestJSON-268050555 tempest-DeleteServersTestJSON-268050555-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:03:55.294216 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-dd8aebfa-b7db-413a-8e97-6ec641897861 tempest-DeleteServersTestJSON-268050555 tempest-DeleteServersTestJSON-268050555-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:03:55.294646 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-dd8aebfa-b7db-413a-8e97-6ec641897861 tempest-DeleteServersTestJSON-268050555 tempest-DeleteServersTestJSON-268050555-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:03:55.428957 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.policy [None req-dd8aebfa-b7db-413a-8e97-6ec641897861 tempest-DeleteServersTestJSON-268050555 tempest-DeleteServersTestJSON-268050555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28384f466c3541358ecea856650f008c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb933fa80ed94ce5b6828e48e86a21c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116157) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:03:55.437417 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: INFO nova.api.openstack.requestlog [None req-dd8aebfa-b7db-413a-8e97-6ec641897861 tempest-DeleteServersTestJSON-268050555 tempest-DeleteServersTestJSON-268050555-project] 10.222.0.18 "GET /compute/v2.1/servers/5a01bf2d-c341-4af1-b2b2-e1f05e46705f" status: 200 len: 1502 microversion: 2.1 time: 0.155485 Dec 15 03:03:55.438045 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: [pid: 116157|app: 0|req: 62/134] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 03:03:55 2021] GET /compute/v2.1/servers/5a01bf2d-c341-4af1-b2b2-e1f05e46705f => generated 1502 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 03:03:55.712414 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi [None req-ea1bac55-ca8b-4f83-b594-6063da13c1e4 tempest-AttachVolumeNegativeTest-1640336653 tempest-AttachVolumeNegativeTest-1640336653-project] Calling method '>' {{(pid=116156) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:03:55.713036 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.compute.api [None req-ea1bac55-ca8b-4f83-b594-6063da13c1e4 tempest-AttachVolumeNegativeTest-1640336653 tempest-AttachVolumeNegativeTest-1640336653-project] [instance: 4923355f-95d6-443d-9487-574f56b87f66] Fetching instance by UUID {{(pid=116156) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:03:55.719726 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-ea1bac55-ca8b-4f83-b594-6063da13c1e4 tempest-AttachVolumeNegativeTest-1640336653 tempest-AttachVolumeNegativeTest-1640336653-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:03:55.720170 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-ea1bac55-ca8b-4f83-b594-6063da13c1e4 tempest-AttachVolumeNegativeTest-1640336653 tempest-AttachVolumeNegativeTest-1640336653-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:03:55.720944 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-ea1bac55-ca8b-4f83-b594-6063da13c1e4 tempest-AttachVolumeNegativeTest-1640336653 tempest-AttachVolumeNegativeTest-1640336653-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:03:55.721372 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-ea1bac55-ca8b-4f83-b594-6063da13c1e4 tempest-AttachVolumeNegativeTest-1640336653 tempest-AttachVolumeNegativeTest-1640336653-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:03:55.851240 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.policy [None req-ea1bac55-ca8b-4f83-b594-6063da13c1e4 tempest-AttachVolumeNegativeTest-1640336653 tempest-AttachVolumeNegativeTest-1640336653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35d37a3d8e504b8186182468b77dd114', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '409b41637da94c469444954258444b4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116156) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:03:55.858707 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: INFO nova.api.openstack.requestlog [None req-ea1bac55-ca8b-4f83-b594-6063da13c1e4 tempest-AttachVolumeNegativeTest-1640336653 tempest-AttachVolumeNegativeTest-1640336653-project] 10.222.0.18 "GET /compute/v2.1/servers/4923355f-95d6-443d-9487-574f56b87f66" status: 200 len: 1508 microversion: 2.1 time: 0.149846 Dec 15 03:03:55.859339 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: [pid: 116156|app: 0|req: 73/135] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 03:03:55 2021] GET /compute/v2.1/servers/4923355f-95d6-443d-9487-574f56b87f66 => generated 1508 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 03:03:55.970702 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi [None req-d15645ba-8052-4f92-9f5d-f260c6435ef5 tempest-ServerRescueNegativeTestJSON-2061875223 tempest-ServerRescueNegativeTestJSON-2061875223-project] Calling method '>' {{(pid=116157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:03:55.971306 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.compute.api [None req-d15645ba-8052-4f92-9f5d-f260c6435ef5 tempest-ServerRescueNegativeTestJSON-2061875223 tempest-ServerRescueNegativeTestJSON-2061875223-project] [instance: 2d20c8be-04a9-4c79-aa0a-138a79fe50cd] Fetching instance by UUID {{(pid=116157) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:03:55.976983 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-d15645ba-8052-4f92-9f5d-f260c6435ef5 tempest-ServerRescueNegativeTestJSON-2061875223 tempest-ServerRescueNegativeTestJSON-2061875223-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:03:55.977429 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-d15645ba-8052-4f92-9f5d-f260c6435ef5 tempest-ServerRescueNegativeTestJSON-2061875223 tempest-ServerRescueNegativeTestJSON-2061875223-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:03:55.978233 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-d15645ba-8052-4f92-9f5d-f260c6435ef5 tempest-ServerRescueNegativeTestJSON-2061875223 tempest-ServerRescueNegativeTestJSON-2061875223-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:03:55.978664 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-d15645ba-8052-4f92-9f5d-f260c6435ef5 tempest-ServerRescueNegativeTestJSON-2061875223 tempest-ServerRescueNegativeTestJSON-2061875223-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:03:56.141023 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.policy [None req-d15645ba-8052-4f92-9f5d-f260c6435ef5 tempest-ServerRescueNegativeTestJSON-2061875223 tempest-ServerRescueNegativeTestJSON-2061875223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ea02b6e8f1548a1bd78952cb7337403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5e8a958d4bf43868502b13728b9583b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116157) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:03:56.158443 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: INFO nova.api.openstack.requestlog [None req-d15645ba-8052-4f92-9f5d-f260c6435ef5 tempest-ServerRescueNegativeTestJSON-2061875223 tempest-ServerRescueNegativeTestJSON-2061875223-project] 10.222.0.18 "GET /compute/v2.1/servers/2d20c8be-04a9-4c79-aa0a-138a79fe50cd" status: 200 len: 1321 microversion: 2.1 time: 0.191828 Dec 15 03:03:56.159296 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: [pid: 116157|app: 0|req: 63/136] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 03:03:55 2021] GET /compute/v2.1/servers/2d20c8be-04a9-4c79-aa0a-138a79fe50cd => generated 1321 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 03:03:57.176216 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi [None req-010cae17-08ca-462f-912e-d0de280f7802 tempest-ServerRescueNegativeTestJSON-2061875223 tempest-ServerRescueNegativeTestJSON-2061875223-project] Calling method '>' {{(pid=116156) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:03:57.176675 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.compute.api [None req-010cae17-08ca-462f-912e-d0de280f7802 tempest-ServerRescueNegativeTestJSON-2061875223 tempest-ServerRescueNegativeTestJSON-2061875223-project] [instance: 2d20c8be-04a9-4c79-aa0a-138a79fe50cd] Fetching instance by UUID {{(pid=116156) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:03:57.182291 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-010cae17-08ca-462f-912e-d0de280f7802 tempest-ServerRescueNegativeTestJSON-2061875223 tempest-ServerRescueNegativeTestJSON-2061875223-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:03:57.182734 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-010cae17-08ca-462f-912e-d0de280f7802 tempest-ServerRescueNegativeTestJSON-2061875223 tempest-ServerRescueNegativeTestJSON-2061875223-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:03:57.183508 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-010cae17-08ca-462f-912e-d0de280f7802 tempest-ServerRescueNegativeTestJSON-2061875223 tempest-ServerRescueNegativeTestJSON-2061875223-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:03:57.183935 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-010cae17-08ca-462f-912e-d0de280f7802 tempest-ServerRescueNegativeTestJSON-2061875223 tempest-ServerRescueNegativeTestJSON-2061875223-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:03:57.331191 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.policy [None req-010cae17-08ca-462f-912e-d0de280f7802 tempest-ServerRescueNegativeTestJSON-2061875223 tempest-ServerRescueNegativeTestJSON-2061875223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ea02b6e8f1548a1bd78952cb7337403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5e8a958d4bf43868502b13728b9583b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116156) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:03:57.338364 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: INFO nova.api.openstack.requestlog [None req-010cae17-08ca-462f-912e-d0de280f7802 tempest-ServerRescueNegativeTestJSON-2061875223 tempest-ServerRescueNegativeTestJSON-2061875223-project] 10.222.0.18 "GET /compute/v2.1/servers/2d20c8be-04a9-4c79-aa0a-138a79fe50cd" status: 200 len: 1321 microversion: 2.1 time: 0.166816 Dec 15 03:03:57.338923 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: [pid: 116156|app: 0|req: 74/137] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 03:03:57 2021] GET /compute/v2.1/servers/2d20c8be-04a9-4c79-aa0a-138a79fe50cd => generated 1321 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 03:03:58.354934 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi [None req-e87da3dc-3e7f-4cd1-a4a1-0d303c7f7f63 tempest-ServerRescueNegativeTestJSON-2061875223 tempest-ServerRescueNegativeTestJSON-2061875223-project] Calling method '>' {{(pid=116157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:03:58.355596 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.compute.api [None req-e87da3dc-3e7f-4cd1-a4a1-0d303c7f7f63 tempest-ServerRescueNegativeTestJSON-2061875223 tempest-ServerRescueNegativeTestJSON-2061875223-project] [instance: 2d20c8be-04a9-4c79-aa0a-138a79fe50cd] Fetching instance by UUID {{(pid=116157) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:03:58.361308 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-e87da3dc-3e7f-4cd1-a4a1-0d303c7f7f63 tempest-ServerRescueNegativeTestJSON-2061875223 tempest-ServerRescueNegativeTestJSON-2061875223-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:03:58.361761 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-e87da3dc-3e7f-4cd1-a4a1-0d303c7f7f63 tempest-ServerRescueNegativeTestJSON-2061875223 tempest-ServerRescueNegativeTestJSON-2061875223-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:03:58.362582 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-e87da3dc-3e7f-4cd1-a4a1-0d303c7f7f63 tempest-ServerRescueNegativeTestJSON-2061875223 tempest-ServerRescueNegativeTestJSON-2061875223-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:03:58.363018 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-e87da3dc-3e7f-4cd1-a4a1-0d303c7f7f63 tempest-ServerRescueNegativeTestJSON-2061875223 tempest-ServerRescueNegativeTestJSON-2061875223-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:03:58.492816 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.policy [None req-e87da3dc-3e7f-4cd1-a4a1-0d303c7f7f63 tempest-ServerRescueNegativeTestJSON-2061875223 tempest-ServerRescueNegativeTestJSON-2061875223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ea02b6e8f1548a1bd78952cb7337403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5e8a958d4bf43868502b13728b9583b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116157) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:03:58.500998 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: INFO nova.api.openstack.requestlog [None req-e87da3dc-3e7f-4cd1-a4a1-0d303c7f7f63 tempest-ServerRescueNegativeTestJSON-2061875223 tempest-ServerRescueNegativeTestJSON-2061875223-project] 10.222.0.18 "GET /compute/v2.1/servers/2d20c8be-04a9-4c79-aa0a-138a79fe50cd" status: 200 len: 1321 microversion: 2.1 time: 0.149684 Dec 15 03:03:58.501557 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: [pid: 116157|app: 0|req: 64/138] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 03:03:58 2021] GET /compute/v2.1/servers/2d20c8be-04a9-4c79-aa0a-138a79fe50cd => generated 1321 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 03:03:59.517295 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi [None req-be685f99-18e9-4826-bbda-e480fd13193f tempest-ServerRescueNegativeTestJSON-2061875223 tempest-ServerRescueNegativeTestJSON-2061875223-project] Calling method '>' {{(pid=116156) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:03:59.517960 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.compute.api [None req-be685f99-18e9-4826-bbda-e480fd13193f tempest-ServerRescueNegativeTestJSON-2061875223 tempest-ServerRescueNegativeTestJSON-2061875223-project] [instance: 2d20c8be-04a9-4c79-aa0a-138a79fe50cd] Fetching instance by UUID {{(pid=116156) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:03:59.525071 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-be685f99-18e9-4826-bbda-e480fd13193f tempest-ServerRescueNegativeTestJSON-2061875223 tempest-ServerRescueNegativeTestJSON-2061875223-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:03:59.525519 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-be685f99-18e9-4826-bbda-e480fd13193f tempest-ServerRescueNegativeTestJSON-2061875223 tempest-ServerRescueNegativeTestJSON-2061875223-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:03:59.526416 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-be685f99-18e9-4826-bbda-e480fd13193f tempest-ServerRescueNegativeTestJSON-2061875223 tempest-ServerRescueNegativeTestJSON-2061875223-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:03:59.526869 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-be685f99-18e9-4826-bbda-e480fd13193f tempest-ServerRescueNegativeTestJSON-2061875223 tempest-ServerRescueNegativeTestJSON-2061875223-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:03:59.658259 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.policy [None req-be685f99-18e9-4826-bbda-e480fd13193f tempest-ServerRescueNegativeTestJSON-2061875223 tempest-ServerRescueNegativeTestJSON-2061875223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ea02b6e8f1548a1bd78952cb7337403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5e8a958d4bf43868502b13728b9583b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116156) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:03:59.665462 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: INFO nova.api.openstack.requestlog [None req-be685f99-18e9-4826-bbda-e480fd13193f tempest-ServerRescueNegativeTestJSON-2061875223 tempest-ServerRescueNegativeTestJSON-2061875223-project] 10.222.0.18 "GET /compute/v2.1/servers/2d20c8be-04a9-4c79-aa0a-138a79fe50cd" status: 200 len: 1516 microversion: 2.1 time: 0.151717 Dec 15 03:03:59.666015 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: [pid: 116156|app: 0|req: 75/139] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 03:03:59 2021] GET /compute/v2.1/servers/2d20c8be-04a9-4c79-aa0a-138a79fe50cd => generated 1516 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 03:03:59.682597 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi [None req-87136cd7-ec0f-48c4-ba9d-b55c202528a6 tempest-ServerRescueNegativeTestJSON-2061875223 tempest-ServerRescueNegativeTestJSON-2061875223-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=116157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 03:03:59.683564 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.compute.api [None req-87136cd7-ec0f-48c4-ba9d-b55c202528a6 tempest-ServerRescueNegativeTestJSON-2061875223 tempest-ServerRescueNegativeTestJSON-2061875223-project] [instance: 2d20c8be-04a9-4c79-aa0a-138a79fe50cd] Fetching instance by UUID {{(pid=116157) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:03:59.690275 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-87136cd7-ec0f-48c4-ba9d-b55c202528a6 tempest-ServerRescueNegativeTestJSON-2061875223 tempest-ServerRescueNegativeTestJSON-2061875223-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:03:59.690802 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-87136cd7-ec0f-48c4-ba9d-b55c202528a6 tempest-ServerRescueNegativeTestJSON-2061875223 tempest-ServerRescueNegativeTestJSON-2061875223-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:03:59.692051 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-87136cd7-ec0f-48c4-ba9d-b55c202528a6 tempest-ServerRescueNegativeTestJSON-2061875223 tempest-ServerRescueNegativeTestJSON-2061875223-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:03:59.692414 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-87136cd7-ec0f-48c4-ba9d-b55c202528a6 tempest-ServerRescueNegativeTestJSON-2061875223 tempest-ServerRescueNegativeTestJSON-2061875223-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:03:59.752758 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.objects.instance [None req-87136cd7-ec0f-48c4-ba9d-b55c202528a6 tempest-ServerRescueNegativeTestJSON-2061875223 tempest-ServerRescueNegativeTestJSON-2061875223-project] Lazy-loading 'flavor' on Instance uuid 2d20c8be-04a9-4c79-aa0a-138a79fe50cd {{(pid=116157) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Dec 15 03:03:59.869002 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: INFO nova.api.openstack.requestlog [None req-87136cd7-ec0f-48c4-ba9d-b55c202528a6 tempest-ServerRescueNegativeTestJSON-2061875223 tempest-ServerRescueNegativeTestJSON-2061875223-project] 10.222.0.18 "POST /compute/v2.1/servers/2d20c8be-04a9-4c79-aa0a-138a79fe50cd/action" status: 200 len: 32 microversion: 2.1 time: 0.189935 Dec 15 03:03:59.869590 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: [pid: 116157|app: 0|req: 65/140] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Dec 15 03:03:59 2021] POST /compute/v2.1/servers/2d20c8be-04a9-4c79-aa0a-138a79fe50cd/action => generated 32 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Dec 15 03:03:59.878361 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi [None req-8aa4eb1d-7bf4-4455-8cd3-8294f6989360 tempest-ServerRescueNegativeTestJSON-2061875223 tempest-ServerRescueNegativeTestJSON-2061875223-project] Calling method '>' {{(pid=116156) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:03:59.879152 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.compute.api [None req-8aa4eb1d-7bf4-4455-8cd3-8294f6989360 tempest-ServerRescueNegativeTestJSON-2061875223 tempest-ServerRescueNegativeTestJSON-2061875223-project] [instance: 2d20c8be-04a9-4c79-aa0a-138a79fe50cd] Fetching instance by UUID {{(pid=116156) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:03:59.884970 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-8aa4eb1d-7bf4-4455-8cd3-8294f6989360 tempest-ServerRescueNegativeTestJSON-2061875223 tempest-ServerRescueNegativeTestJSON-2061875223-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:03:59.885494 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-8aa4eb1d-7bf4-4455-8cd3-8294f6989360 tempest-ServerRescueNegativeTestJSON-2061875223 tempest-ServerRescueNegativeTestJSON-2061875223-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:03:59.886411 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-8aa4eb1d-7bf4-4455-8cd3-8294f6989360 tempest-ServerRescueNegativeTestJSON-2061875223 tempest-ServerRescueNegativeTestJSON-2061875223-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:03:59.886991 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-8aa4eb1d-7bf4-4455-8cd3-8294f6989360 tempest-ServerRescueNegativeTestJSON-2061875223 tempest-ServerRescueNegativeTestJSON-2061875223-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:03:59.914306 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi [None req-82ae757f-a1d9-4ce1-9529-48188b99c5e7 tempest-DeleteServersTestJSON-268050555 tempest-DeleteServersTestJSON-268050555-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "ddb9b192-24b0-4084-a6fe-55f382d88205"}} {{(pid=116157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 03:03:59.915501 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.compute.api [None req-82ae757f-a1d9-4ce1-9529-48188b99c5e7 tempest-DeleteServersTestJSON-268050555 tempest-DeleteServersTestJSON-268050555-project] [instance: 5a01bf2d-c341-4af1-b2b2-e1f05e46705f] Fetching instance by UUID {{(pid=116157) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:03:59.921611 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-82ae757f-a1d9-4ce1-9529-48188b99c5e7 tempest-DeleteServersTestJSON-268050555 tempest-DeleteServersTestJSON-268050555-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:03:59.922611 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-82ae757f-a1d9-4ce1-9529-48188b99c5e7 tempest-DeleteServersTestJSON-268050555 tempest-DeleteServersTestJSON-268050555-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:03:59.923397 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-82ae757f-a1d9-4ce1-9529-48188b99c5e7 tempest-DeleteServersTestJSON-268050555 tempest-DeleteServersTestJSON-268050555-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:03:59.923838 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-82ae757f-a1d9-4ce1-9529-48188b99c5e7 tempest-DeleteServersTestJSON-268050555 tempest-DeleteServersTestJSON-268050555-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:04:00.022610 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.policy [None req-8aa4eb1d-7bf4-4455-8cd3-8294f6989360 tempest-ServerRescueNegativeTestJSON-2061875223 tempest-ServerRescueNegativeTestJSON-2061875223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ea02b6e8f1548a1bd78952cb7337403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5e8a958d4bf43868502b13728b9583b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116156) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:04:00.029841 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: INFO nova.api.openstack.requestlog [None req-8aa4eb1d-7bf4-4455-8cd3-8294f6989360 tempest-ServerRescueNegativeTestJSON-2061875223 tempest-ServerRescueNegativeTestJSON-2061875223-project] 10.222.0.18 "GET /compute/v2.1/servers/2d20c8be-04a9-4c79-aa0a-138a79fe50cd" status: 200 len: 1522 microversion: 2.1 time: 0.155038 Dec 15 03:04:00.030451 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: [pid: 116156|app: 0|req: 76/141] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 03:03:59 2021] GET /compute/v2.1/servers/2d20c8be-04a9-4c79-aa0a-138a79fe50cd => generated 1522 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 03:04:01.048405 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi [None req-f19e3dfd-69ec-4067-88a3-515719ee140b tempest-ServerRescueNegativeTestJSON-2061875223 tempest-ServerRescueNegativeTestJSON-2061875223-project] Calling method '>' {{(pid=116156) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:04:01.049025 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.compute.api [None req-f19e3dfd-69ec-4067-88a3-515719ee140b tempest-ServerRescueNegativeTestJSON-2061875223 tempest-ServerRescueNegativeTestJSON-2061875223-project] [instance: 2d20c8be-04a9-4c79-aa0a-138a79fe50cd] Fetching instance by UUID {{(pid=116156) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:04:01.055489 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-f19e3dfd-69ec-4067-88a3-515719ee140b tempest-ServerRescueNegativeTestJSON-2061875223 tempest-ServerRescueNegativeTestJSON-2061875223-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:04:01.055932 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-f19e3dfd-69ec-4067-88a3-515719ee140b tempest-ServerRescueNegativeTestJSON-2061875223 tempest-ServerRescueNegativeTestJSON-2061875223-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:04:01.056702 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-f19e3dfd-69ec-4067-88a3-515719ee140b tempest-ServerRescueNegativeTestJSON-2061875223 tempest-ServerRescueNegativeTestJSON-2061875223-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:04:01.057127 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-f19e3dfd-69ec-4067-88a3-515719ee140b tempest-ServerRescueNegativeTestJSON-2061875223 tempest-ServerRescueNegativeTestJSON-2061875223-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:04:01.202033 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.policy [None req-f19e3dfd-69ec-4067-88a3-515719ee140b tempest-ServerRescueNegativeTestJSON-2061875223 tempest-ServerRescueNegativeTestJSON-2061875223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ea02b6e8f1548a1bd78952cb7337403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5e8a958d4bf43868502b13728b9583b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116156) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:04:01.220979 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: INFO nova.api.openstack.requestlog [None req-f19e3dfd-69ec-4067-88a3-515719ee140b tempest-ServerRescueNegativeTestJSON-2061875223 tempest-ServerRescueNegativeTestJSON-2061875223-project] 10.222.0.18 "GET /compute/v2.1/servers/2d20c8be-04a9-4c79-aa0a-138a79fe50cd" status: 200 len: 1522 microversion: 2.1 time: 0.176573 Dec 15 03:04:01.221583 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: [pid: 116156|app: 0|req: 77/142] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 03:04:01 2021] GET /compute/v2.1/servers/2d20c8be-04a9-4c79-aa0a-138a79fe50cd => generated 1522 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 03:04:02.237438 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi [None req-3fb68b67-a0bd-435d-8394-cd293029424b tempest-ServerRescueNegativeTestJSON-2061875223 tempest-ServerRescueNegativeTestJSON-2061875223-project] Calling method '>' {{(pid=116156) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:04:02.238102 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.compute.api [None req-3fb68b67-a0bd-435d-8394-cd293029424b tempest-ServerRescueNegativeTestJSON-2061875223 tempest-ServerRescueNegativeTestJSON-2061875223-project] [instance: 2d20c8be-04a9-4c79-aa0a-138a79fe50cd] Fetching instance by UUID {{(pid=116156) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:04:02.244255 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-3fb68b67-a0bd-435d-8394-cd293029424b tempest-ServerRescueNegativeTestJSON-2061875223 tempest-ServerRescueNegativeTestJSON-2061875223-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:04:02.244706 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-3fb68b67-a0bd-435d-8394-cd293029424b tempest-ServerRescueNegativeTestJSON-2061875223 tempest-ServerRescueNegativeTestJSON-2061875223-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:04:02.245566 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-3fb68b67-a0bd-435d-8394-cd293029424b tempest-ServerRescueNegativeTestJSON-2061875223 tempest-ServerRescueNegativeTestJSON-2061875223-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:04:02.246020 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-3fb68b67-a0bd-435d-8394-cd293029424b tempest-ServerRescueNegativeTestJSON-2061875223 tempest-ServerRescueNegativeTestJSON-2061875223-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:04:02.379706 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.policy [None req-3fb68b67-a0bd-435d-8394-cd293029424b tempest-ServerRescueNegativeTestJSON-2061875223 tempest-ServerRescueNegativeTestJSON-2061875223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ea02b6e8f1548a1bd78952cb7337403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5e8a958d4bf43868502b13728b9583b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116156) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:04:02.386772 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: INFO nova.api.openstack.requestlog [None req-3fb68b67-a0bd-435d-8394-cd293029424b tempest-ServerRescueNegativeTestJSON-2061875223 tempest-ServerRescueNegativeTestJSON-2061875223-project] 10.222.0.18 "GET /compute/v2.1/servers/2d20c8be-04a9-4c79-aa0a-138a79fe50cd" status: 200 len: 1522 microversion: 2.1 time: 0.152956 Dec 15 03:04:02.387326 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: [pid: 116156|app: 0|req: 78/143] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 03:04:02 2021] GET /compute/v2.1/servers/2d20c8be-04a9-4c79-aa0a-138a79fe50cd => generated 1522 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 03:04:02.987010 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: INFO nova.api.openstack.requestlog [None req-82ae757f-a1d9-4ce1-9529-48188b99c5e7 tempest-DeleteServersTestJSON-268050555 tempest-DeleteServersTestJSON-268050555-project] 10.222.0.18 "POST /compute/v2.1/servers/5a01bf2d-c341-4af1-b2b2-e1f05e46705f/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 3.076756 Dec 15 03:04:02.987719 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: [pid: 116157|app: 0|req: 66/144] 10.222.0.18 () {60 vars in 1322 bytes} [Wed Dec 15 03:03:59 2021] POST /compute/v2.1/servers/5a01bf2d-c341-4af1-b2b2-e1f05e46705f/os-volume_attachments => generated 194 bytes in 3079 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 15 03:04:03.404906 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi [None req-18dc922f-bb0b-4fe3-a84c-f4083f5d6f7e tempest-ServerRescueNegativeTestJSON-2061875223 tempest-ServerRescueNegativeTestJSON-2061875223-project] Calling method '>' {{(pid=116156) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:04:03.406621 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.compute.api [None req-18dc922f-bb0b-4fe3-a84c-f4083f5d6f7e tempest-ServerRescueNegativeTestJSON-2061875223 tempest-ServerRescueNegativeTestJSON-2061875223-project] [instance: 2d20c8be-04a9-4c79-aa0a-138a79fe50cd] Fetching instance by UUID {{(pid=116156) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:04:03.412497 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-18dc922f-bb0b-4fe3-a84c-f4083f5d6f7e tempest-ServerRescueNegativeTestJSON-2061875223 tempest-ServerRescueNegativeTestJSON-2061875223-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:04:03.413107 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-18dc922f-bb0b-4fe3-a84c-f4083f5d6f7e tempest-ServerRescueNegativeTestJSON-2061875223 tempest-ServerRescueNegativeTestJSON-2061875223-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:04:03.413731 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-18dc922f-bb0b-4fe3-a84c-f4083f5d6f7e tempest-ServerRescueNegativeTestJSON-2061875223 tempest-ServerRescueNegativeTestJSON-2061875223-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:04:03.414274 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-18dc922f-bb0b-4fe3-a84c-f4083f5d6f7e tempest-ServerRescueNegativeTestJSON-2061875223 tempest-ServerRescueNegativeTestJSON-2061875223-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:04:03.574398 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.policy [None req-18dc922f-bb0b-4fe3-a84c-f4083f5d6f7e tempest-ServerRescueNegativeTestJSON-2061875223 tempest-ServerRescueNegativeTestJSON-2061875223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ea02b6e8f1548a1bd78952cb7337403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5e8a958d4bf43868502b13728b9583b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116156) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:04:03.582747 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: INFO nova.api.openstack.requestlog [None req-18dc922f-bb0b-4fe3-a84c-f4083f5d6f7e tempest-ServerRescueNegativeTestJSON-2061875223 tempest-ServerRescueNegativeTestJSON-2061875223-project] 10.222.0.18 "GET /compute/v2.1/servers/2d20c8be-04a9-4c79-aa0a-138a79fe50cd" status: 200 len: 1522 microversion: 2.1 time: 0.181942 Dec 15 03:04:03.583486 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: [pid: 116156|app: 0|req: 79/145] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 03:04:03 2021] GET /compute/v2.1/servers/2d20c8be-04a9-4c79-aa0a-138a79fe50cd => generated 1522 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 03:04:04.600762 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi [None req-0c11e802-363d-4189-b00a-182ff0c49303 tempest-ServerRescueNegativeTestJSON-2061875223 tempest-ServerRescueNegativeTestJSON-2061875223-project] Calling method '>' {{(pid=116157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:04:04.601455 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.compute.api [None req-0c11e802-363d-4189-b00a-182ff0c49303 tempest-ServerRescueNegativeTestJSON-2061875223 tempest-ServerRescueNegativeTestJSON-2061875223-project] [instance: 2d20c8be-04a9-4c79-aa0a-138a79fe50cd] Fetching instance by UUID {{(pid=116157) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:04:04.607644 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-0c11e802-363d-4189-b00a-182ff0c49303 tempest-ServerRescueNegativeTestJSON-2061875223 tempest-ServerRescueNegativeTestJSON-2061875223-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:04:04.608093 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-0c11e802-363d-4189-b00a-182ff0c49303 tempest-ServerRescueNegativeTestJSON-2061875223 tempest-ServerRescueNegativeTestJSON-2061875223-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:04:04.608870 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-0c11e802-363d-4189-b00a-182ff0c49303 tempest-ServerRescueNegativeTestJSON-2061875223 tempest-ServerRescueNegativeTestJSON-2061875223-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:04:04.609316 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-0c11e802-363d-4189-b00a-182ff0c49303 tempest-ServerRescueNegativeTestJSON-2061875223 tempest-ServerRescueNegativeTestJSON-2061875223-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:04:04.740929 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.policy [None req-0c11e802-363d-4189-b00a-182ff0c49303 tempest-ServerRescueNegativeTestJSON-2061875223 tempest-ServerRescueNegativeTestJSON-2061875223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ea02b6e8f1548a1bd78952cb7337403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5e8a958d4bf43868502b13728b9583b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116157) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:04:04.748214 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: INFO nova.api.openstack.requestlog [None req-0c11e802-363d-4189-b00a-182ff0c49303 tempest-ServerRescueNegativeTestJSON-2061875223 tempest-ServerRescueNegativeTestJSON-2061875223-project] 10.222.0.18 "GET /compute/v2.1/servers/2d20c8be-04a9-4c79-aa0a-138a79fe50cd" status: 200 len: 1522 microversion: 2.1 time: 0.151864 Dec 15 03:04:04.748768 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: [pid: 116157|app: 0|req: 67/146] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 03:04:04 2021] GET /compute/v2.1/servers/2d20c8be-04a9-4c79-aa0a-138a79fe50cd => generated 1522 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 03:04:05.764467 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi [None req-9c7d172b-119d-4f70-86d1-7782c5804196 tempest-ServerRescueNegativeTestJSON-2061875223 tempest-ServerRescueNegativeTestJSON-2061875223-project] Calling method '>' {{(pid=116156) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:04:05.765036 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.compute.api [None req-9c7d172b-119d-4f70-86d1-7782c5804196 tempest-ServerRescueNegativeTestJSON-2061875223 tempest-ServerRescueNegativeTestJSON-2061875223-project] [instance: 2d20c8be-04a9-4c79-aa0a-138a79fe50cd] Fetching instance by UUID {{(pid=116156) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:04:05.770827 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-9c7d172b-119d-4f70-86d1-7782c5804196 tempest-ServerRescueNegativeTestJSON-2061875223 tempest-ServerRescueNegativeTestJSON-2061875223-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:04:05.771270 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-9c7d172b-119d-4f70-86d1-7782c5804196 tempest-ServerRescueNegativeTestJSON-2061875223 tempest-ServerRescueNegativeTestJSON-2061875223-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:04:05.772036 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-9c7d172b-119d-4f70-86d1-7782c5804196 tempest-ServerRescueNegativeTestJSON-2061875223 tempest-ServerRescueNegativeTestJSON-2061875223-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:04:05.772465 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-9c7d172b-119d-4f70-86d1-7782c5804196 tempest-ServerRescueNegativeTestJSON-2061875223 tempest-ServerRescueNegativeTestJSON-2061875223-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:04:05.901633 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.policy [None req-9c7d172b-119d-4f70-86d1-7782c5804196 tempest-ServerRescueNegativeTestJSON-2061875223 tempest-ServerRescueNegativeTestJSON-2061875223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ea02b6e8f1548a1bd78952cb7337403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5e8a958d4bf43868502b13728b9583b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116156) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:04:05.909301 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: INFO nova.api.openstack.requestlog [None req-9c7d172b-119d-4f70-86d1-7782c5804196 tempest-ServerRescueNegativeTestJSON-2061875223 tempest-ServerRescueNegativeTestJSON-2061875223-project] 10.222.0.18 "GET /compute/v2.1/servers/2d20c8be-04a9-4c79-aa0a-138a79fe50cd" status: 200 len: 1522 microversion: 2.1 time: 0.148407 Dec 15 03:04:05.909862 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: [pid: 116156|app: 0|req: 80/147] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 03:04:05 2021] GET /compute/v2.1/servers/2d20c8be-04a9-4c79-aa0a-138a79fe50cd => generated 1522 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 03:04:06.805906 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi [None req-cc2c55c5-54a8-49b2-9a11-870f53934f3d tempest-AttachVolumeNegativeTest-1640336653 tempest-AttachVolumeNegativeTest-1640336653-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "62001670-a8d1-401f-8a9a-bf61da09791d"}} {{(pid=116157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 03:04:06.807036 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.compute.api [None req-cc2c55c5-54a8-49b2-9a11-870f53934f3d tempest-AttachVolumeNegativeTest-1640336653 tempest-AttachVolumeNegativeTest-1640336653-project] [instance: 4923355f-95d6-443d-9487-574f56b87f66] Fetching instance by UUID {{(pid=116157) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:04:06.813769 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-cc2c55c5-54a8-49b2-9a11-870f53934f3d tempest-AttachVolumeNegativeTest-1640336653 tempest-AttachVolumeNegativeTest-1640336653-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:04:06.814232 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-cc2c55c5-54a8-49b2-9a11-870f53934f3d tempest-AttachVolumeNegativeTest-1640336653 tempest-AttachVolumeNegativeTest-1640336653-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:04:06.815011 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-cc2c55c5-54a8-49b2-9a11-870f53934f3d tempest-AttachVolumeNegativeTest-1640336653 tempest-AttachVolumeNegativeTest-1640336653-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:04:06.815443 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-cc2c55c5-54a8-49b2-9a11-870f53934f3d tempest-AttachVolumeNegativeTest-1640336653 tempest-AttachVolumeNegativeTest-1640336653-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:04:06.927542 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi [None req-0424b094-4fb5-4987-b262-80dc046433fe tempest-ServerRescueNegativeTestJSON-2061875223 tempest-ServerRescueNegativeTestJSON-2061875223-project] Calling method '>' {{(pid=116156) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:04:06.928339 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.compute.api [None req-0424b094-4fb5-4987-b262-80dc046433fe tempest-ServerRescueNegativeTestJSON-2061875223 tempest-ServerRescueNegativeTestJSON-2061875223-project] [instance: 2d20c8be-04a9-4c79-aa0a-138a79fe50cd] Fetching instance by UUID {{(pid=116156) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:04:06.934022 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-0424b094-4fb5-4987-b262-80dc046433fe tempest-ServerRescueNegativeTestJSON-2061875223 tempest-ServerRescueNegativeTestJSON-2061875223-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:04:06.934641 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-0424b094-4fb5-4987-b262-80dc046433fe tempest-ServerRescueNegativeTestJSON-2061875223 tempest-ServerRescueNegativeTestJSON-2061875223-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:04:06.935415 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-0424b094-4fb5-4987-b262-80dc046433fe tempest-ServerRescueNegativeTestJSON-2061875223 tempest-ServerRescueNegativeTestJSON-2061875223-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:04:06.935956 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-0424b094-4fb5-4987-b262-80dc046433fe tempest-ServerRescueNegativeTestJSON-2061875223 tempest-ServerRescueNegativeTestJSON-2061875223-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:04:07.071901 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.policy [None req-0424b094-4fb5-4987-b262-80dc046433fe tempest-ServerRescueNegativeTestJSON-2061875223 tempest-ServerRescueNegativeTestJSON-2061875223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ea02b6e8f1548a1bd78952cb7337403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5e8a958d4bf43868502b13728b9583b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116156) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:04:07.079505 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: INFO nova.api.openstack.requestlog [None req-0424b094-4fb5-4987-b262-80dc046433fe tempest-ServerRescueNegativeTestJSON-2061875223 tempest-ServerRescueNegativeTestJSON-2061875223-project] 10.222.0.18 "GET /compute/v2.1/servers/2d20c8be-04a9-4c79-aa0a-138a79fe50cd" status: 200 len: 1522 microversion: 2.1 time: 0.156985 Dec 15 03:04:07.080070 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: [pid: 116156|app: 0|req: 81/148] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 03:04:06 2021] GET /compute/v2.1/servers/2d20c8be-04a9-4c79-aa0a-138a79fe50cd => generated 1522 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 03:04:07.139457 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: INFO nova.api.openstack.requestlog [None req-cc2c55c5-54a8-49b2-9a11-870f53934f3d tempest-AttachVolumeNegativeTest-1640336653 tempest-AttachVolumeNegativeTest-1640336653-project] 10.222.0.18 "POST /compute/v2.1/servers/4923355f-95d6-443d-9487-574f56b87f66/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.337072 Dec 15 03:04:07.140276 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: [pid: 116157|app: 0|req: 68/149] 10.222.0.18 () {60 vars in 1322 bytes} [Wed Dec 15 03:04:06 2021] POST /compute/v2.1/servers/4923355f-95d6-443d-9487-574f56b87f66/os-volume_attachments => generated 194 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 03:04:08.098802 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi [None req-79ab00d6-1fba-415b-af75-ea121628ae4e tempest-ServerRescueNegativeTestJSON-2061875223 tempest-ServerRescueNegativeTestJSON-2061875223-project] Calling method '>' {{(pid=116156) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:04:08.099508 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.compute.api [None req-79ab00d6-1fba-415b-af75-ea121628ae4e tempest-ServerRescueNegativeTestJSON-2061875223 tempest-ServerRescueNegativeTestJSON-2061875223-project] [instance: 2d20c8be-04a9-4c79-aa0a-138a79fe50cd] Fetching instance by UUID {{(pid=116156) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:04:08.115946 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-79ab00d6-1fba-415b-af75-ea121628ae4e tempest-ServerRescueNegativeTestJSON-2061875223 tempest-ServerRescueNegativeTestJSON-2061875223-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:04:08.116858 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-79ab00d6-1fba-415b-af75-ea121628ae4e tempest-ServerRescueNegativeTestJSON-2061875223 tempest-ServerRescueNegativeTestJSON-2061875223-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:04:08.118605 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-79ab00d6-1fba-415b-af75-ea121628ae4e tempest-ServerRescueNegativeTestJSON-2061875223 tempest-ServerRescueNegativeTestJSON-2061875223-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:04:08.119097 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-79ab00d6-1fba-415b-af75-ea121628ae4e tempest-ServerRescueNegativeTestJSON-2061875223 tempest-ServerRescueNegativeTestJSON-2061875223-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:04:08.290773 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.policy [None req-79ab00d6-1fba-415b-af75-ea121628ae4e tempest-ServerRescueNegativeTestJSON-2061875223 tempest-ServerRescueNegativeTestJSON-2061875223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ea02b6e8f1548a1bd78952cb7337403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5e8a958d4bf43868502b13728b9583b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116156) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:04:08.298644 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: INFO nova.api.openstack.requestlog [None req-79ab00d6-1fba-415b-af75-ea121628ae4e tempest-ServerRescueNegativeTestJSON-2061875223 tempest-ServerRescueNegativeTestJSON-2061875223-project] 10.222.0.18 "GET /compute/v2.1/servers/2d20c8be-04a9-4c79-aa0a-138a79fe50cd" status: 200 len: 1522 microversion: 2.1 time: 0.205759 Dec 15 03:04:08.299379 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: [pid: 116156|app: 0|req: 82/150] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 03:04:08 2021] GET /compute/v2.1/servers/2d20c8be-04a9-4c79-aa0a-138a79fe50cd => generated 1522 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 03:04:09.316202 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi [None req-fd10ab58-eed3-477b-9652-531b69f346a0 tempest-ServerRescueNegativeTestJSON-2061875223 tempest-ServerRescueNegativeTestJSON-2061875223-project] Calling method '>' {{(pid=116157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:04:09.316887 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.compute.api [None req-fd10ab58-eed3-477b-9652-531b69f346a0 tempest-ServerRescueNegativeTestJSON-2061875223 tempest-ServerRescueNegativeTestJSON-2061875223-project] [instance: 2d20c8be-04a9-4c79-aa0a-138a79fe50cd] Fetching instance by UUID {{(pid=116157) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:04:09.323503 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-fd10ab58-eed3-477b-9652-531b69f346a0 tempest-ServerRescueNegativeTestJSON-2061875223 tempest-ServerRescueNegativeTestJSON-2061875223-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:04:09.323952 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-fd10ab58-eed3-477b-9652-531b69f346a0 tempest-ServerRescueNegativeTestJSON-2061875223 tempest-ServerRescueNegativeTestJSON-2061875223-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:04:09.324727 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-fd10ab58-eed3-477b-9652-531b69f346a0 tempest-ServerRescueNegativeTestJSON-2061875223 tempest-ServerRescueNegativeTestJSON-2061875223-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:04:09.325163 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-fd10ab58-eed3-477b-9652-531b69f346a0 tempest-ServerRescueNegativeTestJSON-2061875223 tempest-ServerRescueNegativeTestJSON-2061875223-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:04:09.475306 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.policy [None req-fd10ab58-eed3-477b-9652-531b69f346a0 tempest-ServerRescueNegativeTestJSON-2061875223 tempest-ServerRescueNegativeTestJSON-2061875223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ea02b6e8f1548a1bd78952cb7337403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5e8a958d4bf43868502b13728b9583b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116157) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:04:09.482567 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: INFO nova.api.openstack.requestlog [None req-fd10ab58-eed3-477b-9652-531b69f346a0 tempest-ServerRescueNegativeTestJSON-2061875223 tempest-ServerRescueNegativeTestJSON-2061875223-project] 10.222.0.18 "GET /compute/v2.1/servers/2d20c8be-04a9-4c79-aa0a-138a79fe50cd" status: 200 len: 1522 microversion: 2.1 time: 0.170381 Dec 15 03:04:09.483121 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: [pid: 116157|app: 0|req: 69/151] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 03:04:09 2021] GET /compute/v2.1/servers/2d20c8be-04a9-4c79-aa0a-138a79fe50cd => generated 1522 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 03:04:10.501032 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi [None req-5d98a6df-960c-49ed-bbb1-f7ee682ea576 tempest-ServerRescueNegativeTestJSON-2061875223 tempest-ServerRescueNegativeTestJSON-2061875223-project] Calling method '>' {{(pid=116156) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:04:10.501974 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.compute.api [None req-5d98a6df-960c-49ed-bbb1-f7ee682ea576 tempest-ServerRescueNegativeTestJSON-2061875223 tempest-ServerRescueNegativeTestJSON-2061875223-project] [instance: 2d20c8be-04a9-4c79-aa0a-138a79fe50cd] Fetching instance by UUID {{(pid=116156) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:04:10.508689 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-5d98a6df-960c-49ed-bbb1-f7ee682ea576 tempest-ServerRescueNegativeTestJSON-2061875223 tempest-ServerRescueNegativeTestJSON-2061875223-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:04:10.509236 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-5d98a6df-960c-49ed-bbb1-f7ee682ea576 tempest-ServerRescueNegativeTestJSON-2061875223 tempest-ServerRescueNegativeTestJSON-2061875223-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:04:10.510561 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-5d98a6df-960c-49ed-bbb1-f7ee682ea576 tempest-ServerRescueNegativeTestJSON-2061875223 tempest-ServerRescueNegativeTestJSON-2061875223-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:04:10.511087 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-5d98a6df-960c-49ed-bbb1-f7ee682ea576 tempest-ServerRescueNegativeTestJSON-2061875223 tempest-ServerRescueNegativeTestJSON-2061875223-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:04:10.642378 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.policy [None req-5d98a6df-960c-49ed-bbb1-f7ee682ea576 tempest-ServerRescueNegativeTestJSON-2061875223 tempest-ServerRescueNegativeTestJSON-2061875223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ea02b6e8f1548a1bd78952cb7337403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5e8a958d4bf43868502b13728b9583b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116156) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:04:10.649516 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: INFO nova.api.openstack.requestlog [None req-5d98a6df-960c-49ed-bbb1-f7ee682ea576 tempest-ServerRescueNegativeTestJSON-2061875223 tempest-ServerRescueNegativeTestJSON-2061875223-project] 10.222.0.18 "GET /compute/v2.1/servers/2d20c8be-04a9-4c79-aa0a-138a79fe50cd" status: 200 len: 1522 microversion: 2.1 time: 0.152823 Dec 15 03:04:10.650134 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: [pid: 116156|app: 0|req: 83/152] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 03:04:10 2021] GET /compute/v2.1/servers/2d20c8be-04a9-4c79-aa0a-138a79fe50cd => generated 1522 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 03:04:11.667491 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi [None req-b4e818f6-66bc-4344-888f-87fc84bfa076 tempest-ServerRescueNegativeTestJSON-2061875223 tempest-ServerRescueNegativeTestJSON-2061875223-project] Calling method '>' {{(pid=116157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:04:11.668089 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.compute.api [None req-b4e818f6-66bc-4344-888f-87fc84bfa076 tempest-ServerRescueNegativeTestJSON-2061875223 tempest-ServerRescueNegativeTestJSON-2061875223-project] [instance: 2d20c8be-04a9-4c79-aa0a-138a79fe50cd] Fetching instance by UUID {{(pid=116157) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:04:11.674732 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-b4e818f6-66bc-4344-888f-87fc84bfa076 tempest-ServerRescueNegativeTestJSON-2061875223 tempest-ServerRescueNegativeTestJSON-2061875223-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:04:11.675197 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-b4e818f6-66bc-4344-888f-87fc84bfa076 tempest-ServerRescueNegativeTestJSON-2061875223 tempest-ServerRescueNegativeTestJSON-2061875223-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:04:11.675945 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-b4e818f6-66bc-4344-888f-87fc84bfa076 tempest-ServerRescueNegativeTestJSON-2061875223 tempest-ServerRescueNegativeTestJSON-2061875223-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:04:11.676377 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-b4e818f6-66bc-4344-888f-87fc84bfa076 tempest-ServerRescueNegativeTestJSON-2061875223 tempest-ServerRescueNegativeTestJSON-2061875223-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:04:11.803316 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.policy [None req-b4e818f6-66bc-4344-888f-87fc84bfa076 tempest-ServerRescueNegativeTestJSON-2061875223 tempest-ServerRescueNegativeTestJSON-2061875223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ea02b6e8f1548a1bd78952cb7337403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5e8a958d4bf43868502b13728b9583b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116157) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:04:11.810535 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: INFO nova.api.openstack.requestlog [None req-b4e818f6-66bc-4344-888f-87fc84bfa076 tempest-ServerRescueNegativeTestJSON-2061875223 tempest-ServerRescueNegativeTestJSON-2061875223-project] 10.222.0.18 "GET /compute/v2.1/servers/2d20c8be-04a9-4c79-aa0a-138a79fe50cd" status: 200 len: 1522 microversion: 2.1 time: 0.146676 Dec 15 03:04:11.811100 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: [pid: 116157|app: 0|req: 70/153] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 03:04:11 2021] GET /compute/v2.1/servers/2d20c8be-04a9-4c79-aa0a-138a79fe50cd => generated 1522 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 03:04:12.827248 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi [None req-1c3733f4-3c1b-4cae-ad2c-8a219292dd26 tempest-ServerRescueNegativeTestJSON-2061875223 tempest-ServerRescueNegativeTestJSON-2061875223-project] Calling method '>' {{(pid=116156) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:04:12.827868 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.compute.api [None req-1c3733f4-3c1b-4cae-ad2c-8a219292dd26 tempest-ServerRescueNegativeTestJSON-2061875223 tempest-ServerRescueNegativeTestJSON-2061875223-project] [instance: 2d20c8be-04a9-4c79-aa0a-138a79fe50cd] Fetching instance by UUID {{(pid=116156) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:04:12.834510 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-1c3733f4-3c1b-4cae-ad2c-8a219292dd26 tempest-ServerRescueNegativeTestJSON-2061875223 tempest-ServerRescueNegativeTestJSON-2061875223-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:04:12.834947 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-1c3733f4-3c1b-4cae-ad2c-8a219292dd26 tempest-ServerRescueNegativeTestJSON-2061875223 tempest-ServerRescueNegativeTestJSON-2061875223-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:04:12.835713 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-1c3733f4-3c1b-4cae-ad2c-8a219292dd26 tempest-ServerRescueNegativeTestJSON-2061875223 tempest-ServerRescueNegativeTestJSON-2061875223-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:04:12.836141 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-1c3733f4-3c1b-4cae-ad2c-8a219292dd26 tempest-ServerRescueNegativeTestJSON-2061875223 tempest-ServerRescueNegativeTestJSON-2061875223-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:04:12.970528 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.policy [None req-1c3733f4-3c1b-4cae-ad2c-8a219292dd26 tempest-ServerRescueNegativeTestJSON-2061875223 tempest-ServerRescueNegativeTestJSON-2061875223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ea02b6e8f1548a1bd78952cb7337403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5e8a958d4bf43868502b13728b9583b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116156) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:04:12.977811 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: INFO nova.api.openstack.requestlog [None req-1c3733f4-3c1b-4cae-ad2c-8a219292dd26 tempest-ServerRescueNegativeTestJSON-2061875223 tempest-ServerRescueNegativeTestJSON-2061875223-project] 10.222.0.18 "GET /compute/v2.1/servers/2d20c8be-04a9-4c79-aa0a-138a79fe50cd" status: 200 len: 1522 microversion: 2.1 time: 0.154219 Dec 15 03:04:12.978412 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: [pid: 116156|app: 0|req: 84/154] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 03:04:12 2021] GET /compute/v2.1/servers/2d20c8be-04a9-4c79-aa0a-138a79fe50cd => generated 1522 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 03:04:13.995804 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi [None req-88c41228-1663-404e-8655-c3db17dac7f5 tempest-ServerRescueNegativeTestJSON-2061875223 tempest-ServerRescueNegativeTestJSON-2061875223-project] Calling method '>' {{(pid=116157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:04:13.996474 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.compute.api [None req-88c41228-1663-404e-8655-c3db17dac7f5 tempest-ServerRescueNegativeTestJSON-2061875223 tempest-ServerRescueNegativeTestJSON-2061875223-project] [instance: 2d20c8be-04a9-4c79-aa0a-138a79fe50cd] Fetching instance by UUID {{(pid=116157) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:04:14.002693 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-88c41228-1663-404e-8655-c3db17dac7f5 tempest-ServerRescueNegativeTestJSON-2061875223 tempest-ServerRescueNegativeTestJSON-2061875223-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:04:14.003146 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-88c41228-1663-404e-8655-c3db17dac7f5 tempest-ServerRescueNegativeTestJSON-2061875223 tempest-ServerRescueNegativeTestJSON-2061875223-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:04:14.003930 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-88c41228-1663-404e-8655-c3db17dac7f5 tempest-ServerRescueNegativeTestJSON-2061875223 tempest-ServerRescueNegativeTestJSON-2061875223-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:04:14.004363 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-88c41228-1663-404e-8655-c3db17dac7f5 tempest-ServerRescueNegativeTestJSON-2061875223 tempest-ServerRescueNegativeTestJSON-2061875223-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:04:14.138563 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.policy [None req-88c41228-1663-404e-8655-c3db17dac7f5 tempest-ServerRescueNegativeTestJSON-2061875223 tempest-ServerRescueNegativeTestJSON-2061875223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ea02b6e8f1548a1bd78952cb7337403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5e8a958d4bf43868502b13728b9583b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116157) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:04:14.146406 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: INFO nova.api.openstack.requestlog [None req-88c41228-1663-404e-8655-c3db17dac7f5 tempest-ServerRescueNegativeTestJSON-2061875223 tempest-ServerRescueNegativeTestJSON-2061875223-project] 10.222.0.18 "GET /compute/v2.1/servers/2d20c8be-04a9-4c79-aa0a-138a79fe50cd" status: 200 len: 1522 microversion: 2.1 time: 0.154841 Dec 15 03:04:14.147075 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: [pid: 116157|app: 0|req: 71/155] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 03:04:13 2021] GET /compute/v2.1/servers/2d20c8be-04a9-4c79-aa0a-138a79fe50cd => generated 1522 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 03:04:15.163271 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi [None req-06f1900b-f5e4-499f-af3a-8b24bcc66290 tempest-ServerRescueNegativeTestJSON-2061875223 tempest-ServerRescueNegativeTestJSON-2061875223-project] Calling method '>' {{(pid=116156) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:04:15.163880 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.compute.api [None req-06f1900b-f5e4-499f-af3a-8b24bcc66290 tempest-ServerRescueNegativeTestJSON-2061875223 tempest-ServerRescueNegativeTestJSON-2061875223-project] [instance: 2d20c8be-04a9-4c79-aa0a-138a79fe50cd] Fetching instance by UUID {{(pid=116156) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:04:15.169729 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-06f1900b-f5e4-499f-af3a-8b24bcc66290 tempest-ServerRescueNegativeTestJSON-2061875223 tempest-ServerRescueNegativeTestJSON-2061875223-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:04:15.170229 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-06f1900b-f5e4-499f-af3a-8b24bcc66290 tempest-ServerRescueNegativeTestJSON-2061875223 tempest-ServerRescueNegativeTestJSON-2061875223-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:04:15.171022 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-06f1900b-f5e4-499f-af3a-8b24bcc66290 tempest-ServerRescueNegativeTestJSON-2061875223 tempest-ServerRescueNegativeTestJSON-2061875223-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:04:15.171488 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-06f1900b-f5e4-499f-af3a-8b24bcc66290 tempest-ServerRescueNegativeTestJSON-2061875223 tempest-ServerRescueNegativeTestJSON-2061875223-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:04:15.326549 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.policy [None req-06f1900b-f5e4-499f-af3a-8b24bcc66290 tempest-ServerRescueNegativeTestJSON-2061875223 tempest-ServerRescueNegativeTestJSON-2061875223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ea02b6e8f1548a1bd78952cb7337403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5e8a958d4bf43868502b13728b9583b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116156) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:04:15.334358 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: INFO nova.api.openstack.requestlog [None req-06f1900b-f5e4-499f-af3a-8b24bcc66290 tempest-ServerRescueNegativeTestJSON-2061875223 tempest-ServerRescueNegativeTestJSON-2061875223-project] 10.222.0.18 "GET /compute/v2.1/servers/2d20c8be-04a9-4c79-aa0a-138a79fe50cd" status: 200 len: 1522 microversion: 2.1 time: 0.174744 Dec 15 03:04:15.334927 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: [pid: 116156|app: 0|req: 85/156] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 03:04:15 2021] GET /compute/v2.1/servers/2d20c8be-04a9-4c79-aa0a-138a79fe50cd => generated 1522 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 03:04:16.351895 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi [None req-59d1d5c7-760b-4ec5-98db-69f6e944030d tempest-ServerRescueNegativeTestJSON-2061875223 tempest-ServerRescueNegativeTestJSON-2061875223-project] Calling method '>' {{(pid=116157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:04:16.352508 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.compute.api [None req-59d1d5c7-760b-4ec5-98db-69f6e944030d tempest-ServerRescueNegativeTestJSON-2061875223 tempest-ServerRescueNegativeTestJSON-2061875223-project] [instance: 2d20c8be-04a9-4c79-aa0a-138a79fe50cd] Fetching instance by UUID {{(pid=116157) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:04:16.358634 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-59d1d5c7-760b-4ec5-98db-69f6e944030d tempest-ServerRescueNegativeTestJSON-2061875223 tempest-ServerRescueNegativeTestJSON-2061875223-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:04:16.359088 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-59d1d5c7-760b-4ec5-98db-69f6e944030d tempest-ServerRescueNegativeTestJSON-2061875223 tempest-ServerRescueNegativeTestJSON-2061875223-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:04:16.360493 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-59d1d5c7-760b-4ec5-98db-69f6e944030d tempest-ServerRescueNegativeTestJSON-2061875223 tempest-ServerRescueNegativeTestJSON-2061875223-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:04:16.360937 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-59d1d5c7-760b-4ec5-98db-69f6e944030d tempest-ServerRescueNegativeTestJSON-2061875223 tempest-ServerRescueNegativeTestJSON-2061875223-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:04:16.491003 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.policy [None req-59d1d5c7-760b-4ec5-98db-69f6e944030d tempest-ServerRescueNegativeTestJSON-2061875223 tempest-ServerRescueNegativeTestJSON-2061875223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ea02b6e8f1548a1bd78952cb7337403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5e8a958d4bf43868502b13728b9583b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116157) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:04:16.498550 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: INFO nova.api.openstack.requestlog [None req-59d1d5c7-760b-4ec5-98db-69f6e944030d tempest-ServerRescueNegativeTestJSON-2061875223 tempest-ServerRescueNegativeTestJSON-2061875223-project] 10.222.0.18 "GET /compute/v2.1/servers/2d20c8be-04a9-4c79-aa0a-138a79fe50cd" status: 200 len: 1522 microversion: 2.1 time: 0.150216 Dec 15 03:04:16.499200 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: [pid: 116157|app: 0|req: 72/157] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 03:04:16 2021] GET /compute/v2.1/servers/2d20c8be-04a9-4c79-aa0a-138a79fe50cd => generated 1522 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 03:04:17.515482 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi [None req-5cda22e5-7146-4b78-afe2-66e78fe7c2e9 tempest-ServerRescueNegativeTestJSON-2061875223 tempest-ServerRescueNegativeTestJSON-2061875223-project] Calling method '>' {{(pid=116156) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:04:17.516105 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.compute.api [None req-5cda22e5-7146-4b78-afe2-66e78fe7c2e9 tempest-ServerRescueNegativeTestJSON-2061875223 tempest-ServerRescueNegativeTestJSON-2061875223-project] [instance: 2d20c8be-04a9-4c79-aa0a-138a79fe50cd] Fetching instance by UUID {{(pid=116156) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:04:17.522449 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-5cda22e5-7146-4b78-afe2-66e78fe7c2e9 tempest-ServerRescueNegativeTestJSON-2061875223 tempest-ServerRescueNegativeTestJSON-2061875223-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:04:17.522920 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-5cda22e5-7146-4b78-afe2-66e78fe7c2e9 tempest-ServerRescueNegativeTestJSON-2061875223 tempest-ServerRescueNegativeTestJSON-2061875223-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:04:17.523716 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-5cda22e5-7146-4b78-afe2-66e78fe7c2e9 tempest-ServerRescueNegativeTestJSON-2061875223 tempest-ServerRescueNegativeTestJSON-2061875223-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:04:17.524142 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-5cda22e5-7146-4b78-afe2-66e78fe7c2e9 tempest-ServerRescueNegativeTestJSON-2061875223 tempest-ServerRescueNegativeTestJSON-2061875223-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:04:17.664427 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.policy [None req-5cda22e5-7146-4b78-afe2-66e78fe7c2e9 tempest-ServerRescueNegativeTestJSON-2061875223 tempest-ServerRescueNegativeTestJSON-2061875223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ea02b6e8f1548a1bd78952cb7337403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5e8a958d4bf43868502b13728b9583b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116156) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:04:17.671610 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: INFO nova.api.openstack.requestlog [None req-5cda22e5-7146-4b78-afe2-66e78fe7c2e9 tempest-ServerRescueNegativeTestJSON-2061875223 tempest-ServerRescueNegativeTestJSON-2061875223-project] 10.222.0.18 "GET /compute/v2.1/servers/2d20c8be-04a9-4c79-aa0a-138a79fe50cd" status: 200 len: 1522 microversion: 2.1 time: 0.159797 Dec 15 03:04:17.672690 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: [pid: 116156|app: 0|req: 86/158] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 03:04:17 2021] GET /compute/v2.1/servers/2d20c8be-04a9-4c79-aa0a-138a79fe50cd => generated 1522 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 03:04:18.689110 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi [None req-b7cb6f38-6fc6-4743-9a03-c238c0146f29 tempest-ServerRescueNegativeTestJSON-2061875223 tempest-ServerRescueNegativeTestJSON-2061875223-project] Calling method '>' {{(pid=116157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:04:18.689863 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.compute.api [None req-b7cb6f38-6fc6-4743-9a03-c238c0146f29 tempest-ServerRescueNegativeTestJSON-2061875223 tempest-ServerRescueNegativeTestJSON-2061875223-project] [instance: 2d20c8be-04a9-4c79-aa0a-138a79fe50cd] Fetching instance by UUID {{(pid=116157) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:04:18.696953 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-b7cb6f38-6fc6-4743-9a03-c238c0146f29 tempest-ServerRescueNegativeTestJSON-2061875223 tempest-ServerRescueNegativeTestJSON-2061875223-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:04:18.697516 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-b7cb6f38-6fc6-4743-9a03-c238c0146f29 tempest-ServerRescueNegativeTestJSON-2061875223 tempest-ServerRescueNegativeTestJSON-2061875223-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:04:18.698504 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-b7cb6f38-6fc6-4743-9a03-c238c0146f29 tempest-ServerRescueNegativeTestJSON-2061875223 tempest-ServerRescueNegativeTestJSON-2061875223-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:04:18.699053 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-b7cb6f38-6fc6-4743-9a03-c238c0146f29 tempest-ServerRescueNegativeTestJSON-2061875223 tempest-ServerRescueNegativeTestJSON-2061875223-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:04:18.847083 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.policy [None req-b7cb6f38-6fc6-4743-9a03-c238c0146f29 tempest-ServerRescueNegativeTestJSON-2061875223 tempest-ServerRescueNegativeTestJSON-2061875223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ea02b6e8f1548a1bd78952cb7337403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5e8a958d4bf43868502b13728b9583b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116157) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:04:18.855130 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: INFO nova.api.openstack.requestlog [None req-b7cb6f38-6fc6-4743-9a03-c238c0146f29 tempest-ServerRescueNegativeTestJSON-2061875223 tempest-ServerRescueNegativeTestJSON-2061875223-project] 10.222.0.18 "GET /compute/v2.1/servers/2d20c8be-04a9-4c79-aa0a-138a79fe50cd" status: 200 len: 1522 microversion: 2.1 time: 0.169704 Dec 15 03:04:18.855805 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: [pid: 116157|app: 0|req: 73/159] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 03:04:18 2021] GET /compute/v2.1/servers/2d20c8be-04a9-4c79-aa0a-138a79fe50cd => generated 1522 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 03:04:19.208667 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi [None req-4f12e5d4-dbcc-481b-baf0-727b2b4643be tempest-DeleteServersTestJSON-268050555 tempest-DeleteServersTestJSON-268050555-project] Calling method '>' {{(pid=116156) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:04:19.209754 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.compute.api [None req-4f12e5d4-dbcc-481b-baf0-727b2b4643be tempest-DeleteServersTestJSON-268050555 tempest-DeleteServersTestJSON-268050555-project] [instance: 5a01bf2d-c341-4af1-b2b2-e1f05e46705f] Fetching instance by UUID {{(pid=116156) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:04:19.218748 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-4f12e5d4-dbcc-481b-baf0-727b2b4643be tempest-DeleteServersTestJSON-268050555 tempest-DeleteServersTestJSON-268050555-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:04:19.219653 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-4f12e5d4-dbcc-481b-baf0-727b2b4643be tempest-DeleteServersTestJSON-268050555 tempest-DeleteServersTestJSON-268050555-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:04:19.221029 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-4f12e5d4-dbcc-481b-baf0-727b2b4643be tempest-DeleteServersTestJSON-268050555 tempest-DeleteServersTestJSON-268050555-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:04:19.221689 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-4f12e5d4-dbcc-481b-baf0-727b2b4643be tempest-DeleteServersTestJSON-268050555 tempest-DeleteServersTestJSON-268050555-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:04:19.249214 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.compute.api [None req-4f12e5d4-dbcc-481b-baf0-727b2b4643be tempest-DeleteServersTestJSON-268050555 tempest-DeleteServersTestJSON-268050555-project] [instance: 5a01bf2d-c341-4af1-b2b2-e1f05e46705f] Going to try to terminate instance {{(pid=116156) delete /opt/stack/nova/nova/compute/api.py:2614}} Dec 15 03:04:19.424715 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: INFO nova.api.openstack.requestlog [None req-4f12e5d4-dbcc-481b-baf0-727b2b4643be tempest-DeleteServersTestJSON-268050555 tempest-DeleteServersTestJSON-268050555-project] 10.222.0.18 "DELETE /compute/v2.1/servers/5a01bf2d-c341-4af1-b2b2-e1f05e46705f" status: 204 len: 0 microversion: 2.1 time: 0.219407 Dec 15 03:04:19.425307 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: [pid: 116156|app: 0|req: 87/160] 10.222.0.18 () {58 vars in 1238 bytes} [Wed Dec 15 03:04:19 2021] DELETE /compute/v2.1/servers/5a01bf2d-c341-4af1-b2b2-e1f05e46705f => generated 0 bytes in 221 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Dec 15 03:04:19.433464 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi [None req-50a7f041-ed4d-483c-817f-e210532e9b3f tempest-DeleteServersTestJSON-268050555 tempest-DeleteServersTestJSON-268050555-project] Calling method '>' {{(pid=116157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:04:19.434117 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.compute.api [None req-50a7f041-ed4d-483c-817f-e210532e9b3f tempest-DeleteServersTestJSON-268050555 tempest-DeleteServersTestJSON-268050555-project] [instance: 5a01bf2d-c341-4af1-b2b2-e1f05e46705f] Fetching instance by UUID {{(pid=116157) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:04:19.440511 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-50a7f041-ed4d-483c-817f-e210532e9b3f tempest-DeleteServersTestJSON-268050555 tempest-DeleteServersTestJSON-268050555-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:04:19.441046 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-50a7f041-ed4d-483c-817f-e210532e9b3f tempest-DeleteServersTestJSON-268050555 tempest-DeleteServersTestJSON-268050555-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:04:19.442021 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-50a7f041-ed4d-483c-817f-e210532e9b3f tempest-DeleteServersTestJSON-268050555 tempest-DeleteServersTestJSON-268050555-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:04:19.443471 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-50a7f041-ed4d-483c-817f-e210532e9b3f tempest-DeleteServersTestJSON-268050555 tempest-DeleteServersTestJSON-268050555-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:04:19.653553 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.policy [None req-50a7f041-ed4d-483c-817f-e210532e9b3f tempest-DeleteServersTestJSON-268050555 tempest-DeleteServersTestJSON-268050555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28384f466c3541358ecea856650f008c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb933fa80ed94ce5b6828e48e86a21c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116157) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:04:19.664725 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: INFO nova.api.openstack.requestlog [None req-50a7f041-ed4d-483c-817f-e210532e9b3f tempest-DeleteServersTestJSON-268050555 tempest-DeleteServersTestJSON-268050555-project] 10.222.0.18 "GET /compute/v2.1/servers/5a01bf2d-c341-4af1-b2b2-e1f05e46705f" status: 200 len: 1554 microversion: 2.1 time: 0.235075 Dec 15 03:04:19.670103 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: [pid: 116157|app: 0|req: 74/161] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 03:04:19 2021] GET /compute/v2.1/servers/5a01bf2d-c341-4af1-b2b2-e1f05e46705f => generated 1554 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 03:04:19.873154 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi [None req-229d2bcb-42cf-423a-9cbd-5602a0828125 tempest-ServerRescueNegativeTestJSON-2061875223 tempest-ServerRescueNegativeTestJSON-2061875223-project] Calling method '>' {{(pid=116156) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:04:19.873846 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.compute.api [None req-229d2bcb-42cf-423a-9cbd-5602a0828125 tempest-ServerRescueNegativeTestJSON-2061875223 tempest-ServerRescueNegativeTestJSON-2061875223-project] [instance: 2d20c8be-04a9-4c79-aa0a-138a79fe50cd] Fetching instance by UUID {{(pid=116156) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:04:19.879693 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-229d2bcb-42cf-423a-9cbd-5602a0828125 tempest-ServerRescueNegativeTestJSON-2061875223 tempest-ServerRescueNegativeTestJSON-2061875223-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:04:19.880138 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-229d2bcb-42cf-423a-9cbd-5602a0828125 tempest-ServerRescueNegativeTestJSON-2061875223 tempest-ServerRescueNegativeTestJSON-2061875223-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:04:19.880942 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-229d2bcb-42cf-423a-9cbd-5602a0828125 tempest-ServerRescueNegativeTestJSON-2061875223 tempest-ServerRescueNegativeTestJSON-2061875223-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:04:19.881368 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-229d2bcb-42cf-423a-9cbd-5602a0828125 tempest-ServerRescueNegativeTestJSON-2061875223 tempest-ServerRescueNegativeTestJSON-2061875223-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:04:20.020272 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.policy [None req-229d2bcb-42cf-423a-9cbd-5602a0828125 tempest-ServerRescueNegativeTestJSON-2061875223 tempest-ServerRescueNegativeTestJSON-2061875223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ea02b6e8f1548a1bd78952cb7337403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5e8a958d4bf43868502b13728b9583b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116156) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:04:20.028327 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: INFO nova.api.openstack.requestlog [None req-229d2bcb-42cf-423a-9cbd-5602a0828125 tempest-ServerRescueNegativeTestJSON-2061875223 tempest-ServerRescueNegativeTestJSON-2061875223-project] 10.222.0.18 "GET /compute/v2.1/servers/2d20c8be-04a9-4c79-aa0a-138a79fe50cd" status: 200 len: 1522 microversion: 2.1 time: 0.159530 Dec 15 03:04:20.028891 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: [pid: 116156|app: 0|req: 88/162] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 03:04:19 2021] GET /compute/v2.1/servers/2d20c8be-04a9-4c79-aa0a-138a79fe50cd => generated 1522 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 03:04:20.687482 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi [None req-f7bbfba5-4dda-46e9-b7d6-f2b57c17377f tempest-DeleteServersTestJSON-268050555 tempest-DeleteServersTestJSON-268050555-project] Calling method '>' {{(pid=116157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:04:20.688081 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.compute.api [None req-f7bbfba5-4dda-46e9-b7d6-f2b57c17377f tempest-DeleteServersTestJSON-268050555 tempest-DeleteServersTestJSON-268050555-project] [instance: 5a01bf2d-c341-4af1-b2b2-e1f05e46705f] Fetching instance by UUID {{(pid=116157) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:04:20.694449 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-f7bbfba5-4dda-46e9-b7d6-f2b57c17377f tempest-DeleteServersTestJSON-268050555 tempest-DeleteServersTestJSON-268050555-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:04:20.694896 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-f7bbfba5-4dda-46e9-b7d6-f2b57c17377f tempest-DeleteServersTestJSON-268050555 tempest-DeleteServersTestJSON-268050555-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:04:20.696044 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-f7bbfba5-4dda-46e9-b7d6-f2b57c17377f tempest-DeleteServersTestJSON-268050555 tempest-DeleteServersTestJSON-268050555-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:04:20.696482 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-f7bbfba5-4dda-46e9-b7d6-f2b57c17377f tempest-DeleteServersTestJSON-268050555 tempest-DeleteServersTestJSON-268050555-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:04:20.841960 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.policy [None req-f7bbfba5-4dda-46e9-b7d6-f2b57c17377f tempest-DeleteServersTestJSON-268050555 tempest-DeleteServersTestJSON-268050555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28384f466c3541358ecea856650f008c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb933fa80ed94ce5b6828e48e86a21c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116157) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:04:20.850390 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: INFO nova.api.openstack.requestlog [None req-f7bbfba5-4dda-46e9-b7d6-f2b57c17377f tempest-DeleteServersTestJSON-268050555 tempest-DeleteServersTestJSON-268050555-project] 10.222.0.18 "GET /compute/v2.1/servers/5a01bf2d-c341-4af1-b2b2-e1f05e46705f" status: 200 len: 1554 microversion: 2.1 time: 0.166524 Dec 15 03:04:20.851144 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: [pid: 116157|app: 0|req: 75/163] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 03:04:20 2021] GET /compute/v2.1/servers/5a01bf2d-c341-4af1-b2b2-e1f05e46705f => generated 1554 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 03:04:21.045794 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi [None req-acf0ad8e-9e48-42ee-8846-b6965629e4e9 tempest-ServerRescueNegativeTestJSON-2061875223 tempest-ServerRescueNegativeTestJSON-2061875223-project] Calling method '>' {{(pid=116156) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:04:21.046432 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.compute.api [None req-acf0ad8e-9e48-42ee-8846-b6965629e4e9 tempest-ServerRescueNegativeTestJSON-2061875223 tempest-ServerRescueNegativeTestJSON-2061875223-project] [instance: 2d20c8be-04a9-4c79-aa0a-138a79fe50cd] Fetching instance by UUID {{(pid=116156) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:04:21.052955 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-acf0ad8e-9e48-42ee-8846-b6965629e4e9 tempest-ServerRescueNegativeTestJSON-2061875223 tempest-ServerRescueNegativeTestJSON-2061875223-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:04:21.053404 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-acf0ad8e-9e48-42ee-8846-b6965629e4e9 tempest-ServerRescueNegativeTestJSON-2061875223 tempest-ServerRescueNegativeTestJSON-2061875223-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:04:21.054457 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-acf0ad8e-9e48-42ee-8846-b6965629e4e9 tempest-ServerRescueNegativeTestJSON-2061875223 tempest-ServerRescueNegativeTestJSON-2061875223-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:04:21.054775 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-acf0ad8e-9e48-42ee-8846-b6965629e4e9 tempest-ServerRescueNegativeTestJSON-2061875223 tempest-ServerRescueNegativeTestJSON-2061875223-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:04:21.199010 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.policy [None req-acf0ad8e-9e48-42ee-8846-b6965629e4e9 tempest-ServerRescueNegativeTestJSON-2061875223 tempest-ServerRescueNegativeTestJSON-2061875223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ea02b6e8f1548a1bd78952cb7337403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5e8a958d4bf43868502b13728b9583b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116156) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:04:21.207012 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: INFO nova.api.openstack.requestlog [None req-acf0ad8e-9e48-42ee-8846-b6965629e4e9 tempest-ServerRescueNegativeTestJSON-2061875223 tempest-ServerRescueNegativeTestJSON-2061875223-project] 10.222.0.18 "GET /compute/v2.1/servers/2d20c8be-04a9-4c79-aa0a-138a79fe50cd" status: 200 len: 1522 microversion: 2.1 time: 0.164824 Dec 15 03:04:21.207586 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: [pid: 116156|app: 0|req: 89/164] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 03:04:21 2021] GET /compute/v2.1/servers/2d20c8be-04a9-4c79-aa0a-138a79fe50cd => generated 1522 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 03:04:21.867804 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi [None req-b02f35e7-a6c0-4c25-818a-156ee66648d4 tempest-DeleteServersTestJSON-268050555 tempest-DeleteServersTestJSON-268050555-project] Calling method '>' {{(pid=116157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:04:21.868411 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.compute.api [None req-b02f35e7-a6c0-4c25-818a-156ee66648d4 tempest-DeleteServersTestJSON-268050555 tempest-DeleteServersTestJSON-268050555-project] [instance: 5a01bf2d-c341-4af1-b2b2-e1f05e46705f] Fetching instance by UUID {{(pid=116157) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:04:21.875571 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-b02f35e7-a6c0-4c25-818a-156ee66648d4 tempest-DeleteServersTestJSON-268050555 tempest-DeleteServersTestJSON-268050555-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:04:21.876032 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-b02f35e7-a6c0-4c25-818a-156ee66648d4 tempest-DeleteServersTestJSON-268050555 tempest-DeleteServersTestJSON-268050555-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:04:21.876854 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-b02f35e7-a6c0-4c25-818a-156ee66648d4 tempest-DeleteServersTestJSON-268050555 tempest-DeleteServersTestJSON-268050555-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:04:21.877291 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-b02f35e7-a6c0-4c25-818a-156ee66648d4 tempest-DeleteServersTestJSON-268050555 tempest-DeleteServersTestJSON-268050555-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:04:22.009126 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.policy [None req-b02f35e7-a6c0-4c25-818a-156ee66648d4 tempest-DeleteServersTestJSON-268050555 tempest-DeleteServersTestJSON-268050555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28384f466c3541358ecea856650f008c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb933fa80ed94ce5b6828e48e86a21c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116157) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:04:22.017516 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: INFO nova.api.openstack.requestlog [None req-b02f35e7-a6c0-4c25-818a-156ee66648d4 tempest-DeleteServersTestJSON-268050555 tempest-DeleteServersTestJSON-268050555-project] 10.222.0.18 "GET /compute/v2.1/servers/5a01bf2d-c341-4af1-b2b2-e1f05e46705f" status: 200 len: 1554 microversion: 2.1 time: 0.152844 Dec 15 03:04:22.018200 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: [pid: 116157|app: 0|req: 76/165] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 03:04:21 2021] GET /compute/v2.1/servers/5a01bf2d-c341-4af1-b2b2-e1f05e46705f => generated 1554 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 03:04:22.226936 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi [None req-99a34568-da17-44cb-882e-f3e2c224acdc tempest-ServerRescueNegativeTestJSON-2061875223 tempest-ServerRescueNegativeTestJSON-2061875223-project] Calling method '>' {{(pid=116156) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:04:22.229523 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.compute.api [None req-99a34568-da17-44cb-882e-f3e2c224acdc tempest-ServerRescueNegativeTestJSON-2061875223 tempest-ServerRescueNegativeTestJSON-2061875223-project] [instance: 2d20c8be-04a9-4c79-aa0a-138a79fe50cd] Fetching instance by UUID {{(pid=116156) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:04:22.236689 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-99a34568-da17-44cb-882e-f3e2c224acdc tempest-ServerRescueNegativeTestJSON-2061875223 tempest-ServerRescueNegativeTestJSON-2061875223-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:04:22.237545 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-99a34568-da17-44cb-882e-f3e2c224acdc tempest-ServerRescueNegativeTestJSON-2061875223 tempest-ServerRescueNegativeTestJSON-2061875223-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:04:22.238368 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-99a34568-da17-44cb-882e-f3e2c224acdc tempest-ServerRescueNegativeTestJSON-2061875223 tempest-ServerRescueNegativeTestJSON-2061875223-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:04:22.238955 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-99a34568-da17-44cb-882e-f3e2c224acdc tempest-ServerRescueNegativeTestJSON-2061875223 tempest-ServerRescueNegativeTestJSON-2061875223-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:04:22.430443 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.policy [None req-99a34568-da17-44cb-882e-f3e2c224acdc tempest-ServerRescueNegativeTestJSON-2061875223 tempest-ServerRescueNegativeTestJSON-2061875223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ea02b6e8f1548a1bd78952cb7337403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5e8a958d4bf43868502b13728b9583b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116156) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:04:22.439963 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: INFO nova.api.openstack.requestlog [None req-99a34568-da17-44cb-882e-f3e2c224acdc tempest-ServerRescueNegativeTestJSON-2061875223 tempest-ServerRescueNegativeTestJSON-2061875223-project] 10.222.0.18 "GET /compute/v2.1/servers/2d20c8be-04a9-4c79-aa0a-138a79fe50cd" status: 200 len: 1522 microversion: 2.1 time: 0.218247 Dec 15 03:04:22.441513 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: [pid: 116156|app: 0|req: 90/166] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 03:04:22 2021] GET /compute/v2.1/servers/2d20c8be-04a9-4c79-aa0a-138a79fe50cd => generated 1522 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 03:04:23.035539 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi [None req-bb3b18be-850f-445f-b349-7bcfb4dd8a92 tempest-DeleteServersTestJSON-268050555 tempest-DeleteServersTestJSON-268050555-project] Calling method '>' {{(pid=116157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:04:23.036148 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.compute.api [None req-bb3b18be-850f-445f-b349-7bcfb4dd8a92 tempest-DeleteServersTestJSON-268050555 tempest-DeleteServersTestJSON-268050555-project] [instance: 5a01bf2d-c341-4af1-b2b2-e1f05e46705f] Fetching instance by UUID {{(pid=116157) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:04:23.046327 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-bb3b18be-850f-445f-b349-7bcfb4dd8a92 tempest-DeleteServersTestJSON-268050555 tempest-DeleteServersTestJSON-268050555-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:04:23.046802 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-bb3b18be-850f-445f-b349-7bcfb4dd8a92 tempest-DeleteServersTestJSON-268050555 tempest-DeleteServersTestJSON-268050555-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:04:23.048006 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-bb3b18be-850f-445f-b349-7bcfb4dd8a92 tempest-DeleteServersTestJSON-268050555 tempest-DeleteServersTestJSON-268050555-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:04:23.049228 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-bb3b18be-850f-445f-b349-7bcfb4dd8a92 tempest-DeleteServersTestJSON-268050555 tempest-DeleteServersTestJSON-268050555-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:04:23.293264 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.policy [None req-bb3b18be-850f-445f-b349-7bcfb4dd8a92 tempest-DeleteServersTestJSON-268050555 tempest-DeleteServersTestJSON-268050555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28384f466c3541358ecea856650f008c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb933fa80ed94ce5b6828e48e86a21c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116157) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:04:23.303909 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: INFO nova.api.openstack.requestlog [None req-bb3b18be-850f-445f-b349-7bcfb4dd8a92 tempest-DeleteServersTestJSON-268050555 tempest-DeleteServersTestJSON-268050555-project] 10.222.0.18 "GET /compute/v2.1/servers/5a01bf2d-c341-4af1-b2b2-e1f05e46705f" status: 200 len: 1512 microversion: 2.1 time: 0.273802 Dec 15 03:04:23.307347 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: [pid: 116157|app: 0|req: 77/167] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 03:04:23 2021] GET /compute/v2.1/servers/5a01bf2d-c341-4af1-b2b2-e1f05e46705f => generated 1512 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 03:04:23.319780 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi [req-3546f576-37bd-4af9-819c-f0f071c8146b req-5244672e-de83-4e19-8aad-c863aebbdc22 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5a01bf2d-c341-4af1-b2b2-e1f05e46705f", "name": "network-vif-deleted", "tag": "fe412742-6f13-4058-be01-92b028115500"}]} {{(pid=116156) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 03:04:23.322135 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 15 03:04:23.322135 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: warnings.warn(msg) Dec 15 03:04:23.330659 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [req-3546f576-37bd-4af9-819c-f0f071c8146b req-5244672e-de83-4e19-8aad-c863aebbdc22 service nova] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:04:23.331191 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [req-3546f576-37bd-4af9-819c-f0f071c8146b req-5244672e-de83-4e19-8aad-c863aebbdc22 service nova] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:04:23.342493 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: INFO nova.api.openstack.compute.server_external_events [req-3546f576-37bd-4af9-819c-f0f071c8146b req-5244672e-de83-4e19-8aad-c863aebbdc22 service nova] Creating event network-vif-deleted:fe412742-6f13-4058-be01-92b028115500 for instance 5a01bf2d-c341-4af1-b2b2-e1f05e46705f on hv-cinder-81803 Dec 15 03:04:23.347949 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: INFO nova.api.openstack.requestlog [req-3546f576-37bd-4af9-819c-f0f071c8146b req-5244672e-de83-4e19-8aad-c863aebbdc22 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035696 Dec 15 03:04:23.348599 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: [pid: 116156|app: 0|req: 91/168] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Dec 15 03:04:23 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 03:04:23.457552 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi [None req-3a4207bd-18dc-40e4-b2c6-abfb39426934 tempest-ServerRescueNegativeTestJSON-2061875223 tempest-ServerRescueNegativeTestJSON-2061875223-project] Calling method '>' {{(pid=116157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:04:23.458181 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.compute.api [None req-3a4207bd-18dc-40e4-b2c6-abfb39426934 tempest-ServerRescueNegativeTestJSON-2061875223 tempest-ServerRescueNegativeTestJSON-2061875223-project] [instance: 2d20c8be-04a9-4c79-aa0a-138a79fe50cd] Fetching instance by UUID {{(pid=116157) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:04:23.464832 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-3a4207bd-18dc-40e4-b2c6-abfb39426934 tempest-ServerRescueNegativeTestJSON-2061875223 tempest-ServerRescueNegativeTestJSON-2061875223-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:04:23.465401 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-3a4207bd-18dc-40e4-b2c6-abfb39426934 tempest-ServerRescueNegativeTestJSON-2061875223 tempest-ServerRescueNegativeTestJSON-2061875223-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:04:23.466793 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-3a4207bd-18dc-40e4-b2c6-abfb39426934 tempest-ServerRescueNegativeTestJSON-2061875223 tempest-ServerRescueNegativeTestJSON-2061875223-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:04:23.467247 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-3a4207bd-18dc-40e4-b2c6-abfb39426934 tempest-ServerRescueNegativeTestJSON-2061875223 tempest-ServerRescueNegativeTestJSON-2061875223-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:04:23.617028 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.policy [None req-3a4207bd-18dc-40e4-b2c6-abfb39426934 tempest-ServerRescueNegativeTestJSON-2061875223 tempest-ServerRescueNegativeTestJSON-2061875223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ea02b6e8f1548a1bd78952cb7337403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5e8a958d4bf43868502b13728b9583b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116157) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:04:23.624984 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: INFO nova.api.openstack.requestlog [None req-3a4207bd-18dc-40e4-b2c6-abfb39426934 tempest-ServerRescueNegativeTestJSON-2061875223 tempest-ServerRescueNegativeTestJSON-2061875223-project] 10.222.0.18 "GET /compute/v2.1/servers/2d20c8be-04a9-4c79-aa0a-138a79fe50cd" status: 200 len: 1522 microversion: 2.1 time: 0.171501 Dec 15 03:04:23.634530 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: [pid: 116157|app: 0|req: 78/169] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 03:04:23 2021] GET /compute/v2.1/servers/2d20c8be-04a9-4c79-aa0a-138a79fe50cd => generated 1522 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 03:04:24.325724 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi [None req-64e9987e-3be5-4e7e-9eee-0d88edc0c212 tempest-DeleteServersTestJSON-268050555 tempest-DeleteServersTestJSON-268050555-project] Calling method '>' {{(pid=116156) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:04:24.325724 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.compute.api [None req-64e9987e-3be5-4e7e-9eee-0d88edc0c212 tempest-DeleteServersTestJSON-268050555 tempest-DeleteServersTestJSON-268050555-project] [instance: 5a01bf2d-c341-4af1-b2b2-e1f05e46705f] Fetching instance by UUID {{(pid=116156) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:04:24.336100 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-64e9987e-3be5-4e7e-9eee-0d88edc0c212 tempest-DeleteServersTestJSON-268050555 tempest-DeleteServersTestJSON-268050555-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:04:24.336563 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-64e9987e-3be5-4e7e-9eee-0d88edc0c212 tempest-DeleteServersTestJSON-268050555 tempest-DeleteServersTestJSON-268050555-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:04:24.337730 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-64e9987e-3be5-4e7e-9eee-0d88edc0c212 tempest-DeleteServersTestJSON-268050555 tempest-DeleteServersTestJSON-268050555-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:04:24.338305 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-64e9987e-3be5-4e7e-9eee-0d88edc0c212 tempest-DeleteServersTestJSON-268050555 tempest-DeleteServersTestJSON-268050555-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:04:24.380577 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-64e9987e-3be5-4e7e-9eee-0d88edc0c212 tempest-DeleteServersTestJSON-268050555 tempest-DeleteServersTestJSON-268050555-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:04:24.380577 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-64e9987e-3be5-4e7e-9eee-0d88edc0c212 tempest-DeleteServersTestJSON-268050555 tempest-DeleteServersTestJSON-268050555-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:04:24.380577 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.objects.instance [None req-64e9987e-3be5-4e7e-9eee-0d88edc0c212 tempest-DeleteServersTestJSON-268050555 tempest-DeleteServersTestJSON-268050555-project] Lazy-loading 'fault' on Instance uuid 5a01bf2d-c341-4af1-b2b2-e1f05e46705f {{(pid=116156) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Dec 15 03:04:24.437372 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.policy [None req-64e9987e-3be5-4e7e-9eee-0d88edc0c212 tempest-DeleteServersTestJSON-268050555 tempest-DeleteServersTestJSON-268050555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28384f466c3541358ecea856650f008c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb933fa80ed94ce5b6828e48e86a21c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116156) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:04:24.446268 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: INFO nova.api.openstack.requestlog [None req-64e9987e-3be5-4e7e-9eee-0d88edc0c212 tempest-DeleteServersTestJSON-268050555 tempest-DeleteServersTestJSON-268050555-project] 10.222.0.18 "GET /compute/v2.1/servers/5a01bf2d-c341-4af1-b2b2-e1f05e46705f" status: 200 len: 1351 microversion: 2.1 time: 0.126185 Dec 15 03:04:24.447049 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: [pid: 116156|app: 0|req: 92/170] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 03:04:24 2021] GET /compute/v2.1/servers/5a01bf2d-c341-4af1-b2b2-e1f05e46705f => generated 1351 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 03:04:24.643218 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi [None req-5c858ac0-43b9-4d33-92cd-39445cf4be18 tempest-ServerRescueNegativeTestJSON-2061875223 tempest-ServerRescueNegativeTestJSON-2061875223-project] Calling method '>' {{(pid=116157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:04:24.643834 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.compute.api [None req-5c858ac0-43b9-4d33-92cd-39445cf4be18 tempest-ServerRescueNegativeTestJSON-2061875223 tempest-ServerRescueNegativeTestJSON-2061875223-project] [instance: 2d20c8be-04a9-4c79-aa0a-138a79fe50cd] Fetching instance by UUID {{(pid=116157) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:04:24.663569 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-5c858ac0-43b9-4d33-92cd-39445cf4be18 tempest-ServerRescueNegativeTestJSON-2061875223 tempest-ServerRescueNegativeTestJSON-2061875223-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:04:24.664021 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-5c858ac0-43b9-4d33-92cd-39445cf4be18 tempest-ServerRescueNegativeTestJSON-2061875223 tempest-ServerRescueNegativeTestJSON-2061875223-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:04:24.664816 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-5c858ac0-43b9-4d33-92cd-39445cf4be18 tempest-ServerRescueNegativeTestJSON-2061875223 tempest-ServerRescueNegativeTestJSON-2061875223-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:04:24.665325 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-5c858ac0-43b9-4d33-92cd-39445cf4be18 tempest-ServerRescueNegativeTestJSON-2061875223 tempest-ServerRescueNegativeTestJSON-2061875223-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:04:24.830379 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.policy [None req-5c858ac0-43b9-4d33-92cd-39445cf4be18 tempest-ServerRescueNegativeTestJSON-2061875223 tempest-ServerRescueNegativeTestJSON-2061875223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ea02b6e8f1548a1bd78952cb7337403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5e8a958d4bf43868502b13728b9583b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116157) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:04:24.837616 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: INFO nova.api.openstack.requestlog [None req-5c858ac0-43b9-4d33-92cd-39445cf4be18 tempest-ServerRescueNegativeTestJSON-2061875223 tempest-ServerRescueNegativeTestJSON-2061875223-project] 10.222.0.18 "GET /compute/v2.1/servers/2d20c8be-04a9-4c79-aa0a-138a79fe50cd" status: 200 len: 1522 microversion: 2.1 time: 0.199407 Dec 15 03:04:24.838380 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: [pid: 116157|app: 0|req: 79/171] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 03:04:24 2021] GET /compute/v2.1/servers/2d20c8be-04a9-4c79-aa0a-138a79fe50cd => generated 1522 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 03:04:25.464810 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi [None req-d379f1ac-070f-40fb-ae7f-fb3d20823b4c tempest-DeleteServersTestJSON-268050555 tempest-DeleteServersTestJSON-268050555-project] Calling method '>' {{(pid=116156) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:04:25.465581 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.compute.api [None req-d379f1ac-070f-40fb-ae7f-fb3d20823b4c tempest-DeleteServersTestJSON-268050555 tempest-DeleteServersTestJSON-268050555-project] [instance: 5a01bf2d-c341-4af1-b2b2-e1f05e46705f] Fetching instance by UUID {{(pid=116156) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:04:25.472160 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-d379f1ac-070f-40fb-ae7f-fb3d20823b4c tempest-DeleteServersTestJSON-268050555 tempest-DeleteServersTestJSON-268050555-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:04:25.472393 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-d379f1ac-070f-40fb-ae7f-fb3d20823b4c tempest-DeleteServersTestJSON-268050555 tempest-DeleteServersTestJSON-268050555-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:04:25.473190 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-d379f1ac-070f-40fb-ae7f-fb3d20823b4c tempest-DeleteServersTestJSON-268050555 tempest-DeleteServersTestJSON-268050555-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:04:25.473625 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-d379f1ac-070f-40fb-ae7f-fb3d20823b4c tempest-DeleteServersTestJSON-268050555 tempest-DeleteServersTestJSON-268050555-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:04:25.487889 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: INFO nova.api.openstack.wsgi [None req-d379f1ac-070f-40fb-ae7f-fb3d20823b4c tempest-DeleteServersTestJSON-268050555 tempest-DeleteServersTestJSON-268050555-project] HTTP exception thrown: Instance 5a01bf2d-c341-4af1-b2b2-e1f05e46705f could not be found. Dec 15 03:04:25.488493 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi [None req-d379f1ac-070f-40fb-ae7f-fb3d20823b4c tempest-DeleteServersTestJSON-268050555 tempest-DeleteServersTestJSON-268050555-project] Returning 404 to user: Instance 5a01bf2d-c341-4af1-b2b2-e1f05e46705f could not be found. {{(pid=116156) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 15 03:04:25.497309 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: INFO nova.api.openstack.requestlog [None req-d379f1ac-070f-40fb-ae7f-fb3d20823b4c tempest-DeleteServersTestJSON-268050555 tempest-DeleteServersTestJSON-268050555-project] 10.222.0.18 "GET /compute/v2.1/servers/5a01bf2d-c341-4af1-b2b2-e1f05e46705f" status: 404 len: 111 microversion: 2.1 time: 0.028798 Dec 15 03:04:25.497928 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: [pid: 116156|app: 0|req: 93/172] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 03:04:25 2021] GET /compute/v2.1/servers/5a01bf2d-c341-4af1-b2b2-e1f05e46705f => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 15 03:04:25.566351 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi [None req-ba7d5fe6-ae23-4256-b10e-6f16787c97f9 tempest-AttachVolumeNegativeTest-1640336653 tempest-AttachVolumeNegativeTest-1640336653-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-611837721", "imageRef": "5195b034-9fa4-468b-a94d-ef3ee79ce449", "flavorRef": "452", "networks": [{"uuid": "b0713a87-683c-42de-a9a0-98522d8ec589"}]}} {{(pid=116157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 03:04:25.614798 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi [None req-79bdcc74-8602-4ad8-89cf-cb974c5b275b tempest-DeleteServersTestJSON-268050555 tempest-DeleteServersTestJSON-268050555-project] Calling method '>' {{(pid=116156) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:04:25.615901 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.compute.api [None req-79bdcc74-8602-4ad8-89cf-cb974c5b275b tempest-DeleteServersTestJSON-268050555 tempest-DeleteServersTestJSON-268050555-project] [instance: 5a01bf2d-c341-4af1-b2b2-e1f05e46705f] Fetching instance by UUID {{(pid=116156) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:04:25.621789 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-79bdcc74-8602-4ad8-89cf-cb974c5b275b tempest-DeleteServersTestJSON-268050555 tempest-DeleteServersTestJSON-268050555-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:04:25.622522 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-79bdcc74-8602-4ad8-89cf-cb974c5b275b tempest-DeleteServersTestJSON-268050555 tempest-DeleteServersTestJSON-268050555-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:04:25.623463 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-79bdcc74-8602-4ad8-89cf-cb974c5b275b tempest-DeleteServersTestJSON-268050555 tempest-DeleteServersTestJSON-268050555-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:04:25.623899 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-79bdcc74-8602-4ad8-89cf-cb974c5b275b tempest-DeleteServersTestJSON-268050555 tempest-DeleteServersTestJSON-268050555-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:04:25.636390 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: INFO nova.api.openstack.wsgi [None req-79bdcc74-8602-4ad8-89cf-cb974c5b275b tempest-DeleteServersTestJSON-268050555 tempest-DeleteServersTestJSON-268050555-project] HTTP exception thrown: Instance 5a01bf2d-c341-4af1-b2b2-e1f05e46705f could not be found. Dec 15 03:04:25.636979 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi [None req-79bdcc74-8602-4ad8-89cf-cb974c5b275b tempest-DeleteServersTestJSON-268050555 tempest-DeleteServersTestJSON-268050555-project] Returning 404 to user: Instance 5a01bf2d-c341-4af1-b2b2-e1f05e46705f could not be found. {{(pid=116156) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 15 03:04:25.637792 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: INFO nova.api.openstack.requestlog [None req-79bdcc74-8602-4ad8-89cf-cb974c5b275b tempest-DeleteServersTestJSON-268050555 tempest-DeleteServersTestJSON-268050555-project] 10.222.0.18 "GET /compute/v2.1/servers/5a01bf2d-c341-4af1-b2b2-e1f05e46705f/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.027345 Dec 15 03:04:25.638478 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: [pid: 116156|app: 0|req: 94/173] 10.222.0.18 () {58 vars in 1301 bytes} [Wed Dec 15 03:04:25 2021] GET /compute/v2.1/servers/5a01bf2d-c341-4af1-b2b2-e1f05e46705f/os-volume_attachments => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Dec 15 03:04:25.858467 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi [None req-14040532-62ca-4d02-b2de-66c57b017afd tempest-ServerRescueNegativeTestJSON-2061875223 tempest-ServerRescueNegativeTestJSON-2061875223-project] Calling method '>' {{(pid=116156) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:04:25.859300 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.compute.api [None req-14040532-62ca-4d02-b2de-66c57b017afd tempest-ServerRescueNegativeTestJSON-2061875223 tempest-ServerRescueNegativeTestJSON-2061875223-project] [instance: 2d20c8be-04a9-4c79-aa0a-138a79fe50cd] Fetching instance by UUID {{(pid=116156) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:04:25.866218 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-14040532-62ca-4d02-b2de-66c57b017afd tempest-ServerRescueNegativeTestJSON-2061875223 tempest-ServerRescueNegativeTestJSON-2061875223-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:04:25.866990 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-14040532-62ca-4d02-b2de-66c57b017afd tempest-ServerRescueNegativeTestJSON-2061875223 tempest-ServerRescueNegativeTestJSON-2061875223-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:04:25.868031 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-14040532-62ca-4d02-b2de-66c57b017afd tempest-ServerRescueNegativeTestJSON-2061875223 tempest-ServerRescueNegativeTestJSON-2061875223-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:04:25.868623 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-14040532-62ca-4d02-b2de-66c57b017afd tempest-ServerRescueNegativeTestJSON-2061875223 tempest-ServerRescueNegativeTestJSON-2061875223-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:04:26.017239 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.policy [None req-14040532-62ca-4d02-b2de-66c57b017afd tempest-ServerRescueNegativeTestJSON-2061875223 tempest-ServerRescueNegativeTestJSON-2061875223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ea02b6e8f1548a1bd78952cb7337403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5e8a958d4bf43868502b13728b9583b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116156) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:04:26.026906 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: INFO nova.api.openstack.requestlog [None req-14040532-62ca-4d02-b2de-66c57b017afd tempest-ServerRescueNegativeTestJSON-2061875223 tempest-ServerRescueNegativeTestJSON-2061875223-project] 10.222.0.18 "GET /compute/v2.1/servers/2d20c8be-04a9-4c79-aa0a-138a79fe50cd" status: 200 len: 1522 microversion: 2.1 time: 0.172075 Dec 15 03:04:26.029019 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: [pid: 116156|app: 0|req: 95/174] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 03:04:25 2021] GET /compute/v2.1/servers/2d20c8be-04a9-4c79-aa0a-138a79fe50cd => generated 1522 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 03:04:26.871490 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi [None req-e62f4d5d-c47c-41e3-97c9-66bacce20b2c tempest-DeleteServersTestJSON-268050555 tempest-DeleteServersTestJSON-268050555-project] Calling method '>' {{(pid=116156) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:04:26.872400 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.compute.api [None req-e62f4d5d-c47c-41e3-97c9-66bacce20b2c tempest-DeleteServersTestJSON-268050555 tempest-DeleteServersTestJSON-268050555-project] [instance: 5a01bf2d-c341-4af1-b2b2-e1f05e46705f] Fetching instance by UUID {{(pid=116156) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:04:26.879124 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-e62f4d5d-c47c-41e3-97c9-66bacce20b2c tempest-DeleteServersTestJSON-268050555 tempest-DeleteServersTestJSON-268050555-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:04:26.879575 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-e62f4d5d-c47c-41e3-97c9-66bacce20b2c tempest-DeleteServersTestJSON-268050555 tempest-DeleteServersTestJSON-268050555-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:04:26.880241 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-e62f4d5d-c47c-41e3-97c9-66bacce20b2c tempest-DeleteServersTestJSON-268050555 tempest-DeleteServersTestJSON-268050555-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:04:26.880701 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-e62f4d5d-c47c-41e3-97c9-66bacce20b2c tempest-DeleteServersTestJSON-268050555 tempest-DeleteServersTestJSON-268050555-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:04:26.900323 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: INFO nova.api.openstack.wsgi [None req-e62f4d5d-c47c-41e3-97c9-66bacce20b2c tempest-DeleteServersTestJSON-268050555 tempest-DeleteServersTestJSON-268050555-project] HTTP exception thrown: Instance 5a01bf2d-c341-4af1-b2b2-e1f05e46705f could not be found. Dec 15 03:04:26.901116 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi [None req-e62f4d5d-c47c-41e3-97c9-66bacce20b2c tempest-DeleteServersTestJSON-268050555 tempest-DeleteServersTestJSON-268050555-project] Returning 404 to user: Instance 5a01bf2d-c341-4af1-b2b2-e1f05e46705f could not be found. {{(pid=116156) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 15 03:04:26.902375 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: INFO nova.api.openstack.requestlog [None req-e62f4d5d-c47c-41e3-97c9-66bacce20b2c tempest-DeleteServersTestJSON-268050555 tempest-DeleteServersTestJSON-268050555-project] 10.222.0.18 "DELETE /compute/v2.1/servers/5a01bf2d-c341-4af1-b2b2-e1f05e46705f" status: 404 len: 111 microversion: 2.1 time: 0.034860 Dec 15 03:04:26.903330 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: [pid: 116156|app: 0|req: 96/175] 10.222.0.18 () {58 vars in 1238 bytes} [Wed Dec 15 03:04:26 2021] DELETE /compute/v2.1/servers/5a01bf2d-c341-4af1-b2b2-e1f05e46705f => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Dec 15 03:04:26.912369 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi [None req-868cb3fd-c3e8-4511-86d2-3756eeccc3f9 tempest-DeleteServersTestJSON-268050555 tempest-DeleteServersTestJSON-268050555-project] Calling method '>' {{(pid=116156) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:04:26.921197 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.compute.api [None req-868cb3fd-c3e8-4511-86d2-3756eeccc3f9 tempest-DeleteServersTestJSON-268050555 tempest-DeleteServersTestJSON-268050555-project] [instance: 5a01bf2d-c341-4af1-b2b2-e1f05e46705f] Fetching instance by UUID {{(pid=116156) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:04:26.921197 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-868cb3fd-c3e8-4511-86d2-3756eeccc3f9 tempest-DeleteServersTestJSON-268050555 tempest-DeleteServersTestJSON-268050555-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:04:26.921197 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-868cb3fd-c3e8-4511-86d2-3756eeccc3f9 tempest-DeleteServersTestJSON-268050555 tempest-DeleteServersTestJSON-268050555-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:04:26.921197 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-868cb3fd-c3e8-4511-86d2-3756eeccc3f9 tempest-DeleteServersTestJSON-268050555 tempest-DeleteServersTestJSON-268050555-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:04:26.921492 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-868cb3fd-c3e8-4511-86d2-3756eeccc3f9 tempest-DeleteServersTestJSON-268050555 tempest-DeleteServersTestJSON-268050555-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:04:26.933929 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: INFO nova.api.openstack.wsgi [None req-868cb3fd-c3e8-4511-86d2-3756eeccc3f9 tempest-DeleteServersTestJSON-268050555 tempest-DeleteServersTestJSON-268050555-project] HTTP exception thrown: Instance 5a01bf2d-c341-4af1-b2b2-e1f05e46705f could not be found. Dec 15 03:04:26.934547 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi [None req-868cb3fd-c3e8-4511-86d2-3756eeccc3f9 tempest-DeleteServersTestJSON-268050555 tempest-DeleteServersTestJSON-268050555-project] Returning 404 to user: Instance 5a01bf2d-c341-4af1-b2b2-e1f05e46705f could not be found. {{(pid=116156) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 15 03:04:26.935363 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: INFO nova.api.openstack.requestlog [None req-868cb3fd-c3e8-4511-86d2-3756eeccc3f9 tempest-DeleteServersTestJSON-268050555 tempest-DeleteServersTestJSON-268050555-project] 10.222.0.18 "GET /compute/v2.1/servers/5a01bf2d-c341-4af1-b2b2-e1f05e46705f" status: 404 len: 111 microversion: 2.1 time: 0.028054 Dec 15 03:04:26.935882 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: [pid: 116156|app: 0|req: 97/176] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 03:04:26 2021] GET /compute/v2.1/servers/5a01bf2d-c341-4af1-b2b2-e1f05e46705f => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 15 03:04:27.043780 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi [None req-ba24c3f3-a593-46ff-82af-77d4906a5cb8 tempest-ServerRescueNegativeTestJSON-2061875223 tempest-ServerRescueNegativeTestJSON-2061875223-project] Calling method '>' {{(pid=116156) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:04:27.044416 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.compute.api [None req-ba24c3f3-a593-46ff-82af-77d4906a5cb8 tempest-ServerRescueNegativeTestJSON-2061875223 tempest-ServerRescueNegativeTestJSON-2061875223-project] [instance: 2d20c8be-04a9-4c79-aa0a-138a79fe50cd] Fetching instance by UUID {{(pid=116156) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:04:27.050599 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-ba24c3f3-a593-46ff-82af-77d4906a5cb8 tempest-ServerRescueNegativeTestJSON-2061875223 tempest-ServerRescueNegativeTestJSON-2061875223-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:04:27.050973 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-ba24c3f3-a593-46ff-82af-77d4906a5cb8 tempest-ServerRescueNegativeTestJSON-2061875223 tempest-ServerRescueNegativeTestJSON-2061875223-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:04:27.051757 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-ba24c3f3-a593-46ff-82af-77d4906a5cb8 tempest-ServerRescueNegativeTestJSON-2061875223 tempest-ServerRescueNegativeTestJSON-2061875223-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:04:27.052190 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-ba24c3f3-a593-46ff-82af-77d4906a5cb8 tempest-ServerRescueNegativeTestJSON-2061875223 tempest-ServerRescueNegativeTestJSON-2061875223-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:04:27.248716 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.policy [None req-ba24c3f3-a593-46ff-82af-77d4906a5cb8 tempest-ServerRescueNegativeTestJSON-2061875223 tempest-ServerRescueNegativeTestJSON-2061875223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ea02b6e8f1548a1bd78952cb7337403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5e8a958d4bf43868502b13728b9583b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116156) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:04:27.256622 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: INFO nova.api.openstack.requestlog [None req-ba24c3f3-a593-46ff-82af-77d4906a5cb8 tempest-ServerRescueNegativeTestJSON-2061875223 tempest-ServerRescueNegativeTestJSON-2061875223-project] 10.222.0.18 "GET /compute/v2.1/servers/2d20c8be-04a9-4c79-aa0a-138a79fe50cd" status: 200 len: 1522 microversion: 2.1 time: 0.216488 Dec 15 03:04:27.257187 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: [pid: 116156|app: 0|req: 98/177] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 03:04:27 2021] GET /compute/v2.1/servers/2d20c8be-04a9-4c79-aa0a-138a79fe50cd => generated 1522 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 03:04:28.274124 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi [None req-d1672d7f-5f24-4aea-900e-6009173be3b2 tempest-ServerRescueNegativeTestJSON-2061875223 tempest-ServerRescueNegativeTestJSON-2061875223-project] Calling method '>' {{(pid=116156) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:04:28.274946 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.compute.api [None req-d1672d7f-5f24-4aea-900e-6009173be3b2 tempest-ServerRescueNegativeTestJSON-2061875223 tempest-ServerRescueNegativeTestJSON-2061875223-project] [instance: 2d20c8be-04a9-4c79-aa0a-138a79fe50cd] Fetching instance by UUID {{(pid=116156) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:04:28.281017 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-d1672d7f-5f24-4aea-900e-6009173be3b2 tempest-ServerRescueNegativeTestJSON-2061875223 tempest-ServerRescueNegativeTestJSON-2061875223-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:04:28.282031 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-d1672d7f-5f24-4aea-900e-6009173be3b2 tempest-ServerRescueNegativeTestJSON-2061875223 tempest-ServerRescueNegativeTestJSON-2061875223-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:04:28.283697 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-d1672d7f-5f24-4aea-900e-6009173be3b2 tempest-ServerRescueNegativeTestJSON-2061875223 tempest-ServerRescueNegativeTestJSON-2061875223-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:04:28.284377 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-d1672d7f-5f24-4aea-900e-6009173be3b2 tempest-ServerRescueNegativeTestJSON-2061875223 tempest-ServerRescueNegativeTestJSON-2061875223-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:04:28.428765 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.policy [None req-d1672d7f-5f24-4aea-900e-6009173be3b2 tempest-ServerRescueNegativeTestJSON-2061875223 tempest-ServerRescueNegativeTestJSON-2061875223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ea02b6e8f1548a1bd78952cb7337403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5e8a958d4bf43868502b13728b9583b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116156) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:04:28.436223 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: INFO nova.api.openstack.requestlog [None req-d1672d7f-5f24-4aea-900e-6009173be3b2 tempest-ServerRescueNegativeTestJSON-2061875223 tempest-ServerRescueNegativeTestJSON-2061875223-project] 10.222.0.18 "GET /compute/v2.1/servers/2d20c8be-04a9-4c79-aa0a-138a79fe50cd" status: 200 len: 1522 microversion: 2.1 time: 0.166631 Dec 15 03:04:28.437008 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: [pid: 116156|app: 0|req: 99/178] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 03:04:28 2021] GET /compute/v2.1/servers/2d20c8be-04a9-4c79-aa0a-138a79fe50cd => generated 1522 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 03:04:29.453857 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi [None req-903b8531-7198-458a-94f9-a5dc29bdb1dc tempest-ServerRescueNegativeTestJSON-2061875223 tempest-ServerRescueNegativeTestJSON-2061875223-project] Calling method '>' {{(pid=116156) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:04:29.455177 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.compute.api [None req-903b8531-7198-458a-94f9-a5dc29bdb1dc tempest-ServerRescueNegativeTestJSON-2061875223 tempest-ServerRescueNegativeTestJSON-2061875223-project] [instance: 2d20c8be-04a9-4c79-aa0a-138a79fe50cd] Fetching instance by UUID {{(pid=116156) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:04:29.467439 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-903b8531-7198-458a-94f9-a5dc29bdb1dc tempest-ServerRescueNegativeTestJSON-2061875223 tempest-ServerRescueNegativeTestJSON-2061875223-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:04:29.468118 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-903b8531-7198-458a-94f9-a5dc29bdb1dc tempest-ServerRescueNegativeTestJSON-2061875223 tempest-ServerRescueNegativeTestJSON-2061875223-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:04:29.470423 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-903b8531-7198-458a-94f9-a5dc29bdb1dc tempest-ServerRescueNegativeTestJSON-2061875223 tempest-ServerRescueNegativeTestJSON-2061875223-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:04:29.472269 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-903b8531-7198-458a-94f9-a5dc29bdb1dc tempest-ServerRescueNegativeTestJSON-2061875223 tempest-ServerRescueNegativeTestJSON-2061875223-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:04:29.631416 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.policy [None req-903b8531-7198-458a-94f9-a5dc29bdb1dc tempest-ServerRescueNegativeTestJSON-2061875223 tempest-ServerRescueNegativeTestJSON-2061875223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ea02b6e8f1548a1bd78952cb7337403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5e8a958d4bf43868502b13728b9583b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116156) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:04:29.644538 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: INFO nova.api.openstack.requestlog [None req-903b8531-7198-458a-94f9-a5dc29bdb1dc tempest-ServerRescueNegativeTestJSON-2061875223 tempest-ServerRescueNegativeTestJSON-2061875223-project] 10.222.0.18 "GET /compute/v2.1/servers/2d20c8be-04a9-4c79-aa0a-138a79fe50cd" status: 200 len: 1522 microversion: 2.1 time: 0.194532 Dec 15 03:04:29.645958 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: [pid: 116156|app: 0|req: 100/179] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 03:04:29 2021] GET /compute/v2.1/servers/2d20c8be-04a9-4c79-aa0a-138a79fe50cd => generated 1522 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 03:04:30.661880 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi [None req-5b8cd59c-67d3-499a-9b08-24b521280149 tempest-ServerRescueNegativeTestJSON-2061875223 tempest-ServerRescueNegativeTestJSON-2061875223-project] Calling method '>' {{(pid=116156) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:04:30.662550 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.compute.api [None req-5b8cd59c-67d3-499a-9b08-24b521280149 tempest-ServerRescueNegativeTestJSON-2061875223 tempest-ServerRescueNegativeTestJSON-2061875223-project] [instance: 2d20c8be-04a9-4c79-aa0a-138a79fe50cd] Fetching instance by UUID {{(pid=116156) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:04:30.669102 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-5b8cd59c-67d3-499a-9b08-24b521280149 tempest-ServerRescueNegativeTestJSON-2061875223 tempest-ServerRescueNegativeTestJSON-2061875223-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:04:30.669638 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-5b8cd59c-67d3-499a-9b08-24b521280149 tempest-ServerRescueNegativeTestJSON-2061875223 tempest-ServerRescueNegativeTestJSON-2061875223-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:04:30.670807 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-5b8cd59c-67d3-499a-9b08-24b521280149 tempest-ServerRescueNegativeTestJSON-2061875223 tempest-ServerRescueNegativeTestJSON-2061875223-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:04:30.671456 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-5b8cd59c-67d3-499a-9b08-24b521280149 tempest-ServerRescueNegativeTestJSON-2061875223 tempest-ServerRescueNegativeTestJSON-2061875223-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:04:31.137684 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.policy [None req-5b8cd59c-67d3-499a-9b08-24b521280149 tempest-ServerRescueNegativeTestJSON-2061875223 tempest-ServerRescueNegativeTestJSON-2061875223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ea02b6e8f1548a1bd78952cb7337403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5e8a958d4bf43868502b13728b9583b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116156) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:04:31.145424 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: INFO nova.api.openstack.requestlog [None req-5b8cd59c-67d3-499a-9b08-24b521280149 tempest-ServerRescueNegativeTestJSON-2061875223 tempest-ServerRescueNegativeTestJSON-2061875223-project] 10.222.0.18 "GET /compute/v2.1/servers/2d20c8be-04a9-4c79-aa0a-138a79fe50cd" status: 200 len: 1522 microversion: 2.1 time: 0.487097 Dec 15 03:04:31.146006 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: [pid: 116156|app: 0|req: 101/180] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 03:04:30 2021] GET /compute/v2.1/servers/2d20c8be-04a9-4c79-aa0a-138a79fe50cd => generated 1522 bytes in 488 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 03:04:32.165318 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi [None req-fa37954d-e921-4b47-9899-9dad65323d76 tempest-ServerRescueNegativeTestJSON-2061875223 tempest-ServerRescueNegativeTestJSON-2061875223-project] Calling method '>' {{(pid=116156) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:04:32.166020 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.compute.api [None req-fa37954d-e921-4b47-9899-9dad65323d76 tempest-ServerRescueNegativeTestJSON-2061875223 tempest-ServerRescueNegativeTestJSON-2061875223-project] [instance: 2d20c8be-04a9-4c79-aa0a-138a79fe50cd] Fetching instance by UUID {{(pid=116156) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:04:32.184826 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-fa37954d-e921-4b47-9899-9dad65323d76 tempest-ServerRescueNegativeTestJSON-2061875223 tempest-ServerRescueNegativeTestJSON-2061875223-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:04:32.185306 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-fa37954d-e921-4b47-9899-9dad65323d76 tempest-ServerRescueNegativeTestJSON-2061875223 tempest-ServerRescueNegativeTestJSON-2061875223-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:04:32.186587 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-fa37954d-e921-4b47-9899-9dad65323d76 tempest-ServerRescueNegativeTestJSON-2061875223 tempest-ServerRescueNegativeTestJSON-2061875223-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:04:32.187299 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-fa37954d-e921-4b47-9899-9dad65323d76 tempest-ServerRescueNegativeTestJSON-2061875223 tempest-ServerRescueNegativeTestJSON-2061875223-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:04:32.535416 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.policy [None req-fa37954d-e921-4b47-9899-9dad65323d76 tempest-ServerRescueNegativeTestJSON-2061875223 tempest-ServerRescueNegativeTestJSON-2061875223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ea02b6e8f1548a1bd78952cb7337403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5e8a958d4bf43868502b13728b9583b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116156) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:04:32.544018 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: INFO nova.api.openstack.requestlog [None req-fa37954d-e921-4b47-9899-9dad65323d76 tempest-ServerRescueNegativeTestJSON-2061875223 tempest-ServerRescueNegativeTestJSON-2061875223-project] 10.222.0.18 "GET /compute/v2.1/servers/2d20c8be-04a9-4c79-aa0a-138a79fe50cd" status: 200 len: 1522 microversion: 2.1 time: 0.382805 Dec 15 03:04:32.544981 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: [pid: 116156|app: 0|req: 102/181] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 03:04:32 2021] GET /compute/v2.1/servers/2d20c8be-04a9-4c79-aa0a-138a79fe50cd => generated 1522 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 03:04:33.560562 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi [None req-ffc4f160-0d48-4b51-ab3c-d242c4b2084e tempest-ServerRescueNegativeTestJSON-2061875223 tempest-ServerRescueNegativeTestJSON-2061875223-project] Calling method '>' {{(pid=116156) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:04:33.561184 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.compute.api [None req-ffc4f160-0d48-4b51-ab3c-d242c4b2084e tempest-ServerRescueNegativeTestJSON-2061875223 tempest-ServerRescueNegativeTestJSON-2061875223-project] [instance: 2d20c8be-04a9-4c79-aa0a-138a79fe50cd] Fetching instance by UUID {{(pid=116156) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:04:33.570177 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-ffc4f160-0d48-4b51-ab3c-d242c4b2084e tempest-ServerRescueNegativeTestJSON-2061875223 tempest-ServerRescueNegativeTestJSON-2061875223-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:04:33.570627 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-ffc4f160-0d48-4b51-ab3c-d242c4b2084e tempest-ServerRescueNegativeTestJSON-2061875223 tempest-ServerRescueNegativeTestJSON-2061875223-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:04:33.571432 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-ffc4f160-0d48-4b51-ab3c-d242c4b2084e tempest-ServerRescueNegativeTestJSON-2061875223 tempest-ServerRescueNegativeTestJSON-2061875223-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:04:33.571867 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-ffc4f160-0d48-4b51-ab3c-d242c4b2084e tempest-ServerRescueNegativeTestJSON-2061875223 tempest-ServerRescueNegativeTestJSON-2061875223-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:04:33.775378 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.network.neutron [None req-ba7d5fe6-ae23-4256-b10e-6f16787c97f9 tempest-AttachVolumeNegativeTest-1640336653 tempest-AttachVolumeNegativeTest-1640336653-project] validate_networks() for [('b0713a87-683c-42de-a9a0-98522d8ec589', None, None, None, None, None)] {{(pid=116157) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Dec 15 03:04:33.852506 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.policy [None req-ffc4f160-0d48-4b51-ab3c-d242c4b2084e tempest-ServerRescueNegativeTestJSON-2061875223 tempest-ServerRescueNegativeTestJSON-2061875223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ea02b6e8f1548a1bd78952cb7337403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5e8a958d4bf43868502b13728b9583b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116156) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:04:33.864857 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: INFO nova.api.openstack.requestlog [None req-ffc4f160-0d48-4b51-ab3c-d242c4b2084e tempest-ServerRescueNegativeTestJSON-2061875223 tempest-ServerRescueNegativeTestJSON-2061875223-project] 10.222.0.18 "GET /compute/v2.1/servers/2d20c8be-04a9-4c79-aa0a-138a79fe50cd" status: 200 len: 1522 microversion: 2.1 time: 0.307765 Dec 15 03:04:33.866377 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: [pid: 116156|app: 0|req: 103/182] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 03:04:33 2021] GET /compute/v2.1/servers/2d20c8be-04a9-4c79-aa0a-138a79fe50cd => generated 1522 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 03:04:33.871210 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi [None req-a41cba20-4acf-4d2f-9b17-7bc293534f36 tempest-VolumesActionsTest-1837279088 tempest-VolumesActionsTest-1837279088-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-982543768", "imageRef": "5195b034-9fa4-468b-a94d-ef3ee79ce449", "flavorRef": "452", "networks": [{"uuid": "0789cf04-9022-405f-9413-73b756ea9873"}]}} {{(pid=116156) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 03:04:33.973472 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.network.neutron [None req-a41cba20-4acf-4d2f-9b17-7bc293534f36 tempest-VolumesActionsTest-1837279088 tempest-VolumesActionsTest-1837279088-project] validate_networks() for [('0789cf04-9022-405f-9413-73b756ea9873', None, None, None, None, None)] {{(pid=116156) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Dec 15 03:04:34.758037 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.virt.hardware [None req-ba7d5fe6-ae23-4256-b10e-6f16787c97f9 tempest-AttachVolumeNegativeTest-1640336653 tempest-AttachVolumeNegativeTest-1640336653-project] Flavor limits 0:0:0 {{(pid=116157) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Dec 15 03:04:34.759048 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.virt.hardware [None req-ba7d5fe6-ae23-4256-b10e-6f16787c97f9 tempest-AttachVolumeNegativeTest-1640336653 tempest-AttachVolumeNegativeTest-1640336653-project] Image limits 0:0:0 {{(pid=116157) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Dec 15 03:04:34.759623 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.virt.hardware [None req-ba7d5fe6-ae23-4256-b10e-6f16787c97f9 tempest-AttachVolumeNegativeTest-1640336653 tempest-AttachVolumeNegativeTest-1640336653-project] Flavor pref 0:0:0 {{(pid=116157) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Dec 15 03:04:34.760027 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.virt.hardware [None req-ba7d5fe6-ae23-4256-b10e-6f16787c97f9 tempest-AttachVolumeNegativeTest-1640336653 tempest-AttachVolumeNegativeTest-1640336653-project] Image pref 0:0:0 {{(pid=116157) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Dec 15 03:04:34.770799 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.virt.hardware [None req-ba7d5fe6-ae23-4256-b10e-6f16787c97f9 tempest-AttachVolumeNegativeTest-1640336653 tempest-AttachVolumeNegativeTest-1640336653-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116157) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Dec 15 03:04:34.792550 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-ba7d5fe6-ae23-4256-b10e-6f16787c97f9 tempest-AttachVolumeNegativeTest-1640336653 tempest-AttachVolumeNegativeTest-1640336653-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:04:34.793171 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-ba7d5fe6-ae23-4256-b10e-6f16787c97f9 tempest-AttachVolumeNegativeTest-1640336653 tempest-AttachVolumeNegativeTest-1640336653-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:04:34.793826 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-ba7d5fe6-ae23-4256-b10e-6f16787c97f9 tempest-AttachVolumeNegativeTest-1640336653 tempest-AttachVolumeNegativeTest-1640336653-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:04:34.794369 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-ba7d5fe6-ae23-4256-b10e-6f16787c97f9 tempest-AttachVolumeNegativeTest-1640336653 tempest-AttachVolumeNegativeTest-1640336653-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:04:34.834089 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.quota [None req-ba7d5fe6-ae23-4256-b10e-6f16787c97f9 tempest-AttachVolumeNegativeTest-1640336653 tempest-AttachVolumeNegativeTest-1640336653-project] Getting quotas for project 409b41637da94c469444954258444b4b. Resources: {'cores', 'instances', 'ram'} {{(pid=116157) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 15 03:04:34.842633 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.virt.hardware [None req-a41cba20-4acf-4d2f-9b17-7bc293534f36 tempest-VolumesActionsTest-1837279088 tempest-VolumesActionsTest-1837279088-project] Flavor limits 0:0:0 {{(pid=116156) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Dec 15 03:04:34.843718 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.virt.hardware [None req-a41cba20-4acf-4d2f-9b17-7bc293534f36 tempest-VolumesActionsTest-1837279088 tempest-VolumesActionsTest-1837279088-project] Image limits 0:0:0 {{(pid=116156) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Dec 15 03:04:34.844587 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.virt.hardware [None req-a41cba20-4acf-4d2f-9b17-7bc293534f36 tempest-VolumesActionsTest-1837279088 tempest-VolumesActionsTest-1837279088-project] Flavor pref 0:0:0 {{(pid=116156) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Dec 15 03:04:34.845207 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.virt.hardware [None req-a41cba20-4acf-4d2f-9b17-7bc293534f36 tempest-VolumesActionsTest-1837279088 tempest-VolumesActionsTest-1837279088-project] Image pref 0:0:0 {{(pid=116156) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Dec 15 03:04:34.845826 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.virt.hardware [None req-a41cba20-4acf-4d2f-9b17-7bc293534f36 tempest-VolumesActionsTest-1837279088 tempest-VolumesActionsTest-1837279088-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116156) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Dec 15 03:04:34.861467 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-a41cba20-4acf-4d2f-9b17-7bc293534f36 tempest-VolumesActionsTest-1837279088 tempest-VolumesActionsTest-1837279088-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:04:34.867089 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-a41cba20-4acf-4d2f-9b17-7bc293534f36 tempest-VolumesActionsTest-1837279088 tempest-VolumesActionsTest-1837279088-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:04:34.868292 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-a41cba20-4acf-4d2f-9b17-7bc293534f36 tempest-VolumesActionsTest-1837279088 tempest-VolumesActionsTest-1837279088-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:04:34.868638 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.quota [None req-ba7d5fe6-ae23-4256-b10e-6f16787c97f9 tempest-AttachVolumeNegativeTest-1640336653 tempest-AttachVolumeNegativeTest-1640336653-project] Getting quotas for user 35d37a3d8e504b8186182468b77dd114 and project 409b41637da94c469444954258444b4b. Resources: {'cores', 'instances', 'ram'} {{(pid=116157) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 15 03:04:34.870779 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-a41cba20-4acf-4d2f-9b17-7bc293534f36 tempest-VolumesActionsTest-1837279088 tempest-VolumesActionsTest-1837279088-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:04:34.902887 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.compute.api [None req-ba7d5fe6-ae23-4256-b10e-6f16787c97f9 tempest-AttachVolumeNegativeTest-1640336653 tempest-AttachVolumeNegativeTest-1640336653-project] Going to run 1 instances... {{(pid=116157) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Dec 15 03:04:34.908975 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.compute.api [None req-ba7d5fe6-ae23-4256-b10e-6f16787c97f9 tempest-AttachVolumeNegativeTest-1640336653 tempest-AttachVolumeNegativeTest-1640336653-project] [instance: b302a057-8ba0-4cec-bcb7-805bd598c638] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='5195b034-9fa4-468b-a94d-ef3ee79ce449',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=116157) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Dec 15 03:04:34.942649 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.quota [None req-a41cba20-4acf-4d2f-9b17-7bc293534f36 tempest-VolumesActionsTest-1837279088 tempest-VolumesActionsTest-1837279088-project] Getting quotas for project b6eaf458d3c84ba59b078dc0a3bf1763. Resources: {'cores', 'instances', 'ram'} {{(pid=116156) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 15 03:04:34.955830 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.quota [None req-a41cba20-4acf-4d2f-9b17-7bc293534f36 tempest-VolumesActionsTest-1837279088 tempest-VolumesActionsTest-1837279088-project] Getting quotas for user 0e440754469c4407840a651d560ce08a and project b6eaf458d3c84ba59b078dc0a3bf1763. Resources: {'cores', 'instances', 'ram'} {{(pid=116156) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 15 03:04:34.984453 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.compute.api [None req-a41cba20-4acf-4d2f-9b17-7bc293534f36 tempest-VolumesActionsTest-1837279088 tempest-VolumesActionsTest-1837279088-project] Going to run 1 instances... {{(pid=116156) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Dec 15 03:04:34.988790 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.compute.api [None req-a41cba20-4acf-4d2f-9b17-7bc293534f36 tempest-VolumesActionsTest-1837279088 tempest-VolumesActionsTest-1837279088-project] [instance: 0c1f5052-62a2-4847-ab40-6e1a9df040ca] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='5195b034-9fa4-468b-a94d-ef3ee79ce449',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=116156) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Dec 15 03:04:35.034717 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: INFO nova.api.openstack.requestlog [None req-ba7d5fe6-ae23-4256-b10e-6f16787c97f9 tempest-AttachVolumeNegativeTest-1640336653 tempest-AttachVolumeNegativeTest-1640336653-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 9.473032 Dec 15 03:04:35.035367 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: [pid: 116157|app: 0|req: 80/183] 10.222.0.18 () {60 vars in 1146 bytes} [Wed Dec 15 03:04:25 2021] POST /compute/v2.1/servers => generated 380 bytes in 9475 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Dec 15 03:04:35.055227 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi [None req-492bfc19-01f9-4848-ae56-09ca19eea26c tempest-ServerRescueNegativeTestJSON-2061875223 tempest-ServerRescueNegativeTestJSON-2061875223-project] Calling method '>' {{(pid=116157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:04:35.055865 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.compute.api [None req-492bfc19-01f9-4848-ae56-09ca19eea26c tempest-ServerRescueNegativeTestJSON-2061875223 tempest-ServerRescueNegativeTestJSON-2061875223-project] [instance: 2d20c8be-04a9-4c79-aa0a-138a79fe50cd] Fetching instance by UUID {{(pid=116157) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:04:35.071381 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-492bfc19-01f9-4848-ae56-09ca19eea26c tempest-ServerRescueNegativeTestJSON-2061875223 tempest-ServerRescueNegativeTestJSON-2061875223-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:04:35.072121 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-492bfc19-01f9-4848-ae56-09ca19eea26c tempest-ServerRescueNegativeTestJSON-2061875223 tempest-ServerRescueNegativeTestJSON-2061875223-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:04:35.073099 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-492bfc19-01f9-4848-ae56-09ca19eea26c tempest-ServerRescueNegativeTestJSON-2061875223 tempest-ServerRescueNegativeTestJSON-2061875223-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:04:35.073697 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-492bfc19-01f9-4848-ae56-09ca19eea26c tempest-ServerRescueNegativeTestJSON-2061875223 tempest-ServerRescueNegativeTestJSON-2061875223-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:04:35.126905 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: INFO nova.api.openstack.requestlog [None req-a41cba20-4acf-4d2f-9b17-7bc293534f36 tempest-VolumesActionsTest-1837279088 tempest-VolumesActionsTest-1837279088-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.258802 Dec 15 03:04:35.127424 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: [pid: 116156|app: 0|req: 104/184] 10.222.0.18 () {60 vars in 1146 bytes} [Wed Dec 15 03:04:33 2021] POST /compute/v2.1/servers => generated 380 bytes in 1260 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Dec 15 03:04:35.149448 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi [None req-54a47dce-ced5-4f85-80d6-fd8e2476628e tempest-AttachVolumeNegativeTest-1640336653 tempest-AttachVolumeNegativeTest-1640336653-project] Calling method '>' {{(pid=116156) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:04:35.150101 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.compute.api [None req-54a47dce-ced5-4f85-80d6-fd8e2476628e tempest-AttachVolumeNegativeTest-1640336653 tempest-AttachVolumeNegativeTest-1640336653-project] [instance: b302a057-8ba0-4cec-bcb7-805bd598c638] Fetching instance by UUID {{(pid=116156) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:04:35.344378 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.policy [None req-54a47dce-ced5-4f85-80d6-fd8e2476628e tempest-AttachVolumeNegativeTest-1640336653 tempest-AttachVolumeNegativeTest-1640336653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35d37a3d8e504b8186182468b77dd114', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '409b41637da94c469444954258444b4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116156) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:04:35.358757 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: INFO nova.api.openstack.requestlog [None req-54a47dce-ced5-4f85-80d6-fd8e2476628e tempest-AttachVolumeNegativeTest-1640336653 tempest-AttachVolumeNegativeTest-1640336653-project] 10.222.0.18 "GET /compute/v2.1/servers/b302a057-8ba0-4cec-bcb7-805bd598c638" status: 200 len: 1217 microversion: 2.1 time: 0.217272 Dec 15 03:04:35.362853 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: [pid: 116156|app: 0|req: 105/185] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 03:04:35 2021] GET /compute/v2.1/servers/b302a057-8ba0-4cec-bcb7-805bd598c638 => generated 1217 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 03:04:35.382903 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi [None req-03467e39-7b75-4cde-be39-376e733cf991 tempest-VolumesActionsTest-1837279088 tempest-VolumesActionsTest-1837279088-project] Calling method '>' {{(pid=116156) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:04:35.385856 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.compute.api [None req-03467e39-7b75-4cde-be39-376e733cf991 tempest-VolumesActionsTest-1837279088 tempest-VolumesActionsTest-1837279088-project] [instance: 0c1f5052-62a2-4847-ab40-6e1a9df040ca] Fetching instance by UUID {{(pid=116156) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:04:35.508941 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.policy [None req-492bfc19-01f9-4848-ae56-09ca19eea26c tempest-ServerRescueNegativeTestJSON-2061875223 tempest-ServerRescueNegativeTestJSON-2061875223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ea02b6e8f1548a1bd78952cb7337403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5e8a958d4bf43868502b13728b9583b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116157) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:04:35.519374 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: INFO nova.api.openstack.requestlog [None req-492bfc19-01f9-4848-ae56-09ca19eea26c tempest-ServerRescueNegativeTestJSON-2061875223 tempest-ServerRescueNegativeTestJSON-2061875223-project] 10.222.0.18 "GET /compute/v2.1/servers/2d20c8be-04a9-4c79-aa0a-138a79fe50cd" status: 200 len: 1522 microversion: 2.1 time: 0.482923 Dec 15 03:04:35.526965 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: [pid: 116157|app: 0|req: 81/186] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 03:04:35 2021] GET /compute/v2.1/servers/2d20c8be-04a9-4c79-aa0a-138a79fe50cd => generated 1522 bytes in 491 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 03:04:35.529565 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.policy [None req-03467e39-7b75-4cde-be39-376e733cf991 tempest-VolumesActionsTest-1837279088 tempest-VolumesActionsTest-1837279088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e440754469c4407840a651d560ce08a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6eaf458d3c84ba59b078dc0a3bf1763', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116156) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:04:35.553082 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: INFO nova.api.openstack.requestlog [None req-03467e39-7b75-4cde-be39-376e733cf991 tempest-VolumesActionsTest-1837279088 tempest-VolumesActionsTest-1837279088-project] 10.222.0.18 "GET /compute/v2.1/servers/0c1f5052-62a2-4847-ab40-6e1a9df040ca" status: 200 len: 1213 microversion: 2.1 time: 0.188280 Dec 15 03:04:35.555916 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: [pid: 116156|app: 0|req: 106/187] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 03:04:35 2021] GET /compute/v2.1/servers/0c1f5052-62a2-4847-ab40-6e1a9df040ca => generated 1213 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 03:04:36.036946 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi [None req-b5f57ae7-86a8-4c89-96be-9009be04cb97 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Action: 'create', calling method: .version_select at 0x7f126a3afb80>, body: {"keypair": {"name": "tempest-keypair-1409502793"}} {{(pid=116157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 03:04:36.063507 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.quota [None req-b5f57ae7-86a8-4c89-96be-9009be04cb97 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Getting quotas for project 9f16202549724b878f908d68384ec9c9. Resources: {'key_pairs'} {{(pid=116157) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 15 03:04:36.067470 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.quota [None req-b5f57ae7-86a8-4c89-96be-9009be04cb97 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Getting quotas for user fedc11e2dbd74b919982a0657222cca4 and project 9f16202549724b878f908d68384ec9c9. Resources: {'key_pairs'} {{(pid=116157) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 15 03:04:36.381015 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi [None req-587bb2ee-b475-45dc-912a-4399f4ec73c5 tempest-AttachVolumeNegativeTest-1640336653 tempest-AttachVolumeNegativeTest-1640336653-project] Calling method '>' {{(pid=116156) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:04:36.382485 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.compute.api [None req-587bb2ee-b475-45dc-912a-4399f4ec73c5 tempest-AttachVolumeNegativeTest-1640336653 tempest-AttachVolumeNegativeTest-1640336653-project] [instance: b302a057-8ba0-4cec-bcb7-805bd598c638] Fetching instance by UUID {{(pid=116156) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:04:36.398008 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-587bb2ee-b475-45dc-912a-4399f4ec73c5 tempest-AttachVolumeNegativeTest-1640336653 tempest-AttachVolumeNegativeTest-1640336653-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:04:36.398582 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-587bb2ee-b475-45dc-912a-4399f4ec73c5 tempest-AttachVolumeNegativeTest-1640336653 tempest-AttachVolumeNegativeTest-1640336653-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:04:36.400821 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-587bb2ee-b475-45dc-912a-4399f4ec73c5 tempest-AttachVolumeNegativeTest-1640336653 tempest-AttachVolumeNegativeTest-1640336653-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:04:36.401784 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-587bb2ee-b475-45dc-912a-4399f4ec73c5 tempest-AttachVolumeNegativeTest-1640336653 tempest-AttachVolumeNegativeTest-1640336653-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:04:36.424785 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.quota [None req-b5f57ae7-86a8-4c89-96be-9009be04cb97 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Getting quotas for project 9f16202549724b878f908d68384ec9c9. Resources: {'key_pairs'} {{(pid=116157) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 15 03:04:36.429622 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.quota [None req-b5f57ae7-86a8-4c89-96be-9009be04cb97 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Getting quotas for user fedc11e2dbd74b919982a0657222cca4 and project 9f16202549724b878f908d68384ec9c9. Resources: {'key_pairs'} {{(pid=116157) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 15 03:04:36.448069 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: INFO nova.api.openstack.requestlog [None req-b5f57ae7-86a8-4c89-96be-9009be04cb97 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] 10.222.0.18 "POST /compute/v2.1/os-keypairs" status: 201 len: 2320 microversion: 2.20 time: 0.918893 Dec 15 03:04:36.449110 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: [pid: 116157|app: 0|req: 82/188] 10.222.0.18 () {62 vars in 1198 bytes} [Wed Dec 15 03:04:35 2021] POST /compute/v2.1/os-keypairs => generated 2320 bytes in 921 msecs (HTTP/1.1 201) 9 headers in 365 bytes (1 switches on core 0) Dec 15 03:04:36.512254 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.policy [None req-587bb2ee-b475-45dc-912a-4399f4ec73c5 tempest-AttachVolumeNegativeTest-1640336653 tempest-AttachVolumeNegativeTest-1640336653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35d37a3d8e504b8186182468b77dd114', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '409b41637da94c469444954258444b4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116156) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:04:36.523095 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: INFO nova.api.openstack.requestlog [None req-587bb2ee-b475-45dc-912a-4399f4ec73c5 tempest-AttachVolumeNegativeTest-1640336653 tempest-AttachVolumeNegativeTest-1640336653-project] 10.222.0.18 "GET /compute/v2.1/servers/b302a057-8ba0-4cec-bcb7-805bd598c638" status: 200 len: 1269 microversion: 2.1 time: 0.147438 Dec 15 03:04:36.524548 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: [pid: 116156|app: 0|req: 107/189] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 03:04:36 2021] GET /compute/v2.1/servers/b302a057-8ba0-4cec-bcb7-805bd598c638 => generated 1269 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 03:04:36.539274 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi [None req-cc6c4b86-fd56-47d4-890d-ec7c381e874d tempest-ServerRescueNegativeTestJSON-2061875223 tempest-ServerRescueNegativeTestJSON-2061875223-project] Calling method '>' {{(pid=116157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:04:36.540288 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.compute.api [None req-cc6c4b86-fd56-47d4-890d-ec7c381e874d tempest-ServerRescueNegativeTestJSON-2061875223 tempest-ServerRescueNegativeTestJSON-2061875223-project] [instance: 2d20c8be-04a9-4c79-aa0a-138a79fe50cd] Fetching instance by UUID {{(pid=116157) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:04:36.548400 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-cc6c4b86-fd56-47d4-890d-ec7c381e874d tempest-ServerRescueNegativeTestJSON-2061875223 tempest-ServerRescueNegativeTestJSON-2061875223-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:04:36.552205 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-cc6c4b86-fd56-47d4-890d-ec7c381e874d tempest-ServerRescueNegativeTestJSON-2061875223 tempest-ServerRescueNegativeTestJSON-2061875223-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:04:36.556063 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-cc6c4b86-fd56-47d4-890d-ec7c381e874d tempest-ServerRescueNegativeTestJSON-2061875223 tempest-ServerRescueNegativeTestJSON-2061875223-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:04:36.556709 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-cc6c4b86-fd56-47d4-890d-ec7c381e874d tempest-ServerRescueNegativeTestJSON-2061875223 tempest-ServerRescueNegativeTestJSON-2061875223-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:04:36.575031 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi [None req-e7a4304c-c589-4308-8fce-0b86cad92b6c tempest-VolumesActionsTest-1837279088 tempest-VolumesActionsTest-1837279088-project] Calling method '>' {{(pid=116156) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:04:36.575662 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.compute.api [None req-e7a4304c-c589-4308-8fce-0b86cad92b6c tempest-VolumesActionsTest-1837279088 tempest-VolumesActionsTest-1837279088-project] [instance: 0c1f5052-62a2-4847-ab40-6e1a9df040ca] Fetching instance by UUID {{(pid=116156) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:04:36.589492 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-e7a4304c-c589-4308-8fce-0b86cad92b6c tempest-VolumesActionsTest-1837279088 tempest-VolumesActionsTest-1837279088-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:04:36.591598 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-e7a4304c-c589-4308-8fce-0b86cad92b6c tempest-VolumesActionsTest-1837279088 tempest-VolumesActionsTest-1837279088-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:04:36.592637 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-e7a4304c-c589-4308-8fce-0b86cad92b6c tempest-VolumesActionsTest-1837279088 tempest-VolumesActionsTest-1837279088-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:04:36.593949 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-e7a4304c-c589-4308-8fce-0b86cad92b6c tempest-VolumesActionsTest-1837279088 tempest-VolumesActionsTest-1837279088-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:04:36.702177 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.policy [None req-e7a4304c-c589-4308-8fce-0b86cad92b6c tempest-VolumesActionsTest-1837279088 tempest-VolumesActionsTest-1837279088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e440754469c4407840a651d560ce08a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6eaf458d3c84ba59b078dc0a3bf1763', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116156) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:04:36.722084 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: INFO nova.api.openstack.requestlog [None req-e7a4304c-c589-4308-8fce-0b86cad92b6c tempest-VolumesActionsTest-1837279088 tempest-VolumesActionsTest-1837279088-project] 10.222.0.18 "GET /compute/v2.1/servers/0c1f5052-62a2-4847-ab40-6e1a9df040ca" status: 200 len: 1209 microversion: 2.1 time: 0.153215 Dec 15 03:04:36.722671 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: [pid: 116156|app: 0|req: 108/190] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 03:04:36 2021] GET /compute/v2.1/servers/0c1f5052-62a2-4847-ab40-6e1a9df040ca => generated 1209 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 03:04:37.157626 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.policy [None req-cc6c4b86-fd56-47d4-890d-ec7c381e874d tempest-ServerRescueNegativeTestJSON-2061875223 tempest-ServerRescueNegativeTestJSON-2061875223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ea02b6e8f1548a1bd78952cb7337403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5e8a958d4bf43868502b13728b9583b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116157) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:04:37.165941 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: INFO nova.api.openstack.requestlog [None req-cc6c4b86-fd56-47d4-890d-ec7c381e874d tempest-ServerRescueNegativeTestJSON-2061875223 tempest-ServerRescueNegativeTestJSON-2061875223-project] 10.222.0.18 "GET /compute/v2.1/servers/2d20c8be-04a9-4c79-aa0a-138a79fe50cd" status: 200 len: 1522 microversion: 2.1 time: 0.631925 Dec 15 03:04:37.179770 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: [pid: 116157|app: 0|req: 83/191] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 03:04:36 2021] GET /compute/v2.1/servers/2d20c8be-04a9-4c79-aa0a-138a79fe50cd => generated 1522 bytes in 646 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 03:04:37.544622 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi [None req-2ecb3abb-1fc4-4595-847c-52e4db7691bb tempest-AttachVolumeNegativeTest-1640336653 tempest-AttachVolumeNegativeTest-1640336653-project] Calling method '>' {{(pid=116156) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:04:37.545874 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.compute.api [None req-2ecb3abb-1fc4-4595-847c-52e4db7691bb tempest-AttachVolumeNegativeTest-1640336653 tempest-AttachVolumeNegativeTest-1640336653-project] [instance: b302a057-8ba0-4cec-bcb7-805bd598c638] Fetching instance by UUID {{(pid=116156) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:04:37.554839 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-2ecb3abb-1fc4-4595-847c-52e4db7691bb tempest-AttachVolumeNegativeTest-1640336653 tempest-AttachVolumeNegativeTest-1640336653-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:04:37.565766 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-2ecb3abb-1fc4-4595-847c-52e4db7691bb tempest-AttachVolumeNegativeTest-1640336653 tempest-AttachVolumeNegativeTest-1640336653-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:04:37.566771 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-2ecb3abb-1fc4-4595-847c-52e4db7691bb tempest-AttachVolumeNegativeTest-1640336653 tempest-AttachVolumeNegativeTest-1640336653-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:04:37.567222 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-2ecb3abb-1fc4-4595-847c-52e4db7691bb tempest-AttachVolumeNegativeTest-1640336653 tempest-AttachVolumeNegativeTest-1640336653-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:04:37.742135 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi [None req-acfd1df4-62bc-4258-99ae-34edcdd4fb7f tempest-VolumesActionsTest-1837279088 tempest-VolumesActionsTest-1837279088-project] Calling method '>' {{(pid=116157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:04:37.742952 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.compute.api [None req-acfd1df4-62bc-4258-99ae-34edcdd4fb7f tempest-VolumesActionsTest-1837279088 tempest-VolumesActionsTest-1837279088-project] [instance: 0c1f5052-62a2-4847-ab40-6e1a9df040ca] Fetching instance by UUID {{(pid=116157) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:04:37.756352 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-acfd1df4-62bc-4258-99ae-34edcdd4fb7f tempest-VolumesActionsTest-1837279088 tempest-VolumesActionsTest-1837279088-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:04:37.758624 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-acfd1df4-62bc-4258-99ae-34edcdd4fb7f tempest-VolumesActionsTest-1837279088 tempest-VolumesActionsTest-1837279088-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:04:37.759895 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-acfd1df4-62bc-4258-99ae-34edcdd4fb7f tempest-VolumesActionsTest-1837279088 tempest-VolumesActionsTest-1837279088-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:04:37.761937 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-acfd1df4-62bc-4258-99ae-34edcdd4fb7f tempest-VolumesActionsTest-1837279088 tempest-VolumesActionsTest-1837279088-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:04:37.762760 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.policy [None req-2ecb3abb-1fc4-4595-847c-52e4db7691bb tempest-AttachVolumeNegativeTest-1640336653 tempest-AttachVolumeNegativeTest-1640336653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35d37a3d8e504b8186182468b77dd114', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '409b41637da94c469444954258444b4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116156) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:04:37.786194 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: INFO nova.api.openstack.requestlog [None req-2ecb3abb-1fc4-4595-847c-52e4db7691bb tempest-AttachVolumeNegativeTest-1640336653 tempest-AttachVolumeNegativeTest-1640336653-project] 10.222.0.18 "GET /compute/v2.1/servers/b302a057-8ba0-4cec-bcb7-805bd598c638" status: 200 len: 1275 microversion: 2.1 time: 0.246737 Dec 15 03:04:37.787365 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: [pid: 116156|app: 0|req: 109/192] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 03:04:37 2021] GET /compute/v2.1/servers/b302a057-8ba0-4cec-bcb7-805bd598c638 => generated 1275 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 03:04:37.970133 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.policy [None req-acfd1df4-62bc-4258-99ae-34edcdd4fb7f tempest-VolumesActionsTest-1837279088 tempest-VolumesActionsTest-1837279088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e440754469c4407840a651d560ce08a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6eaf458d3c84ba59b078dc0a3bf1763', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116157) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:04:37.985853 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: INFO nova.api.openstack.requestlog [None req-acfd1df4-62bc-4258-99ae-34edcdd4fb7f tempest-VolumesActionsTest-1837279088 tempest-VolumesActionsTest-1837279088-project] 10.222.0.18 "GET /compute/v2.1/servers/0c1f5052-62a2-4847-ab40-6e1a9df040ca" status: 200 len: 1273 microversion: 2.1 time: 0.248861 Dec 15 03:04:37.994843 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: [pid: 116157|app: 0|req: 84/193] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 03:04:37 2021] GET /compute/v2.1/servers/0c1f5052-62a2-4847-ab40-6e1a9df040ca => generated 1273 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 03:04:38.183578 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi [None req-7b397c0a-37a3-4037-9b28-1d6d13642eed tempest-ServerRescueNegativeTestJSON-2061875223 tempest-ServerRescueNegativeTestJSON-2061875223-project] Calling method '>' {{(pid=116156) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:04:38.185731 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.compute.api [None req-7b397c0a-37a3-4037-9b28-1d6d13642eed tempest-ServerRescueNegativeTestJSON-2061875223 tempest-ServerRescueNegativeTestJSON-2061875223-project] [instance: 2d20c8be-04a9-4c79-aa0a-138a79fe50cd] Fetching instance by UUID {{(pid=116156) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:04:38.199965 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-7b397c0a-37a3-4037-9b28-1d6d13642eed tempest-ServerRescueNegativeTestJSON-2061875223 tempest-ServerRescueNegativeTestJSON-2061875223-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:04:38.208416 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-7b397c0a-37a3-4037-9b28-1d6d13642eed tempest-ServerRescueNegativeTestJSON-2061875223 tempest-ServerRescueNegativeTestJSON-2061875223-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:04:38.209719 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-7b397c0a-37a3-4037-9b28-1d6d13642eed tempest-ServerRescueNegativeTestJSON-2061875223 tempest-ServerRescueNegativeTestJSON-2061875223-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:04:38.213150 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-7b397c0a-37a3-4037-9b28-1d6d13642eed tempest-ServerRescueNegativeTestJSON-2061875223 tempest-ServerRescueNegativeTestJSON-2061875223-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:04:38.631996 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.policy [None req-7b397c0a-37a3-4037-9b28-1d6d13642eed tempest-ServerRescueNegativeTestJSON-2061875223 tempest-ServerRescueNegativeTestJSON-2061875223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ea02b6e8f1548a1bd78952cb7337403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5e8a958d4bf43868502b13728b9583b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116156) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:04:38.666596 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: INFO nova.api.openstack.requestlog [None req-7b397c0a-37a3-4037-9b28-1d6d13642eed tempest-ServerRescueNegativeTestJSON-2061875223 tempest-ServerRescueNegativeTestJSON-2061875223-project] 10.222.0.18 "GET /compute/v2.1/servers/2d20c8be-04a9-4c79-aa0a-138a79fe50cd" status: 200 len: 1522 microversion: 2.1 time: 0.466976 Dec 15 03:04:38.666596 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: [pid: 116156|app: 0|req: 110/194] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 03:04:38 2021] GET /compute/v2.1/servers/2d20c8be-04a9-4c79-aa0a-138a79fe50cd => generated 1522 bytes in 475 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 03:04:38.807693 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi [None req-4368a3bc-8357-4734-844e-2138697c2e33 tempest-AttachVolumeNegativeTest-1640336653 tempest-AttachVolumeNegativeTest-1640336653-project] Calling method '>' {{(pid=116157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:04:38.808807 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.compute.api [None req-4368a3bc-8357-4734-844e-2138697c2e33 tempest-AttachVolumeNegativeTest-1640336653 tempest-AttachVolumeNegativeTest-1640336653-project] [instance: b302a057-8ba0-4cec-bcb7-805bd598c638] Fetching instance by UUID {{(pid=116157) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:04:38.825704 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-4368a3bc-8357-4734-844e-2138697c2e33 tempest-AttachVolumeNegativeTest-1640336653 tempest-AttachVolumeNegativeTest-1640336653-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:04:38.826997 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-4368a3bc-8357-4734-844e-2138697c2e33 tempest-AttachVolumeNegativeTest-1640336653 tempest-AttachVolumeNegativeTest-1640336653-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:04:38.830726 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-4368a3bc-8357-4734-844e-2138697c2e33 tempest-AttachVolumeNegativeTest-1640336653 tempest-AttachVolumeNegativeTest-1640336653-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:04:38.831188 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-4368a3bc-8357-4734-844e-2138697c2e33 tempest-AttachVolumeNegativeTest-1640336653 tempest-AttachVolumeNegativeTest-1640336653-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:04:39.003109 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi [None req-5a125f1f-4d28-4c33-a7b9-52aa88b37d63 tempest-VolumesActionsTest-1837279088 tempest-VolumesActionsTest-1837279088-project] Calling method '>' {{(pid=116156) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:04:39.004447 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.compute.api [None req-5a125f1f-4d28-4c33-a7b9-52aa88b37d63 tempest-VolumesActionsTest-1837279088 tempest-VolumesActionsTest-1837279088-project] [instance: 0c1f5052-62a2-4847-ab40-6e1a9df040ca] Fetching instance by UUID {{(pid=116156) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:04:39.015480 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-5a125f1f-4d28-4c33-a7b9-52aa88b37d63 tempest-VolumesActionsTest-1837279088 tempest-VolumesActionsTest-1837279088-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:04:39.018148 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-5a125f1f-4d28-4c33-a7b9-52aa88b37d63 tempest-VolumesActionsTest-1837279088 tempest-VolumesActionsTest-1837279088-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:04:39.023519 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-5a125f1f-4d28-4c33-a7b9-52aa88b37d63 tempest-VolumesActionsTest-1837279088 tempest-VolumesActionsTest-1837279088-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:04:39.024151 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-5a125f1f-4d28-4c33-a7b9-52aa88b37d63 tempest-VolumesActionsTest-1837279088 tempest-VolumesActionsTest-1837279088-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:04:39.066950 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.policy [None req-4368a3bc-8357-4734-844e-2138697c2e33 tempest-AttachVolumeNegativeTest-1640336653 tempest-AttachVolumeNegativeTest-1640336653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35d37a3d8e504b8186182468b77dd114', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '409b41637da94c469444954258444b4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116157) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:04:39.081066 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: INFO nova.api.openstack.requestlog [None req-4368a3bc-8357-4734-844e-2138697c2e33 tempest-AttachVolumeNegativeTest-1640336653 tempest-AttachVolumeNegativeTest-1640336653-project] 10.222.0.18 "GET /compute/v2.1/servers/b302a057-8ba0-4cec-bcb7-805bd598c638" status: 200 len: 1275 microversion: 2.1 time: 0.278207 Dec 15 03:04:39.085437 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: [pid: 116157|app: 0|req: 85/195] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 03:04:38 2021] GET /compute/v2.1/servers/b302a057-8ba0-4cec-bcb7-805bd598c638 => generated 1275 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 03:04:39.219105 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.policy [None req-5a125f1f-4d28-4c33-a7b9-52aa88b37d63 tempest-VolumesActionsTest-1837279088 tempest-VolumesActionsTest-1837279088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e440754469c4407840a651d560ce08a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6eaf458d3c84ba59b078dc0a3bf1763', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116156) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:04:39.231234 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: INFO nova.api.openstack.requestlog [None req-5a125f1f-4d28-4c33-a7b9-52aa88b37d63 tempest-VolumesActionsTest-1837279088 tempest-VolumesActionsTest-1837279088-project] 10.222.0.18 "GET /compute/v2.1/servers/0c1f5052-62a2-4847-ab40-6e1a9df040ca" status: 200 len: 1271 microversion: 2.1 time: 0.230092 Dec 15 03:04:39.243012 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: [pid: 116156|app: 0|req: 111/196] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 03:04:38 2021] GET /compute/v2.1/servers/0c1f5052-62a2-4847-ab40-6e1a9df040ca => generated 1271 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 03:04:39.581252 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi [None req-41f79549-1dd8-4a07-a390-fa03872501f6 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-688981162", "imageRef": "5195b034-9fa4-468b-a94d-ef3ee79ce449", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "c53e204d-72ac-4b08-b5d5-620e7d8224e3"}], "security_groups": [{"name": "tempest-securitygroup--206221736"}], "key_name": "tempest-keypair-1409502793", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=116157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 03:04:39.676734 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi [None req-9f3d0fb1-f0fc-425e-8f4b-f9fecd67e208 tempest-ServerRescueNegativeTestJSON-2061875223 tempest-ServerRescueNegativeTestJSON-2061875223-project] Calling method '>' {{(pid=116156) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:04:39.678167 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.compute.api [None req-9f3d0fb1-f0fc-425e-8f4b-f9fecd67e208 tempest-ServerRescueNegativeTestJSON-2061875223 tempest-ServerRescueNegativeTestJSON-2061875223-project] [instance: 2d20c8be-04a9-4c79-aa0a-138a79fe50cd] Fetching instance by UUID {{(pid=116156) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:04:39.686852 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-9f3d0fb1-f0fc-425e-8f4b-f9fecd67e208 tempest-ServerRescueNegativeTestJSON-2061875223 tempest-ServerRescueNegativeTestJSON-2061875223-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:04:39.692269 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-9f3d0fb1-f0fc-425e-8f4b-f9fecd67e208 tempest-ServerRescueNegativeTestJSON-2061875223 tempest-ServerRescueNegativeTestJSON-2061875223-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:04:39.695183 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-9f3d0fb1-f0fc-425e-8f4b-f9fecd67e208 tempest-ServerRescueNegativeTestJSON-2061875223 tempest-ServerRescueNegativeTestJSON-2061875223-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:04:39.697918 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-9f3d0fb1-f0fc-425e-8f4b-f9fecd67e208 tempest-ServerRescueNegativeTestJSON-2061875223 tempest-ServerRescueNegativeTestJSON-2061875223-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:04:39.870238 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.network.neutron [None req-41f79549-1dd8-4a07-a390-fa03872501f6 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] validate_networks() for [('c53e204d-72ac-4b08-b5d5-620e7d8224e3', None, None, None, None, None)] {{(pid=116157) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Dec 15 03:04:40.222680 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.policy [None req-9f3d0fb1-f0fc-425e-8f4b-f9fecd67e208 tempest-ServerRescueNegativeTestJSON-2061875223 tempest-ServerRescueNegativeTestJSON-2061875223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ea02b6e8f1548a1bd78952cb7337403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5e8a958d4bf43868502b13728b9583b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116156) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:04:40.231468 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: INFO nova.api.openstack.requestlog [None req-9f3d0fb1-f0fc-425e-8f4b-f9fecd67e208 tempest-ServerRescueNegativeTestJSON-2061875223 tempest-ServerRescueNegativeTestJSON-2061875223-project] 10.222.0.18 "GET /compute/v2.1/servers/2d20c8be-04a9-4c79-aa0a-138a79fe50cd" status: 200 len: 1522 microversion: 2.1 time: 0.559272 Dec 15 03:04:40.234320 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: [pid: 116156|app: 0|req: 112/197] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 03:04:39 2021] GET /compute/v2.1/servers/2d20c8be-04a9-4c79-aa0a-138a79fe50cd => generated 1522 bytes in 563 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 03:04:40.240880 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi [None req-c42dcf93-a689-4796-af72-a0ac1872d011 tempest-AttachVolumeNegativeTest-1640336653 tempest-AttachVolumeNegativeTest-1640336653-project] Calling method '>' {{(pid=116156) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:04:40.241705 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.compute.api [None req-c42dcf93-a689-4796-af72-a0ac1872d011 tempest-AttachVolumeNegativeTest-1640336653 tempest-AttachVolumeNegativeTest-1640336653-project] [instance: b302a057-8ba0-4cec-bcb7-805bd598c638] Fetching instance by UUID {{(pid=116156) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:04:40.264731 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-c42dcf93-a689-4796-af72-a0ac1872d011 tempest-AttachVolumeNegativeTest-1640336653 tempest-AttachVolumeNegativeTest-1640336653-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:04:40.265373 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-c42dcf93-a689-4796-af72-a0ac1872d011 tempest-AttachVolumeNegativeTest-1640336653 tempest-AttachVolumeNegativeTest-1640336653-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:04:40.266294 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-c42dcf93-a689-4796-af72-a0ac1872d011 tempest-AttachVolumeNegativeTest-1640336653 tempest-AttachVolumeNegativeTest-1640336653-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:04:40.270943 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-c42dcf93-a689-4796-af72-a0ac1872d011 tempest-AttachVolumeNegativeTest-1640336653 tempest-AttachVolumeNegativeTest-1640336653-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:04:40.490639 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.policy [None req-c42dcf93-a689-4796-af72-a0ac1872d011 tempest-AttachVolumeNegativeTest-1640336653 tempest-AttachVolumeNegativeTest-1640336653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35d37a3d8e504b8186182468b77dd114', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '409b41637da94c469444954258444b4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116156) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:04:40.500256 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: INFO nova.api.openstack.requestlog [None req-c42dcf93-a689-4796-af72-a0ac1872d011 tempest-AttachVolumeNegativeTest-1640336653 tempest-AttachVolumeNegativeTest-1640336653-project] 10.222.0.18 "GET /compute/v2.1/servers/b302a057-8ba0-4cec-bcb7-805bd598c638" status: 200 len: 1317 microversion: 2.1 time: 0.262989 Dec 15 03:04:40.500879 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: [pid: 116156|app: 0|req: 113/198] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 03:04:40 2021] GET /compute/v2.1/servers/b302a057-8ba0-4cec-bcb7-805bd598c638 => generated 1317 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 03:04:40.509079 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi [None req-7e9fba36-82b8-47c9-938a-689c9365fd4c tempest-VolumesActionsTest-1837279088 tempest-VolumesActionsTest-1837279088-project] Calling method '>' {{(pid=116156) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:04:40.509692 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.compute.api [None req-7e9fba36-82b8-47c9-938a-689c9365fd4c tempest-VolumesActionsTest-1837279088 tempest-VolumesActionsTest-1837279088-project] [instance: 0c1f5052-62a2-4847-ab40-6e1a9df040ca] Fetching instance by UUID {{(pid=116156) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:04:40.522998 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-7e9fba36-82b8-47c9-938a-689c9365fd4c tempest-VolumesActionsTest-1837279088 tempest-VolumesActionsTest-1837279088-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:04:40.522998 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-7e9fba36-82b8-47c9-938a-689c9365fd4c tempest-VolumesActionsTest-1837279088 tempest-VolumesActionsTest-1837279088-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:04:40.522998 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-7e9fba36-82b8-47c9-938a-689c9365fd4c tempest-VolumesActionsTest-1837279088 tempest-VolumesActionsTest-1837279088-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:04:40.522998 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-7e9fba36-82b8-47c9-938a-689c9365fd4c tempest-VolumesActionsTest-1837279088 tempest-VolumesActionsTest-1837279088-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:04:40.659991 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.policy [None req-7e9fba36-82b8-47c9-938a-689c9365fd4c tempest-VolumesActionsTest-1837279088 tempest-VolumesActionsTest-1837279088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e440754469c4407840a651d560ce08a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6eaf458d3c84ba59b078dc0a3bf1763', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116156) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:04:40.667365 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: INFO nova.api.openstack.requestlog [None req-7e9fba36-82b8-47c9-938a-689c9365fd4c tempest-VolumesActionsTest-1837279088 tempest-VolumesActionsTest-1837279088-project] 10.222.0.18 "GET /compute/v2.1/servers/0c1f5052-62a2-4847-ab40-6e1a9df040ca" status: 200 len: 1313 microversion: 2.1 time: 0.165481 Dec 15 03:04:40.668080 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: [pid: 116156|app: 0|req: 114/199] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 03:04:40 2021] GET /compute/v2.1/servers/0c1f5052-62a2-4847-ab40-6e1a9df040ca => generated 1313 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 03:04:41.251556 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi [None req-96034128-806b-44e3-9e01-c819f11c26d5 tempest-ServerRescueNegativeTestJSON-2061875223 tempest-ServerRescueNegativeTestJSON-2061875223-project] Calling method '>' {{(pid=116156) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:04:41.252777 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.compute.api [None req-96034128-806b-44e3-9e01-c819f11c26d5 tempest-ServerRescueNegativeTestJSON-2061875223 tempest-ServerRescueNegativeTestJSON-2061875223-project] [instance: 2d20c8be-04a9-4c79-aa0a-138a79fe50cd] Fetching instance by UUID {{(pid=116156) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:04:41.262216 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-96034128-806b-44e3-9e01-c819f11c26d5 tempest-ServerRescueNegativeTestJSON-2061875223 tempest-ServerRescueNegativeTestJSON-2061875223-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:04:41.264324 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-96034128-806b-44e3-9e01-c819f11c26d5 tempest-ServerRescueNegativeTestJSON-2061875223 tempest-ServerRescueNegativeTestJSON-2061875223-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:04:41.265350 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-96034128-806b-44e3-9e01-c819f11c26d5 tempest-ServerRescueNegativeTestJSON-2061875223 tempest-ServerRescueNegativeTestJSON-2061875223-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:04:41.267617 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-96034128-806b-44e3-9e01-c819f11c26d5 tempest-ServerRescueNegativeTestJSON-2061875223 tempest-ServerRescueNegativeTestJSON-2061875223-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:04:41.362259 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.virt.hardware [None req-41f79549-1dd8-4a07-a390-fa03872501f6 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Flavor limits 0:0:0 {{(pid=116157) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Dec 15 03:04:41.362716 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.virt.hardware [None req-41f79549-1dd8-4a07-a390-fa03872501f6 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Image limits 0:0:0 {{(pid=116157) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Dec 15 03:04:41.363147 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.virt.hardware [None req-41f79549-1dd8-4a07-a390-fa03872501f6 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Flavor pref 0:0:0 {{(pid=116157) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Dec 15 03:04:41.363745 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.virt.hardware [None req-41f79549-1dd8-4a07-a390-fa03872501f6 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Image pref 0:0:0 {{(pid=116157) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Dec 15 03:04:41.363962 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.virt.hardware [None req-41f79549-1dd8-4a07-a390-fa03872501f6 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116157) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Dec 15 03:04:41.392038 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-41f79549-1dd8-4a07-a390-fa03872501f6 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:04:41.392702 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-41f79549-1dd8-4a07-a390-fa03872501f6 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:04:41.393730 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-41f79549-1dd8-4a07-a390-fa03872501f6 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:04:41.394346 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-41f79549-1dd8-4a07-a390-fa03872501f6 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:04:41.434258 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.quota [None req-41f79549-1dd8-4a07-a390-fa03872501f6 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Getting quotas for project 9f16202549724b878f908d68384ec9c9. Resources: {'cores', 'instances', 'ram'} {{(pid=116157) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 15 03:04:41.443964 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.quota [None req-41f79549-1dd8-4a07-a390-fa03872501f6 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Getting quotas for user fedc11e2dbd74b919982a0657222cca4 and project 9f16202549724b878f908d68384ec9c9. Resources: {'cores', 'instances', 'ram'} {{(pid=116157) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 15 03:04:41.474062 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.compute.api [None req-41f79549-1dd8-4a07-a390-fa03872501f6 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Going to run 1 instances... {{(pid=116157) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Dec 15 03:04:41.479409 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.compute.api [None req-41f79549-1dd8-4a07-a390-fa03872501f6 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] [instance: b89094ac-aee1-4bd6-a33d-8c4347cebfc7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='5195b034-9fa4-468b-a94d-ef3ee79ce449',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=116157) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Dec 15 03:04:41.486152 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.policy [None req-96034128-806b-44e3-9e01-c819f11c26d5 tempest-ServerRescueNegativeTestJSON-2061875223 tempest-ServerRescueNegativeTestJSON-2061875223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ea02b6e8f1548a1bd78952cb7337403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5e8a958d4bf43868502b13728b9583b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116156) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:04:41.504740 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: INFO nova.api.openstack.requestlog [None req-96034128-806b-44e3-9e01-c819f11c26d5 tempest-ServerRescueNegativeTestJSON-2061875223 tempest-ServerRescueNegativeTestJSON-2061875223-project] 10.222.0.18 "GET /compute/v2.1/servers/2d20c8be-04a9-4c79-aa0a-138a79fe50cd" status: 200 len: 1502 microversion: 2.1 time: 0.257188 Dec 15 03:04:41.507609 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: [pid: 116156|app: 0|req: 115/200] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 03:04:41 2021] GET /compute/v2.1/servers/2d20c8be-04a9-4c79-aa0a-138a79fe50cd => generated 1502 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 03:04:41.516216 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi [None req-f98c6646-2460-4850-8f4c-408c9482d26b tempest-AttachVolumeNegativeTest-1640336653 tempest-AttachVolumeNegativeTest-1640336653-project] Calling method '>' {{(pid=116156) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:04:41.522301 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.compute.api [None req-f98c6646-2460-4850-8f4c-408c9482d26b tempest-AttachVolumeNegativeTest-1640336653 tempest-AttachVolumeNegativeTest-1640336653-project] [instance: b302a057-8ba0-4cec-bcb7-805bd598c638] Fetching instance by UUID {{(pid=116156) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:04:41.531667 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-f98c6646-2460-4850-8f4c-408c9482d26b tempest-AttachVolumeNegativeTest-1640336653 tempest-AttachVolumeNegativeTest-1640336653-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:04:41.532473 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-f98c6646-2460-4850-8f4c-408c9482d26b tempest-AttachVolumeNegativeTest-1640336653 tempest-AttachVolumeNegativeTest-1640336653-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:04:41.533420 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-f98c6646-2460-4850-8f4c-408c9482d26b tempest-AttachVolumeNegativeTest-1640336653 tempest-AttachVolumeNegativeTest-1640336653-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:04:41.534063 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-f98c6646-2460-4850-8f4c-408c9482d26b tempest-AttachVolumeNegativeTest-1640336653 tempest-AttachVolumeNegativeTest-1640336653-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:04:41.597692 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: INFO nova.api.openstack.requestlog [None req-41f79549-1dd8-4a07-a390-fa03872501f6 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.20 time: 2.027370 Dec 15 03:04:41.598370 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: [pid: 116157|app: 0|req: 86/201] 10.222.0.18 () {62 vars in 1187 bytes} [Wed Dec 15 03:04:39 2021] POST /compute/v2.1/servers => generated 401 bytes in 2029 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Dec 15 03:04:41.604275 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi [None req-5a0d6bea-d6b1-4e30-b0ef-8dcaff14ab73 tempest-ServerRescueNegativeTestJSON-2061875223 tempest-ServerRescueNegativeTestJSON-2061875223-project] Calling method '>' {{(pid=116157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:04:41.605673 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.compute.api [None req-5a0d6bea-d6b1-4e30-b0ef-8dcaff14ab73 tempest-ServerRescueNegativeTestJSON-2061875223 tempest-ServerRescueNegativeTestJSON-2061875223-project] [instance: 9bbb0abf-72a3-4fbc-8235-7a3ecfc8d006] Fetching instance by UUID {{(pid=116157) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:04:41.615554 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-5a0d6bea-d6b1-4e30-b0ef-8dcaff14ab73 tempest-ServerRescueNegativeTestJSON-2061875223 tempest-ServerRescueNegativeTestJSON-2061875223-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:04:41.616358 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-5a0d6bea-d6b1-4e30-b0ef-8dcaff14ab73 tempest-ServerRescueNegativeTestJSON-2061875223 tempest-ServerRescueNegativeTestJSON-2061875223-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:04:41.617247 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-5a0d6bea-d6b1-4e30-b0ef-8dcaff14ab73 tempest-ServerRescueNegativeTestJSON-2061875223 tempest-ServerRescueNegativeTestJSON-2061875223-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:04:41.617864 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-5a0d6bea-d6b1-4e30-b0ef-8dcaff14ab73 tempest-ServerRescueNegativeTestJSON-2061875223 tempest-ServerRescueNegativeTestJSON-2061875223-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:04:41.863606 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.policy [None req-f98c6646-2460-4850-8f4c-408c9482d26b tempest-AttachVolumeNegativeTest-1640336653 tempest-AttachVolumeNegativeTest-1640336653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35d37a3d8e504b8186182468b77dd114', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '409b41637da94c469444954258444b4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116156) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:04:41.872391 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: INFO nova.api.openstack.requestlog [None req-f98c6646-2460-4850-8f4c-408c9482d26b tempest-AttachVolumeNegativeTest-1640336653 tempest-AttachVolumeNegativeTest-1640336653-project] 10.222.0.18 "GET /compute/v2.1/servers/b302a057-8ba0-4cec-bcb7-805bd598c638" status: 200 len: 1317 microversion: 2.1 time: 0.359360 Dec 15 03:04:41.878427 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: [pid: 116156|app: 0|req: 116/202] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 03:04:41 2021] GET /compute/v2.1/servers/b302a057-8ba0-4cec-bcb7-805bd598c638 => generated 1317 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 03:04:41.882880 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi [None req-b61171a1-decd-4721-9c22-7427ba949f49 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Calling method '>' {{(pid=116156) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:04:41.886677 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.compute.api [None req-b61171a1-decd-4721-9c22-7427ba949f49 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] [instance: b89094ac-aee1-4bd6-a33d-8c4347cebfc7] Fetching instance by UUID {{(pid=116156) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:04:41.999082 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.policy [None req-b61171a1-decd-4721-9c22-7427ba949f49 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fedc11e2dbd74b919982a0657222cca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f16202549724b878f908d68384ec9c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116156) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:04:42.007468 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.policy [None req-b61171a1-decd-4721-9c22-7427ba949f49 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fedc11e2dbd74b919982a0657222cca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f16202549724b878f908d68384ec9c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116156) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:04:42.008982 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.policy [None req-b61171a1-decd-4721-9c22-7427ba949f49 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fedc11e2dbd74b919982a0657222cca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f16202549724b878f908d68384ec9c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116156) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:04:42.022938 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: INFO nova.api.openstack.requestlog [None req-b61171a1-decd-4721-9c22-7427ba949f49 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] 10.222.0.18 "GET /compute/v2.1/servers/b89094ac-aee1-4bd6-a33d-8c4347cebfc7" status: 200 len: 1281 microversion: 2.20 time: 0.130791 Dec 15 03:04:42.023622 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: [pid: 116156|app: 0|req: 117/203] 10.222.0.18 () {60 vars in 1276 bytes} [Wed Dec 15 03:04:41 2021] GET /compute/v2.1/servers/b89094ac-aee1-4bd6-a33d-8c4347cebfc7 => generated 1281 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 03:04:42.036800 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi [None req-6aaa1d45-02de-4e08-96cb-74653e1bdacd tempest-VolumesActionsTest-1837279088 tempest-VolumesActionsTest-1837279088-project] Calling method '>' {{(pid=116156) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:04:42.037415 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.compute.api [None req-6aaa1d45-02de-4e08-96cb-74653e1bdacd tempest-VolumesActionsTest-1837279088 tempest-VolumesActionsTest-1837279088-project] [instance: 0c1f5052-62a2-4847-ab40-6e1a9df040ca] Fetching instance by UUID {{(pid=116156) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:04:42.052392 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-6aaa1d45-02de-4e08-96cb-74653e1bdacd tempest-VolumesActionsTest-1837279088 tempest-VolumesActionsTest-1837279088-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:04:42.052873 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-6aaa1d45-02de-4e08-96cb-74653e1bdacd tempest-VolumesActionsTest-1837279088 tempest-VolumesActionsTest-1837279088-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:04:42.053654 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-6aaa1d45-02de-4e08-96cb-74653e1bdacd tempest-VolumesActionsTest-1837279088 tempest-VolumesActionsTest-1837279088-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:04:42.054121 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-6aaa1d45-02de-4e08-96cb-74653e1bdacd tempest-VolumesActionsTest-1837279088 tempest-VolumesActionsTest-1837279088-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:04:42.195691 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.policy [None req-5a0d6bea-d6b1-4e30-b0ef-8dcaff14ab73 tempest-ServerRescueNegativeTestJSON-2061875223 tempest-ServerRescueNegativeTestJSON-2061875223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ea02b6e8f1548a1bd78952cb7337403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5e8a958d4bf43868502b13728b9583b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116157) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:04:42.207562 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: INFO nova.api.openstack.requestlog [None req-5a0d6bea-d6b1-4e30-b0ef-8dcaff14ab73 tempest-ServerRescueNegativeTestJSON-2061875223 tempest-ServerRescueNegativeTestJSON-2061875223-project] 10.222.0.18 "GET /compute/v2.1/servers/9bbb0abf-72a3-4fbc-8235-7a3ecfc8d006" status: 200 len: 1515 microversion: 2.1 time: 0.607613 Dec 15 03:04:42.208216 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: [pid: 116157|app: 0|req: 87/204] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 03:04:41 2021] GET /compute/v2.1/servers/9bbb0abf-72a3-4fbc-8235-7a3ecfc8d006 => generated 1515 bytes in 609 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 03:04:42.286646 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi [req-48376201-fc8c-48f4-b7e3-bde6c9cd9b0e req-c657a50e-050b-4814-b4ec-1aff87c4aa7f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0c1f5052-62a2-4847-ab40-6e1a9df040ca", "tag": "337016c2-5d41-4e99-80d1-0be601ec8027"}]} {{(pid=116157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 03:04:42.297143 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 15 03:04:42.297143 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: warnings.warn(msg) Dec 15 03:04:42.324012 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [req-48376201-fc8c-48f4-b7e3-bde6c9cd9b0e req-c657a50e-050b-4814-b4ec-1aff87c4aa7f service nova] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:04:42.324817 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [req-48376201-fc8c-48f4-b7e3-bde6c9cd9b0e req-c657a50e-050b-4814-b4ec-1aff87c4aa7f service nova] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:04:42.358966 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: INFO nova.api.openstack.compute.server_external_events [req-48376201-fc8c-48f4-b7e3-bde6c9cd9b0e req-c657a50e-050b-4814-b4ec-1aff87c4aa7f service nova] Creating event network-changed:337016c2-5d41-4e99-80d1-0be601ec8027 for instance 0c1f5052-62a2-4847-ab40-6e1a9df040ca on hv-cinder-81803 Dec 15 03:04:42.366237 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.policy [None req-6aaa1d45-02de-4e08-96cb-74653e1bdacd tempest-VolumesActionsTest-1837279088 tempest-VolumesActionsTest-1837279088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e440754469c4407840a651d560ce08a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6eaf458d3c84ba59b078dc0a3bf1763', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116156) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:04:42.375382 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: INFO nova.api.openstack.requestlog [req-48376201-fc8c-48f4-b7e3-bde6c9cd9b0e req-c657a50e-050b-4814-b4ec-1aff87c4aa7f service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.092807 Dec 15 03:04:42.377593 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: [pid: 116157|app: 0|req: 88/205] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Dec 15 03:04:42 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 15 03:04:42.384564 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: INFO nova.api.openstack.requestlog [None req-6aaa1d45-02de-4e08-96cb-74653e1bdacd tempest-VolumesActionsTest-1837279088 tempest-VolumesActionsTest-1837279088-project] 10.222.0.18 "GET /compute/v2.1/servers/0c1f5052-62a2-4847-ab40-6e1a9df040ca" status: 200 len: 1313 microversion: 2.1 time: 0.359789 Dec 15 03:04:42.397395 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: [pid: 116156|app: 0|req: 118/206] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 03:04:42 2021] GET /compute/v2.1/servers/0c1f5052-62a2-4847-ab40-6e1a9df040ca => generated 1313 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 03:04:42.890632 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi [None req-88316b85-394d-40ce-88fa-7e8fc8447b09 tempest-AttachVolumeNegativeTest-1640336653 tempest-AttachVolumeNegativeTest-1640336653-project] Calling method '>' {{(pid=116157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:04:42.891949 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.compute.api [None req-88316b85-394d-40ce-88fa-7e8fc8447b09 tempest-AttachVolumeNegativeTest-1640336653 tempest-AttachVolumeNegativeTest-1640336653-project] [instance: b302a057-8ba0-4cec-bcb7-805bd598c638] Fetching instance by UUID {{(pid=116157) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:04:42.899177 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-88316b85-394d-40ce-88fa-7e8fc8447b09 tempest-AttachVolumeNegativeTest-1640336653 tempest-AttachVolumeNegativeTest-1640336653-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:04:42.899641 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-88316b85-394d-40ce-88fa-7e8fc8447b09 tempest-AttachVolumeNegativeTest-1640336653 tempest-AttachVolumeNegativeTest-1640336653-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:04:42.900433 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-88316b85-394d-40ce-88fa-7e8fc8447b09 tempest-AttachVolumeNegativeTest-1640336653 tempest-AttachVolumeNegativeTest-1640336653-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:04:42.900925 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-88316b85-394d-40ce-88fa-7e8fc8447b09 tempest-AttachVolumeNegativeTest-1640336653 tempest-AttachVolumeNegativeTest-1640336653-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:04:43.042194 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi [None req-47a73742-9cf6-4249-ae00-32c366111291 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Calling method '>' {{(pid=116156) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:04:43.042798 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.compute.api [None req-47a73742-9cf6-4249-ae00-32c366111291 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] [instance: b89094ac-aee1-4bd6-a33d-8c4347cebfc7] Fetching instance by UUID {{(pid=116156) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:04:43.048867 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-47a73742-9cf6-4249-ae00-32c366111291 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:04:43.049609 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-47a73742-9cf6-4249-ae00-32c366111291 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:04:43.050626 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-47a73742-9cf6-4249-ae00-32c366111291 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:04:43.051195 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-47a73742-9cf6-4249-ae00-32c366111291 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:04:43.214301 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.policy [None req-47a73742-9cf6-4249-ae00-32c366111291 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fedc11e2dbd74b919982a0657222cca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f16202549724b878f908d68384ec9c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116156) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:04:43.216487 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.policy [None req-88316b85-394d-40ce-88fa-7e8fc8447b09 tempest-AttachVolumeNegativeTest-1640336653 tempest-AttachVolumeNegativeTest-1640336653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35d37a3d8e504b8186182468b77dd114', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '409b41637da94c469444954258444b4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116157) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:04:43.229658 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.policy [None req-47a73742-9cf6-4249-ae00-32c366111291 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fedc11e2dbd74b919982a0657222cca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f16202549724b878f908d68384ec9c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116156) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:04:43.232801 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.policy [None req-47a73742-9cf6-4249-ae00-32c366111291 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fedc11e2dbd74b919982a0657222cca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f16202549724b878f908d68384ec9c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116156) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:04:43.235092 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: INFO nova.api.openstack.requestlog [None req-47a73742-9cf6-4249-ae00-32c366111291 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] 10.222.0.18 "GET /compute/v2.1/servers/b89094ac-aee1-4bd6-a33d-8c4347cebfc7" status: 200 len: 1333 microversion: 2.20 time: 0.197190 Dec 15 03:04:43.238370 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: [pid: 116156|app: 0|req: 119/207] 10.222.0.18 () {60 vars in 1276 bytes} [Wed Dec 15 03:04:43 2021] GET /compute/v2.1/servers/b89094ac-aee1-4bd6-a33d-8c4347cebfc7 => generated 1333 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 03:04:43.240742 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: INFO nova.api.openstack.requestlog [None req-88316b85-394d-40ce-88fa-7e8fc8447b09 tempest-AttachVolumeNegativeTest-1640336653 tempest-AttachVolumeNegativeTest-1640336653-project] 10.222.0.18 "GET /compute/v2.1/servers/b302a057-8ba0-4cec-bcb7-805bd598c638" status: 200 len: 1317 microversion: 2.1 time: 0.353715 Dec 15 03:04:43.241346 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: [pid: 116157|app: 0|req: 89/208] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 03:04:42 2021] GET /compute/v2.1/servers/b302a057-8ba0-4cec-bcb7-805bd598c638 => generated 1317 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 03:04:43.401941 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi [None req-4e5b72b1-5a8f-4fcc-b2b8-d1c7cd4de394 tempest-VolumesActionsTest-1837279088 tempest-VolumesActionsTest-1837279088-project] Calling method '>' {{(pid=116156) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:04:43.407123 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.compute.api [None req-4e5b72b1-5a8f-4fcc-b2b8-d1c7cd4de394 tempest-VolumesActionsTest-1837279088 tempest-VolumesActionsTest-1837279088-project] [instance: 0c1f5052-62a2-4847-ab40-6e1a9df040ca] Fetching instance by UUID {{(pid=116156) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:04:43.423014 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-4e5b72b1-5a8f-4fcc-b2b8-d1c7cd4de394 tempest-VolumesActionsTest-1837279088 tempest-VolumesActionsTest-1837279088-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:04:43.423462 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-4e5b72b1-5a8f-4fcc-b2b8-d1c7cd4de394 tempest-VolumesActionsTest-1837279088 tempest-VolumesActionsTest-1837279088-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:04:43.424258 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-4e5b72b1-5a8f-4fcc-b2b8-d1c7cd4de394 tempest-VolumesActionsTest-1837279088 tempest-VolumesActionsTest-1837279088-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:04:43.425178 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-4e5b72b1-5a8f-4fcc-b2b8-d1c7cd4de394 tempest-VolumesActionsTest-1837279088 tempest-VolumesActionsTest-1837279088-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:04:43.644708 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.policy [None req-4e5b72b1-5a8f-4fcc-b2b8-d1c7cd4de394 tempest-VolumesActionsTest-1837279088 tempest-VolumesActionsTest-1837279088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e440754469c4407840a651d560ce08a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6eaf458d3c84ba59b078dc0a3bf1763', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116156) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:04:43.664817 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: INFO nova.api.openstack.requestlog [None req-4e5b72b1-5a8f-4fcc-b2b8-d1c7cd4de394 tempest-VolumesActionsTest-1837279088 tempest-VolumesActionsTest-1837279088-project] 10.222.0.18 "GET /compute/v2.1/servers/0c1f5052-62a2-4847-ab40-6e1a9df040ca" status: 200 len: 1313 microversion: 2.1 time: 0.266876 Dec 15 03:04:43.668482 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: [pid: 116156|app: 0|req: 120/209] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 03:04:43 2021] GET /compute/v2.1/servers/0c1f5052-62a2-4847-ab40-6e1a9df040ca => generated 1313 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 03:04:43.785670 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi [None req-ef0fd969-c32b-472c-bc62-8332f998cb85 tempest-ServerRescueNegativeTestJSON-2061875223 tempest-ServerRescueNegativeTestJSON-2061875223-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=116157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 03:04:43.786724 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.compute.api [None req-ef0fd969-c32b-472c-bc62-8332f998cb85 tempest-ServerRescueNegativeTestJSON-2061875223 tempest-ServerRescueNegativeTestJSON-2061875223-project] [instance: 9bbb0abf-72a3-4fbc-8235-7a3ecfc8d006] Fetching instance by UUID {{(pid=116157) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:04:43.803029 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-ef0fd969-c32b-472c-bc62-8332f998cb85 tempest-ServerRescueNegativeTestJSON-2061875223 tempest-ServerRescueNegativeTestJSON-2061875223-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:04:43.804378 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-ef0fd969-c32b-472c-bc62-8332f998cb85 tempest-ServerRescueNegativeTestJSON-2061875223 tempest-ServerRescueNegativeTestJSON-2061875223-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:04:43.805222 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-ef0fd969-c32b-472c-bc62-8332f998cb85 tempest-ServerRescueNegativeTestJSON-2061875223 tempest-ServerRescueNegativeTestJSON-2061875223-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:04:43.805659 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-ef0fd969-c32b-472c-bc62-8332f998cb85 tempest-ServerRescueNegativeTestJSON-2061875223 tempest-ServerRescueNegativeTestJSON-2061875223-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:04:43.866781 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.objects.instance [None req-ef0fd969-c32b-472c-bc62-8332f998cb85 tempest-ServerRescueNegativeTestJSON-2061875223 tempest-ServerRescueNegativeTestJSON-2061875223-project] Lazy-loading 'flavor' on Instance uuid 9bbb0abf-72a3-4fbc-8235-7a3ecfc8d006 {{(pid=116157) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Dec 15 03:04:44.007975 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: INFO nova.api.openstack.requestlog [None req-ef0fd969-c32b-472c-bc62-8332f998cb85 tempest-ServerRescueNegativeTestJSON-2061875223 tempest-ServerRescueNegativeTestJSON-2061875223-project] 10.222.0.18 "POST /compute/v2.1/servers/9bbb0abf-72a3-4fbc-8235-7a3ecfc8d006/action" status: 200 len: 32 microversion: 2.1 time: 0.227377 Dec 15 03:04:44.010221 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: [pid: 116157|app: 0|req: 90/210] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Dec 15 03:04:43 2021] POST /compute/v2.1/servers/9bbb0abf-72a3-4fbc-8235-7a3ecfc8d006/action => generated 32 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Dec 15 03:04:44.026424 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi [None req-3868e30e-370c-4d84-bcdd-ac4a08816d77 tempest-ServerRescueNegativeTestJSON-2061875223 tempest-ServerRescueNegativeTestJSON-2061875223-project] Calling method '>' {{(pid=116156) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:04:44.029102 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.compute.api [None req-3868e30e-370c-4d84-bcdd-ac4a08816d77 tempest-ServerRescueNegativeTestJSON-2061875223 tempest-ServerRescueNegativeTestJSON-2061875223-project] [instance: 9bbb0abf-72a3-4fbc-8235-7a3ecfc8d006] Fetching instance by UUID {{(pid=116156) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:04:44.042941 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-3868e30e-370c-4d84-bcdd-ac4a08816d77 tempest-ServerRescueNegativeTestJSON-2061875223 tempest-ServerRescueNegativeTestJSON-2061875223-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:04:44.043642 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-3868e30e-370c-4d84-bcdd-ac4a08816d77 tempest-ServerRescueNegativeTestJSON-2061875223 tempest-ServerRescueNegativeTestJSON-2061875223-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:04:44.044779 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-3868e30e-370c-4d84-bcdd-ac4a08816d77 tempest-ServerRescueNegativeTestJSON-2061875223 tempest-ServerRescueNegativeTestJSON-2061875223-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:04:44.045438 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-3868e30e-370c-4d84-bcdd-ac4a08816d77 tempest-ServerRescueNegativeTestJSON-2061875223 tempest-ServerRescueNegativeTestJSON-2061875223-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:04:44.270838 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi [None req-62caa708-69c6-4e4b-9b48-04bceb249ec0 tempest-AttachVolumeNegativeTest-1640336653 tempest-AttachVolumeNegativeTest-1640336653-project] Calling method '>' {{(pid=116157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:04:44.272222 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.compute.api [None req-62caa708-69c6-4e4b-9b48-04bceb249ec0 tempest-AttachVolumeNegativeTest-1640336653 tempest-AttachVolumeNegativeTest-1640336653-project] [instance: b302a057-8ba0-4cec-bcb7-805bd598c638] Fetching instance by UUID {{(pid=116157) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:04:44.279942 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-62caa708-69c6-4e4b-9b48-04bceb249ec0 tempest-AttachVolumeNegativeTest-1640336653 tempest-AttachVolumeNegativeTest-1640336653-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:04:44.280612 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-62caa708-69c6-4e4b-9b48-04bceb249ec0 tempest-AttachVolumeNegativeTest-1640336653 tempest-AttachVolumeNegativeTest-1640336653-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:04:44.282148 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-62caa708-69c6-4e4b-9b48-04bceb249ec0 tempest-AttachVolumeNegativeTest-1640336653 tempest-AttachVolumeNegativeTest-1640336653-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:04:44.283016 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-62caa708-69c6-4e4b-9b48-04bceb249ec0 tempest-AttachVolumeNegativeTest-1640336653 tempest-AttachVolumeNegativeTest-1640336653-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:04:44.353879 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.policy [None req-3868e30e-370c-4d84-bcdd-ac4a08816d77 tempest-ServerRescueNegativeTestJSON-2061875223 tempest-ServerRescueNegativeTestJSON-2061875223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ea02b6e8f1548a1bd78952cb7337403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5e8a958d4bf43868502b13728b9583b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116156) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:04:44.364093 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: INFO nova.api.openstack.requestlog [None req-3868e30e-370c-4d84-bcdd-ac4a08816d77 tempest-ServerRescueNegativeTestJSON-2061875223 tempest-ServerRescueNegativeTestJSON-2061875223-project] 10.222.0.18 "GET /compute/v2.1/servers/9bbb0abf-72a3-4fbc-8235-7a3ecfc8d006" status: 200 len: 1521 microversion: 2.1 time: 0.348014 Dec 15 03:04:44.369191 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: [pid: 116156|app: 0|req: 121/211] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 03:04:44 2021] GET /compute/v2.1/servers/9bbb0abf-72a3-4fbc-8235-7a3ecfc8d006 => generated 1521 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 03:04:44.377998 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi [None req-a1804210-3eaf-40b6-849d-e4677b8e3f1b tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Calling method '>' {{(pid=116156) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:04:44.378691 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.compute.api [None req-a1804210-3eaf-40b6-849d-e4677b8e3f1b tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] [instance: b89094ac-aee1-4bd6-a33d-8c4347cebfc7] Fetching instance by UUID {{(pid=116156) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:04:44.395226 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-a1804210-3eaf-40b6-849d-e4677b8e3f1b tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:04:44.397639 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-a1804210-3eaf-40b6-849d-e4677b8e3f1b tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:04:44.398501 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-a1804210-3eaf-40b6-849d-e4677b8e3f1b tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:04:44.399120 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-a1804210-3eaf-40b6-849d-e4677b8e3f1b tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:04:44.553121 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.policy [None req-a1804210-3eaf-40b6-849d-e4677b8e3f1b tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fedc11e2dbd74b919982a0657222cca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f16202549724b878f908d68384ec9c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116156) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:04:44.564605 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.policy [None req-a1804210-3eaf-40b6-849d-e4677b8e3f1b tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fedc11e2dbd74b919982a0657222cca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f16202549724b878f908d68384ec9c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116156) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:04:44.566483 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.policy [None req-a1804210-3eaf-40b6-849d-e4677b8e3f1b tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fedc11e2dbd74b919982a0657222cca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f16202549724b878f908d68384ec9c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116156) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:04:44.568398 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: INFO nova.api.openstack.requestlog [None req-a1804210-3eaf-40b6-849d-e4677b8e3f1b tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] 10.222.0.18 "GET /compute/v2.1/servers/b89094ac-aee1-4bd6-a33d-8c4347cebfc7" status: 200 len: 1339 microversion: 2.20 time: 0.197531 Dec 15 03:04:44.569224 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: [pid: 116156|app: 0|req: 122/212] 10.222.0.18 () {60 vars in 1276 bytes} [Wed Dec 15 03:04:44 2021] GET /compute/v2.1/servers/b89094ac-aee1-4bd6-a33d-8c4347cebfc7 => generated 1339 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 03:04:44.574817 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi [req-26c9fbf8-78f7-4155-bbbb-bd3d6d5001df req-2ee4e55b-69d0-48b2-bee3-6f05a2274f85 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b302a057-8ba0-4cec-bcb7-805bd598c638", "tag": "bd1e9500-c9d2-4a4b-bbc3-fc1261110821"}]} {{(pid=116156) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 03:04:44.577363 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 15 03:04:44.577363 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: warnings.warn(msg) Dec 15 03:04:44.587789 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [req-26c9fbf8-78f7-4155-bbbb-bd3d6d5001df req-2ee4e55b-69d0-48b2-bee3-6f05a2274f85 service nova] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:04:44.588653 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [req-26c9fbf8-78f7-4155-bbbb-bd3d6d5001df req-2ee4e55b-69d0-48b2-bee3-6f05a2274f85 service nova] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:04:44.603251 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: INFO nova.api.openstack.compute.server_external_events [req-26c9fbf8-78f7-4155-bbbb-bd3d6d5001df req-2ee4e55b-69d0-48b2-bee3-6f05a2274f85 service nova] Creating event network-changed:bd1e9500-c9d2-4a4b-bbc3-fc1261110821 for instance b302a057-8ba0-4cec-bcb7-805bd598c638 on hv-cinder-81803 Dec 15 03:04:44.609573 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: INFO nova.api.openstack.requestlog [req-26c9fbf8-78f7-4155-bbbb-bd3d6d5001df req-2ee4e55b-69d0-48b2-bee3-6f05a2274f85 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038499 Dec 15 03:04:44.611414 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: [pid: 116156|app: 0|req: 123/213] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Dec 15 03:04:44 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 03:04:44.693206 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi [None req-4ebce433-9f74-4791-a5c4-c8660e1c6091 tempest-VolumesActionsTest-1837279088 tempest-VolumesActionsTest-1837279088-project] Calling method '>' {{(pid=116156) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:04:44.694729 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.compute.api [None req-4ebce433-9f74-4791-a5c4-c8660e1c6091 tempest-VolumesActionsTest-1837279088 tempest-VolumesActionsTest-1837279088-project] [instance: 0c1f5052-62a2-4847-ab40-6e1a9df040ca] Fetching instance by UUID {{(pid=116156) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:04:44.709703 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-4ebce433-9f74-4791-a5c4-c8660e1c6091 tempest-VolumesActionsTest-1837279088 tempest-VolumesActionsTest-1837279088-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:04:44.710224 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-4ebce433-9f74-4791-a5c4-c8660e1c6091 tempest-VolumesActionsTest-1837279088 tempest-VolumesActionsTest-1837279088-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:04:44.711021 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-4ebce433-9f74-4791-a5c4-c8660e1c6091 tempest-VolumesActionsTest-1837279088 tempest-VolumesActionsTest-1837279088-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:04:44.711643 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-4ebce433-9f74-4791-a5c4-c8660e1c6091 tempest-VolumesActionsTest-1837279088 tempest-VolumesActionsTest-1837279088-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:04:45.016220 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.policy [None req-62caa708-69c6-4e4b-9b48-04bceb249ec0 tempest-AttachVolumeNegativeTest-1640336653 tempest-AttachVolumeNegativeTest-1640336653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35d37a3d8e504b8186182468b77dd114', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '409b41637da94c469444954258444b4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116157) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:04:45.024373 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: INFO nova.api.openstack.requestlog [None req-62caa708-69c6-4e4b-9b48-04bceb249ec0 tempest-AttachVolumeNegativeTest-1640336653 tempest-AttachVolumeNegativeTest-1640336653-project] 10.222.0.18 "GET /compute/v2.1/servers/b302a057-8ba0-4cec-bcb7-805bd598c638" status: 200 len: 1317 microversion: 2.1 time: 0.761310 Dec 15 03:04:45.025042 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: [pid: 116157|app: 0|req: 91/214] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 03:04:44 2021] GET /compute/v2.1/servers/b302a057-8ba0-4cec-bcb7-805bd598c638 => generated 1317 bytes in 764 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 03:04:45.200036 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.policy [None req-4ebce433-9f74-4791-a5c4-c8660e1c6091 tempest-VolumesActionsTest-1837279088 tempest-VolumesActionsTest-1837279088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e440754469c4407840a651d560ce08a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6eaf458d3c84ba59b078dc0a3bf1763', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116156) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:04:45.210261 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: INFO nova.api.openstack.requestlog [None req-4ebce433-9f74-4791-a5c4-c8660e1c6091 tempest-VolumesActionsTest-1837279088 tempest-VolumesActionsTest-1837279088-project] 10.222.0.18 "GET /compute/v2.1/servers/0c1f5052-62a2-4847-ab40-6e1a9df040ca" status: 200 len: 1313 microversion: 2.1 time: 0.529257 Dec 15 03:04:45.211700 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: [pid: 116156|app: 0|req: 124/215] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 03:04:44 2021] GET /compute/v2.1/servers/0c1f5052-62a2-4847-ab40-6e1a9df040ca => generated 1313 bytes in 532 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 03:04:45.384380 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi [None req-c5c065a1-1c0d-4d7c-996a-164465e88dff tempest-ServerRescueNegativeTestJSON-2061875223 tempest-ServerRescueNegativeTestJSON-2061875223-project] Calling method '>' {{(pid=116157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:04:45.386007 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.compute.api [None req-c5c065a1-1c0d-4d7c-996a-164465e88dff tempest-ServerRescueNegativeTestJSON-2061875223 tempest-ServerRescueNegativeTestJSON-2061875223-project] [instance: 9bbb0abf-72a3-4fbc-8235-7a3ecfc8d006] Fetching instance by UUID {{(pid=116157) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:04:45.398419 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-c5c065a1-1c0d-4d7c-996a-164465e88dff tempest-ServerRescueNegativeTestJSON-2061875223 tempest-ServerRescueNegativeTestJSON-2061875223-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:04:45.399077 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-c5c065a1-1c0d-4d7c-996a-164465e88dff tempest-ServerRescueNegativeTestJSON-2061875223 tempest-ServerRescueNegativeTestJSON-2061875223-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:04:45.401308 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-c5c065a1-1c0d-4d7c-996a-164465e88dff tempest-ServerRescueNegativeTestJSON-2061875223 tempest-ServerRescueNegativeTestJSON-2061875223-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:04:45.403881 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-c5c065a1-1c0d-4d7c-996a-164465e88dff tempest-ServerRescueNegativeTestJSON-2061875223 tempest-ServerRescueNegativeTestJSON-2061875223-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:04:45.595100 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi [None req-46ff1238-74c4-4836-8cb3-489a828b3b9a tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Calling method '>' {{(pid=116156) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:04:45.597215 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.compute.api [None req-46ff1238-74c4-4836-8cb3-489a828b3b9a tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] [instance: b89094ac-aee1-4bd6-a33d-8c4347cebfc7] Fetching instance by UUID {{(pid=116156) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:04:45.610243 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-46ff1238-74c4-4836-8cb3-489a828b3b9a tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:04:45.611489 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-46ff1238-74c4-4836-8cb3-489a828b3b9a tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:04:45.613078 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-46ff1238-74c4-4836-8cb3-489a828b3b9a tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:04:45.615264 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-46ff1238-74c4-4836-8cb3-489a828b3b9a tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:04:45.628375 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.policy [None req-c5c065a1-1c0d-4d7c-996a-164465e88dff tempest-ServerRescueNegativeTestJSON-2061875223 tempest-ServerRescueNegativeTestJSON-2061875223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ea02b6e8f1548a1bd78952cb7337403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5e8a958d4bf43868502b13728b9583b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116157) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:04:45.637236 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: INFO nova.api.openstack.requestlog [None req-c5c065a1-1c0d-4d7c-996a-164465e88dff tempest-ServerRescueNegativeTestJSON-2061875223 tempest-ServerRescueNegativeTestJSON-2061875223-project] 10.222.0.18 "GET /compute/v2.1/servers/9bbb0abf-72a3-4fbc-8235-7a3ecfc8d006" status: 200 len: 1521 microversion: 2.1 time: 0.259812 Dec 15 03:04:45.637823 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: [pid: 116157|app: 0|req: 92/216] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 03:04:45 2021] GET /compute/v2.1/servers/9bbb0abf-72a3-4fbc-8235-7a3ecfc8d006 => generated 1521 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 03:04:45.839435 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.policy [None req-46ff1238-74c4-4836-8cb3-489a828b3b9a tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fedc11e2dbd74b919982a0657222cca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f16202549724b878f908d68384ec9c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116156) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:04:45.848531 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.policy [None req-46ff1238-74c4-4836-8cb3-489a828b3b9a tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fedc11e2dbd74b919982a0657222cca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f16202549724b878f908d68384ec9c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116156) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:04:45.850256 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.policy [None req-46ff1238-74c4-4836-8cb3-489a828b3b9a tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fedc11e2dbd74b919982a0657222cca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f16202549724b878f908d68384ec9c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116156) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:04:45.851430 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: INFO nova.api.openstack.requestlog [None req-46ff1238-74c4-4836-8cb3-489a828b3b9a tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] 10.222.0.18 "GET /compute/v2.1/servers/b89094ac-aee1-4bd6-a33d-8c4347cebfc7" status: 200 len: 1406 microversion: 2.20 time: 0.263094 Dec 15 03:04:45.852008 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: [pid: 116156|app: 0|req: 125/217] 10.222.0.18 () {60 vars in 1276 bytes} [Wed Dec 15 03:04:45 2021] GET /compute/v2.1/servers/b89094ac-aee1-4bd6-a33d-8c4347cebfc7 => generated 1406 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 03:04:46.041617 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi [None req-e6a41d9a-660f-4621-8492-cfda9b784abf tempest-AttachVolumeNegativeTest-1640336653 tempest-AttachVolumeNegativeTest-1640336653-project] Calling method '>' {{(pid=116157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:04:46.042245 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.compute.api [None req-e6a41d9a-660f-4621-8492-cfda9b784abf tempest-AttachVolumeNegativeTest-1640336653 tempest-AttachVolumeNegativeTest-1640336653-project] [instance: b302a057-8ba0-4cec-bcb7-805bd598c638] Fetching instance by UUID {{(pid=116157) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:04:46.048715 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-e6a41d9a-660f-4621-8492-cfda9b784abf tempest-AttachVolumeNegativeTest-1640336653 tempest-AttachVolumeNegativeTest-1640336653-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:04:46.049393 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-e6a41d9a-660f-4621-8492-cfda9b784abf tempest-AttachVolumeNegativeTest-1640336653 tempest-AttachVolumeNegativeTest-1640336653-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:04:46.050211 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-e6a41d9a-660f-4621-8492-cfda9b784abf tempest-AttachVolumeNegativeTest-1640336653 tempest-AttachVolumeNegativeTest-1640336653-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:04:46.050638 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-e6a41d9a-660f-4621-8492-cfda9b784abf tempest-AttachVolumeNegativeTest-1640336653 tempest-AttachVolumeNegativeTest-1640336653-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:04:46.211384 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.policy [None req-e6a41d9a-660f-4621-8492-cfda9b784abf tempest-AttachVolumeNegativeTest-1640336653 tempest-AttachVolumeNegativeTest-1640336653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35d37a3d8e504b8186182468b77dd114', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '409b41637da94c469444954258444b4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116157) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:04:46.218451 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: INFO nova.api.openstack.requestlog [None req-e6a41d9a-660f-4621-8492-cfda9b784abf tempest-AttachVolumeNegativeTest-1640336653 tempest-AttachVolumeNegativeTest-1640336653-project] 10.222.0.18 "GET /compute/v2.1/servers/b302a057-8ba0-4cec-bcb7-805bd598c638" status: 200 len: 1317 microversion: 2.1 time: 0.180430 Dec 15 03:04:46.222032 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: [pid: 116157|app: 0|req: 93/218] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 03:04:46 2021] GET /compute/v2.1/servers/b302a057-8ba0-4cec-bcb7-805bd598c638 => generated 1317 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 03:04:46.230732 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi [None req-d8c253de-cd73-4bd2-8780-aa9d52a9215d tempest-VolumesActionsTest-1837279088 tempest-VolumesActionsTest-1837279088-project] Calling method '>' {{(pid=116156) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:04:46.231564 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.compute.api [None req-d8c253de-cd73-4bd2-8780-aa9d52a9215d tempest-VolumesActionsTest-1837279088 tempest-VolumesActionsTest-1837279088-project] [instance: 0c1f5052-62a2-4847-ab40-6e1a9df040ca] Fetching instance by UUID {{(pid=116156) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:04:46.238548 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-d8c253de-cd73-4bd2-8780-aa9d52a9215d tempest-VolumesActionsTest-1837279088 tempest-VolumesActionsTest-1837279088-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:04:46.238995 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-d8c253de-cd73-4bd2-8780-aa9d52a9215d tempest-VolumesActionsTest-1837279088 tempest-VolumesActionsTest-1837279088-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:04:46.239792 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-d8c253de-cd73-4bd2-8780-aa9d52a9215d tempest-VolumesActionsTest-1837279088 tempest-VolumesActionsTest-1837279088-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:04:46.240216 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-d8c253de-cd73-4bd2-8780-aa9d52a9215d tempest-VolumesActionsTest-1837279088 tempest-VolumesActionsTest-1837279088-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:04:46.379675 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.policy [None req-d8c253de-cd73-4bd2-8780-aa9d52a9215d tempest-VolumesActionsTest-1837279088 tempest-VolumesActionsTest-1837279088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e440754469c4407840a651d560ce08a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6eaf458d3c84ba59b078dc0a3bf1763', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116156) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:04:46.387137 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: INFO nova.api.openstack.requestlog [None req-d8c253de-cd73-4bd2-8780-aa9d52a9215d tempest-VolumesActionsTest-1837279088 tempest-VolumesActionsTest-1837279088-project] 10.222.0.18 "GET /compute/v2.1/servers/0c1f5052-62a2-4847-ab40-6e1a9df040ca" status: 200 len: 1313 microversion: 2.1 time: 0.159842 Dec 15 03:04:46.387629 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: [pid: 116156|app: 0|req: 126/219] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 03:04:46 2021] GET /compute/v2.1/servers/0c1f5052-62a2-4847-ab40-6e1a9df040ca => generated 1313 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 03:04:46.655704 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi [None req-bab7d739-98ce-4b7d-abd5-d09510c5c707 tempest-ServerRescueNegativeTestJSON-2061875223 tempest-ServerRescueNegativeTestJSON-2061875223-project] Calling method '>' {{(pid=116157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:04:46.656304 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.compute.api [None req-bab7d739-98ce-4b7d-abd5-d09510c5c707 tempest-ServerRescueNegativeTestJSON-2061875223 tempest-ServerRescueNegativeTestJSON-2061875223-project] [instance: 9bbb0abf-72a3-4fbc-8235-7a3ecfc8d006] Fetching instance by UUID {{(pid=116157) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:04:46.662517 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-bab7d739-98ce-4b7d-abd5-d09510c5c707 tempest-ServerRescueNegativeTestJSON-2061875223 tempest-ServerRescueNegativeTestJSON-2061875223-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:04:46.662966 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-bab7d739-98ce-4b7d-abd5-d09510c5c707 tempest-ServerRescueNegativeTestJSON-2061875223 tempest-ServerRescueNegativeTestJSON-2061875223-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:04:46.663765 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-bab7d739-98ce-4b7d-abd5-d09510c5c707 tempest-ServerRescueNegativeTestJSON-2061875223 tempest-ServerRescueNegativeTestJSON-2061875223-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:04:46.664203 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-bab7d739-98ce-4b7d-abd5-d09510c5c707 tempest-ServerRescueNegativeTestJSON-2061875223 tempest-ServerRescueNegativeTestJSON-2061875223-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:04:46.803897 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.policy [None req-bab7d739-98ce-4b7d-abd5-d09510c5c707 tempest-ServerRescueNegativeTestJSON-2061875223 tempest-ServerRescueNegativeTestJSON-2061875223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ea02b6e8f1548a1bd78952cb7337403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5e8a958d4bf43868502b13728b9583b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116157) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:04:46.812525 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: INFO nova.api.openstack.requestlog [None req-bab7d739-98ce-4b7d-abd5-d09510c5c707 tempest-ServerRescueNegativeTestJSON-2061875223 tempest-ServerRescueNegativeTestJSON-2061875223-project] 10.222.0.18 "GET /compute/v2.1/servers/9bbb0abf-72a3-4fbc-8235-7a3ecfc8d006" status: 200 len: 1521 microversion: 2.1 time: 0.160390 Dec 15 03:04:46.813649 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: [pid: 116157|app: 0|req: 94/220] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 03:04:46 2021] GET /compute/v2.1/servers/9bbb0abf-72a3-4fbc-8235-7a3ecfc8d006 => generated 1521 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 03:04:46.872419 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi [None req-361d14d7-bb9e-4a42-8841-d5692547e7db tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Calling method '>' {{(pid=116156) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:04:46.872978 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.compute.api [None req-361d14d7-bb9e-4a42-8841-d5692547e7db tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] [instance: b89094ac-aee1-4bd6-a33d-8c4347cebfc7] Fetching instance by UUID {{(pid=116156) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:04:46.887155 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-361d14d7-bb9e-4a42-8841-d5692547e7db tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:04:46.887715 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-361d14d7-bb9e-4a42-8841-d5692547e7db tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:04:46.888377 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-361d14d7-bb9e-4a42-8841-d5692547e7db tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:04:46.888807 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-361d14d7-bb9e-4a42-8841-d5692547e7db tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:04:47.049359 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.policy [None req-361d14d7-bb9e-4a42-8841-d5692547e7db tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fedc11e2dbd74b919982a0657222cca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f16202549724b878f908d68384ec9c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116156) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:04:47.057036 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.policy [None req-361d14d7-bb9e-4a42-8841-d5692547e7db tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fedc11e2dbd74b919982a0657222cca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f16202549724b878f908d68384ec9c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116156) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:04:47.058733 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.policy [None req-361d14d7-bb9e-4a42-8841-d5692547e7db tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fedc11e2dbd74b919982a0657222cca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f16202549724b878f908d68384ec9c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116156) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:04:47.059845 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: INFO nova.api.openstack.requestlog [None req-361d14d7-bb9e-4a42-8841-d5692547e7db tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] 10.222.0.18 "GET /compute/v2.1/servers/b89094ac-aee1-4bd6-a33d-8c4347cebfc7" status: 200 len: 1406 microversion: 2.20 time: 0.193687 Dec 15 03:04:47.060744 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: [pid: 116156|app: 0|req: 127/221] 10.222.0.18 () {60 vars in 1276 bytes} [Wed Dec 15 03:04:46 2021] GET /compute/v2.1/servers/b89094ac-aee1-4bd6-a33d-8c4347cebfc7 => generated 1406 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 03:04:47.234997 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi [None req-7aa2e898-aef6-4161-88a9-f2b6383d0119 tempest-AttachVolumeNegativeTest-1640336653 tempest-AttachVolumeNegativeTest-1640336653-project] Calling method '>' {{(pid=116157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:04:47.235585 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.compute.api [None req-7aa2e898-aef6-4161-88a9-f2b6383d0119 tempest-AttachVolumeNegativeTest-1640336653 tempest-AttachVolumeNegativeTest-1640336653-project] [instance: b302a057-8ba0-4cec-bcb7-805bd598c638] Fetching instance by UUID {{(pid=116157) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:04:47.241688 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-7aa2e898-aef6-4161-88a9-f2b6383d0119 tempest-AttachVolumeNegativeTest-1640336653 tempest-AttachVolumeNegativeTest-1640336653-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:04:47.242164 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-7aa2e898-aef6-4161-88a9-f2b6383d0119 tempest-AttachVolumeNegativeTest-1640336653 tempest-AttachVolumeNegativeTest-1640336653-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:04:47.242936 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-7aa2e898-aef6-4161-88a9-f2b6383d0119 tempest-AttachVolumeNegativeTest-1640336653 tempest-AttachVolumeNegativeTest-1640336653-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:04:47.243369 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-7aa2e898-aef6-4161-88a9-f2b6383d0119 tempest-AttachVolumeNegativeTest-1640336653 tempest-AttachVolumeNegativeTest-1640336653-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:04:47.373845 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.policy [None req-7aa2e898-aef6-4161-88a9-f2b6383d0119 tempest-AttachVolumeNegativeTest-1640336653 tempest-AttachVolumeNegativeTest-1640336653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35d37a3d8e504b8186182468b77dd114', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '409b41637da94c469444954258444b4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116157) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:04:47.381639 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: INFO nova.api.openstack.requestlog [None req-7aa2e898-aef6-4161-88a9-f2b6383d0119 tempest-AttachVolumeNegativeTest-1640336653 tempest-AttachVolumeNegativeTest-1640336653-project] 10.222.0.18 "GET /compute/v2.1/servers/b302a057-8ba0-4cec-bcb7-805bd598c638" status: 200 len: 1317 microversion: 2.1 time: 0.150228 Dec 15 03:04:47.382231 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: [pid: 116157|app: 0|req: 95/222] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 03:04:47 2021] GET /compute/v2.1/servers/b302a057-8ba0-4cec-bcb7-805bd598c638 => generated 1317 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 03:04:47.403753 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi [None req-670f75df-7f92-4dbf-9e8c-f43aec952841 tempest-VolumesActionsTest-1837279088 tempest-VolumesActionsTest-1837279088-project] Calling method '>' {{(pid=116156) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:04:47.404454 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.compute.api [None req-670f75df-7f92-4dbf-9e8c-f43aec952841 tempest-VolumesActionsTest-1837279088 tempest-VolumesActionsTest-1837279088-project] [instance: 0c1f5052-62a2-4847-ab40-6e1a9df040ca] Fetching instance by UUID {{(pid=116156) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:04:47.411489 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-670f75df-7f92-4dbf-9e8c-f43aec952841 tempest-VolumesActionsTest-1837279088 tempest-VolumesActionsTest-1837279088-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:04:47.412177 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-670f75df-7f92-4dbf-9e8c-f43aec952841 tempest-VolumesActionsTest-1837279088 tempest-VolumesActionsTest-1837279088-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:04:47.413221 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-670f75df-7f92-4dbf-9e8c-f43aec952841 tempest-VolumesActionsTest-1837279088 tempest-VolumesActionsTest-1837279088-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:04:47.413783 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-670f75df-7f92-4dbf-9e8c-f43aec952841 tempest-VolumesActionsTest-1837279088 tempest-VolumesActionsTest-1837279088-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:04:47.550467 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.policy [None req-670f75df-7f92-4dbf-9e8c-f43aec952841 tempest-VolumesActionsTest-1837279088 tempest-VolumesActionsTest-1837279088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e440754469c4407840a651d560ce08a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6eaf458d3c84ba59b078dc0a3bf1763', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116156) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:04:47.557760 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: INFO nova.api.openstack.requestlog [None req-670f75df-7f92-4dbf-9e8c-f43aec952841 tempest-VolumesActionsTest-1837279088 tempest-VolumesActionsTest-1837279088-project] 10.222.0.18 "GET /compute/v2.1/servers/0c1f5052-62a2-4847-ab40-6e1a9df040ca" status: 200 len: 1313 microversion: 2.1 time: 0.157757 Dec 15 03:04:47.558509 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: [pid: 116156|app: 0|req: 128/223] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 03:04:47 2021] GET /compute/v2.1/servers/0c1f5052-62a2-4847-ab40-6e1a9df040ca => generated 1313 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 03:04:47.828764 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi [None req-a03d4475-8d73-48b3-9b38-3072531a259f tempest-ServerRescueNegativeTestJSON-2061875223 tempest-ServerRescueNegativeTestJSON-2061875223-project] Calling method '>' {{(pid=116157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:04:47.829442 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.compute.api [None req-a03d4475-8d73-48b3-9b38-3072531a259f tempest-ServerRescueNegativeTestJSON-2061875223 tempest-ServerRescueNegativeTestJSON-2061875223-project] [instance: 9bbb0abf-72a3-4fbc-8235-7a3ecfc8d006] Fetching instance by UUID {{(pid=116157) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:04:47.835156 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-a03d4475-8d73-48b3-9b38-3072531a259f tempest-ServerRescueNegativeTestJSON-2061875223 tempest-ServerRescueNegativeTestJSON-2061875223-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:04:47.835607 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-a03d4475-8d73-48b3-9b38-3072531a259f tempest-ServerRescueNegativeTestJSON-2061875223 tempest-ServerRescueNegativeTestJSON-2061875223-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:04:47.836554 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-a03d4475-8d73-48b3-9b38-3072531a259f tempest-ServerRescueNegativeTestJSON-2061875223 tempest-ServerRescueNegativeTestJSON-2061875223-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:04:47.837001 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-a03d4475-8d73-48b3-9b38-3072531a259f tempest-ServerRescueNegativeTestJSON-2061875223 tempest-ServerRescueNegativeTestJSON-2061875223-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:04:47.980842 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.policy [None req-a03d4475-8d73-48b3-9b38-3072531a259f tempest-ServerRescueNegativeTestJSON-2061875223 tempest-ServerRescueNegativeTestJSON-2061875223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ea02b6e8f1548a1bd78952cb7337403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5e8a958d4bf43868502b13728b9583b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116157) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:04:47.987818 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: INFO nova.api.openstack.requestlog [None req-a03d4475-8d73-48b3-9b38-3072531a259f tempest-ServerRescueNegativeTestJSON-2061875223 tempest-ServerRescueNegativeTestJSON-2061875223-project] 10.222.0.18 "GET /compute/v2.1/servers/9bbb0abf-72a3-4fbc-8235-7a3ecfc8d006" status: 200 len: 1521 microversion: 2.1 time: 0.162640 Dec 15 03:04:47.988397 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: [pid: 116157|app: 0|req: 96/224] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 03:04:47 2021] GET /compute/v2.1/servers/9bbb0abf-72a3-4fbc-8235-7a3ecfc8d006 => generated 1521 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 03:04:48.081201 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi [None req-e0258b76-178e-406b-a06c-60b227c008bf tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Calling method '>' {{(pid=116156) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:04:48.082082 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.compute.api [None req-e0258b76-178e-406b-a06c-60b227c008bf tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] [instance: b89094ac-aee1-4bd6-a33d-8c4347cebfc7] Fetching instance by UUID {{(pid=116156) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:04:48.089923 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-e0258b76-178e-406b-a06c-60b227c008bf tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:04:48.090681 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-e0258b76-178e-406b-a06c-60b227c008bf tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:04:48.091762 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-e0258b76-178e-406b-a06c-60b227c008bf tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:04:48.092572 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-e0258b76-178e-406b-a06c-60b227c008bf tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:04:48.391489 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.policy [None req-e0258b76-178e-406b-a06c-60b227c008bf tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fedc11e2dbd74b919982a0657222cca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f16202549724b878f908d68384ec9c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116156) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:04:48.398511 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi [None req-18e2c031-0422-4a04-bf1a-294f656cb091 tempest-AttachVolumeNegativeTest-1640336653 tempest-AttachVolumeNegativeTest-1640336653-project] Calling method '>' {{(pid=116157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:04:48.399135 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.compute.api [None req-18e2c031-0422-4a04-bf1a-294f656cb091 tempest-AttachVolumeNegativeTest-1640336653 tempest-AttachVolumeNegativeTest-1640336653-project] [instance: b302a057-8ba0-4cec-bcb7-805bd598c638] Fetching instance by UUID {{(pid=116157) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:04:48.404598 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.policy [None req-e0258b76-178e-406b-a06c-60b227c008bf tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fedc11e2dbd74b919982a0657222cca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f16202549724b878f908d68384ec9c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116156) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:04:48.407241 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-18e2c031-0422-4a04-bf1a-294f656cb091 tempest-AttachVolumeNegativeTest-1640336653 tempest-AttachVolumeNegativeTest-1640336653-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:04:48.407927 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.policy [None req-e0258b76-178e-406b-a06c-60b227c008bf tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fedc11e2dbd74b919982a0657222cca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f16202549724b878f908d68384ec9c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116156) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:04:48.410359 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-18e2c031-0422-4a04-bf1a-294f656cb091 tempest-AttachVolumeNegativeTest-1640336653 tempest-AttachVolumeNegativeTest-1640336653-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:04:48.410607 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: INFO nova.api.openstack.requestlog [None req-e0258b76-178e-406b-a06c-60b227c008bf tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] 10.222.0.18 "GET /compute/v2.1/servers/b89094ac-aee1-4bd6-a33d-8c4347cebfc7" status: 200 len: 1406 microversion: 2.20 time: 0.333077 Dec 15 03:04:48.411236 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-18e2c031-0422-4a04-bf1a-294f656cb091 tempest-AttachVolumeNegativeTest-1640336653 tempest-AttachVolumeNegativeTest-1640336653-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:04:48.411688 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-18e2c031-0422-4a04-bf1a-294f656cb091 tempest-AttachVolumeNegativeTest-1640336653 tempest-AttachVolumeNegativeTest-1640336653-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:04:48.411819 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: [pid: 116156|app: 0|req: 129/225] 10.222.0.18 () {60 vars in 1276 bytes} [Wed Dec 15 03:04:48 2021] GET /compute/v2.1/servers/b89094ac-aee1-4bd6-a33d-8c4347cebfc7 => generated 1406 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Dec 15 03:04:48.575007 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi [None req-eace834b-cf7c-4302-a6e8-ceb162894e04 tempest-VolumesActionsTest-1837279088 tempest-VolumesActionsTest-1837279088-project] Calling method '>' {{(pid=116156) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:04:48.575715 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.compute.api [None req-eace834b-cf7c-4302-a6e8-ceb162894e04 tempest-VolumesActionsTest-1837279088 tempest-VolumesActionsTest-1837279088-project] [instance: 0c1f5052-62a2-4847-ab40-6e1a9df040ca] Fetching instance by UUID {{(pid=116156) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:04:48.582556 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-eace834b-cf7c-4302-a6e8-ceb162894e04 tempest-VolumesActionsTest-1837279088 tempest-VolumesActionsTest-1837279088-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:04:48.583363 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-eace834b-cf7c-4302-a6e8-ceb162894e04 tempest-VolumesActionsTest-1837279088 tempest-VolumesActionsTest-1837279088-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:04:48.584372 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-eace834b-cf7c-4302-a6e8-ceb162894e04 tempest-VolumesActionsTest-1837279088 tempest-VolumesActionsTest-1837279088-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:04:48.585041 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-eace834b-cf7c-4302-a6e8-ceb162894e04 tempest-VolumesActionsTest-1837279088 tempest-VolumesActionsTest-1837279088-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:04:48.706711 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.policy [None req-18e2c031-0422-4a04-bf1a-294f656cb091 tempest-AttachVolumeNegativeTest-1640336653 tempest-AttachVolumeNegativeTest-1640336653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35d37a3d8e504b8186182468b77dd114', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '409b41637da94c469444954258444b4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116157) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:04:48.720047 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: INFO nova.api.openstack.requestlog [None req-18e2c031-0422-4a04-bf1a-294f656cb091 tempest-AttachVolumeNegativeTest-1640336653 tempest-AttachVolumeNegativeTest-1640336653-project] 10.222.0.18 "GET /compute/v2.1/servers/b302a057-8ba0-4cec-bcb7-805bd598c638" status: 200 len: 1317 microversion: 2.1 time: 0.324819 Dec 15 03:04:48.720794 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: [pid: 116157|app: 0|req: 97/226] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 03:04:48 2021] GET /compute/v2.1/servers/b302a057-8ba0-4cec-bcb7-805bd598c638 => generated 1317 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 03:04:48.755734 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.policy [None req-eace834b-cf7c-4302-a6e8-ceb162894e04 tempest-VolumesActionsTest-1837279088 tempest-VolumesActionsTest-1837279088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e440754469c4407840a651d560ce08a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6eaf458d3c84ba59b078dc0a3bf1763', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116156) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:04:48.763218 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: INFO nova.api.openstack.requestlog [None req-eace834b-cf7c-4302-a6e8-ceb162894e04 tempest-VolumesActionsTest-1837279088 tempest-VolumesActionsTest-1837279088-project] 10.222.0.18 "GET /compute/v2.1/servers/0c1f5052-62a2-4847-ab40-6e1a9df040ca" status: 200 len: 1313 microversion: 2.1 time: 0.192153 Dec 15 03:04:48.767137 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: [pid: 116156|app: 0|req: 130/227] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 03:04:48 2021] GET /compute/v2.1/servers/0c1f5052-62a2-4847-ab40-6e1a9df040ca => generated 1313 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 03:04:48.999251 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi [req-bdcc9748-d53a-4aac-8d0a-723f4bcd2f9e req-7fdc4ac3-39b1-4d11-8a00-79ea7b76bbe4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b89094ac-aee1-4bd6-a33d-8c4347cebfc7", "tag": "455e429c-96fb-4858-b8fe-cf282ae96b72"}]} {{(pid=116157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 03:04:49.001652 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 15 03:04:49.001652 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: warnings.warn(msg) Dec 15 03:04:49.007156 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi [None req-c35e9e9f-482d-4ac3-b4c2-602a27972f91 tempest-ServerRescueNegativeTestJSON-2061875223 tempest-ServerRescueNegativeTestJSON-2061875223-project] Calling method '>' {{(pid=116156) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:04:49.008184 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.compute.api [None req-c35e9e9f-482d-4ac3-b4c2-602a27972f91 tempest-ServerRescueNegativeTestJSON-2061875223 tempest-ServerRescueNegativeTestJSON-2061875223-project] [instance: 9bbb0abf-72a3-4fbc-8235-7a3ecfc8d006] Fetching instance by UUID {{(pid=116156) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:04:49.015261 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-c35e9e9f-482d-4ac3-b4c2-602a27972f91 tempest-ServerRescueNegativeTestJSON-2061875223 tempest-ServerRescueNegativeTestJSON-2061875223-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:04:49.016279 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-c35e9e9f-482d-4ac3-b4c2-602a27972f91 tempest-ServerRescueNegativeTestJSON-2061875223 tempest-ServerRescueNegativeTestJSON-2061875223-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:04:49.016507 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [req-bdcc9748-d53a-4aac-8d0a-723f4bcd2f9e req-7fdc4ac3-39b1-4d11-8a00-79ea7b76bbe4 service nova] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:04:49.017059 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [req-bdcc9748-d53a-4aac-8d0a-723f4bcd2f9e req-7fdc4ac3-39b1-4d11-8a00-79ea7b76bbe4 service nova] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:04:49.018490 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-c35e9e9f-482d-4ac3-b4c2-602a27972f91 tempest-ServerRescueNegativeTestJSON-2061875223 tempest-ServerRescueNegativeTestJSON-2061875223-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:04:49.019308 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-c35e9e9f-482d-4ac3-b4c2-602a27972f91 tempest-ServerRescueNegativeTestJSON-2061875223 tempest-ServerRescueNegativeTestJSON-2061875223-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:04:49.048454 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: INFO nova.api.openstack.compute.server_external_events [req-bdcc9748-d53a-4aac-8d0a-723f4bcd2f9e req-7fdc4ac3-39b1-4d11-8a00-79ea7b76bbe4 service nova] Creating event network-changed:455e429c-96fb-4858-b8fe-cf282ae96b72 for instance b89094ac-aee1-4bd6-a33d-8c4347cebfc7 on hv-cinder-81803 Dec 15 03:04:49.054920 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: INFO nova.api.openstack.requestlog [req-bdcc9748-d53a-4aac-8d0a-723f4bcd2f9e req-7fdc4ac3-39b1-4d11-8a00-79ea7b76bbe4 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.058582 Dec 15 03:04:49.055652 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: [pid: 116157|app: 0|req: 98/228] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Dec 15 03:04:48 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 03:04:49.213206 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.policy [None req-c35e9e9f-482d-4ac3-b4c2-602a27972f91 tempest-ServerRescueNegativeTestJSON-2061875223 tempest-ServerRescueNegativeTestJSON-2061875223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ea02b6e8f1548a1bd78952cb7337403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5e8a958d4bf43868502b13728b9583b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116156) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:04:49.221911 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: INFO nova.api.openstack.requestlog [None req-c35e9e9f-482d-4ac3-b4c2-602a27972f91 tempest-ServerRescueNegativeTestJSON-2061875223 tempest-ServerRescueNegativeTestJSON-2061875223-project] 10.222.0.18 "GET /compute/v2.1/servers/9bbb0abf-72a3-4fbc-8235-7a3ecfc8d006" status: 200 len: 1521 microversion: 2.1 time: 0.220170 Dec 15 03:04:49.222509 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: [pid: 116156|app: 0|req: 131/229] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 03:04:48 2021] GET /compute/v2.1/servers/9bbb0abf-72a3-4fbc-8235-7a3ecfc8d006 => generated 1521 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 03:04:49.432529 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi [None req-63c1914d-f9f5-41cb-9070-8f40afaf553d tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Calling method '>' {{(pid=116157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:04:49.433216 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.compute.api [None req-63c1914d-f9f5-41cb-9070-8f40afaf553d tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] [instance: b89094ac-aee1-4bd6-a33d-8c4347cebfc7] Fetching instance by UUID {{(pid=116157) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:04:49.440046 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-63c1914d-f9f5-41cb-9070-8f40afaf553d tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:04:49.440773 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-63c1914d-f9f5-41cb-9070-8f40afaf553d tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:04:49.441735 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-63c1914d-f9f5-41cb-9070-8f40afaf553d tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:04:49.442194 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-63c1914d-f9f5-41cb-9070-8f40afaf553d tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:04:49.586837 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.policy [None req-63c1914d-f9f5-41cb-9070-8f40afaf553d tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fedc11e2dbd74b919982a0657222cca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f16202549724b878f908d68384ec9c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116157) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:04:49.595337 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.policy [None req-63c1914d-f9f5-41cb-9070-8f40afaf553d tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fedc11e2dbd74b919982a0657222cca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f16202549724b878f908d68384ec9c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116157) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:04:49.596941 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.policy [None req-63c1914d-f9f5-41cb-9070-8f40afaf553d tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fedc11e2dbd74b919982a0657222cca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f16202549724b878f908d68384ec9c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116157) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:04:49.598319 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: INFO nova.api.openstack.requestlog [None req-63c1914d-f9f5-41cb-9070-8f40afaf553d tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] 10.222.0.18 "GET /compute/v2.1/servers/b89094ac-aee1-4bd6-a33d-8c4347cebfc7" status: 200 len: 1406 microversion: 2.20 time: 0.170339 Dec 15 03:04:49.599200 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: [pid: 116157|app: 0|req: 99/230] 10.222.0.18 () {60 vars in 1276 bytes} [Wed Dec 15 03:04:49 2021] GET /compute/v2.1/servers/b89094ac-aee1-4bd6-a33d-8c4347cebfc7 => generated 1406 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Dec 15 03:04:49.737063 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi [None req-aa90de4a-0884-4141-be51-2559c82334ee tempest-AttachVolumeNegativeTest-1640336653 tempest-AttachVolumeNegativeTest-1640336653-project] Calling method '>' {{(pid=116156) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:04:49.737674 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.compute.api [None req-aa90de4a-0884-4141-be51-2559c82334ee tempest-AttachVolumeNegativeTest-1640336653 tempest-AttachVolumeNegativeTest-1640336653-project] [instance: b302a057-8ba0-4cec-bcb7-805bd598c638] Fetching instance by UUID {{(pid=116156) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:04:49.744202 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-aa90de4a-0884-4141-be51-2559c82334ee tempest-AttachVolumeNegativeTest-1640336653 tempest-AttachVolumeNegativeTest-1640336653-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:04:49.744718 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-aa90de4a-0884-4141-be51-2559c82334ee tempest-AttachVolumeNegativeTest-1640336653 tempest-AttachVolumeNegativeTest-1640336653-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:04:49.745521 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-aa90de4a-0884-4141-be51-2559c82334ee tempest-AttachVolumeNegativeTest-1640336653 tempest-AttachVolumeNegativeTest-1640336653-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:04:49.745962 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-aa90de4a-0884-4141-be51-2559c82334ee tempest-AttachVolumeNegativeTest-1640336653 tempest-AttachVolumeNegativeTest-1640336653-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:04:49.783352 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi [None req-cab2c6ac-3cde-41a9-b60d-5df4b2d3b66d tempest-VolumesActionsTest-1837279088 tempest-VolumesActionsTest-1837279088-project] Calling method '>' {{(pid=116157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:04:49.784214 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.compute.api [None req-cab2c6ac-3cde-41a9-b60d-5df4b2d3b66d tempest-VolumesActionsTest-1837279088 tempest-VolumesActionsTest-1837279088-project] [instance: 0c1f5052-62a2-4847-ab40-6e1a9df040ca] Fetching instance by UUID {{(pid=116157) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:04:49.790271 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-cab2c6ac-3cde-41a9-b60d-5df4b2d3b66d tempest-VolumesActionsTest-1837279088 tempest-VolumesActionsTest-1837279088-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:04:49.790787 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-cab2c6ac-3cde-41a9-b60d-5df4b2d3b66d tempest-VolumesActionsTest-1837279088 tempest-VolumesActionsTest-1837279088-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:04:49.791588 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-cab2c6ac-3cde-41a9-b60d-5df4b2d3b66d tempest-VolumesActionsTest-1837279088 tempest-VolumesActionsTest-1837279088-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:04:49.792083 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-cab2c6ac-3cde-41a9-b60d-5df4b2d3b66d tempest-VolumesActionsTest-1837279088 tempest-VolumesActionsTest-1837279088-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:04:49.905070 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.policy [None req-aa90de4a-0884-4141-be51-2559c82334ee tempest-AttachVolumeNegativeTest-1640336653 tempest-AttachVolumeNegativeTest-1640336653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35d37a3d8e504b8186182468b77dd114', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '409b41637da94c469444954258444b4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116156) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:04:49.913687 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: INFO nova.api.openstack.requestlog [None req-aa90de4a-0884-4141-be51-2559c82334ee tempest-AttachVolumeNegativeTest-1640336653 tempest-AttachVolumeNegativeTest-1640336653-project] 10.222.0.18 "GET /compute/v2.1/servers/b302a057-8ba0-4cec-bcb7-805bd598c638" status: 200 len: 1317 microversion: 2.1 time: 0.180753 Dec 15 03:04:49.914655 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: [pid: 116156|app: 0|req: 132/231] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 03:04:49 2021] GET /compute/v2.1/servers/b302a057-8ba0-4cec-bcb7-805bd598c638 => generated 1317 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 03:04:49.952300 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.policy [None req-cab2c6ac-3cde-41a9-b60d-5df4b2d3b66d tempest-VolumesActionsTest-1837279088 tempest-VolumesActionsTest-1837279088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e440754469c4407840a651d560ce08a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6eaf458d3c84ba59b078dc0a3bf1763', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116157) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:04:49.959773 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: INFO nova.api.openstack.requestlog [None req-cab2c6ac-3cde-41a9-b60d-5df4b2d3b66d tempest-VolumesActionsTest-1837279088 tempest-VolumesActionsTest-1837279088-project] 10.222.0.18 "GET /compute/v2.1/servers/0c1f5052-62a2-4847-ab40-6e1a9df040ca" status: 200 len: 1313 microversion: 2.1 time: 0.180178 Dec 15 03:04:49.960484 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: [pid: 116157|app: 0|req: 100/232] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 03:04:49 2021] GET /compute/v2.1/servers/0c1f5052-62a2-4847-ab40-6e1a9df040ca => generated 1313 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 03:04:50.238628 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi [None req-f9e473f2-990b-4436-879c-9b1fab786ca9 tempest-ServerRescueNegativeTestJSON-2061875223 tempest-ServerRescueNegativeTestJSON-2061875223-project] Calling method '>' {{(pid=116156) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:04:50.239228 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.compute.api [None req-f9e473f2-990b-4436-879c-9b1fab786ca9 tempest-ServerRescueNegativeTestJSON-2061875223 tempest-ServerRescueNegativeTestJSON-2061875223-project] [instance: 9bbb0abf-72a3-4fbc-8235-7a3ecfc8d006] Fetching instance by UUID {{(pid=116156) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:04:50.244839 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-f9e473f2-990b-4436-879c-9b1fab786ca9 tempest-ServerRescueNegativeTestJSON-2061875223 tempest-ServerRescueNegativeTestJSON-2061875223-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:04:50.245284 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-f9e473f2-990b-4436-879c-9b1fab786ca9 tempest-ServerRescueNegativeTestJSON-2061875223 tempest-ServerRescueNegativeTestJSON-2061875223-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:04:50.246085 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-f9e473f2-990b-4436-879c-9b1fab786ca9 tempest-ServerRescueNegativeTestJSON-2061875223 tempest-ServerRescueNegativeTestJSON-2061875223-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:04:50.246770 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-f9e473f2-990b-4436-879c-9b1fab786ca9 tempest-ServerRescueNegativeTestJSON-2061875223 tempest-ServerRescueNegativeTestJSON-2061875223-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:04:50.385618 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.policy [None req-f9e473f2-990b-4436-879c-9b1fab786ca9 tempest-ServerRescueNegativeTestJSON-2061875223 tempest-ServerRescueNegativeTestJSON-2061875223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ea02b6e8f1548a1bd78952cb7337403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5e8a958d4bf43868502b13728b9583b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116156) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:04:50.393705 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: INFO nova.api.openstack.requestlog [None req-f9e473f2-990b-4436-879c-9b1fab786ca9 tempest-ServerRescueNegativeTestJSON-2061875223 tempest-ServerRescueNegativeTestJSON-2061875223-project] 10.222.0.18 "GET /compute/v2.1/servers/9bbb0abf-72a3-4fbc-8235-7a3ecfc8d006" status: 200 len: 1521 microversion: 2.1 time: 0.159216 Dec 15 03:04:50.394403 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: [pid: 116156|app: 0|req: 133/233] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 03:04:50 2021] GET /compute/v2.1/servers/9bbb0abf-72a3-4fbc-8235-7a3ecfc8d006 => generated 1521 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 03:04:50.616965 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi [None req-76f6b495-19d2-4395-8b3d-c1d2659da1f7 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Calling method '>' {{(pid=116157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:04:50.617658 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.compute.api [None req-76f6b495-19d2-4395-8b3d-c1d2659da1f7 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] [instance: b89094ac-aee1-4bd6-a33d-8c4347cebfc7] Fetching instance by UUID {{(pid=116157) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:04:50.624792 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-76f6b495-19d2-4395-8b3d-c1d2659da1f7 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:04:50.625323 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-76f6b495-19d2-4395-8b3d-c1d2659da1f7 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:04:50.626280 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-76f6b495-19d2-4395-8b3d-c1d2659da1f7 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:04:50.626736 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-76f6b495-19d2-4395-8b3d-c1d2659da1f7 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:04:50.769695 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.policy [None req-76f6b495-19d2-4395-8b3d-c1d2659da1f7 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fedc11e2dbd74b919982a0657222cca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f16202549724b878f908d68384ec9c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116157) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:04:50.778192 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.policy [None req-76f6b495-19d2-4395-8b3d-c1d2659da1f7 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fedc11e2dbd74b919982a0657222cca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f16202549724b878f908d68384ec9c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116157) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:04:50.779813 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.policy [None req-76f6b495-19d2-4395-8b3d-c1d2659da1f7 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fedc11e2dbd74b919982a0657222cca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f16202549724b878f908d68384ec9c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116157) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:04:50.780933 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: INFO nova.api.openstack.requestlog [None req-76f6b495-19d2-4395-8b3d-c1d2659da1f7 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] 10.222.0.18 "GET /compute/v2.1/servers/b89094ac-aee1-4bd6-a33d-8c4347cebfc7" status: 200 len: 1406 microversion: 2.20 time: 0.167651 Dec 15 03:04:50.781660 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: [pid: 116157|app: 0|req: 101/234] 10.222.0.18 () {60 vars in 1276 bytes} [Wed Dec 15 03:04:50 2021] GET /compute/v2.1/servers/b89094ac-aee1-4bd6-a33d-8c4347cebfc7 => generated 1406 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 03:04:50.931384 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi [None req-6756e733-9dfc-428d-92f2-274210a625cd tempest-AttachVolumeNegativeTest-1640336653 tempest-AttachVolumeNegativeTest-1640336653-project] Calling method '>' {{(pid=116156) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:04:50.931997 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.compute.api [None req-6756e733-9dfc-428d-92f2-274210a625cd tempest-AttachVolumeNegativeTest-1640336653 tempest-AttachVolumeNegativeTest-1640336653-project] [instance: b302a057-8ba0-4cec-bcb7-805bd598c638] Fetching instance by UUID {{(pid=116156) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:04:50.938243 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-6756e733-9dfc-428d-92f2-274210a625cd tempest-AttachVolumeNegativeTest-1640336653 tempest-AttachVolumeNegativeTest-1640336653-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:04:50.938687 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-6756e733-9dfc-428d-92f2-274210a625cd tempest-AttachVolumeNegativeTest-1640336653 tempest-AttachVolumeNegativeTest-1640336653-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:04:50.939484 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-6756e733-9dfc-428d-92f2-274210a625cd tempest-AttachVolumeNegativeTest-1640336653 tempest-AttachVolumeNegativeTest-1640336653-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:04:50.939897 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-6756e733-9dfc-428d-92f2-274210a625cd tempest-AttachVolumeNegativeTest-1640336653 tempest-AttachVolumeNegativeTest-1640336653-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:04:50.976610 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi [None req-46c545c0-1f83-4e16-96b2-3da618d1f14f tempest-VolumesActionsTest-1837279088 tempest-VolumesActionsTest-1837279088-project] Calling method '>' {{(pid=116157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:04:50.977491 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.compute.api [None req-46c545c0-1f83-4e16-96b2-3da618d1f14f tempest-VolumesActionsTest-1837279088 tempest-VolumesActionsTest-1837279088-project] [instance: 0c1f5052-62a2-4847-ab40-6e1a9df040ca] Fetching instance by UUID {{(pid=116157) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:04:50.983654 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-46c545c0-1f83-4e16-96b2-3da618d1f14f tempest-VolumesActionsTest-1837279088 tempest-VolumesActionsTest-1837279088-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:04:50.984349 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-46c545c0-1f83-4e16-96b2-3da618d1f14f tempest-VolumesActionsTest-1837279088 tempest-VolumesActionsTest-1837279088-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:04:50.985858 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-46c545c0-1f83-4e16-96b2-3da618d1f14f tempest-VolumesActionsTest-1837279088 tempest-VolumesActionsTest-1837279088-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:04:50.986319 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-46c545c0-1f83-4e16-96b2-3da618d1f14f tempest-VolumesActionsTest-1837279088 tempest-VolumesActionsTest-1837279088-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:04:51.087385 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.policy [None req-6756e733-9dfc-428d-92f2-274210a625cd tempest-AttachVolumeNegativeTest-1640336653 tempest-AttachVolumeNegativeTest-1640336653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35d37a3d8e504b8186182468b77dd114', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '409b41637da94c469444954258444b4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116156) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:04:51.099131 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: INFO nova.api.openstack.requestlog [None req-6756e733-9dfc-428d-92f2-274210a625cd tempest-AttachVolumeNegativeTest-1640336653 tempest-AttachVolumeNegativeTest-1640336653-project] 10.222.0.18 "GET /compute/v2.1/servers/b302a057-8ba0-4cec-bcb7-805bd598c638" status: 200 len: 1317 microversion: 2.1 time: 0.171311 Dec 15 03:04:51.099707 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: [pid: 116156|app: 0|req: 134/235] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 03:04:50 2021] GET /compute/v2.1/servers/b302a057-8ba0-4cec-bcb7-805bd598c638 => generated 1317 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 03:04:51.146488 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.policy [None req-46c545c0-1f83-4e16-96b2-3da618d1f14f tempest-VolumesActionsTest-1837279088 tempest-VolumesActionsTest-1837279088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e440754469c4407840a651d560ce08a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6eaf458d3c84ba59b078dc0a3bf1763', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116157) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:04:51.155617 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: INFO nova.api.openstack.requestlog [None req-46c545c0-1f83-4e16-96b2-3da618d1f14f tempest-VolumesActionsTest-1837279088 tempest-VolumesActionsTest-1837279088-project] 10.222.0.18 "GET /compute/v2.1/servers/0c1f5052-62a2-4847-ab40-6e1a9df040ca" status: 200 len: 1313 microversion: 2.1 time: 0.182719 Dec 15 03:04:51.156189 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: [pid: 116157|app: 0|req: 102/236] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 03:04:50 2021] GET /compute/v2.1/servers/0c1f5052-62a2-4847-ab40-6e1a9df040ca => generated 1313 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 03:04:51.410515 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi [None req-63cca987-cff3-4675-bfe6-71b33b879132 tempest-ServerRescueNegativeTestJSON-2061875223 tempest-ServerRescueNegativeTestJSON-2061875223-project] Calling method '>' {{(pid=116156) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:04:51.411735 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.compute.api [None req-63cca987-cff3-4675-bfe6-71b33b879132 tempest-ServerRescueNegativeTestJSON-2061875223 tempest-ServerRescueNegativeTestJSON-2061875223-project] [instance: 9bbb0abf-72a3-4fbc-8235-7a3ecfc8d006] Fetching instance by UUID {{(pid=116156) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:04:51.418222 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-63cca987-cff3-4675-bfe6-71b33b879132 tempest-ServerRescueNegativeTestJSON-2061875223 tempest-ServerRescueNegativeTestJSON-2061875223-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:04:51.419465 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-63cca987-cff3-4675-bfe6-71b33b879132 tempest-ServerRescueNegativeTestJSON-2061875223 tempest-ServerRescueNegativeTestJSON-2061875223-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:04:51.420665 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-63cca987-cff3-4675-bfe6-71b33b879132 tempest-ServerRescueNegativeTestJSON-2061875223 tempest-ServerRescueNegativeTestJSON-2061875223-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:04:51.421115 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-63cca987-cff3-4675-bfe6-71b33b879132 tempest-ServerRescueNegativeTestJSON-2061875223 tempest-ServerRescueNegativeTestJSON-2061875223-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:04:51.556058 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.policy [None req-63cca987-cff3-4675-bfe6-71b33b879132 tempest-ServerRescueNegativeTestJSON-2061875223 tempest-ServerRescueNegativeTestJSON-2061875223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ea02b6e8f1548a1bd78952cb7337403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5e8a958d4bf43868502b13728b9583b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116156) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:04:51.563912 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: INFO nova.api.openstack.requestlog [None req-63cca987-cff3-4675-bfe6-71b33b879132 tempest-ServerRescueNegativeTestJSON-2061875223 tempest-ServerRescueNegativeTestJSON-2061875223-project] 10.222.0.18 "GET /compute/v2.1/servers/9bbb0abf-72a3-4fbc-8235-7a3ecfc8d006" status: 200 len: 1521 microversion: 2.1 time: 0.157703 Dec 15 03:04:51.564487 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: [pid: 116156|app: 0|req: 135/237] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 03:04:51 2021] GET /compute/v2.1/servers/9bbb0abf-72a3-4fbc-8235-7a3ecfc8d006 => generated 1521 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 03:04:51.798577 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi [None req-9f2017c9-3c75-43a5-a329-c690a5c0934c tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Calling method '>' {{(pid=116157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:04:51.799197 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.compute.api [None req-9f2017c9-3c75-43a5-a329-c690a5c0934c tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] [instance: b89094ac-aee1-4bd6-a33d-8c4347cebfc7] Fetching instance by UUID {{(pid=116157) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:04:51.806529 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-9f2017c9-3c75-43a5-a329-c690a5c0934c tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:04:51.806984 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-9f2017c9-3c75-43a5-a329-c690a5c0934c tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:04:51.807816 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-9f2017c9-3c75-43a5-a329-c690a5c0934c tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:04:51.808252 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-9f2017c9-3c75-43a5-a329-c690a5c0934c tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:04:51.967144 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.policy [None req-9f2017c9-3c75-43a5-a329-c690a5c0934c tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fedc11e2dbd74b919982a0657222cca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f16202549724b878f908d68384ec9c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116157) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:04:51.977258 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.policy [None req-9f2017c9-3c75-43a5-a329-c690a5c0934c tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fedc11e2dbd74b919982a0657222cca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f16202549724b878f908d68384ec9c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116157) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:04:51.979231 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.policy [None req-9f2017c9-3c75-43a5-a329-c690a5c0934c tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fedc11e2dbd74b919982a0657222cca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f16202549724b878f908d68384ec9c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116157) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:04:51.980830 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: INFO nova.api.openstack.requestlog [None req-9f2017c9-3c75-43a5-a329-c690a5c0934c tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] 10.222.0.18 "GET /compute/v2.1/servers/b89094ac-aee1-4bd6-a33d-8c4347cebfc7" status: 200 len: 1406 microversion: 2.20 time: 0.185995 Dec 15 03:04:51.982210 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: [pid: 116157|app: 0|req: 103/238] 10.222.0.18 () {60 vars in 1276 bytes} [Wed Dec 15 03:04:51 2021] GET /compute/v2.1/servers/b89094ac-aee1-4bd6-a33d-8c4347cebfc7 => generated 1406 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 03:04:52.119176 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi [None req-f1e6b382-8267-496e-b0a5-4870dbbdd7a3 tempest-AttachVolumeNegativeTest-1640336653 tempest-AttachVolumeNegativeTest-1640336653-project] Calling method '>' {{(pid=116156) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:04:52.120308 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.compute.api [None req-f1e6b382-8267-496e-b0a5-4870dbbdd7a3 tempest-AttachVolumeNegativeTest-1640336653 tempest-AttachVolumeNegativeTest-1640336653-project] [instance: b302a057-8ba0-4cec-bcb7-805bd598c638] Fetching instance by UUID {{(pid=116156) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:04:52.130655 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-f1e6b382-8267-496e-b0a5-4870dbbdd7a3 tempest-AttachVolumeNegativeTest-1640336653 tempest-AttachVolumeNegativeTest-1640336653-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:04:52.131127 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-f1e6b382-8267-496e-b0a5-4870dbbdd7a3 tempest-AttachVolumeNegativeTest-1640336653 tempest-AttachVolumeNegativeTest-1640336653-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:04:52.131997 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-f1e6b382-8267-496e-b0a5-4870dbbdd7a3 tempest-AttachVolumeNegativeTest-1640336653 tempest-AttachVolumeNegativeTest-1640336653-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:04:52.132470 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-f1e6b382-8267-496e-b0a5-4870dbbdd7a3 tempest-AttachVolumeNegativeTest-1640336653 tempest-AttachVolumeNegativeTest-1640336653-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:04:52.173483 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi [None req-f4a2418d-eda4-47ac-9873-d2860f94c942 tempest-VolumesActionsTest-1837279088 tempest-VolumesActionsTest-1837279088-project] Calling method '>' {{(pid=116157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:04:52.174453 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.compute.api [None req-f4a2418d-eda4-47ac-9873-d2860f94c942 tempest-VolumesActionsTest-1837279088 tempest-VolumesActionsTest-1837279088-project] [instance: 0c1f5052-62a2-4847-ab40-6e1a9df040ca] Fetching instance by UUID {{(pid=116157) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:04:52.182663 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-f4a2418d-eda4-47ac-9873-d2860f94c942 tempest-VolumesActionsTest-1837279088 tempest-VolumesActionsTest-1837279088-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:04:52.183251 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-f4a2418d-eda4-47ac-9873-d2860f94c942 tempest-VolumesActionsTest-1837279088 tempest-VolumesActionsTest-1837279088-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:04:52.184141 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-f4a2418d-eda4-47ac-9873-d2860f94c942 tempest-VolumesActionsTest-1837279088 tempest-VolumesActionsTest-1837279088-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:04:52.185436 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-f4a2418d-eda4-47ac-9873-d2860f94c942 tempest-VolumesActionsTest-1837279088 tempest-VolumesActionsTest-1837279088-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:04:52.284808 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.policy [None req-f1e6b382-8267-496e-b0a5-4870dbbdd7a3 tempest-AttachVolumeNegativeTest-1640336653 tempest-AttachVolumeNegativeTest-1640336653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35d37a3d8e504b8186182468b77dd114', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '409b41637da94c469444954258444b4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116156) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:04:52.291885 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: INFO nova.api.openstack.requestlog [None req-f1e6b382-8267-496e-b0a5-4870dbbdd7a3 tempest-AttachVolumeNegativeTest-1640336653 tempest-AttachVolumeNegativeTest-1640336653-project] 10.222.0.18 "GET /compute/v2.1/servers/b302a057-8ba0-4cec-bcb7-805bd598c638" status: 200 len: 1317 microversion: 2.1 time: 0.179940 Dec 15 03:04:52.292466 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: [pid: 116156|app: 0|req: 136/239] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 03:04:52 2021] GET /compute/v2.1/servers/b302a057-8ba0-4cec-bcb7-805bd598c638 => generated 1317 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 03:04:52.418121 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.policy [None req-f4a2418d-eda4-47ac-9873-d2860f94c942 tempest-VolumesActionsTest-1837279088 tempest-VolumesActionsTest-1837279088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e440754469c4407840a651d560ce08a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6eaf458d3c84ba59b078dc0a3bf1763', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116157) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:04:52.425748 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: INFO nova.api.openstack.requestlog [None req-f4a2418d-eda4-47ac-9873-d2860f94c942 tempest-VolumesActionsTest-1837279088 tempest-VolumesActionsTest-1837279088-project] 10.222.0.18 "GET /compute/v2.1/servers/0c1f5052-62a2-4847-ab40-6e1a9df040ca" status: 200 len: 1313 microversion: 2.1 time: 0.257051 Dec 15 03:04:52.426358 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: [pid: 116157|app: 0|req: 104/240] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 03:04:52 2021] GET /compute/v2.1/servers/0c1f5052-62a2-4847-ab40-6e1a9df040ca => generated 1313 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 03:04:52.581045 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi [None req-39defce7-974f-41b6-bfb4-3ba8a5e3aba0 tempest-ServerRescueNegativeTestJSON-2061875223 tempest-ServerRescueNegativeTestJSON-2061875223-project] Calling method '>' {{(pid=116156) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:04:52.581658 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.compute.api [None req-39defce7-974f-41b6-bfb4-3ba8a5e3aba0 tempest-ServerRescueNegativeTestJSON-2061875223 tempest-ServerRescueNegativeTestJSON-2061875223-project] [instance: 9bbb0abf-72a3-4fbc-8235-7a3ecfc8d006] Fetching instance by UUID {{(pid=116156) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:04:52.587509 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-39defce7-974f-41b6-bfb4-3ba8a5e3aba0 tempest-ServerRescueNegativeTestJSON-2061875223 tempest-ServerRescueNegativeTestJSON-2061875223-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:04:52.587959 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-39defce7-974f-41b6-bfb4-3ba8a5e3aba0 tempest-ServerRescueNegativeTestJSON-2061875223 tempest-ServerRescueNegativeTestJSON-2061875223-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:04:52.588747 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-39defce7-974f-41b6-bfb4-3ba8a5e3aba0 tempest-ServerRescueNegativeTestJSON-2061875223 tempest-ServerRescueNegativeTestJSON-2061875223-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:04:52.589185 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-39defce7-974f-41b6-bfb4-3ba8a5e3aba0 tempest-ServerRescueNegativeTestJSON-2061875223 tempest-ServerRescueNegativeTestJSON-2061875223-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:04:52.722449 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.policy [None req-39defce7-974f-41b6-bfb4-3ba8a5e3aba0 tempest-ServerRescueNegativeTestJSON-2061875223 tempest-ServerRescueNegativeTestJSON-2061875223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ea02b6e8f1548a1bd78952cb7337403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5e8a958d4bf43868502b13728b9583b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116156) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:04:52.729743 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: INFO nova.api.openstack.requestlog [None req-39defce7-974f-41b6-bfb4-3ba8a5e3aba0 tempest-ServerRescueNegativeTestJSON-2061875223 tempest-ServerRescueNegativeTestJSON-2061875223-project] 10.222.0.18 "GET /compute/v2.1/servers/9bbb0abf-72a3-4fbc-8235-7a3ecfc8d006" status: 200 len: 1521 microversion: 2.1 time: 0.152329 Dec 15 03:04:52.730349 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: [pid: 116156|app: 0|req: 137/241] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 03:04:52 2021] GET /compute/v2.1/servers/9bbb0abf-72a3-4fbc-8235-7a3ecfc8d006 => generated 1521 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 03:04:53.000226 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi [None req-53ede407-d0dd-4222-bf0b-8d4a232b4e49 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Calling method '>' {{(pid=116157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:04:53.001284 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.compute.api [None req-53ede407-d0dd-4222-bf0b-8d4a232b4e49 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] [instance: b89094ac-aee1-4bd6-a33d-8c4347cebfc7] Fetching instance by UUID {{(pid=116157) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:04:53.007511 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-53ede407-d0dd-4222-bf0b-8d4a232b4e49 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:04:53.007970 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-53ede407-d0dd-4222-bf0b-8d4a232b4e49 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:04:53.008811 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-53ede407-d0dd-4222-bf0b-8d4a232b4e49 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:04:53.009250 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-53ede407-d0dd-4222-bf0b-8d4a232b4e49 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:04:53.139846 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.policy [None req-53ede407-d0dd-4222-bf0b-8d4a232b4e49 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fedc11e2dbd74b919982a0657222cca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f16202549724b878f908d68384ec9c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116157) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:04:53.157187 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.policy [None req-53ede407-d0dd-4222-bf0b-8d4a232b4e49 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fedc11e2dbd74b919982a0657222cca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f16202549724b878f908d68384ec9c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116157) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:04:53.158714 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.policy [None req-53ede407-d0dd-4222-bf0b-8d4a232b4e49 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fedc11e2dbd74b919982a0657222cca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f16202549724b878f908d68384ec9c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116157) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:04:53.159818 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: INFO nova.api.openstack.requestlog [None req-53ede407-d0dd-4222-bf0b-8d4a232b4e49 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] 10.222.0.18 "GET /compute/v2.1/servers/b89094ac-aee1-4bd6-a33d-8c4347cebfc7" status: 200 len: 1406 microversion: 2.20 time: 0.163719 Dec 15 03:04:53.160370 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: [pid: 116157|app: 0|req: 105/242] 10.222.0.18 () {60 vars in 1276 bytes} [Wed Dec 15 03:04:52 2021] GET /compute/v2.1/servers/b89094ac-aee1-4bd6-a33d-8c4347cebfc7 => generated 1406 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 03:04:53.308705 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi [None req-082ebe0c-3fa7-4985-8ba7-5cfcdc2ebdbf tempest-AttachVolumeNegativeTest-1640336653 tempest-AttachVolumeNegativeTest-1640336653-project] Calling method '>' {{(pid=116156) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:04:53.309304 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.compute.api [None req-082ebe0c-3fa7-4985-8ba7-5cfcdc2ebdbf tempest-AttachVolumeNegativeTest-1640336653 tempest-AttachVolumeNegativeTest-1640336653-project] [instance: b302a057-8ba0-4cec-bcb7-805bd598c638] Fetching instance by UUID {{(pid=116156) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:04:53.315765 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-082ebe0c-3fa7-4985-8ba7-5cfcdc2ebdbf tempest-AttachVolumeNegativeTest-1640336653 tempest-AttachVolumeNegativeTest-1640336653-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:04:53.316247 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-082ebe0c-3fa7-4985-8ba7-5cfcdc2ebdbf tempest-AttachVolumeNegativeTest-1640336653 tempest-AttachVolumeNegativeTest-1640336653-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:04:53.317036 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-082ebe0c-3fa7-4985-8ba7-5cfcdc2ebdbf tempest-AttachVolumeNegativeTest-1640336653 tempest-AttachVolumeNegativeTest-1640336653-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:04:53.317491 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-082ebe0c-3fa7-4985-8ba7-5cfcdc2ebdbf tempest-AttachVolumeNegativeTest-1640336653 tempest-AttachVolumeNegativeTest-1640336653-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:04:53.442261 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi [None req-9a465b87-3c88-4071-b2b7-41f4cd5a2c29 tempest-VolumesActionsTest-1837279088 tempest-VolumesActionsTest-1837279088-project] Calling method '>' {{(pid=116157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:04:53.442872 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.compute.api [None req-9a465b87-3c88-4071-b2b7-41f4cd5a2c29 tempest-VolumesActionsTest-1837279088 tempest-VolumesActionsTest-1837279088-project] [instance: 0c1f5052-62a2-4847-ab40-6e1a9df040ca] Fetching instance by UUID {{(pid=116157) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:04:53.446365 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.policy [None req-082ebe0c-3fa7-4985-8ba7-5cfcdc2ebdbf tempest-AttachVolumeNegativeTest-1640336653 tempest-AttachVolumeNegativeTest-1640336653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35d37a3d8e504b8186182468b77dd114', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '409b41637da94c469444954258444b4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116156) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:04:53.448577 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-9a465b87-3c88-4071-b2b7-41f4cd5a2c29 tempest-VolumesActionsTest-1837279088 tempest-VolumesActionsTest-1837279088-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:04:53.449166 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-9a465b87-3c88-4071-b2b7-41f4cd5a2c29 tempest-VolumesActionsTest-1837279088 tempest-VolumesActionsTest-1837279088-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:04:53.449961 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-9a465b87-3c88-4071-b2b7-41f4cd5a2c29 tempest-VolumesActionsTest-1837279088 tempest-VolumesActionsTest-1837279088-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:04:53.450424 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-9a465b87-3c88-4071-b2b7-41f4cd5a2c29 tempest-VolumesActionsTest-1837279088 tempest-VolumesActionsTest-1837279088-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:04:53.456392 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: INFO nova.api.openstack.requestlog [None req-082ebe0c-3fa7-4985-8ba7-5cfcdc2ebdbf tempest-AttachVolumeNegativeTest-1640336653 tempest-AttachVolumeNegativeTest-1640336653-project] 10.222.0.18 "GET /compute/v2.1/servers/b302a057-8ba0-4cec-bcb7-805bd598c638" status: 200 len: 1317 microversion: 2.1 time: 0.151172 Dec 15 03:04:53.456972 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: [pid: 116156|app: 0|req: 138/243] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 03:04:53 2021] GET /compute/v2.1/servers/b302a057-8ba0-4cec-bcb7-805bd598c638 => generated 1317 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 03:04:53.584958 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.policy [None req-9a465b87-3c88-4071-b2b7-41f4cd5a2c29 tempest-VolumesActionsTest-1837279088 tempest-VolumesActionsTest-1837279088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e440754469c4407840a651d560ce08a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6eaf458d3c84ba59b078dc0a3bf1763', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116157) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:04:53.592089 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: INFO nova.api.openstack.requestlog [None req-9a465b87-3c88-4071-b2b7-41f4cd5a2c29 tempest-VolumesActionsTest-1837279088 tempest-VolumesActionsTest-1837279088-project] 10.222.0.18 "GET /compute/v2.1/servers/0c1f5052-62a2-4847-ab40-6e1a9df040ca" status: 200 len: 1313 microversion: 2.1 time: 0.154051 Dec 15 03:04:53.592642 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: [pid: 116157|app: 0|req: 106/244] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 03:04:53 2021] GET /compute/v2.1/servers/0c1f5052-62a2-4847-ab40-6e1a9df040ca => generated 1313 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 03:04:53.746851 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi [None req-0ad98cc8-1aac-4e9a-9995-998d1a99651e tempest-ServerRescueNegativeTestJSON-2061875223 tempest-ServerRescueNegativeTestJSON-2061875223-project] Calling method '>' {{(pid=116156) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:04:53.747470 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.compute.api [None req-0ad98cc8-1aac-4e9a-9995-998d1a99651e tempest-ServerRescueNegativeTestJSON-2061875223 tempest-ServerRescueNegativeTestJSON-2061875223-project] [instance: 9bbb0abf-72a3-4fbc-8235-7a3ecfc8d006] Fetching instance by UUID {{(pid=116156) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:04:53.754056 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-0ad98cc8-1aac-4e9a-9995-998d1a99651e tempest-ServerRescueNegativeTestJSON-2061875223 tempest-ServerRescueNegativeTestJSON-2061875223-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:04:53.754513 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-0ad98cc8-1aac-4e9a-9995-998d1a99651e tempest-ServerRescueNegativeTestJSON-2061875223 tempest-ServerRescueNegativeTestJSON-2061875223-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:04:53.755312 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-0ad98cc8-1aac-4e9a-9995-998d1a99651e tempest-ServerRescueNegativeTestJSON-2061875223 tempest-ServerRescueNegativeTestJSON-2061875223-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:04:53.755750 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-0ad98cc8-1aac-4e9a-9995-998d1a99651e tempest-ServerRescueNegativeTestJSON-2061875223 tempest-ServerRescueNegativeTestJSON-2061875223-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:04:53.889483 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.policy [None req-0ad98cc8-1aac-4e9a-9995-998d1a99651e tempest-ServerRescueNegativeTestJSON-2061875223 tempest-ServerRescueNegativeTestJSON-2061875223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ea02b6e8f1548a1bd78952cb7337403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5e8a958d4bf43868502b13728b9583b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116156) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:04:53.896680 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: INFO nova.api.openstack.requestlog [None req-0ad98cc8-1aac-4e9a-9995-998d1a99651e tempest-ServerRescueNegativeTestJSON-2061875223 tempest-ServerRescueNegativeTestJSON-2061875223-project] 10.222.0.18 "GET /compute/v2.1/servers/9bbb0abf-72a3-4fbc-8235-7a3ecfc8d006" status: 200 len: 1521 microversion: 2.1 time: 0.153685 Dec 15 03:04:53.897240 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: [pid: 116156|app: 0|req: 139/245] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 03:04:53 2021] GET /compute/v2.1/servers/9bbb0abf-72a3-4fbc-8235-7a3ecfc8d006 => generated 1521 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 03:04:54.180708 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi [None req-78305e15-45fd-4d17-88a1-611267d9a3cc tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Calling method '>' {{(pid=116157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:04:54.181316 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.compute.api [None req-78305e15-45fd-4d17-88a1-611267d9a3cc tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] [instance: b89094ac-aee1-4bd6-a33d-8c4347cebfc7] Fetching instance by UUID {{(pid=116157) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:04:54.187487 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-78305e15-45fd-4d17-88a1-611267d9a3cc tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:04:54.187929 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-78305e15-45fd-4d17-88a1-611267d9a3cc tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:04:54.188753 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-78305e15-45fd-4d17-88a1-611267d9a3cc tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:04:54.189115 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-78305e15-45fd-4d17-88a1-611267d9a3cc tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:04:54.316417 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.policy [None req-78305e15-45fd-4d17-88a1-611267d9a3cc tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fedc11e2dbd74b919982a0657222cca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f16202549724b878f908d68384ec9c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116157) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:04:54.324288 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.policy [None req-78305e15-45fd-4d17-88a1-611267d9a3cc tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fedc11e2dbd74b919982a0657222cca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f16202549724b878f908d68384ec9c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116157) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:04:54.325671 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.policy [None req-78305e15-45fd-4d17-88a1-611267d9a3cc tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fedc11e2dbd74b919982a0657222cca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f16202549724b878f908d68384ec9c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116157) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:04:54.326807 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: INFO nova.api.openstack.requestlog [None req-78305e15-45fd-4d17-88a1-611267d9a3cc tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] 10.222.0.18 "GET /compute/v2.1/servers/b89094ac-aee1-4bd6-a33d-8c4347cebfc7" status: 200 len: 1406 microversion: 2.20 time: 0.149844 Dec 15 03:04:54.327488 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: [pid: 116157|app: 0|req: 107/246] 10.222.0.18 () {60 vars in 1276 bytes} [Wed Dec 15 03:04:54 2021] GET /compute/v2.1/servers/b89094ac-aee1-4bd6-a33d-8c4347cebfc7 => generated 1406 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 03:04:54.473050 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi [None req-a26bd551-57f0-4814-92b7-af0a085c5c22 tempest-AttachVolumeNegativeTest-1640336653 tempest-AttachVolumeNegativeTest-1640336653-project] Calling method '>' {{(pid=116156) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:04:54.473593 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.compute.api [None req-a26bd551-57f0-4814-92b7-af0a085c5c22 tempest-AttachVolumeNegativeTest-1640336653 tempest-AttachVolumeNegativeTest-1640336653-project] [instance: b302a057-8ba0-4cec-bcb7-805bd598c638] Fetching instance by UUID {{(pid=116156) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:04:54.479526 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-a26bd551-57f0-4814-92b7-af0a085c5c22 tempest-AttachVolumeNegativeTest-1640336653 tempest-AttachVolumeNegativeTest-1640336653-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:04:54.479975 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-a26bd551-57f0-4814-92b7-af0a085c5c22 tempest-AttachVolumeNegativeTest-1640336653 tempest-AttachVolumeNegativeTest-1640336653-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:04:54.480751 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-a26bd551-57f0-4814-92b7-af0a085c5c22 tempest-AttachVolumeNegativeTest-1640336653 tempest-AttachVolumeNegativeTest-1640336653-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:04:54.481274 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-a26bd551-57f0-4814-92b7-af0a085c5c22 tempest-AttachVolumeNegativeTest-1640336653 tempest-AttachVolumeNegativeTest-1640336653-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:04:54.605486 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.policy [None req-a26bd551-57f0-4814-92b7-af0a085c5c22 tempest-AttachVolumeNegativeTest-1640336653 tempest-AttachVolumeNegativeTest-1640336653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35d37a3d8e504b8186182468b77dd114', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '409b41637da94c469444954258444b4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116156) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:04:54.608307 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi [None req-a07f4d5d-f60f-4b95-aec6-b7e3136750a2 tempest-VolumesActionsTest-1837279088 tempest-VolumesActionsTest-1837279088-project] Calling method '>' {{(pid=116157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:04:54.608945 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.compute.api [None req-a07f4d5d-f60f-4b95-aec6-b7e3136750a2 tempest-VolumesActionsTest-1837279088 tempest-VolumesActionsTest-1837279088-project] [instance: 0c1f5052-62a2-4847-ab40-6e1a9df040ca] Fetching instance by UUID {{(pid=116157) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:04:54.612957 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: INFO nova.api.openstack.requestlog [None req-a26bd551-57f0-4814-92b7-af0a085c5c22 tempest-AttachVolumeNegativeTest-1640336653 tempest-AttachVolumeNegativeTest-1640336653-project] 10.222.0.18 "GET /compute/v2.1/servers/b302a057-8ba0-4cec-bcb7-805bd598c638" status: 200 len: 1317 microversion: 2.1 time: 0.144296 Dec 15 03:04:54.613524 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: [pid: 116156|app: 0|req: 140/247] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 03:04:54 2021] GET /compute/v2.1/servers/b302a057-8ba0-4cec-bcb7-805bd598c638 => generated 1317 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 03:04:54.614666 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-a07f4d5d-f60f-4b95-aec6-b7e3136750a2 tempest-VolumesActionsTest-1837279088 tempest-VolumesActionsTest-1837279088-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:04:54.615124 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-a07f4d5d-f60f-4b95-aec6-b7e3136750a2 tempest-VolumesActionsTest-1837279088 tempest-VolumesActionsTest-1837279088-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:04:54.615905 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-a07f4d5d-f60f-4b95-aec6-b7e3136750a2 tempest-VolumesActionsTest-1837279088 tempest-VolumesActionsTest-1837279088-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:04:54.616342 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-a07f4d5d-f60f-4b95-aec6-b7e3136750a2 tempest-VolumesActionsTest-1837279088 tempest-VolumesActionsTest-1837279088-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:04:54.742865 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.policy [None req-a07f4d5d-f60f-4b95-aec6-b7e3136750a2 tempest-VolumesActionsTest-1837279088 tempest-VolumesActionsTest-1837279088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e440754469c4407840a651d560ce08a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6eaf458d3c84ba59b078dc0a3bf1763', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116157) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:04:54.750300 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: INFO nova.api.openstack.requestlog [None req-a07f4d5d-f60f-4b95-aec6-b7e3136750a2 tempest-VolumesActionsTest-1837279088 tempest-VolumesActionsTest-1837279088-project] 10.222.0.18 "GET /compute/v2.1/servers/0c1f5052-62a2-4847-ab40-6e1a9df040ca" status: 200 len: 1313 microversion: 2.1 time: 0.145471 Dec 15 03:04:54.751380 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: [pid: 116157|app: 0|req: 108/248] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 03:04:54 2021] GET /compute/v2.1/servers/0c1f5052-62a2-4847-ab40-6e1a9df040ca => generated 1313 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 03:04:54.913739 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi [None req-77028fe7-470c-48c4-995c-c9c5f6a83f80 tempest-ServerRescueNegativeTestJSON-2061875223 tempest-ServerRescueNegativeTestJSON-2061875223-project] Calling method '>' {{(pid=116156) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:04:54.914380 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.compute.api [None req-77028fe7-470c-48c4-995c-c9c5f6a83f80 tempest-ServerRescueNegativeTestJSON-2061875223 tempest-ServerRescueNegativeTestJSON-2061875223-project] [instance: 9bbb0abf-72a3-4fbc-8235-7a3ecfc8d006] Fetching instance by UUID {{(pid=116156) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:04:54.920015 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-77028fe7-470c-48c4-995c-c9c5f6a83f80 tempest-ServerRescueNegativeTestJSON-2061875223 tempest-ServerRescueNegativeTestJSON-2061875223-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:04:54.920461 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-77028fe7-470c-48c4-995c-c9c5f6a83f80 tempest-ServerRescueNegativeTestJSON-2061875223 tempest-ServerRescueNegativeTestJSON-2061875223-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:04:54.921237 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-77028fe7-470c-48c4-995c-c9c5f6a83f80 tempest-ServerRescueNegativeTestJSON-2061875223 tempest-ServerRescueNegativeTestJSON-2061875223-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:04:54.921678 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-77028fe7-470c-48c4-995c-c9c5f6a83f80 tempest-ServerRescueNegativeTestJSON-2061875223 tempest-ServerRescueNegativeTestJSON-2061875223-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:04:55.049189 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.policy [None req-77028fe7-470c-48c4-995c-c9c5f6a83f80 tempest-ServerRescueNegativeTestJSON-2061875223 tempest-ServerRescueNegativeTestJSON-2061875223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ea02b6e8f1548a1bd78952cb7337403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5e8a958d4bf43868502b13728b9583b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116156) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:04:55.056387 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: INFO nova.api.openstack.requestlog [None req-77028fe7-470c-48c4-995c-c9c5f6a83f80 tempest-ServerRescueNegativeTestJSON-2061875223 tempest-ServerRescueNegativeTestJSON-2061875223-project] 10.222.0.18 "GET /compute/v2.1/servers/9bbb0abf-72a3-4fbc-8235-7a3ecfc8d006" status: 200 len: 1521 microversion: 2.1 time: 0.146276 Dec 15 03:04:55.056949 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: [pid: 116156|app: 0|req: 141/249] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 03:04:54 2021] GET /compute/v2.1/servers/9bbb0abf-72a3-4fbc-8235-7a3ecfc8d006 => generated 1521 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 03:04:55.344932 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi [None req-07a44e7b-7107-4405-a1a8-328b32db8021 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Calling method '>' {{(pid=116157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:04:55.345524 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.compute.api [None req-07a44e7b-7107-4405-a1a8-328b32db8021 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] [instance: b89094ac-aee1-4bd6-a33d-8c4347cebfc7] Fetching instance by UUID {{(pid=116157) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:04:55.351846 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-07a44e7b-7107-4405-a1a8-328b32db8021 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:04:55.352322 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-07a44e7b-7107-4405-a1a8-328b32db8021 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:04:55.353106 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-07a44e7b-7107-4405-a1a8-328b32db8021 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:04:55.353537 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-07a44e7b-7107-4405-a1a8-328b32db8021 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:04:55.479993 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.policy [None req-07a44e7b-7107-4405-a1a8-328b32db8021 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fedc11e2dbd74b919982a0657222cca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f16202549724b878f908d68384ec9c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116157) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:04:55.488298 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.policy [None req-07a44e7b-7107-4405-a1a8-328b32db8021 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fedc11e2dbd74b919982a0657222cca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f16202549724b878f908d68384ec9c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116157) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:04:55.489789 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.policy [None req-07a44e7b-7107-4405-a1a8-328b32db8021 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fedc11e2dbd74b919982a0657222cca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f16202549724b878f908d68384ec9c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116157) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:04:55.491007 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: INFO nova.api.openstack.requestlog [None req-07a44e7b-7107-4405-a1a8-328b32db8021 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] 10.222.0.18 "GET /compute/v2.1/servers/b89094ac-aee1-4bd6-a33d-8c4347cebfc7" status: 200 len: 1406 microversion: 2.20 time: 0.150289 Dec 15 03:04:55.491598 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: [pid: 116157|app: 0|req: 109/250] 10.222.0.18 () {60 vars in 1276 bytes} [Wed Dec 15 03:04:55 2021] GET /compute/v2.1/servers/b89094ac-aee1-4bd6-a33d-8c4347cebfc7 => generated 1406 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 03:04:55.629542 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi [None req-69af5de1-c497-44aa-b04b-5759b70aae4e tempest-AttachVolumeNegativeTest-1640336653 tempest-AttachVolumeNegativeTest-1640336653-project] Calling method '>' {{(pid=116156) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:04:55.630097 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.compute.api [None req-69af5de1-c497-44aa-b04b-5759b70aae4e tempest-AttachVolumeNegativeTest-1640336653 tempest-AttachVolumeNegativeTest-1640336653-project] [instance: b302a057-8ba0-4cec-bcb7-805bd598c638] Fetching instance by UUID {{(pid=116156) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:04:55.635872 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-69af5de1-c497-44aa-b04b-5759b70aae4e tempest-AttachVolumeNegativeTest-1640336653 tempest-AttachVolumeNegativeTest-1640336653-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:04:55.636308 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-69af5de1-c497-44aa-b04b-5759b70aae4e tempest-AttachVolumeNegativeTest-1640336653 tempest-AttachVolumeNegativeTest-1640336653-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:04:55.637071 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-69af5de1-c497-44aa-b04b-5759b70aae4e tempest-AttachVolumeNegativeTest-1640336653 tempest-AttachVolumeNegativeTest-1640336653-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:04:55.637495 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-69af5de1-c497-44aa-b04b-5759b70aae4e tempest-AttachVolumeNegativeTest-1640336653 tempest-AttachVolumeNegativeTest-1640336653-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:04:55.767747 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi [None req-ed8215fc-f17e-4f26-96b2-5318e6dedaf4 tempest-VolumesActionsTest-1837279088 tempest-VolumesActionsTest-1837279088-project] Calling method '>' {{(pid=116157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:04:55.768382 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.compute.api [None req-ed8215fc-f17e-4f26-96b2-5318e6dedaf4 tempest-VolumesActionsTest-1837279088 tempest-VolumesActionsTest-1837279088-project] [instance: 0c1f5052-62a2-4847-ab40-6e1a9df040ca] Fetching instance by UUID {{(pid=116157) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:04:55.774413 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-ed8215fc-f17e-4f26-96b2-5318e6dedaf4 tempest-VolumesActionsTest-1837279088 tempest-VolumesActionsTest-1837279088-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:04:55.774860 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-ed8215fc-f17e-4f26-96b2-5318e6dedaf4 tempest-VolumesActionsTest-1837279088 tempest-VolumesActionsTest-1837279088-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:04:55.775647 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-ed8215fc-f17e-4f26-96b2-5318e6dedaf4 tempest-VolumesActionsTest-1837279088 tempest-VolumesActionsTest-1837279088-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:04:55.776078 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-ed8215fc-f17e-4f26-96b2-5318e6dedaf4 tempest-VolumesActionsTest-1837279088 tempest-VolumesActionsTest-1837279088-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:04:55.911293 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.policy [None req-ed8215fc-f17e-4f26-96b2-5318e6dedaf4 tempest-VolumesActionsTest-1837279088 tempest-VolumesActionsTest-1837279088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e440754469c4407840a651d560ce08a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6eaf458d3c84ba59b078dc0a3bf1763', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116157) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:04:55.918463 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: INFO nova.api.openstack.requestlog [None req-ed8215fc-f17e-4f26-96b2-5318e6dedaf4 tempest-VolumesActionsTest-1837279088 tempest-VolumesActionsTest-1837279088-project] 10.222.0.18 "GET /compute/v2.1/servers/0c1f5052-62a2-4847-ab40-6e1a9df040ca" status: 200 len: 1313 microversion: 2.1 time: 0.154804 Dec 15 03:04:55.919023 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: [pid: 116157|app: 0|req: 110/251] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 03:04:55 2021] GET /compute/v2.1/servers/0c1f5052-62a2-4847-ab40-6e1a9df040ca => generated 1313 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 03:04:55.931958 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.policy [None req-69af5de1-c497-44aa-b04b-5759b70aae4e tempest-AttachVolumeNegativeTest-1640336653 tempest-AttachVolumeNegativeTest-1640336653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35d37a3d8e504b8186182468b77dd114', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '409b41637da94c469444954258444b4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116156) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:04:55.939130 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: INFO nova.api.openstack.requestlog [None req-69af5de1-c497-44aa-b04b-5759b70aae4e tempest-AttachVolumeNegativeTest-1640336653 tempest-AttachVolumeNegativeTest-1640336653-project] 10.222.0.18 "GET /compute/v2.1/servers/b302a057-8ba0-4cec-bcb7-805bd598c638" status: 200 len: 1317 microversion: 2.1 time: 0.313243 Dec 15 03:04:55.939688 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: [pid: 116156|app: 0|req: 142/252] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 03:04:55 2021] GET /compute/v2.1/servers/b302a057-8ba0-4cec-bcb7-805bd598c638 => generated 1317 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 03:04:56.072951 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi [None req-6ea3b750-6c75-4909-8f70-5496d49b88e1 tempest-ServerRescueNegativeTestJSON-2061875223 tempest-ServerRescueNegativeTestJSON-2061875223-project] Calling method '>' {{(pid=116157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:04:56.073699 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.compute.api [None req-6ea3b750-6c75-4909-8f70-5496d49b88e1 tempest-ServerRescueNegativeTestJSON-2061875223 tempest-ServerRescueNegativeTestJSON-2061875223-project] [instance: 9bbb0abf-72a3-4fbc-8235-7a3ecfc8d006] Fetching instance by UUID {{(pid=116157) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:04:56.080041 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-6ea3b750-6c75-4909-8f70-5496d49b88e1 tempest-ServerRescueNegativeTestJSON-2061875223 tempest-ServerRescueNegativeTestJSON-2061875223-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:04:56.080492 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-6ea3b750-6c75-4909-8f70-5496d49b88e1 tempest-ServerRescueNegativeTestJSON-2061875223 tempest-ServerRescueNegativeTestJSON-2061875223-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:04:56.081267 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-6ea3b750-6c75-4909-8f70-5496d49b88e1 tempest-ServerRescueNegativeTestJSON-2061875223 tempest-ServerRescueNegativeTestJSON-2061875223-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:04:56.081708 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-6ea3b750-6c75-4909-8f70-5496d49b88e1 tempest-ServerRescueNegativeTestJSON-2061875223 tempest-ServerRescueNegativeTestJSON-2061875223-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:04:56.215302 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.policy [None req-6ea3b750-6c75-4909-8f70-5496d49b88e1 tempest-ServerRescueNegativeTestJSON-2061875223 tempest-ServerRescueNegativeTestJSON-2061875223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ea02b6e8f1548a1bd78952cb7337403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5e8a958d4bf43868502b13728b9583b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116157) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:04:56.222670 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: INFO nova.api.openstack.requestlog [None req-6ea3b750-6c75-4909-8f70-5496d49b88e1 tempest-ServerRescueNegativeTestJSON-2061875223 tempest-ServerRescueNegativeTestJSON-2061875223-project] 10.222.0.18 "GET /compute/v2.1/servers/9bbb0abf-72a3-4fbc-8235-7a3ecfc8d006" status: 200 len: 1521 microversion: 2.1 time: 0.153259 Dec 15 03:04:56.223218 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: [pid: 116157|app: 0|req: 111/253] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 03:04:56 2021] GET /compute/v2.1/servers/9bbb0abf-72a3-4fbc-8235-7a3ecfc8d006 => generated 1521 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 03:04:56.509565 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi [None req-7c21d511-a6ed-47ad-ad46-3d427797e4be tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Calling method '>' {{(pid=116156) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:04:56.510202 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.compute.api [None req-7c21d511-a6ed-47ad-ad46-3d427797e4be tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] [instance: b89094ac-aee1-4bd6-a33d-8c4347cebfc7] Fetching instance by UUID {{(pid=116156) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:04:56.515853 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-7c21d511-a6ed-47ad-ad46-3d427797e4be tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:04:56.516475 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-7c21d511-a6ed-47ad-ad46-3d427797e4be tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:04:56.517061 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-7c21d511-a6ed-47ad-ad46-3d427797e4be tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:04:56.517487 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-7c21d511-a6ed-47ad-ad46-3d427797e4be tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:04:56.646634 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.policy [None req-7c21d511-a6ed-47ad-ad46-3d427797e4be tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fedc11e2dbd74b919982a0657222cca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f16202549724b878f908d68384ec9c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116156) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:04:56.654219 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.policy [None req-7c21d511-a6ed-47ad-ad46-3d427797e4be tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fedc11e2dbd74b919982a0657222cca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f16202549724b878f908d68384ec9c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116156) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:04:56.655716 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.policy [None req-7c21d511-a6ed-47ad-ad46-3d427797e4be tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fedc11e2dbd74b919982a0657222cca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f16202549724b878f908d68384ec9c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116156) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:04:56.656801 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: INFO nova.api.openstack.requestlog [None req-7c21d511-a6ed-47ad-ad46-3d427797e4be tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] 10.222.0.18 "GET /compute/v2.1/servers/b89094ac-aee1-4bd6-a33d-8c4347cebfc7" status: 200 len: 1406 microversion: 2.20 time: 0.150934 Dec 15 03:04:56.657526 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: [pid: 116156|app: 0|req: 143/254] 10.222.0.18 () {60 vars in 1276 bytes} [Wed Dec 15 03:04:56 2021] GET /compute/v2.1/servers/b89094ac-aee1-4bd6-a33d-8c4347cebfc7 => generated 1406 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 03:04:56.934793 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi [None req-84e28d26-8f8f-4d77-b33c-2a92cee27aab tempest-VolumesActionsTest-1837279088 tempest-VolumesActionsTest-1837279088-project] Calling method '>' {{(pid=116157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:04:56.935627 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.compute.api [None req-84e28d26-8f8f-4d77-b33c-2a92cee27aab tempest-VolumesActionsTest-1837279088 tempest-VolumesActionsTest-1837279088-project] [instance: 0c1f5052-62a2-4847-ab40-6e1a9df040ca] Fetching instance by UUID {{(pid=116157) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:04:56.941885 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-84e28d26-8f8f-4d77-b33c-2a92cee27aab tempest-VolumesActionsTest-1837279088 tempest-VolumesActionsTest-1837279088-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:04:56.942255 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-84e28d26-8f8f-4d77-b33c-2a92cee27aab tempest-VolumesActionsTest-1837279088 tempest-VolumesActionsTest-1837279088-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:04:56.943035 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-84e28d26-8f8f-4d77-b33c-2a92cee27aab tempest-VolumesActionsTest-1837279088 tempest-VolumesActionsTest-1837279088-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:04:56.943473 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-84e28d26-8f8f-4d77-b33c-2a92cee27aab tempest-VolumesActionsTest-1837279088 tempest-VolumesActionsTest-1837279088-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:04:56.957855 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi [None req-68760de9-29e3-427a-8ddd-efa63a5c0868 tempest-AttachVolumeNegativeTest-1640336653 tempest-AttachVolumeNegativeTest-1640336653-project] Calling method '>' {{(pid=116156) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:04:56.957855 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.compute.api [None req-68760de9-29e3-427a-8ddd-efa63a5c0868 tempest-AttachVolumeNegativeTest-1640336653 tempest-AttachVolumeNegativeTest-1640336653-project] [instance: b302a057-8ba0-4cec-bcb7-805bd598c638] Fetching instance by UUID {{(pid=116156) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:04:56.968193 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-68760de9-29e3-427a-8ddd-efa63a5c0868 tempest-AttachVolumeNegativeTest-1640336653 tempest-AttachVolumeNegativeTest-1640336653-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:04:56.968802 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-68760de9-29e3-427a-8ddd-efa63a5c0868 tempest-AttachVolumeNegativeTest-1640336653 tempest-AttachVolumeNegativeTest-1640336653-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:04:56.970378 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-68760de9-29e3-427a-8ddd-efa63a5c0868 tempest-AttachVolumeNegativeTest-1640336653 tempest-AttachVolumeNegativeTest-1640336653-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:04:56.970819 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-68760de9-29e3-427a-8ddd-efa63a5c0868 tempest-AttachVolumeNegativeTest-1640336653 tempest-AttachVolumeNegativeTest-1640336653-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:04:57.090461 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.policy [None req-84e28d26-8f8f-4d77-b33c-2a92cee27aab tempest-VolumesActionsTest-1837279088 tempest-VolumesActionsTest-1837279088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e440754469c4407840a651d560ce08a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6eaf458d3c84ba59b078dc0a3bf1763', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116157) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:04:57.098398 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: INFO nova.api.openstack.requestlog [None req-84e28d26-8f8f-4d77-b33c-2a92cee27aab tempest-VolumesActionsTest-1837279088 tempest-VolumesActionsTest-1837279088-project] 10.222.0.18 "GET /compute/v2.1/servers/0c1f5052-62a2-4847-ab40-6e1a9df040ca" status: 200 len: 1313 microversion: 2.1 time: 0.167645 Dec 15 03:04:57.098966 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: [pid: 116157|app: 0|req: 112/255] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 03:04:56 2021] GET /compute/v2.1/servers/0c1f5052-62a2-4847-ab40-6e1a9df040ca => generated 1313 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 03:04:57.123936 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.policy [None req-68760de9-29e3-427a-8ddd-efa63a5c0868 tempest-AttachVolumeNegativeTest-1640336653 tempest-AttachVolumeNegativeTest-1640336653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35d37a3d8e504b8186182468b77dd114', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '409b41637da94c469444954258444b4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116156) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:04:57.131170 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: INFO nova.api.openstack.requestlog [None req-68760de9-29e3-427a-8ddd-efa63a5c0868 tempest-AttachVolumeNegativeTest-1640336653 tempest-AttachVolumeNegativeTest-1640336653-project] 10.222.0.18 "GET /compute/v2.1/servers/b302a057-8ba0-4cec-bcb7-805bd598c638" status: 200 len: 1317 microversion: 2.1 time: 0.178956 Dec 15 03:04:57.131773 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: [pid: 116156|app: 0|req: 144/256] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 03:04:56 2021] GET /compute/v2.1/servers/b302a057-8ba0-4cec-bcb7-805bd598c638 => generated 1317 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 03:04:57.238265 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi [None req-44803699-921f-47b8-a8a4-e5b99b5ce4a2 tempest-ServerRescueNegativeTestJSON-2061875223 tempest-ServerRescueNegativeTestJSON-2061875223-project] Calling method '>' {{(pid=116157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:04:57.238913 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.compute.api [None req-44803699-921f-47b8-a8a4-e5b99b5ce4a2 tempest-ServerRescueNegativeTestJSON-2061875223 tempest-ServerRescueNegativeTestJSON-2061875223-project] [instance: 9bbb0abf-72a3-4fbc-8235-7a3ecfc8d006] Fetching instance by UUID {{(pid=116157) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:04:57.244555 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-44803699-921f-47b8-a8a4-e5b99b5ce4a2 tempest-ServerRescueNegativeTestJSON-2061875223 tempest-ServerRescueNegativeTestJSON-2061875223-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:04:57.245016 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-44803699-921f-47b8-a8a4-e5b99b5ce4a2 tempest-ServerRescueNegativeTestJSON-2061875223 tempest-ServerRescueNegativeTestJSON-2061875223-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:04:57.245806 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-44803699-921f-47b8-a8a4-e5b99b5ce4a2 tempest-ServerRescueNegativeTestJSON-2061875223 tempest-ServerRescueNegativeTestJSON-2061875223-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:04:57.246275 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-44803699-921f-47b8-a8a4-e5b99b5ce4a2 tempest-ServerRescueNegativeTestJSON-2061875223 tempest-ServerRescueNegativeTestJSON-2061875223-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:04:57.385466 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.policy [None req-44803699-921f-47b8-a8a4-e5b99b5ce4a2 tempest-ServerRescueNegativeTestJSON-2061875223 tempest-ServerRescueNegativeTestJSON-2061875223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ea02b6e8f1548a1bd78952cb7337403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5e8a958d4bf43868502b13728b9583b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116157) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:04:57.393714 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: INFO nova.api.openstack.requestlog [None req-44803699-921f-47b8-a8a4-e5b99b5ce4a2 tempest-ServerRescueNegativeTestJSON-2061875223 tempest-ServerRescueNegativeTestJSON-2061875223-project] 10.222.0.18 "GET /compute/v2.1/servers/9bbb0abf-72a3-4fbc-8235-7a3ecfc8d006" status: 200 len: 1521 microversion: 2.1 time: 0.159017 Dec 15 03:04:57.396324 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: [pid: 116157|app: 0|req: 113/257] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 03:04:57 2021] GET /compute/v2.1/servers/9bbb0abf-72a3-4fbc-8235-7a3ecfc8d006 => generated 1521 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 03:04:57.674378 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi [None req-41c4159b-f57b-483e-b57f-1aab21550d38 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Calling method '>' {{(pid=116156) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:04:57.674974 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.compute.api [None req-41c4159b-f57b-483e-b57f-1aab21550d38 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] [instance: b89094ac-aee1-4bd6-a33d-8c4347cebfc7] Fetching instance by UUID {{(pid=116156) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:04:57.681236 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-41c4159b-f57b-483e-b57f-1aab21550d38 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:04:57.681744 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-41c4159b-f57b-483e-b57f-1aab21550d38 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:04:57.682623 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-41c4159b-f57b-483e-b57f-1aab21550d38 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:04:57.683063 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-41c4159b-f57b-483e-b57f-1aab21550d38 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:04:57.811185 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.policy [None req-41c4159b-f57b-483e-b57f-1aab21550d38 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fedc11e2dbd74b919982a0657222cca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f16202549724b878f908d68384ec9c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116156) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:04:57.819266 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.policy [None req-41c4159b-f57b-483e-b57f-1aab21550d38 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fedc11e2dbd74b919982a0657222cca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f16202549724b878f908d68384ec9c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116156) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:04:57.820749 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.policy [None req-41c4159b-f57b-483e-b57f-1aab21550d38 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fedc11e2dbd74b919982a0657222cca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f16202549724b878f908d68384ec9c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116156) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:04:57.821839 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: INFO nova.api.openstack.requestlog [None req-41c4159b-f57b-483e-b57f-1aab21550d38 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] 10.222.0.18 "GET /compute/v2.1/servers/b89094ac-aee1-4bd6-a33d-8c4347cebfc7" status: 200 len: 1406 microversion: 2.20 time: 0.151177 Dec 15 03:04:57.822419 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: [pid: 116156|app: 0|req: 145/258] 10.222.0.18 () {60 vars in 1276 bytes} [Wed Dec 15 03:04:57 2021] GET /compute/v2.1/servers/b89094ac-aee1-4bd6-a33d-8c4347cebfc7 => generated 1406 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 03:04:58.116168 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi [None req-0a7af7c2-cc48-4758-8401-68321b051615 tempest-VolumesActionsTest-1837279088 tempest-VolumesActionsTest-1837279088-project] Calling method '>' {{(pid=116157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:04:58.116819 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.compute.api [None req-0a7af7c2-cc48-4758-8401-68321b051615 tempest-VolumesActionsTest-1837279088 tempest-VolumesActionsTest-1837279088-project] [instance: 0c1f5052-62a2-4847-ab40-6e1a9df040ca] Fetching instance by UUID {{(pid=116157) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:04:58.123283 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-0a7af7c2-cc48-4758-8401-68321b051615 tempest-VolumesActionsTest-1837279088 tempest-VolumesActionsTest-1837279088-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:04:58.123739 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-0a7af7c2-cc48-4758-8401-68321b051615 tempest-VolumesActionsTest-1837279088 tempest-VolumesActionsTest-1837279088-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:04:58.124556 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-0a7af7c2-cc48-4758-8401-68321b051615 tempest-VolumesActionsTest-1837279088 tempest-VolumesActionsTest-1837279088-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:04:58.125003 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-0a7af7c2-cc48-4758-8401-68321b051615 tempest-VolumesActionsTest-1837279088 tempest-VolumesActionsTest-1837279088-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:04:58.148135 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi [None req-be62f11b-9fd8-4a7f-ad5c-7987957f5880 tempest-AttachVolumeNegativeTest-1640336653 tempest-AttachVolumeNegativeTest-1640336653-project] Calling method '>' {{(pid=116156) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:04:58.149362 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.compute.api [None req-be62f11b-9fd8-4a7f-ad5c-7987957f5880 tempest-AttachVolumeNegativeTest-1640336653 tempest-AttachVolumeNegativeTest-1640336653-project] [instance: b302a057-8ba0-4cec-bcb7-805bd598c638] Fetching instance by UUID {{(pid=116156) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:04:58.155275 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-be62f11b-9fd8-4a7f-ad5c-7987957f5880 tempest-AttachVolumeNegativeTest-1640336653 tempest-AttachVolumeNegativeTest-1640336653-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:04:58.165421 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-be62f11b-9fd8-4a7f-ad5c-7987957f5880 tempest-AttachVolumeNegativeTest-1640336653 tempest-AttachVolumeNegativeTest-1640336653-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:04:58.166340 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-be62f11b-9fd8-4a7f-ad5c-7987957f5880 tempest-AttachVolumeNegativeTest-1640336653 tempest-AttachVolumeNegativeTest-1640336653-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:04:58.166786 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-be62f11b-9fd8-4a7f-ad5c-7987957f5880 tempest-AttachVolumeNegativeTest-1640336653 tempest-AttachVolumeNegativeTest-1640336653-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:04:58.273639 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.policy [None req-0a7af7c2-cc48-4758-8401-68321b051615 tempest-VolumesActionsTest-1837279088 tempest-VolumesActionsTest-1837279088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e440754469c4407840a651d560ce08a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6eaf458d3c84ba59b078dc0a3bf1763', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116157) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:04:58.282230 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: INFO nova.api.openstack.requestlog [None req-0a7af7c2-cc48-4758-8401-68321b051615 tempest-VolumesActionsTest-1837279088 tempest-VolumesActionsTest-1837279088-project] 10.222.0.18 "GET /compute/v2.1/servers/0c1f5052-62a2-4847-ab40-6e1a9df040ca" status: 200 len: 1313 microversion: 2.1 time: 0.169376 Dec 15 03:04:58.282982 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: [pid: 116157|app: 0|req: 114/259] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 03:04:58 2021] GET /compute/v2.1/servers/0c1f5052-62a2-4847-ab40-6e1a9df040ca => generated 1313 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 03:04:58.316845 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.policy [None req-be62f11b-9fd8-4a7f-ad5c-7987957f5880 tempest-AttachVolumeNegativeTest-1640336653 tempest-AttachVolumeNegativeTest-1640336653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35d37a3d8e504b8186182468b77dd114', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '409b41637da94c469444954258444b4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116156) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:04:58.323997 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: INFO nova.api.openstack.requestlog [None req-be62f11b-9fd8-4a7f-ad5c-7987957f5880 tempest-AttachVolumeNegativeTest-1640336653 tempest-AttachVolumeNegativeTest-1640336653-project] 10.222.0.18 "GET /compute/v2.1/servers/b302a057-8ba0-4cec-bcb7-805bd598c638" status: 200 len: 1317 microversion: 2.1 time: 0.179797 Dec 15 03:04:58.324556 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: [pid: 116156|app: 0|req: 146/260] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 03:04:58 2021] GET /compute/v2.1/servers/b302a057-8ba0-4cec-bcb7-805bd598c638 => generated 1317 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 03:04:58.421119 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi [None req-5bcc0418-5a3c-4dd9-9976-9a0bcb9ad34a tempest-ServerRescueNegativeTestJSON-2061875223 tempest-ServerRescueNegativeTestJSON-2061875223-project] Calling method '>' {{(pid=116157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:04:58.421763 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.compute.api [None req-5bcc0418-5a3c-4dd9-9976-9a0bcb9ad34a tempest-ServerRescueNegativeTestJSON-2061875223 tempest-ServerRescueNegativeTestJSON-2061875223-project] [instance: 9bbb0abf-72a3-4fbc-8235-7a3ecfc8d006] Fetching instance by UUID {{(pid=116157) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:04:58.428078 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-5bcc0418-5a3c-4dd9-9976-9a0bcb9ad34a tempest-ServerRescueNegativeTestJSON-2061875223 tempest-ServerRescueNegativeTestJSON-2061875223-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:04:58.428541 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-5bcc0418-5a3c-4dd9-9976-9a0bcb9ad34a tempest-ServerRescueNegativeTestJSON-2061875223 tempest-ServerRescueNegativeTestJSON-2061875223-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:04:58.429324 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-5bcc0418-5a3c-4dd9-9976-9a0bcb9ad34a tempest-ServerRescueNegativeTestJSON-2061875223 tempest-ServerRescueNegativeTestJSON-2061875223-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:04:58.429761 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-5bcc0418-5a3c-4dd9-9976-9a0bcb9ad34a tempest-ServerRescueNegativeTestJSON-2061875223 tempest-ServerRescueNegativeTestJSON-2061875223-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:04:58.786665 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.policy [None req-5bcc0418-5a3c-4dd9-9976-9a0bcb9ad34a tempest-ServerRescueNegativeTestJSON-2061875223 tempest-ServerRescueNegativeTestJSON-2061875223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ea02b6e8f1548a1bd78952cb7337403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5e8a958d4bf43868502b13728b9583b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116157) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:04:58.793937 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: INFO nova.api.openstack.requestlog [None req-5bcc0418-5a3c-4dd9-9976-9a0bcb9ad34a tempest-ServerRescueNegativeTestJSON-2061875223 tempest-ServerRescueNegativeTestJSON-2061875223-project] 10.222.0.18 "GET /compute/v2.1/servers/9bbb0abf-72a3-4fbc-8235-7a3ecfc8d006" status: 200 len: 1521 microversion: 2.1 time: 0.376424 Dec 15 03:04:58.794618 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: [pid: 116157|app: 0|req: 115/261] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 03:04:58 2021] GET /compute/v2.1/servers/9bbb0abf-72a3-4fbc-8235-7a3ecfc8d006 => generated 1521 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 03:04:58.839493 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi [None req-9c2fc597-2bea-467b-b4d0-2b1017fcd090 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Calling method '>' {{(pid=116156) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:04:58.840141 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.compute.api [None req-9c2fc597-2bea-467b-b4d0-2b1017fcd090 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] [instance: b89094ac-aee1-4bd6-a33d-8c4347cebfc7] Fetching instance by UUID {{(pid=116156) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:04:58.852010 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-9c2fc597-2bea-467b-b4d0-2b1017fcd090 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:04:58.852641 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-9c2fc597-2bea-467b-b4d0-2b1017fcd090 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:04:58.853800 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-9c2fc597-2bea-467b-b4d0-2b1017fcd090 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:04:58.854446 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-9c2fc597-2bea-467b-b4d0-2b1017fcd090 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:04:59.025475 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.policy [None req-9c2fc597-2bea-467b-b4d0-2b1017fcd090 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fedc11e2dbd74b919982a0657222cca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f16202549724b878f908d68384ec9c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116156) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:04:59.033612 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.policy [None req-9c2fc597-2bea-467b-b4d0-2b1017fcd090 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fedc11e2dbd74b919982a0657222cca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f16202549724b878f908d68384ec9c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116156) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:04:59.035034 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.policy [None req-9c2fc597-2bea-467b-b4d0-2b1017fcd090 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fedc11e2dbd74b919982a0657222cca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f16202549724b878f908d68384ec9c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116156) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:04:59.036150 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: INFO nova.api.openstack.requestlog [None req-9c2fc597-2bea-467b-b4d0-2b1017fcd090 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] 10.222.0.18 "GET /compute/v2.1/servers/b89094ac-aee1-4bd6-a33d-8c4347cebfc7" status: 200 len: 1406 microversion: 2.20 time: 0.200281 Dec 15 03:04:59.036688 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: [pid: 116156|app: 0|req: 147/262] 10.222.0.18 () {60 vars in 1276 bytes} [Wed Dec 15 03:04:58 2021] GET /compute/v2.1/servers/b89094ac-aee1-4bd6-a33d-8c4347cebfc7 => generated 1406 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 03:04:59.298718 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi [None req-afbbf563-865e-4acf-a763-28b7415e3de7 tempest-VolumesActionsTest-1837279088 tempest-VolumesActionsTest-1837279088-project] Calling method '>' {{(pid=116157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:04:59.299362 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.compute.api [None req-afbbf563-865e-4acf-a763-28b7415e3de7 tempest-VolumesActionsTest-1837279088 tempest-VolumesActionsTest-1837279088-project] [instance: 0c1f5052-62a2-4847-ab40-6e1a9df040ca] Fetching instance by UUID {{(pid=116157) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:04:59.305417 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-afbbf563-865e-4acf-a763-28b7415e3de7 tempest-VolumesActionsTest-1837279088 tempest-VolumesActionsTest-1837279088-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:04:59.305862 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-afbbf563-865e-4acf-a763-28b7415e3de7 tempest-VolumesActionsTest-1837279088 tempest-VolumesActionsTest-1837279088-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:04:59.306679 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-afbbf563-865e-4acf-a763-28b7415e3de7 tempest-VolumesActionsTest-1837279088 tempest-VolumesActionsTest-1837279088-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:04:59.307110 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-afbbf563-865e-4acf-a763-28b7415e3de7 tempest-VolumesActionsTest-1837279088 tempest-VolumesActionsTest-1837279088-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:04:59.340864 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi [None req-95ab6313-b8f0-4dca-b396-f2e03d8891cd tempest-AttachVolumeNegativeTest-1640336653 tempest-AttachVolumeNegativeTest-1640336653-project] Calling method '>' {{(pid=116156) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:04:59.341476 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.compute.api [None req-95ab6313-b8f0-4dca-b396-f2e03d8891cd tempest-AttachVolumeNegativeTest-1640336653 tempest-AttachVolumeNegativeTest-1640336653-project] [instance: b302a057-8ba0-4cec-bcb7-805bd598c638] Fetching instance by UUID {{(pid=116156) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:04:59.348755 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-95ab6313-b8f0-4dca-b396-f2e03d8891cd tempest-AttachVolumeNegativeTest-1640336653 tempest-AttachVolumeNegativeTest-1640336653-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:04:59.349553 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-95ab6313-b8f0-4dca-b396-f2e03d8891cd tempest-AttachVolumeNegativeTest-1640336653 tempest-AttachVolumeNegativeTest-1640336653-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:04:59.350500 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-95ab6313-b8f0-4dca-b396-f2e03d8891cd tempest-AttachVolumeNegativeTest-1640336653 tempest-AttachVolumeNegativeTest-1640336653-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:04:59.350945 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-95ab6313-b8f0-4dca-b396-f2e03d8891cd tempest-AttachVolumeNegativeTest-1640336653 tempest-AttachVolumeNegativeTest-1640336653-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:04:59.445196 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.policy [None req-afbbf563-865e-4acf-a763-28b7415e3de7 tempest-VolumesActionsTest-1837279088 tempest-VolumesActionsTest-1837279088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e440754469c4407840a651d560ce08a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6eaf458d3c84ba59b078dc0a3bf1763', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116157) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:04:59.452534 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: INFO nova.api.openstack.requestlog [None req-afbbf563-865e-4acf-a763-28b7415e3de7 tempest-VolumesActionsTest-1837279088 tempest-VolumesActionsTest-1837279088-project] 10.222.0.18 "GET /compute/v2.1/servers/0c1f5052-62a2-4847-ab40-6e1a9df040ca" status: 200 len: 1313 microversion: 2.1 time: 0.157341 Dec 15 03:04:59.453531 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: [pid: 116157|app: 0|req: 116/263] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 03:04:59 2021] GET /compute/v2.1/servers/0c1f5052-62a2-4847-ab40-6e1a9df040ca => generated 1313 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 03:04:59.537412 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.policy [None req-95ab6313-b8f0-4dca-b396-f2e03d8891cd tempest-AttachVolumeNegativeTest-1640336653 tempest-AttachVolumeNegativeTest-1640336653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35d37a3d8e504b8186182468b77dd114', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '409b41637da94c469444954258444b4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116156) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:04:59.544371 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: INFO nova.api.openstack.requestlog [None req-95ab6313-b8f0-4dca-b396-f2e03d8891cd tempest-AttachVolumeNegativeTest-1640336653 tempest-AttachVolumeNegativeTest-1640336653-project] 10.222.0.18 "GET /compute/v2.1/servers/b302a057-8ba0-4cec-bcb7-805bd598c638" status: 200 len: 1317 microversion: 2.1 time: 0.207419 Dec 15 03:04:59.545017 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: [pid: 116156|app: 0|req: 148/264] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 03:04:59 2021] GET /compute/v2.1/servers/b302a057-8ba0-4cec-bcb7-805bd598c638 => generated 1317 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 03:04:59.810457 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi [None req-fd323d14-5177-4d78-96d5-e0a5f935d58a tempest-ServerRescueNegativeTestJSON-2061875223 tempest-ServerRescueNegativeTestJSON-2061875223-project] Calling method '>' {{(pid=116157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:04:59.811072 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.compute.api [None req-fd323d14-5177-4d78-96d5-e0a5f935d58a tempest-ServerRescueNegativeTestJSON-2061875223 tempest-ServerRescueNegativeTestJSON-2061875223-project] [instance: 9bbb0abf-72a3-4fbc-8235-7a3ecfc8d006] Fetching instance by UUID {{(pid=116157) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:04:59.816818 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-fd323d14-5177-4d78-96d5-e0a5f935d58a tempest-ServerRescueNegativeTestJSON-2061875223 tempest-ServerRescueNegativeTestJSON-2061875223-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:04:59.817274 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-fd323d14-5177-4d78-96d5-e0a5f935d58a tempest-ServerRescueNegativeTestJSON-2061875223 tempest-ServerRescueNegativeTestJSON-2061875223-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:04:59.818083 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-fd323d14-5177-4d78-96d5-e0a5f935d58a tempest-ServerRescueNegativeTestJSON-2061875223 tempest-ServerRescueNegativeTestJSON-2061875223-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:04:59.818523 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-fd323d14-5177-4d78-96d5-e0a5f935d58a tempest-ServerRescueNegativeTestJSON-2061875223 tempest-ServerRescueNegativeTestJSON-2061875223-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:04:59.952927 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.policy [None req-fd323d14-5177-4d78-96d5-e0a5f935d58a tempest-ServerRescueNegativeTestJSON-2061875223 tempest-ServerRescueNegativeTestJSON-2061875223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ea02b6e8f1548a1bd78952cb7337403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5e8a958d4bf43868502b13728b9583b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116157) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:04:59.960491 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: INFO nova.api.openstack.requestlog [None req-fd323d14-5177-4d78-96d5-e0a5f935d58a tempest-ServerRescueNegativeTestJSON-2061875223 tempest-ServerRescueNegativeTestJSON-2061875223-project] 10.222.0.18 "GET /compute/v2.1/servers/9bbb0abf-72a3-4fbc-8235-7a3ecfc8d006" status: 200 len: 1521 microversion: 2.1 time: 0.153673 Dec 15 03:04:59.961137 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: [pid: 116157|app: 0|req: 117/265] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 03:04:59 2021] GET /compute/v2.1/servers/9bbb0abf-72a3-4fbc-8235-7a3ecfc8d006 => generated 1521 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 03:05:00.054166 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi [None req-11c4c1d9-60da-4d10-b54f-684dfd53464d tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Calling method '>' {{(pid=116156) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:05:00.054770 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.compute.api [None req-11c4c1d9-60da-4d10-b54f-684dfd53464d tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] [instance: b89094ac-aee1-4bd6-a33d-8c4347cebfc7] Fetching instance by UUID {{(pid=116156) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:05:00.060928 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-11c4c1d9-60da-4d10-b54f-684dfd53464d tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:05:00.061506 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-11c4c1d9-60da-4d10-b54f-684dfd53464d tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:05:00.062239 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-11c4c1d9-60da-4d10-b54f-684dfd53464d tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:05:00.062672 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-11c4c1d9-60da-4d10-b54f-684dfd53464d tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:05:00.194077 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.policy [None req-11c4c1d9-60da-4d10-b54f-684dfd53464d tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fedc11e2dbd74b919982a0657222cca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f16202549724b878f908d68384ec9c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116156) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:05:00.201818 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.policy [None req-11c4c1d9-60da-4d10-b54f-684dfd53464d tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fedc11e2dbd74b919982a0657222cca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f16202549724b878f908d68384ec9c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116156) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:05:00.203406 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.policy [None req-11c4c1d9-60da-4d10-b54f-684dfd53464d tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fedc11e2dbd74b919982a0657222cca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f16202549724b878f908d68384ec9c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116156) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:05:00.204957 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: INFO nova.api.openstack.requestlog [None req-11c4c1d9-60da-4d10-b54f-684dfd53464d tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] 10.222.0.18 "GET /compute/v2.1/servers/b89094ac-aee1-4bd6-a33d-8c4347cebfc7" status: 200 len: 1406 microversion: 2.20 time: 0.154433 Dec 15 03:05:00.215606 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: [pid: 116156|app: 0|req: 149/266] 10.222.0.18 () {60 vars in 1276 bytes} [Wed Dec 15 03:05:00 2021] GET /compute/v2.1/servers/b89094ac-aee1-4bd6-a33d-8c4347cebfc7 => generated 1406 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 03:05:00.470013 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi [None req-a1f2c4c9-ca06-4352-a81b-4f56b13b818f tempest-VolumesActionsTest-1837279088 tempest-VolumesActionsTest-1837279088-project] Calling method '>' {{(pid=116157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:05:00.470641 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.compute.api [None req-a1f2c4c9-ca06-4352-a81b-4f56b13b818f tempest-VolumesActionsTest-1837279088 tempest-VolumesActionsTest-1837279088-project] [instance: 0c1f5052-62a2-4847-ab40-6e1a9df040ca] Fetching instance by UUID {{(pid=116157) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:05:00.476332 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-a1f2c4c9-ca06-4352-a81b-4f56b13b818f tempest-VolumesActionsTest-1837279088 tempest-VolumesActionsTest-1837279088-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:05:00.476779 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-a1f2c4c9-ca06-4352-a81b-4f56b13b818f tempest-VolumesActionsTest-1837279088 tempest-VolumesActionsTest-1837279088-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:05:00.477555 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-a1f2c4c9-ca06-4352-a81b-4f56b13b818f tempest-VolumesActionsTest-1837279088 tempest-VolumesActionsTest-1837279088-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:05:00.478000 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-a1f2c4c9-ca06-4352-a81b-4f56b13b818f tempest-VolumesActionsTest-1837279088 tempest-VolumesActionsTest-1837279088-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:05:00.562037 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi [None req-e7095e99-a2ee-4c55-9b6f-faee85e2707a tempest-AttachVolumeNegativeTest-1640336653 tempest-AttachVolumeNegativeTest-1640336653-project] Calling method '>' {{(pid=116156) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:05:00.563429 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.compute.api [None req-e7095e99-a2ee-4c55-9b6f-faee85e2707a tempest-AttachVolumeNegativeTest-1640336653 tempest-AttachVolumeNegativeTest-1640336653-project] [instance: b302a057-8ba0-4cec-bcb7-805bd598c638] Fetching instance by UUID {{(pid=116156) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:05:00.580549 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-e7095e99-a2ee-4c55-9b6f-faee85e2707a tempest-AttachVolumeNegativeTest-1640336653 tempest-AttachVolumeNegativeTest-1640336653-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:05:00.585307 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-e7095e99-a2ee-4c55-9b6f-faee85e2707a tempest-AttachVolumeNegativeTest-1640336653 tempest-AttachVolumeNegativeTest-1640336653-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:05:00.586668 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-e7095e99-a2ee-4c55-9b6f-faee85e2707a tempest-AttachVolumeNegativeTest-1640336653 tempest-AttachVolumeNegativeTest-1640336653-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:05:00.586851 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-e7095e99-a2ee-4c55-9b6f-faee85e2707a tempest-AttachVolumeNegativeTest-1640336653 tempest-AttachVolumeNegativeTest-1640336653-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:05:00.619722 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.policy [None req-a1f2c4c9-ca06-4352-a81b-4f56b13b818f tempest-VolumesActionsTest-1837279088 tempest-VolumesActionsTest-1837279088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e440754469c4407840a651d560ce08a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6eaf458d3c84ba59b078dc0a3bf1763', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116157) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:05:00.631153 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: INFO nova.api.openstack.requestlog [None req-a1f2c4c9-ca06-4352-a81b-4f56b13b818f tempest-VolumesActionsTest-1837279088 tempest-VolumesActionsTest-1837279088-project] 10.222.0.18 "GET /compute/v2.1/servers/0c1f5052-62a2-4847-ab40-6e1a9df040ca" status: 200 len: 1313 microversion: 2.1 time: 0.165305 Dec 15 03:05:00.633182 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: [pid: 116157|app: 0|req: 118/267] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 03:05:00 2021] GET /compute/v2.1/servers/0c1f5052-62a2-4847-ab40-6e1a9df040ca => generated 1313 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 03:05:00.769951 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.policy [None req-e7095e99-a2ee-4c55-9b6f-faee85e2707a tempest-AttachVolumeNegativeTest-1640336653 tempest-AttachVolumeNegativeTest-1640336653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35d37a3d8e504b8186182468b77dd114', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '409b41637da94c469444954258444b4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116156) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:05:00.788036 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: INFO nova.api.openstack.requestlog [None req-e7095e99-a2ee-4c55-9b6f-faee85e2707a tempest-AttachVolumeNegativeTest-1640336653 tempest-AttachVolumeNegativeTest-1640336653-project] 10.222.0.18 "GET /compute/v2.1/servers/b302a057-8ba0-4cec-bcb7-805bd598c638" status: 200 len: 1317 microversion: 2.1 time: 0.221836 Dec 15 03:05:00.788036 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: [pid: 116156|app: 0|req: 150/268] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 03:05:00 2021] GET /compute/v2.1/servers/b302a057-8ba0-4cec-bcb7-805bd598c638 => generated 1317 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 03:05:00.978201 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi [None req-9777d8e3-53e6-483a-a5d3-35d404702c6d tempest-ServerRescueNegativeTestJSON-2061875223 tempest-ServerRescueNegativeTestJSON-2061875223-project] Calling method '>' {{(pid=116157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:05:00.978827 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.compute.api [None req-9777d8e3-53e6-483a-a5d3-35d404702c6d tempest-ServerRescueNegativeTestJSON-2061875223 tempest-ServerRescueNegativeTestJSON-2061875223-project] [instance: 9bbb0abf-72a3-4fbc-8235-7a3ecfc8d006] Fetching instance by UUID {{(pid=116157) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:05:00.985475 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-9777d8e3-53e6-483a-a5d3-35d404702c6d tempest-ServerRescueNegativeTestJSON-2061875223 tempest-ServerRescueNegativeTestJSON-2061875223-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:05:00.986068 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-9777d8e3-53e6-483a-a5d3-35d404702c6d tempest-ServerRescueNegativeTestJSON-2061875223 tempest-ServerRescueNegativeTestJSON-2061875223-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:05:00.987043 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-9777d8e3-53e6-483a-a5d3-35d404702c6d tempest-ServerRescueNegativeTestJSON-2061875223 tempest-ServerRescueNegativeTestJSON-2061875223-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:05:00.987493 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-9777d8e3-53e6-483a-a5d3-35d404702c6d tempest-ServerRescueNegativeTestJSON-2061875223 tempest-ServerRescueNegativeTestJSON-2061875223-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:05:01.148589 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.policy [None req-9777d8e3-53e6-483a-a5d3-35d404702c6d tempest-ServerRescueNegativeTestJSON-2061875223 tempest-ServerRescueNegativeTestJSON-2061875223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ea02b6e8f1548a1bd78952cb7337403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5e8a958d4bf43868502b13728b9583b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116157) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:05:01.149957 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi [req-222c0567-cfb2-48b9-b5f8-da16346a9f31 req-3a0fde25-5b8e-45fb-b112-3de9b64ffd04 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0c1f5052-62a2-4847-ab40-6e1a9df040ca", "name": "network-vif-plugged", "status": "completed", "tag": "337016c2-5d41-4e99-80d1-0be601ec8027"}]} {{(pid=116156) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 03:05:01.151557 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 15 03:05:01.151557 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: warnings.warn(msg) Dec 15 03:05:01.164234 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [req-222c0567-cfb2-48b9-b5f8-da16346a9f31 req-3a0fde25-5b8e-45fb-b112-3de9b64ffd04 service nova] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:05:01.164830 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [req-222c0567-cfb2-48b9-b5f8-da16346a9f31 req-3a0fde25-5b8e-45fb-b112-3de9b64ffd04 service nova] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:05:01.171347 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: INFO nova.api.openstack.requestlog [None req-9777d8e3-53e6-483a-a5d3-35d404702c6d tempest-ServerRescueNegativeTestJSON-2061875223 tempest-ServerRescueNegativeTestJSON-2061875223-project] 10.222.0.18 "GET /compute/v2.1/servers/9bbb0abf-72a3-4fbc-8235-7a3ecfc8d006" status: 200 len: 1521 microversion: 2.1 time: 0.194832 Dec 15 03:05:01.172131 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: [pid: 116157|app: 0|req: 119/269] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 03:05:00 2021] GET /compute/v2.1/servers/9bbb0abf-72a3-4fbc-8235-7a3ecfc8d006 => generated 1521 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 03:05:01.181389 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: INFO nova.api.openstack.compute.server_external_events [req-222c0567-cfb2-48b9-b5f8-da16346a9f31 req-3a0fde25-5b8e-45fb-b112-3de9b64ffd04 service nova] Creating event network-vif-plugged:337016c2-5d41-4e99-80d1-0be601ec8027 for instance 0c1f5052-62a2-4847-ab40-6e1a9df040ca on hv-cinder-81803 Dec 15 03:05:01.187491 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: INFO nova.api.openstack.requestlog [req-222c0567-cfb2-48b9-b5f8-da16346a9f31 req-3a0fde25-5b8e-45fb-b112-3de9b64ffd04 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040905 Dec 15 03:05:01.189906 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: [pid: 116156|app: 0|req: 151/270] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Dec 15 03:05:01 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 15 03:05:01.222794 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi [None req-a1fc88f8-69cd-4432-81d3-222d82e122f3 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Calling method '>' {{(pid=116157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:05:01.223907 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.compute.api [None req-a1fc88f8-69cd-4432-81d3-222d82e122f3 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] [instance: b89094ac-aee1-4bd6-a33d-8c4347cebfc7] Fetching instance by UUID {{(pid=116157) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:05:01.232457 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-a1fc88f8-69cd-4432-81d3-222d82e122f3 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:05:01.233157 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-a1fc88f8-69cd-4432-81d3-222d82e122f3 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:05:01.235850 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-a1fc88f8-69cd-4432-81d3-222d82e122f3 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:05:01.236578 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-a1fc88f8-69cd-4432-81d3-222d82e122f3 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:05:01.439706 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.policy [None req-a1fc88f8-69cd-4432-81d3-222d82e122f3 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fedc11e2dbd74b919982a0657222cca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f16202549724b878f908d68384ec9c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116157) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:05:01.447499 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.policy [None req-a1fc88f8-69cd-4432-81d3-222d82e122f3 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fedc11e2dbd74b919982a0657222cca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f16202549724b878f908d68384ec9c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116157) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:05:01.449634 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.policy [None req-a1fc88f8-69cd-4432-81d3-222d82e122f3 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fedc11e2dbd74b919982a0657222cca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f16202549724b878f908d68384ec9c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116157) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:05:01.450869 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: INFO nova.api.openstack.requestlog [None req-a1fc88f8-69cd-4432-81d3-222d82e122f3 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] 10.222.0.18 "GET /compute/v2.1/servers/b89094ac-aee1-4bd6-a33d-8c4347cebfc7" status: 200 len: 1406 microversion: 2.20 time: 0.232338 Dec 15 03:05:01.457059 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: [pid: 116157|app: 0|req: 120/271] 10.222.0.18 () {60 vars in 1276 bytes} [Wed Dec 15 03:05:01 2021] GET /compute/v2.1/servers/b89094ac-aee1-4bd6-a33d-8c4347cebfc7 => generated 1406 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 03:05:01.648284 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi [None req-a50e279e-21e3-4fad-86a1-e72fda9a54aa tempest-VolumesActionsTest-1837279088 tempest-VolumesActionsTest-1837279088-project] Calling method '>' {{(pid=116156) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:05:01.649006 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.compute.api [None req-a50e279e-21e3-4fad-86a1-e72fda9a54aa tempest-VolumesActionsTest-1837279088 tempest-VolumesActionsTest-1837279088-project] [instance: 0c1f5052-62a2-4847-ab40-6e1a9df040ca] Fetching instance by UUID {{(pid=116156) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:05:01.654911 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-a50e279e-21e3-4fad-86a1-e72fda9a54aa tempest-VolumesActionsTest-1837279088 tempest-VolumesActionsTest-1837279088-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:05:01.655359 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-a50e279e-21e3-4fad-86a1-e72fda9a54aa tempest-VolumesActionsTest-1837279088 tempest-VolumesActionsTest-1837279088-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:05:01.656130 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-a50e279e-21e3-4fad-86a1-e72fda9a54aa tempest-VolumesActionsTest-1837279088 tempest-VolumesActionsTest-1837279088-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:05:01.656566 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-a50e279e-21e3-4fad-86a1-e72fda9a54aa tempest-VolumesActionsTest-1837279088 tempest-VolumesActionsTest-1837279088-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:05:01.797925 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.policy [None req-a50e279e-21e3-4fad-86a1-e72fda9a54aa tempest-VolumesActionsTest-1837279088 tempest-VolumesActionsTest-1837279088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e440754469c4407840a651d560ce08a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6eaf458d3c84ba59b078dc0a3bf1763', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116156) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:05:01.804228 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi [None req-d3101ca8-0f8d-4ac6-97de-ccbe37a01d5c tempest-AttachVolumeNegativeTest-1640336653 tempest-AttachVolumeNegativeTest-1640336653-project] Calling method '>' {{(pid=116157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:05:01.804824 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.compute.api [None req-d3101ca8-0f8d-4ac6-97de-ccbe37a01d5c tempest-AttachVolumeNegativeTest-1640336653 tempest-AttachVolumeNegativeTest-1640336653-project] [instance: b302a057-8ba0-4cec-bcb7-805bd598c638] Fetching instance by UUID {{(pid=116157) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:05:01.808124 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: INFO nova.api.openstack.requestlog [None req-a50e279e-21e3-4fad-86a1-e72fda9a54aa tempest-VolumesActionsTest-1837279088 tempest-VolumesActionsTest-1837279088-project] 10.222.0.18 "GET /compute/v2.1/servers/0c1f5052-62a2-4847-ab40-6e1a9df040ca" status: 200 len: 1313 microversion: 2.1 time: 0.163633 Dec 15 03:05:01.811885 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: [pid: 116156|app: 0|req: 152/272] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 03:05:01 2021] GET /compute/v2.1/servers/0c1f5052-62a2-4847-ab40-6e1a9df040ca => generated 1313 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 03:05:01.813235 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-d3101ca8-0f8d-4ac6-97de-ccbe37a01d5c tempest-AttachVolumeNegativeTest-1640336653 tempest-AttachVolumeNegativeTest-1640336653-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:05:01.813883 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-d3101ca8-0f8d-4ac6-97de-ccbe37a01d5c tempest-AttachVolumeNegativeTest-1640336653 tempest-AttachVolumeNegativeTest-1640336653-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:05:01.814881 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-d3101ca8-0f8d-4ac6-97de-ccbe37a01d5c tempest-AttachVolumeNegativeTest-1640336653 tempest-AttachVolumeNegativeTest-1640336653-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:05:01.815477 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-d3101ca8-0f8d-4ac6-97de-ccbe37a01d5c tempest-AttachVolumeNegativeTest-1640336653 tempest-AttachVolumeNegativeTest-1640336653-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:05:01.964503 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.policy [None req-d3101ca8-0f8d-4ac6-97de-ccbe37a01d5c tempest-AttachVolumeNegativeTest-1640336653 tempest-AttachVolumeNegativeTest-1640336653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35d37a3d8e504b8186182468b77dd114', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '409b41637da94c469444954258444b4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116157) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:05:01.974299 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: INFO nova.api.openstack.requestlog [None req-d3101ca8-0f8d-4ac6-97de-ccbe37a01d5c tempest-AttachVolumeNegativeTest-1640336653 tempest-AttachVolumeNegativeTest-1640336653-project] 10.222.0.18 "GET /compute/v2.1/servers/b302a057-8ba0-4cec-bcb7-805bd598c638" status: 200 len: 1317 microversion: 2.1 time: 0.173577 Dec 15 03:05:01.975332 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: [pid: 116157|app: 0|req: 121/273] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 03:05:01 2021] GET /compute/v2.1/servers/b302a057-8ba0-4cec-bcb7-805bd598c638 => generated 1317 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 03:05:02.188100 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi [None req-6113ecfb-c56b-4596-98ba-5c104e64fe05 tempest-ServerRescueNegativeTestJSON-2061875223 tempest-ServerRescueNegativeTestJSON-2061875223-project] Calling method '>' {{(pid=116156) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:05:02.188708 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.compute.api [None req-6113ecfb-c56b-4596-98ba-5c104e64fe05 tempest-ServerRescueNegativeTestJSON-2061875223 tempest-ServerRescueNegativeTestJSON-2061875223-project] [instance: 9bbb0abf-72a3-4fbc-8235-7a3ecfc8d006] Fetching instance by UUID {{(pid=116156) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:05:02.195099 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-6113ecfb-c56b-4596-98ba-5c104e64fe05 tempest-ServerRescueNegativeTestJSON-2061875223 tempest-ServerRescueNegativeTestJSON-2061875223-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:05:02.195562 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-6113ecfb-c56b-4596-98ba-5c104e64fe05 tempest-ServerRescueNegativeTestJSON-2061875223 tempest-ServerRescueNegativeTestJSON-2061875223-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:05:02.197106 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-6113ecfb-c56b-4596-98ba-5c104e64fe05 tempest-ServerRescueNegativeTestJSON-2061875223 tempest-ServerRescueNegativeTestJSON-2061875223-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:05:02.197567 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-6113ecfb-c56b-4596-98ba-5c104e64fe05 tempest-ServerRescueNegativeTestJSON-2061875223 tempest-ServerRescueNegativeTestJSON-2061875223-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:05:02.338454 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.policy [None req-6113ecfb-c56b-4596-98ba-5c104e64fe05 tempest-ServerRescueNegativeTestJSON-2061875223 tempest-ServerRescueNegativeTestJSON-2061875223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ea02b6e8f1548a1bd78952cb7337403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5e8a958d4bf43868502b13728b9583b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116156) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:05:02.346082 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: INFO nova.api.openstack.requestlog [None req-6113ecfb-c56b-4596-98ba-5c104e64fe05 tempest-ServerRescueNegativeTestJSON-2061875223 tempest-ServerRescueNegativeTestJSON-2061875223-project] 10.222.0.18 "GET /compute/v2.1/servers/9bbb0abf-72a3-4fbc-8235-7a3ecfc8d006" status: 200 len: 1521 microversion: 2.1 time: 0.161526 Dec 15 03:05:02.346665 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: [pid: 116156|app: 0|req: 153/274] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 03:05:02 2021] GET /compute/v2.1/servers/9bbb0abf-72a3-4fbc-8235-7a3ecfc8d006 => generated 1521 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 03:05:02.468177 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi [None req-20e2d4a7-4762-46c9-93a5-187580f86972 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Calling method '>' {{(pid=116157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:05:02.468777 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.compute.api [None req-20e2d4a7-4762-46c9-93a5-187580f86972 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] [instance: b89094ac-aee1-4bd6-a33d-8c4347cebfc7] Fetching instance by UUID {{(pid=116157) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:05:02.475102 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-20e2d4a7-4762-46c9-93a5-187580f86972 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:05:02.475549 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-20e2d4a7-4762-46c9-93a5-187580f86972 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:05:02.476320 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-20e2d4a7-4762-46c9-93a5-187580f86972 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:05:02.476751 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-20e2d4a7-4762-46c9-93a5-187580f86972 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:05:02.611671 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.policy [None req-20e2d4a7-4762-46c9-93a5-187580f86972 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fedc11e2dbd74b919982a0657222cca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f16202549724b878f908d68384ec9c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116157) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:05:02.622031 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.policy [None req-20e2d4a7-4762-46c9-93a5-187580f86972 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fedc11e2dbd74b919982a0657222cca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f16202549724b878f908d68384ec9c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116157) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:05:02.623563 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.policy [None req-20e2d4a7-4762-46c9-93a5-187580f86972 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fedc11e2dbd74b919982a0657222cca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f16202549724b878f908d68384ec9c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116157) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:05:02.624909 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: INFO nova.api.openstack.requestlog [None req-20e2d4a7-4762-46c9-93a5-187580f86972 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] 10.222.0.18 "GET /compute/v2.1/servers/b89094ac-aee1-4bd6-a33d-8c4347cebfc7" status: 200 len: 1406 microversion: 2.20 time: 0.160366 Dec 15 03:05:02.635245 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: [pid: 116157|app: 0|req: 122/275] 10.222.0.18 () {60 vars in 1276 bytes} [Wed Dec 15 03:05:02 2021] GET /compute/v2.1/servers/b89094ac-aee1-4bd6-a33d-8c4347cebfc7 => generated 1406 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 03:05:02.825528 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi [None req-cba4056d-d545-4ec0-93bc-34198cc59754 tempest-VolumesActionsTest-1837279088 tempest-VolumesActionsTest-1837279088-project] Calling method '>' {{(pid=116156) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:05:02.826183 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.compute.api [None req-cba4056d-d545-4ec0-93bc-34198cc59754 tempest-VolumesActionsTest-1837279088 tempest-VolumesActionsTest-1837279088-project] [instance: 0c1f5052-62a2-4847-ab40-6e1a9df040ca] Fetching instance by UUID {{(pid=116156) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:05:02.832449 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-cba4056d-d545-4ec0-93bc-34198cc59754 tempest-VolumesActionsTest-1837279088 tempest-VolumesActionsTest-1837279088-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:05:02.832897 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-cba4056d-d545-4ec0-93bc-34198cc59754 tempest-VolumesActionsTest-1837279088 tempest-VolumesActionsTest-1837279088-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:05:02.833679 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-cba4056d-d545-4ec0-93bc-34198cc59754 tempest-VolumesActionsTest-1837279088 tempest-VolumesActionsTest-1837279088-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:05:02.834149 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-cba4056d-d545-4ec0-93bc-34198cc59754 tempest-VolumesActionsTest-1837279088 tempest-VolumesActionsTest-1837279088-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:05:02.957799 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.policy [None req-cba4056d-d545-4ec0-93bc-34198cc59754 tempest-VolumesActionsTest-1837279088 tempest-VolumesActionsTest-1837279088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e440754469c4407840a651d560ce08a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6eaf458d3c84ba59b078dc0a3bf1763', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116156) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:05:02.964835 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: INFO nova.api.openstack.requestlog [None req-cba4056d-d545-4ec0-93bc-34198cc59754 tempest-VolumesActionsTest-1837279088 tempest-VolumesActionsTest-1837279088-project] 10.222.0.18 "GET /compute/v2.1/servers/0c1f5052-62a2-4847-ab40-6e1a9df040ca" status: 200 len: 1313 microversion: 2.1 time: 0.143009 Dec 15 03:05:02.965394 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: [pid: 116156|app: 0|req: 154/276] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 03:05:02 2021] GET /compute/v2.1/servers/0c1f5052-62a2-4847-ab40-6e1a9df040ca => generated 1313 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 03:05:02.991039 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi [None req-a291ae8a-1c4a-47a8-967f-f1eb0827a232 tempest-AttachVolumeNegativeTest-1640336653 tempest-AttachVolumeNegativeTest-1640336653-project] Calling method '>' {{(pid=116157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:05:02.991670 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.compute.api [None req-a291ae8a-1c4a-47a8-967f-f1eb0827a232 tempest-AttachVolumeNegativeTest-1640336653 tempest-AttachVolumeNegativeTest-1640336653-project] [instance: b302a057-8ba0-4cec-bcb7-805bd598c638] Fetching instance by UUID {{(pid=116157) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:05:02.998009 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-a291ae8a-1c4a-47a8-967f-f1eb0827a232 tempest-AttachVolumeNegativeTest-1640336653 tempest-AttachVolumeNegativeTest-1640336653-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:05:02.998613 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-a291ae8a-1c4a-47a8-967f-f1eb0827a232 tempest-AttachVolumeNegativeTest-1640336653 tempest-AttachVolumeNegativeTest-1640336653-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:05:02.999337 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-a291ae8a-1c4a-47a8-967f-f1eb0827a232 tempest-AttachVolumeNegativeTest-1640336653 tempest-AttachVolumeNegativeTest-1640336653-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:05:02.999765 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-a291ae8a-1c4a-47a8-967f-f1eb0827a232 tempest-AttachVolumeNegativeTest-1640336653 tempest-AttachVolumeNegativeTest-1640336653-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:05:03.126563 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.policy [None req-a291ae8a-1c4a-47a8-967f-f1eb0827a232 tempest-AttachVolumeNegativeTest-1640336653 tempest-AttachVolumeNegativeTest-1640336653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35d37a3d8e504b8186182468b77dd114', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '409b41637da94c469444954258444b4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116157) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:05:03.133660 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: INFO nova.api.openstack.requestlog [None req-a291ae8a-1c4a-47a8-967f-f1eb0827a232 tempest-AttachVolumeNegativeTest-1640336653 tempest-AttachVolumeNegativeTest-1640336653-project] 10.222.0.18 "GET /compute/v2.1/servers/b302a057-8ba0-4cec-bcb7-805bd598c638" status: 200 len: 1317 microversion: 2.1 time: 0.146197 Dec 15 03:05:03.134252 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: [pid: 116157|app: 0|req: 123/277] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 03:05:02 2021] GET /compute/v2.1/servers/b302a057-8ba0-4cec-bcb7-805bd598c638 => generated 1317 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 03:05:03.205744 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi [req-1e1eafa2-b5d5-4e07-abca-0f26aedda39f req-04788b6d-adc2-4a47-a1a0-8156da41f22d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b302a057-8ba0-4cec-bcb7-805bd598c638", "name": "network-vif-plugged", "status": "completed", "tag": "bd1e9500-c9d2-4a4b-bbc3-fc1261110821"}]} {{(pid=116156) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 03:05:03.207374 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 15 03:05:03.207374 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: warnings.warn(msg) Dec 15 03:05:03.213694 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [req-1e1eafa2-b5d5-4e07-abca-0f26aedda39f req-04788b6d-adc2-4a47-a1a0-8156da41f22d service nova] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:05:03.214158 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [req-1e1eafa2-b5d5-4e07-abca-0f26aedda39f req-04788b6d-adc2-4a47-a1a0-8156da41f22d service nova] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:05:03.225734 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: INFO nova.api.openstack.compute.server_external_events [req-1e1eafa2-b5d5-4e07-abca-0f26aedda39f req-04788b6d-adc2-4a47-a1a0-8156da41f22d service nova] Creating event network-vif-plugged:bd1e9500-c9d2-4a4b-bbc3-fc1261110821 for instance b302a057-8ba0-4cec-bcb7-805bd598c638 on hv-cinder-81803 Dec 15 03:05:03.230579 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: INFO nova.api.openstack.requestlog [req-1e1eafa2-b5d5-4e07-abca-0f26aedda39f req-04788b6d-adc2-4a47-a1a0-8156da41f22d service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028765 Dec 15 03:05:03.231130 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: [pid: 116156|app: 0|req: 155/278] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Dec 15 03:05:03 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 03:05:03.363145 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi [None req-d5b70e18-3d18-4844-8390-2be9a95c4962 tempest-ServerRescueNegativeTestJSON-2061875223 tempest-ServerRescueNegativeTestJSON-2061875223-project] Calling method '>' {{(pid=116157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:05:03.363774 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.compute.api [None req-d5b70e18-3d18-4844-8390-2be9a95c4962 tempest-ServerRescueNegativeTestJSON-2061875223 tempest-ServerRescueNegativeTestJSON-2061875223-project] [instance: 9bbb0abf-72a3-4fbc-8235-7a3ecfc8d006] Fetching instance by UUID {{(pid=116157) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:05:03.369460 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-d5b70e18-3d18-4844-8390-2be9a95c4962 tempest-ServerRescueNegativeTestJSON-2061875223 tempest-ServerRescueNegativeTestJSON-2061875223-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:05:03.369906 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-d5b70e18-3d18-4844-8390-2be9a95c4962 tempest-ServerRescueNegativeTestJSON-2061875223 tempest-ServerRescueNegativeTestJSON-2061875223-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:05:03.370707 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-d5b70e18-3d18-4844-8390-2be9a95c4962 tempest-ServerRescueNegativeTestJSON-2061875223 tempest-ServerRescueNegativeTestJSON-2061875223-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:05:03.371139 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-d5b70e18-3d18-4844-8390-2be9a95c4962 tempest-ServerRescueNegativeTestJSON-2061875223 tempest-ServerRescueNegativeTestJSON-2061875223-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:05:03.499583 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.policy [None req-d5b70e18-3d18-4844-8390-2be9a95c4962 tempest-ServerRescueNegativeTestJSON-2061875223 tempest-ServerRescueNegativeTestJSON-2061875223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ea02b6e8f1548a1bd78952cb7337403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5e8a958d4bf43868502b13728b9583b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116157) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:05:03.507390 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: INFO nova.api.openstack.requestlog [None req-d5b70e18-3d18-4844-8390-2be9a95c4962 tempest-ServerRescueNegativeTestJSON-2061875223 tempest-ServerRescueNegativeTestJSON-2061875223-project] 10.222.0.18 "GET /compute/v2.1/servers/9bbb0abf-72a3-4fbc-8235-7a3ecfc8d006" status: 200 len: 1521 microversion: 2.1 time: 0.148371 Dec 15 03:05:03.507948 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: [pid: 116157|app: 0|req: 124/279] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 03:05:03 2021] GET /compute/v2.1/servers/9bbb0abf-72a3-4fbc-8235-7a3ecfc8d006 => generated 1521 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 03:05:03.644727 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi [None req-42c676c3-0876-4104-9658-d847c5b0b56d tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Calling method '>' {{(pid=116156) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:05:03.645424 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.compute.api [None req-42c676c3-0876-4104-9658-d847c5b0b56d tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] [instance: b89094ac-aee1-4bd6-a33d-8c4347cebfc7] Fetching instance by UUID {{(pid=116156) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:05:03.651414 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-42c676c3-0876-4104-9658-d847c5b0b56d tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:05:03.651886 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-42c676c3-0876-4104-9658-d847c5b0b56d tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:05:03.652637 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-42c676c3-0876-4104-9658-d847c5b0b56d tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:05:03.653070 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-42c676c3-0876-4104-9658-d847c5b0b56d tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:05:03.787391 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.policy [None req-42c676c3-0876-4104-9658-d847c5b0b56d tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fedc11e2dbd74b919982a0657222cca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f16202549724b878f908d68384ec9c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116156) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:05:03.795218 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.policy [None req-42c676c3-0876-4104-9658-d847c5b0b56d tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fedc11e2dbd74b919982a0657222cca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f16202549724b878f908d68384ec9c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116156) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:05:03.797026 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.policy [None req-42c676c3-0876-4104-9658-d847c5b0b56d tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fedc11e2dbd74b919982a0657222cca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f16202549724b878f908d68384ec9c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116156) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:05:03.798720 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: INFO nova.api.openstack.requestlog [None req-42c676c3-0876-4104-9658-d847c5b0b56d tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] 10.222.0.18 "GET /compute/v2.1/servers/b89094ac-aee1-4bd6-a33d-8c4347cebfc7" status: 200 len: 1406 microversion: 2.20 time: 0.157969 Dec 15 03:05:03.799262 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: [pid: 116156|app: 0|req: 156/280] 10.222.0.18 () {60 vars in 1276 bytes} [Wed Dec 15 03:05:03 2021] GET /compute/v2.1/servers/b89094ac-aee1-4bd6-a33d-8c4347cebfc7 => generated 1406 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 03:05:03.980379 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi [None req-5c81d52b-2281-4007-b80b-052ebba2617b tempest-VolumesActionsTest-1837279088 tempest-VolumesActionsTest-1837279088-project] Calling method '>' {{(pid=116157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:05:03.980905 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.compute.api [None req-5c81d52b-2281-4007-b80b-052ebba2617b tempest-VolumesActionsTest-1837279088 tempest-VolumesActionsTest-1837279088-project] [instance: 0c1f5052-62a2-4847-ab40-6e1a9df040ca] Fetching instance by UUID {{(pid=116157) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:05:03.986936 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-5c81d52b-2281-4007-b80b-052ebba2617b tempest-VolumesActionsTest-1837279088 tempest-VolumesActionsTest-1837279088-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:05:03.987384 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-5c81d52b-2281-4007-b80b-052ebba2617b tempest-VolumesActionsTest-1837279088 tempest-VolumesActionsTest-1837279088-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:05:03.988158 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-5c81d52b-2281-4007-b80b-052ebba2617b tempest-VolumesActionsTest-1837279088 tempest-VolumesActionsTest-1837279088-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:05:03.988588 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-5c81d52b-2281-4007-b80b-052ebba2617b tempest-VolumesActionsTest-1837279088 tempest-VolumesActionsTest-1837279088-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:05:04.116043 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.policy [None req-5c81d52b-2281-4007-b80b-052ebba2617b tempest-VolumesActionsTest-1837279088 tempest-VolumesActionsTest-1837279088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e440754469c4407840a651d560ce08a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6eaf458d3c84ba59b078dc0a3bf1763', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116157) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:05:04.123415 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: INFO nova.api.openstack.requestlog [None req-5c81d52b-2281-4007-b80b-052ebba2617b tempest-VolumesActionsTest-1837279088 tempest-VolumesActionsTest-1837279088-project] 10.222.0.18 "GET /compute/v2.1/servers/0c1f5052-62a2-4847-ab40-6e1a9df040ca" status: 200 len: 1313 microversion: 2.1 time: 0.146724 Dec 15 03:05:04.123967 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: [pid: 116157|app: 0|req: 125/281] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 03:05:03 2021] GET /compute/v2.1/servers/0c1f5052-62a2-4847-ab40-6e1a9df040ca => generated 1313 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 03:05:04.149844 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi [None req-5073d39c-79f4-44a2-a538-62e3e1df05e5 tempest-AttachVolumeNegativeTest-1640336653 tempest-AttachVolumeNegativeTest-1640336653-project] Calling method '>' {{(pid=116156) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:05:04.150486 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.compute.api [None req-5073d39c-79f4-44a2-a538-62e3e1df05e5 tempest-AttachVolumeNegativeTest-1640336653 tempest-AttachVolumeNegativeTest-1640336653-project] [instance: b302a057-8ba0-4cec-bcb7-805bd598c638] Fetching instance by UUID {{(pid=116156) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:05:04.156175 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-5073d39c-79f4-44a2-a538-62e3e1df05e5 tempest-AttachVolumeNegativeTest-1640336653 tempest-AttachVolumeNegativeTest-1640336653-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:05:04.156673 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-5073d39c-79f4-44a2-a538-62e3e1df05e5 tempest-AttachVolumeNegativeTest-1640336653 tempest-AttachVolumeNegativeTest-1640336653-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:05:04.157972 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-5073d39c-79f4-44a2-a538-62e3e1df05e5 tempest-AttachVolumeNegativeTest-1640336653 tempest-AttachVolumeNegativeTest-1640336653-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:05:04.158432 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-5073d39c-79f4-44a2-a538-62e3e1df05e5 tempest-AttachVolumeNegativeTest-1640336653 tempest-AttachVolumeNegativeTest-1640336653-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:05:04.290921 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.policy [None req-5073d39c-79f4-44a2-a538-62e3e1df05e5 tempest-AttachVolumeNegativeTest-1640336653 tempest-AttachVolumeNegativeTest-1640336653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35d37a3d8e504b8186182468b77dd114', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '409b41637da94c469444954258444b4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116156) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:05:04.298931 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: INFO nova.api.openstack.requestlog [None req-5073d39c-79f4-44a2-a538-62e3e1df05e5 tempest-AttachVolumeNegativeTest-1640336653 tempest-AttachVolumeNegativeTest-1640336653-project] 10.222.0.18 "GET /compute/v2.1/servers/b302a057-8ba0-4cec-bcb7-805bd598c638" status: 200 len: 1317 microversion: 2.1 time: 0.152590 Dec 15 03:05:04.299488 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: [pid: 116156|app: 0|req: 157/282] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 03:05:04 2021] GET /compute/v2.1/servers/b302a057-8ba0-4cec-bcb7-805bd598c638 => generated 1317 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 03:05:04.524682 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi [None req-33212bad-42dc-4f09-b9d1-30393a2b3734 tempest-ServerRescueNegativeTestJSON-2061875223 tempest-ServerRescueNegativeTestJSON-2061875223-project] Calling method '>' {{(pid=116157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:05:04.525215 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.compute.api [None req-33212bad-42dc-4f09-b9d1-30393a2b3734 tempest-ServerRescueNegativeTestJSON-2061875223 tempest-ServerRescueNegativeTestJSON-2061875223-project] [instance: 9bbb0abf-72a3-4fbc-8235-7a3ecfc8d006] Fetching instance by UUID {{(pid=116157) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:05:04.531079 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-33212bad-42dc-4f09-b9d1-30393a2b3734 tempest-ServerRescueNegativeTestJSON-2061875223 tempest-ServerRescueNegativeTestJSON-2061875223-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:05:04.531537 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-33212bad-42dc-4f09-b9d1-30393a2b3734 tempest-ServerRescueNegativeTestJSON-2061875223 tempest-ServerRescueNegativeTestJSON-2061875223-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:05:04.532322 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-33212bad-42dc-4f09-b9d1-30393a2b3734 tempest-ServerRescueNegativeTestJSON-2061875223 tempest-ServerRescueNegativeTestJSON-2061875223-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:05:04.532771 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-33212bad-42dc-4f09-b9d1-30393a2b3734 tempest-ServerRescueNegativeTestJSON-2061875223 tempest-ServerRescueNegativeTestJSON-2061875223-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:05:04.793846 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.policy [None req-33212bad-42dc-4f09-b9d1-30393a2b3734 tempest-ServerRescueNegativeTestJSON-2061875223 tempest-ServerRescueNegativeTestJSON-2061875223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ea02b6e8f1548a1bd78952cb7337403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5e8a958d4bf43868502b13728b9583b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116157) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:05:04.802013 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: INFO nova.api.openstack.requestlog [None req-33212bad-42dc-4f09-b9d1-30393a2b3734 tempest-ServerRescueNegativeTestJSON-2061875223 tempest-ServerRescueNegativeTestJSON-2061875223-project] 10.222.0.18 "GET /compute/v2.1/servers/9bbb0abf-72a3-4fbc-8235-7a3ecfc8d006" status: 200 len: 1521 microversion: 2.1 time: 0.281124 Dec 15 03:05:04.802843 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: [pid: 116157|app: 0|req: 126/283] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 03:05:04 2021] GET /compute/v2.1/servers/9bbb0abf-72a3-4fbc-8235-7a3ecfc8d006 => generated 1521 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 03:05:04.818277 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi [None req-a5fe5fae-73d0-483d-b9c2-2af87056235b tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Calling method '>' {{(pid=116156) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:05:04.818942 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.compute.api [None req-a5fe5fae-73d0-483d-b9c2-2af87056235b tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] [instance: b89094ac-aee1-4bd6-a33d-8c4347cebfc7] Fetching instance by UUID {{(pid=116156) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:05:04.825134 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-a5fe5fae-73d0-483d-b9c2-2af87056235b tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:05:04.825779 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-a5fe5fae-73d0-483d-b9c2-2af87056235b tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:05:04.826770 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-a5fe5fae-73d0-483d-b9c2-2af87056235b tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:05:04.827401 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-a5fe5fae-73d0-483d-b9c2-2af87056235b tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:05:04.954698 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.policy [None req-a5fe5fae-73d0-483d-b9c2-2af87056235b tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fedc11e2dbd74b919982a0657222cca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f16202549724b878f908d68384ec9c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116156) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:05:04.962272 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.policy [None req-a5fe5fae-73d0-483d-b9c2-2af87056235b tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fedc11e2dbd74b919982a0657222cca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f16202549724b878f908d68384ec9c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116156) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:05:04.963767 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.policy [None req-a5fe5fae-73d0-483d-b9c2-2af87056235b tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fedc11e2dbd74b919982a0657222cca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f16202549724b878f908d68384ec9c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116156) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:05:04.964857 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: INFO nova.api.openstack.requestlog [None req-a5fe5fae-73d0-483d-b9c2-2af87056235b tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] 10.222.0.18 "GET /compute/v2.1/servers/b89094ac-aee1-4bd6-a33d-8c4347cebfc7" status: 200 len: 1406 microversion: 2.20 time: 0.150304 Dec 15 03:05:04.965412 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: [pid: 116156|app: 0|req: 158/284] 10.222.0.18 () {60 vars in 1276 bytes} [Wed Dec 15 03:05:04 2021] GET /compute/v2.1/servers/b89094ac-aee1-4bd6-a33d-8c4347cebfc7 => generated 1406 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 03:05:05.139774 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi [None req-ec207285-2f71-4db1-9393-fb88f5588df6 tempest-VolumesActionsTest-1837279088 tempest-VolumesActionsTest-1837279088-project] Calling method '>' {{(pid=116157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:05:05.140381 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.compute.api [None req-ec207285-2f71-4db1-9393-fb88f5588df6 tempest-VolumesActionsTest-1837279088 tempest-VolumesActionsTest-1837279088-project] [instance: 0c1f5052-62a2-4847-ab40-6e1a9df040ca] Fetching instance by UUID {{(pid=116157) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:05:05.146601 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-ec207285-2f71-4db1-9393-fb88f5588df6 tempest-VolumesActionsTest-1837279088 tempest-VolumesActionsTest-1837279088-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:05:05.147054 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-ec207285-2f71-4db1-9393-fb88f5588df6 tempest-VolumesActionsTest-1837279088 tempest-VolumesActionsTest-1837279088-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:05:05.147834 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-ec207285-2f71-4db1-9393-fb88f5588df6 tempest-VolumesActionsTest-1837279088 tempest-VolumesActionsTest-1837279088-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:05:05.148267 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-ec207285-2f71-4db1-9393-fb88f5588df6 tempest-VolumesActionsTest-1837279088 tempest-VolumesActionsTest-1837279088-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:05:05.245563 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi [req-df32d30e-bbef-4d9e-b045-aff4a8e2d323 req-9f07a419-fa81-4776-9783-7d5124039466 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b89094ac-aee1-4bd6-a33d-8c4347cebfc7", "name": "network-vif-plugged", "status": "completed", "tag": "455e429c-96fb-4858-b8fe-cf282ae96b72"}]} {{(pid=116156) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 03:05:05.247527 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 15 03:05:05.247527 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: warnings.warn(msg) Dec 15 03:05:05.254465 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [req-df32d30e-bbef-4d9e-b045-aff4a8e2d323 req-9f07a419-fa81-4776-9783-7d5124039466 service nova] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:05:05.254989 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [req-df32d30e-bbef-4d9e-b045-aff4a8e2d323 req-9f07a419-fa81-4776-9783-7d5124039466 service nova] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:05:05.265483 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: INFO nova.api.openstack.compute.server_external_events [req-df32d30e-bbef-4d9e-b045-aff4a8e2d323 req-9f07a419-fa81-4776-9783-7d5124039466 service nova] Creating event network-vif-plugged:455e429c-96fb-4858-b8fe-cf282ae96b72 for instance b89094ac-aee1-4bd6-a33d-8c4347cebfc7 on hv-cinder-81803 Dec 15 03:05:05.270329 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: INFO nova.api.openstack.requestlog [req-df32d30e-bbef-4d9e-b045-aff4a8e2d323 req-9f07a419-fa81-4776-9783-7d5124039466 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028268 Dec 15 03:05:05.271067 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: [pid: 116156|app: 0|req: 159/285] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Dec 15 03:05:05 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 15 03:05:05.279898 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.policy [None req-ec207285-2f71-4db1-9393-fb88f5588df6 tempest-VolumesActionsTest-1837279088 tempest-VolumesActionsTest-1837279088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e440754469c4407840a651d560ce08a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6eaf458d3c84ba59b078dc0a3bf1763', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116157) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:05:05.287423 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: INFO nova.api.openstack.requestlog [None req-ec207285-2f71-4db1-9393-fb88f5588df6 tempest-VolumesActionsTest-1837279088 tempest-VolumesActionsTest-1837279088-project] 10.222.0.18 "GET /compute/v2.1/servers/0c1f5052-62a2-4847-ab40-6e1a9df040ca" status: 200 len: 1313 microversion: 2.1 time: 0.151232 Dec 15 03:05:05.287986 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: [pid: 116157|app: 0|req: 127/286] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 03:05:05 2021] GET /compute/v2.1/servers/0c1f5052-62a2-4847-ab40-6e1a9df040ca => generated 1313 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 03:05:05.315844 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi [None req-46316268-e880-4bcd-b3e8-debc77cd1771 tempest-AttachVolumeNegativeTest-1640336653 tempest-AttachVolumeNegativeTest-1640336653-project] Calling method '>' {{(pid=116156) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:05:05.316546 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.compute.api [None req-46316268-e880-4bcd-b3e8-debc77cd1771 tempest-AttachVolumeNegativeTest-1640336653 tempest-AttachVolumeNegativeTest-1640336653-project] [instance: b302a057-8ba0-4cec-bcb7-805bd598c638] Fetching instance by UUID {{(pid=116156) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:05:05.322392 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-46316268-e880-4bcd-b3e8-debc77cd1771 tempest-AttachVolumeNegativeTest-1640336653 tempest-AttachVolumeNegativeTest-1640336653-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:05:05.322843 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-46316268-e880-4bcd-b3e8-debc77cd1771 tempest-AttachVolumeNegativeTest-1640336653 tempest-AttachVolumeNegativeTest-1640336653-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:05:05.323615 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-46316268-e880-4bcd-b3e8-debc77cd1771 tempest-AttachVolumeNegativeTest-1640336653 tempest-AttachVolumeNegativeTest-1640336653-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:05:05.324049 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-46316268-e880-4bcd-b3e8-debc77cd1771 tempest-AttachVolumeNegativeTest-1640336653 tempest-AttachVolumeNegativeTest-1640336653-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:05:05.453886 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.policy [None req-46316268-e880-4bcd-b3e8-debc77cd1771 tempest-AttachVolumeNegativeTest-1640336653 tempest-AttachVolumeNegativeTest-1640336653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35d37a3d8e504b8186182468b77dd114', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '409b41637da94c469444954258444b4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116156) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:05:05.461003 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: INFO nova.api.openstack.requestlog [None req-46316268-e880-4bcd-b3e8-debc77cd1771 tempest-AttachVolumeNegativeTest-1640336653 tempest-AttachVolumeNegativeTest-1640336653-project] 10.222.0.18 "GET /compute/v2.1/servers/b302a057-8ba0-4cec-bcb7-805bd598c638" status: 200 len: 1317 microversion: 2.1 time: 0.149112 Dec 15 03:05:05.461560 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: [pid: 116156|app: 0|req: 160/287] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 03:05:05 2021] GET /compute/v2.1/servers/b302a057-8ba0-4cec-bcb7-805bd598c638 => generated 1317 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 03:05:05.819241 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi [None req-25c3a915-a041-41c5-9826-50a831636007 tempest-ServerRescueNegativeTestJSON-2061875223 tempest-ServerRescueNegativeTestJSON-2061875223-project] Calling method '>' {{(pid=116157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:05:05.819912 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.compute.api [None req-25c3a915-a041-41c5-9826-50a831636007 tempest-ServerRescueNegativeTestJSON-2061875223 tempest-ServerRescueNegativeTestJSON-2061875223-project] [instance: 9bbb0abf-72a3-4fbc-8235-7a3ecfc8d006] Fetching instance by UUID {{(pid=116157) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:05:05.826870 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-25c3a915-a041-41c5-9826-50a831636007 tempest-ServerRescueNegativeTestJSON-2061875223 tempest-ServerRescueNegativeTestJSON-2061875223-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:05:05.827452 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-25c3a915-a041-41c5-9826-50a831636007 tempest-ServerRescueNegativeTestJSON-2061875223 tempest-ServerRescueNegativeTestJSON-2061875223-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:05:05.829040 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-25c3a915-a041-41c5-9826-50a831636007 tempest-ServerRescueNegativeTestJSON-2061875223 tempest-ServerRescueNegativeTestJSON-2061875223-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:05:05.829739 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-25c3a915-a041-41c5-9826-50a831636007 tempest-ServerRescueNegativeTestJSON-2061875223 tempest-ServerRescueNegativeTestJSON-2061875223-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:05:05.981991 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi [None req-442927a8-4abf-4578-a08c-a8403d6d0e9d tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Calling method '>' {{(pid=116156) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:05:05.982599 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.compute.api [None req-442927a8-4abf-4578-a08c-a8403d6d0e9d tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] [instance: b89094ac-aee1-4bd6-a33d-8c4347cebfc7] Fetching instance by UUID {{(pid=116156) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:05:05.988487 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-442927a8-4abf-4578-a08c-a8403d6d0e9d tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:05:05.988939 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-442927a8-4abf-4578-a08c-a8403d6d0e9d tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:05:05.989283 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.policy [None req-25c3a915-a041-41c5-9826-50a831636007 tempest-ServerRescueNegativeTestJSON-2061875223 tempest-ServerRescueNegativeTestJSON-2061875223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ea02b6e8f1548a1bd78952cb7337403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5e8a958d4bf43868502b13728b9583b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116157) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:05:05.989906 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-442927a8-4abf-4578-a08c-a8403d6d0e9d tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:05:05.990392 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-442927a8-4abf-4578-a08c-a8403d6d0e9d tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:05:05.997371 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: INFO nova.api.openstack.requestlog [None req-25c3a915-a041-41c5-9826-50a831636007 tempest-ServerRescueNegativeTestJSON-2061875223 tempest-ServerRescueNegativeTestJSON-2061875223-project] 10.222.0.18 "GET /compute/v2.1/servers/9bbb0abf-72a3-4fbc-8235-7a3ecfc8d006" status: 200 len: 1521 microversion: 2.1 time: 0.181810 Dec 15 03:05:05.997937 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: [pid: 116157|app: 0|req: 128/288] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 03:05:05 2021] GET /compute/v2.1/servers/9bbb0abf-72a3-4fbc-8235-7a3ecfc8d006 => generated 1521 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 03:05:06.151281 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.policy [None req-442927a8-4abf-4578-a08c-a8403d6d0e9d tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fedc11e2dbd74b919982a0657222cca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f16202549724b878f908d68384ec9c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116156) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:05:06.158915 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.policy [None req-442927a8-4abf-4578-a08c-a8403d6d0e9d tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fedc11e2dbd74b919982a0657222cca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f16202549724b878f908d68384ec9c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116156) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:05:06.160399 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.policy [None req-442927a8-4abf-4578-a08c-a8403d6d0e9d tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fedc11e2dbd74b919982a0657222cca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f16202549724b878f908d68384ec9c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116156) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:05:06.161529 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: INFO nova.api.openstack.requestlog [None req-442927a8-4abf-4578-a08c-a8403d6d0e9d tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] 10.222.0.18 "GET /compute/v2.1/servers/b89094ac-aee1-4bd6-a33d-8c4347cebfc7" status: 200 len: 1406 microversion: 2.20 time: 0.183286 Dec 15 03:05:06.162095 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: [pid: 116156|app: 0|req: 161/289] 10.222.0.18 () {60 vars in 1276 bytes} [Wed Dec 15 03:05:05 2021] GET /compute/v2.1/servers/b89094ac-aee1-4bd6-a33d-8c4347cebfc7 => generated 1406 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Dec 15 03:05:06.304133 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi [None req-e495f461-43a8-4a22-9800-302220f4e3f2 tempest-VolumesActionsTest-1837279088 tempest-VolumesActionsTest-1837279088-project] Calling method '>' {{(pid=116157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:05:06.304748 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.compute.api [None req-e495f461-43a8-4a22-9800-302220f4e3f2 tempest-VolumesActionsTest-1837279088 tempest-VolumesActionsTest-1837279088-project] [instance: 0c1f5052-62a2-4847-ab40-6e1a9df040ca] Fetching instance by UUID {{(pid=116157) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:05:06.310969 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-e495f461-43a8-4a22-9800-302220f4e3f2 tempest-VolumesActionsTest-1837279088 tempest-VolumesActionsTest-1837279088-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:05:06.311423 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-e495f461-43a8-4a22-9800-302220f4e3f2 tempest-VolumesActionsTest-1837279088 tempest-VolumesActionsTest-1837279088-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:05:06.312218 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-e495f461-43a8-4a22-9800-302220f4e3f2 tempest-VolumesActionsTest-1837279088 tempest-VolumesActionsTest-1837279088-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:05:06.312656 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-e495f461-43a8-4a22-9800-302220f4e3f2 tempest-VolumesActionsTest-1837279088 tempest-VolumesActionsTest-1837279088-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:05:06.445200 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.policy [None req-e495f461-43a8-4a22-9800-302220f4e3f2 tempest-VolumesActionsTest-1837279088 tempest-VolumesActionsTest-1837279088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e440754469c4407840a651d560ce08a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6eaf458d3c84ba59b078dc0a3bf1763', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116157) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:05:06.452453 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: INFO nova.api.openstack.requestlog [None req-e495f461-43a8-4a22-9800-302220f4e3f2 tempest-VolumesActionsTest-1837279088 tempest-VolumesActionsTest-1837279088-project] 10.222.0.18 "GET /compute/v2.1/servers/0c1f5052-62a2-4847-ab40-6e1a9df040ca" status: 200 len: 1496 microversion: 2.1 time: 0.152022 Dec 15 03:05:06.453100 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: [pid: 116157|app: 0|req: 129/290] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 03:05:06 2021] GET /compute/v2.1/servers/0c1f5052-62a2-4847-ab40-6e1a9df040ca => generated 1496 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 03:05:06.477223 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi [None req-d080cdf8-ec65-430f-b40a-50bafc15f457 tempest-AttachVolumeNegativeTest-1640336653 tempest-AttachVolumeNegativeTest-1640336653-project] Calling method '>' {{(pid=116156) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:05:06.477828 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.compute.api [None req-d080cdf8-ec65-430f-b40a-50bafc15f457 tempest-AttachVolumeNegativeTest-1640336653 tempest-AttachVolumeNegativeTest-1640336653-project] [instance: b302a057-8ba0-4cec-bcb7-805bd598c638] Fetching instance by UUID {{(pid=116156) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:05:06.483593 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-d080cdf8-ec65-430f-b40a-50bafc15f457 tempest-AttachVolumeNegativeTest-1640336653 tempest-AttachVolumeNegativeTest-1640336653-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:05:06.484209 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-d080cdf8-ec65-430f-b40a-50bafc15f457 tempest-AttachVolumeNegativeTest-1640336653 tempest-AttachVolumeNegativeTest-1640336653-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:05:06.485563 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-d080cdf8-ec65-430f-b40a-50bafc15f457 tempest-AttachVolumeNegativeTest-1640336653 tempest-AttachVolumeNegativeTest-1640336653-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:05:06.486043 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-d080cdf8-ec65-430f-b40a-50bafc15f457 tempest-AttachVolumeNegativeTest-1640336653 tempest-AttachVolumeNegativeTest-1640336653-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:05:06.623339 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.policy [None req-d080cdf8-ec65-430f-b40a-50bafc15f457 tempest-AttachVolumeNegativeTest-1640336653 tempest-AttachVolumeNegativeTest-1640336653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35d37a3d8e504b8186182468b77dd114', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '409b41637da94c469444954258444b4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116156) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:05:06.630520 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: INFO nova.api.openstack.requestlog [None req-d080cdf8-ec65-430f-b40a-50bafc15f457 tempest-AttachVolumeNegativeTest-1640336653 tempest-AttachVolumeNegativeTest-1640336653-project] 10.222.0.18 "GET /compute/v2.1/servers/b302a057-8ba0-4cec-bcb7-805bd598c638" status: 200 len: 1317 microversion: 2.1 time: 0.157206 Dec 15 03:05:06.631076 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: [pid: 116156|app: 0|req: 162/291] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 03:05:06 2021] GET /compute/v2.1/servers/b302a057-8ba0-4cec-bcb7-805bd598c638 => generated 1317 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 03:05:07.015638 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi [None req-539710cf-c623-4548-854b-46dc41b0f4dd tempest-ServerRescueNegativeTestJSON-2061875223 tempest-ServerRescueNegativeTestJSON-2061875223-project] Calling method '>' {{(pid=116157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:05:07.017072 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.compute.api [None req-539710cf-c623-4548-854b-46dc41b0f4dd tempest-ServerRescueNegativeTestJSON-2061875223 tempest-ServerRescueNegativeTestJSON-2061875223-project] [instance: 9bbb0abf-72a3-4fbc-8235-7a3ecfc8d006] Fetching instance by UUID {{(pid=116157) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:05:07.023442 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-539710cf-c623-4548-854b-46dc41b0f4dd tempest-ServerRescueNegativeTestJSON-2061875223 tempest-ServerRescueNegativeTestJSON-2061875223-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:05:07.024308 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-539710cf-c623-4548-854b-46dc41b0f4dd tempest-ServerRescueNegativeTestJSON-2061875223 tempest-ServerRescueNegativeTestJSON-2061875223-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:05:07.025223 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-539710cf-c623-4548-854b-46dc41b0f4dd tempest-ServerRescueNegativeTestJSON-2061875223 tempest-ServerRescueNegativeTestJSON-2061875223-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:05:07.025881 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-539710cf-c623-4548-854b-46dc41b0f4dd tempest-ServerRescueNegativeTestJSON-2061875223 tempest-ServerRescueNegativeTestJSON-2061875223-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:05:07.169921 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.policy [None req-539710cf-c623-4548-854b-46dc41b0f4dd tempest-ServerRescueNegativeTestJSON-2061875223 tempest-ServerRescueNegativeTestJSON-2061875223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ea02b6e8f1548a1bd78952cb7337403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5e8a958d4bf43868502b13728b9583b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116157) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:05:07.177889 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: INFO nova.api.openstack.requestlog [None req-539710cf-c623-4548-854b-46dc41b0f4dd tempest-ServerRescueNegativeTestJSON-2061875223 tempest-ServerRescueNegativeTestJSON-2061875223-project] 10.222.0.18 "GET /compute/v2.1/servers/9bbb0abf-72a3-4fbc-8235-7a3ecfc8d006" status: 200 len: 1521 microversion: 2.1 time: 0.166367 Dec 15 03:05:07.178478 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: [pid: 116157|app: 0|req: 130/292] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 03:05:07 2021] GET /compute/v2.1/servers/9bbb0abf-72a3-4fbc-8235-7a3ecfc8d006 => generated 1521 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 03:05:07.180797 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi [None req-b00eb724-af59-486c-96a2-fd22ce1132d4 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Calling method '>' {{(pid=116156) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:05:07.181406 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.compute.api [None req-b00eb724-af59-486c-96a2-fd22ce1132d4 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] [instance: b89094ac-aee1-4bd6-a33d-8c4347cebfc7] Fetching instance by UUID {{(pid=116156) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:05:07.187153 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-b00eb724-af59-486c-96a2-fd22ce1132d4 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:05:07.187626 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-b00eb724-af59-486c-96a2-fd22ce1132d4 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:05:07.189327 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-b00eb724-af59-486c-96a2-fd22ce1132d4 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:05:07.189879 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-b00eb724-af59-486c-96a2-fd22ce1132d4 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:05:07.345273 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.policy [None req-b00eb724-af59-486c-96a2-fd22ce1132d4 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fedc11e2dbd74b919982a0657222cca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f16202549724b878f908d68384ec9c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116156) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:05:07.353312 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi [None req-da190b18-0149-444a-acaf-c7ab021459d8 tempest-VolumesActionsTest-1837279088 tempest-VolumesActionsTest-1837279088-project] Calling method '>' {{(pid=116157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:05:07.353822 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.policy [None req-b00eb724-af59-486c-96a2-fd22ce1132d4 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fedc11e2dbd74b919982a0657222cca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f16202549724b878f908d68384ec9c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116156) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:05:07.353948 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.compute.api [None req-da190b18-0149-444a-acaf-c7ab021459d8 tempest-VolumesActionsTest-1837279088 tempest-VolumesActionsTest-1837279088-project] [instance: 0c1f5052-62a2-4847-ab40-6e1a9df040ca] Fetching instance by UUID {{(pid=116157) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:05:07.355140 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.policy [None req-b00eb724-af59-486c-96a2-fd22ce1132d4 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fedc11e2dbd74b919982a0657222cca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f16202549724b878f908d68384ec9c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116156) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:05:07.356319 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: INFO nova.api.openstack.requestlog [None req-b00eb724-af59-486c-96a2-fd22ce1132d4 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] 10.222.0.18 "GET /compute/v2.1/servers/b89094ac-aee1-4bd6-a33d-8c4347cebfc7" status: 200 len: 1406 microversion: 2.20 time: 0.179321 Dec 15 03:05:07.357588 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: [pid: 116156|app: 0|req: 163/293] 10.222.0.18 () {60 vars in 1276 bytes} [Wed Dec 15 03:05:07 2021] GET /compute/v2.1/servers/b89094ac-aee1-4bd6-a33d-8c4347cebfc7 => generated 1406 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 03:05:07.360593 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-da190b18-0149-444a-acaf-c7ab021459d8 tempest-VolumesActionsTest-1837279088 tempest-VolumesActionsTest-1837279088-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:05:07.361331 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-da190b18-0149-444a-acaf-c7ab021459d8 tempest-VolumesActionsTest-1837279088 tempest-VolumesActionsTest-1837279088-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:05:07.362164 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-da190b18-0149-444a-acaf-c7ab021459d8 tempest-VolumesActionsTest-1837279088 tempest-VolumesActionsTest-1837279088-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:05:07.362754 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-da190b18-0149-444a-acaf-c7ab021459d8 tempest-VolumesActionsTest-1837279088 tempest-VolumesActionsTest-1837279088-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:05:07.388295 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.compute.api [None req-da190b18-0149-444a-acaf-c7ab021459d8 tempest-VolumesActionsTest-1837279088 tempest-VolumesActionsTest-1837279088-project] [instance: 0c1f5052-62a2-4847-ab40-6e1a9df040ca] Going to try to terminate instance {{(pid=116157) delete /opt/stack/nova/nova/compute/api.py:2614}} Dec 15 03:05:07.477040 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: INFO nova.api.openstack.requestlog [None req-da190b18-0149-444a-acaf-c7ab021459d8 tempest-VolumesActionsTest-1837279088 tempest-VolumesActionsTest-1837279088-project] 10.222.0.18 "DELETE /compute/v2.1/servers/0c1f5052-62a2-4847-ab40-6e1a9df040ca" status: 204 len: 0 microversion: 2.1 time: 0.126831 Dec 15 03:05:07.477741 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: [pid: 116157|app: 0|req: 131/294] 10.222.0.18 () {58 vars in 1238 bytes} [Wed Dec 15 03:05:07 2021] DELETE /compute/v2.1/servers/0c1f5052-62a2-4847-ab40-6e1a9df040ca => generated 0 bytes in 129 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Dec 15 03:05:07.486505 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi [None req-09dedf55-582c-4f82-a0a2-d39e280b7fce tempest-VolumesActionsTest-1837279088 tempest-VolumesActionsTest-1837279088-project] Calling method '>' {{(pid=116156) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:05:07.487190 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.compute.api [None req-09dedf55-582c-4f82-a0a2-d39e280b7fce tempest-VolumesActionsTest-1837279088 tempest-VolumesActionsTest-1837279088-project] [instance: 0c1f5052-62a2-4847-ab40-6e1a9df040ca] Fetching instance by UUID {{(pid=116156) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:05:07.493037 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-09dedf55-582c-4f82-a0a2-d39e280b7fce tempest-VolumesActionsTest-1837279088 tempest-VolumesActionsTest-1837279088-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:05:07.493578 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-09dedf55-582c-4f82-a0a2-d39e280b7fce tempest-VolumesActionsTest-1837279088 tempest-VolumesActionsTest-1837279088-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:05:07.494654 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-09dedf55-582c-4f82-a0a2-d39e280b7fce tempest-VolumesActionsTest-1837279088 tempest-VolumesActionsTest-1837279088-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:05:07.495255 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-09dedf55-582c-4f82-a0a2-d39e280b7fce tempest-VolumesActionsTest-1837279088 tempest-VolumesActionsTest-1837279088-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:05:07.631785 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.policy [None req-09dedf55-582c-4f82-a0a2-d39e280b7fce tempest-VolumesActionsTest-1837279088 tempest-VolumesActionsTest-1837279088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e440754469c4407840a651d560ce08a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6eaf458d3c84ba59b078dc0a3bf1763', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116156) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:05:07.638932 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: INFO nova.api.openstack.requestlog [None req-09dedf55-582c-4f82-a0a2-d39e280b7fce tempest-VolumesActionsTest-1837279088 tempest-VolumesActionsTest-1837279088-project] 10.222.0.18 "GET /compute/v2.1/servers/0c1f5052-62a2-4847-ab40-6e1a9df040ca" status: 200 len: 1502 microversion: 2.1 time: 0.156859 Dec 15 03:05:07.639698 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: [pid: 116156|app: 0|req: 164/295] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 03:05:07 2021] GET /compute/v2.1/servers/0c1f5052-62a2-4847-ab40-6e1a9df040ca => generated 1502 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 03:05:07.651584 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi [None req-4721d90d-1e26-4093-98ad-db9e8781533e tempest-AttachVolumeNegativeTest-1640336653 tempest-AttachVolumeNegativeTest-1640336653-project] Calling method '>' {{(pid=116157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:05:07.652271 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.compute.api [None req-4721d90d-1e26-4093-98ad-db9e8781533e tempest-AttachVolumeNegativeTest-1640336653 tempest-AttachVolumeNegativeTest-1640336653-project] [instance: b302a057-8ba0-4cec-bcb7-805bd598c638] Fetching instance by UUID {{(pid=116157) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:05:07.658589 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-4721d90d-1e26-4093-98ad-db9e8781533e tempest-AttachVolumeNegativeTest-1640336653 tempest-AttachVolumeNegativeTest-1640336653-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:05:07.659034 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-4721d90d-1e26-4093-98ad-db9e8781533e tempest-AttachVolumeNegativeTest-1640336653 tempest-AttachVolumeNegativeTest-1640336653-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:05:07.659799 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-4721d90d-1e26-4093-98ad-db9e8781533e tempest-AttachVolumeNegativeTest-1640336653 tempest-AttachVolumeNegativeTest-1640336653-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:05:07.660228 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-4721d90d-1e26-4093-98ad-db9e8781533e tempest-AttachVolumeNegativeTest-1640336653 tempest-AttachVolumeNegativeTest-1640336653-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:05:07.794917 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.policy [None req-4721d90d-1e26-4093-98ad-db9e8781533e tempest-AttachVolumeNegativeTest-1640336653 tempest-AttachVolumeNegativeTest-1640336653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35d37a3d8e504b8186182468b77dd114', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '409b41637da94c469444954258444b4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116157) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:05:07.802067 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: INFO nova.api.openstack.requestlog [None req-4721d90d-1e26-4093-98ad-db9e8781533e tempest-AttachVolumeNegativeTest-1640336653 tempest-AttachVolumeNegativeTest-1640336653-project] 10.222.0.18 "GET /compute/v2.1/servers/b302a057-8ba0-4cec-bcb7-805bd598c638" status: 200 len: 1317 microversion: 2.1 time: 0.154436 Dec 15 03:05:07.802632 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: [pid: 116157|app: 0|req: 132/296] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 03:05:07 2021] GET /compute/v2.1/servers/b302a057-8ba0-4cec-bcb7-805bd598c638 => generated 1317 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 03:05:08.195017 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi [None req-f5d97741-1282-463e-9743-e187ff3ccb2b tempest-ServerRescueNegativeTestJSON-2061875223 tempest-ServerRescueNegativeTestJSON-2061875223-project] Calling method '>' {{(pid=116156) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:05:08.195627 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.compute.api [None req-f5d97741-1282-463e-9743-e187ff3ccb2b tempest-ServerRescueNegativeTestJSON-2061875223 tempest-ServerRescueNegativeTestJSON-2061875223-project] [instance: 9bbb0abf-72a3-4fbc-8235-7a3ecfc8d006] Fetching instance by UUID {{(pid=116156) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:05:08.201735 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-f5d97741-1282-463e-9743-e187ff3ccb2b tempest-ServerRescueNegativeTestJSON-2061875223 tempest-ServerRescueNegativeTestJSON-2061875223-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:05:08.202228 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-f5d97741-1282-463e-9743-e187ff3ccb2b tempest-ServerRescueNegativeTestJSON-2061875223 tempest-ServerRescueNegativeTestJSON-2061875223-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:05:08.203011 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-f5d97741-1282-463e-9743-e187ff3ccb2b tempest-ServerRescueNegativeTestJSON-2061875223 tempest-ServerRescueNegativeTestJSON-2061875223-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:05:08.203451 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-f5d97741-1282-463e-9743-e187ff3ccb2b tempest-ServerRescueNegativeTestJSON-2061875223 tempest-ServerRescueNegativeTestJSON-2061875223-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:05:08.357270 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.policy [None req-f5d97741-1282-463e-9743-e187ff3ccb2b tempest-ServerRescueNegativeTestJSON-2061875223 tempest-ServerRescueNegativeTestJSON-2061875223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ea02b6e8f1548a1bd78952cb7337403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5e8a958d4bf43868502b13728b9583b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116156) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:05:08.365219 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: INFO nova.api.openstack.requestlog [None req-f5d97741-1282-463e-9743-e187ff3ccb2b tempest-ServerRescueNegativeTestJSON-2061875223 tempest-ServerRescueNegativeTestJSON-2061875223-project] 10.222.0.18 "GET /compute/v2.1/servers/9bbb0abf-72a3-4fbc-8235-7a3ecfc8d006" status: 200 len: 1521 microversion: 2.1 time: 0.173826 Dec 15 03:05:08.365803 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: [pid: 116156|app: 0|req: 165/297] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 03:05:08 2021] GET /compute/v2.1/servers/9bbb0abf-72a3-4fbc-8235-7a3ecfc8d006 => generated 1521 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 03:05:08.375175 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi [None req-1946be58-2d51-441d-83d3-fe4ca71530c5 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Calling method '>' {{(pid=116157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:05:08.376455 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.compute.api [None req-1946be58-2d51-441d-83d3-fe4ca71530c5 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] [instance: b89094ac-aee1-4bd6-a33d-8c4347cebfc7] Fetching instance by UUID {{(pid=116157) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:05:08.382802 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-1946be58-2d51-441d-83d3-fe4ca71530c5 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:05:08.383506 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-1946be58-2d51-441d-83d3-fe4ca71530c5 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:05:08.384291 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-1946be58-2d51-441d-83d3-fe4ca71530c5 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:05:08.384726 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-1946be58-2d51-441d-83d3-fe4ca71530c5 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:05:08.545148 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.policy [None req-1946be58-2d51-441d-83d3-fe4ca71530c5 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fedc11e2dbd74b919982a0657222cca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f16202549724b878f908d68384ec9c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116157) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:05:08.553492 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.policy [None req-1946be58-2d51-441d-83d3-fe4ca71530c5 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fedc11e2dbd74b919982a0657222cca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f16202549724b878f908d68384ec9c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116157) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:05:08.555305 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.policy [None req-1946be58-2d51-441d-83d3-fe4ca71530c5 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fedc11e2dbd74b919982a0657222cca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f16202549724b878f908d68384ec9c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116157) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:05:08.556889 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: INFO nova.api.openstack.requestlog [None req-1946be58-2d51-441d-83d3-fe4ca71530c5 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] 10.222.0.18 "GET /compute/v2.1/servers/b89094ac-aee1-4bd6-a33d-8c4347cebfc7" status: 200 len: 1597 microversion: 2.20 time: 0.185501 Dec 15 03:05:08.557605 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: [pid: 116157|app: 0|req: 133/298] 10.222.0.18 () {60 vars in 1276 bytes} [Wed Dec 15 03:05:08 2021] GET /compute/v2.1/servers/b89094ac-aee1-4bd6-a33d-8c4347cebfc7 => generated 1597 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 03:05:08.576322 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi [None req-593e7ede-7eee-4bd7-84b9-875c3b54980e tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Calling method '>' {{(pid=116156) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:05:08.576841 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.compute.api [None req-593e7ede-7eee-4bd7-84b9-875c3b54980e tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] [instance: b89094ac-aee1-4bd6-a33d-8c4347cebfc7] Fetching instance by UUID {{(pid=116156) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:05:08.583396 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-593e7ede-7eee-4bd7-84b9-875c3b54980e tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:05:08.583907 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-593e7ede-7eee-4bd7-84b9-875c3b54980e tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:05:08.584844 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-593e7ede-7eee-4bd7-84b9-875c3b54980e tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:05:08.585462 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-593e7ede-7eee-4bd7-84b9-875c3b54980e tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:05:08.658172 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi [None req-924b08a9-a3ce-457e-8a97-836f67ffd319 tempest-VolumesActionsTest-1837279088 tempest-VolumesActionsTest-1837279088-project] Calling method '>' {{(pid=116157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:05:08.659625 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.compute.api [None req-924b08a9-a3ce-457e-8a97-836f67ffd319 tempest-VolumesActionsTest-1837279088 tempest-VolumesActionsTest-1837279088-project] [instance: 0c1f5052-62a2-4847-ab40-6e1a9df040ca] Fetching instance by UUID {{(pid=116157) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:05:08.666846 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-924b08a9-a3ce-457e-8a97-836f67ffd319 tempest-VolumesActionsTest-1837279088 tempest-VolumesActionsTest-1837279088-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:05:08.669025 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-924b08a9-a3ce-457e-8a97-836f67ffd319 tempest-VolumesActionsTest-1837279088 tempest-VolumesActionsTest-1837279088-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:05:08.670165 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-924b08a9-a3ce-457e-8a97-836f67ffd319 tempest-VolumesActionsTest-1837279088 tempest-VolumesActionsTest-1837279088-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:05:08.671359 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-924b08a9-a3ce-457e-8a97-836f67ffd319 tempest-VolumesActionsTest-1837279088 tempest-VolumesActionsTest-1837279088-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:05:08.704289 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: INFO nova.api.openstack.requestlog [None req-593e7ede-7eee-4bd7-84b9-875c3b54980e tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] 10.222.0.18 "GET /compute/v2.1/servers/b89094ac-aee1-4bd6-a33d-8c4347cebfc7/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.131576 Dec 15 03:05:08.710046 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: [pid: 116156|app: 0|req: 166/299] 10.222.0.18 () {60 vars in 1315 bytes} [Wed Dec 15 03:05:08 2021] GET /compute/v2.1/servers/b89094ac-aee1-4bd6-a33d-8c4347cebfc7/os-interface => generated 284 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 03:05:08.819763 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi [None req-2c25917c-3e4e-4955-b636-6c058c545516 tempest-AttachVolumeNegativeTest-1640336653 tempest-AttachVolumeNegativeTest-1640336653-project] Calling method '>' {{(pid=116156) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:05:08.821399 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.compute.api [None req-2c25917c-3e4e-4955-b636-6c058c545516 tempest-AttachVolumeNegativeTest-1640336653 tempest-AttachVolumeNegativeTest-1640336653-project] [instance: b302a057-8ba0-4cec-bcb7-805bd598c638] Fetching instance by UUID {{(pid=116156) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:05:08.829353 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-2c25917c-3e4e-4955-b636-6c058c545516 tempest-AttachVolumeNegativeTest-1640336653 tempest-AttachVolumeNegativeTest-1640336653-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:05:08.829869 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-2c25917c-3e4e-4955-b636-6c058c545516 tempest-AttachVolumeNegativeTest-1640336653 tempest-AttachVolumeNegativeTest-1640336653-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:05:08.830834 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-2c25917c-3e4e-4955-b636-6c058c545516 tempest-AttachVolumeNegativeTest-1640336653 tempest-AttachVolumeNegativeTest-1640336653-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:05:08.831448 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-2c25917c-3e4e-4955-b636-6c058c545516 tempest-AttachVolumeNegativeTest-1640336653 tempest-AttachVolumeNegativeTest-1640336653-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:05:08.982470 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.policy [None req-2c25917c-3e4e-4955-b636-6c058c545516 tempest-AttachVolumeNegativeTest-1640336653 tempest-AttachVolumeNegativeTest-1640336653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35d37a3d8e504b8186182468b77dd114', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '409b41637da94c469444954258444b4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116156) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:05:08.991475 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: INFO nova.api.openstack.requestlog [None req-2c25917c-3e4e-4955-b636-6c058c545516 tempest-AttachVolumeNegativeTest-1640336653 tempest-AttachVolumeNegativeTest-1640336653-project] 10.222.0.18 "GET /compute/v2.1/servers/b302a057-8ba0-4cec-bcb7-805bd598c638" status: 200 len: 1507 microversion: 2.1 time: 0.176509 Dec 15 03:05:08.992066 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: [pid: 116156|app: 0|req: 167/300] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 03:05:08 2021] GET /compute/v2.1/servers/b302a057-8ba0-4cec-bcb7-805bd598c638 => generated 1507 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 03:05:09.008075 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi [None req-24f6e43c-f7fa-4ad3-929c-277306bd69ac tempest-AttachVolumeNegativeTest-1640336653 tempest-AttachVolumeNegativeTest-1640336653-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "62001670-a8d1-401f-8a9a-bf61da09791d"}} {{(pid=116156) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 03:05:09.009188 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.compute.api [None req-24f6e43c-f7fa-4ad3-929c-277306bd69ac tempest-AttachVolumeNegativeTest-1640336653 tempest-AttachVolumeNegativeTest-1640336653-project] [instance: b302a057-8ba0-4cec-bcb7-805bd598c638] Fetching instance by UUID {{(pid=116156) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:05:09.015657 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.policy [None req-924b08a9-a3ce-457e-8a97-836f67ffd319 tempest-VolumesActionsTest-1837279088 tempest-VolumesActionsTest-1837279088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e440754469c4407840a651d560ce08a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6eaf458d3c84ba59b078dc0a3bf1763', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116157) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:05:09.021792 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-24f6e43c-f7fa-4ad3-929c-277306bd69ac tempest-AttachVolumeNegativeTest-1640336653 tempest-AttachVolumeNegativeTest-1640336653-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:05:09.022461 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-24f6e43c-f7fa-4ad3-929c-277306bd69ac tempest-AttachVolumeNegativeTest-1640336653 tempest-AttachVolumeNegativeTest-1640336653-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:05:09.023423 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-24f6e43c-f7fa-4ad3-929c-277306bd69ac tempest-AttachVolumeNegativeTest-1640336653 tempest-AttachVolumeNegativeTest-1640336653-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:05:09.024038 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: INFO nova.api.openstack.requestlog [None req-924b08a9-a3ce-457e-8a97-836f67ffd319 tempest-VolumesActionsTest-1837279088 tempest-VolumesActionsTest-1837279088-project] 10.222.0.18 "GET /compute/v2.1/servers/0c1f5052-62a2-4847-ab40-6e1a9df040ca" status: 200 len: 1502 microversion: 2.1 time: 0.370960 Dec 15 03:05:09.024215 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-24f6e43c-f7fa-4ad3-929c-277306bd69ac tempest-AttachVolumeNegativeTest-1640336653 tempest-AttachVolumeNegativeTest-1640336653-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:05:09.025066 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: [pid: 116157|app: 0|req: 134/301] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 03:05:08 2021] GET /compute/v2.1/servers/0c1f5052-62a2-4847-ab40-6e1a9df040ca => generated 1502 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 03:05:09.134710 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: INFO nova.api.openstack.wsgi [None req-24f6e43c-f7fa-4ad3-929c-277306bd69ac tempest-AttachVolumeNegativeTest-1640336653 tempest-AttachVolumeNegativeTest-1640336653-project] HTTP exception thrown: Invalid volume: volume 62001670-a8d1-401f-8a9a-bf61da09791d is already attached to instances: 4923355f-95d6-443d-9487-574f56b87f66 Dec 15 03:05:09.135311 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi [None req-24f6e43c-f7fa-4ad3-929c-277306bd69ac tempest-AttachVolumeNegativeTest-1640336653 tempest-AttachVolumeNegativeTest-1640336653-project] Returning 400 to user: Invalid volume: volume 62001670-a8d1-401f-8a9a-bf61da09791d is already attached to instances: 4923355f-95d6-443d-9487-574f56b87f66 {{(pid=116156) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 15 03:05:09.136143 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: INFO nova.api.openstack.requestlog [None req-24f6e43c-f7fa-4ad3-929c-277306bd69ac tempest-AttachVolumeNegativeTest-1640336653 tempest-AttachVolumeNegativeTest-1640336653-project] 10.222.0.18 "POST /compute/v2.1/servers/b302a057-8ba0-4cec-bcb7-805bd598c638/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.131991 Dec 15 03:05:09.136689 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: [pid: 116156|app: 0|req: 168/302] 10.222.0.18 () {60 vars in 1322 bytes} [Wed Dec 15 03:05:09 2021] POST /compute/v2.1/servers/b302a057-8ba0-4cec-bcb7-805bd598c638/os-volume_attachments => generated 174 bytes in 133 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Dec 15 03:05:09.194551 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi [None req-2406c3a9-ac07-4e01-bf55-523f3800f9e1 tempest-AttachVolumeNegativeTest-1640336653 tempest-AttachVolumeNegativeTest-1640336653-project] Calling method '>' {{(pid=116157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:05:09.195144 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.compute.api [None req-2406c3a9-ac07-4e01-bf55-523f3800f9e1 tempest-AttachVolumeNegativeTest-1640336653 tempest-AttachVolumeNegativeTest-1640336653-project] [instance: 4923355f-95d6-443d-9487-574f56b87f66] Fetching instance by UUID {{(pid=116157) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:05:09.213475 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-2406c3a9-ac07-4e01-bf55-523f3800f9e1 tempest-AttachVolumeNegativeTest-1640336653 tempest-AttachVolumeNegativeTest-1640336653-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:05:09.213867 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-2406c3a9-ac07-4e01-bf55-523f3800f9e1 tempest-AttachVolumeNegativeTest-1640336653 tempest-AttachVolumeNegativeTest-1640336653-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:05:09.214771 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-2406c3a9-ac07-4e01-bf55-523f3800f9e1 tempest-AttachVolumeNegativeTest-1640336653 tempest-AttachVolumeNegativeTest-1640336653-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:05:09.215151 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-2406c3a9-ac07-4e01-bf55-523f3800f9e1 tempest-AttachVolumeNegativeTest-1640336653 tempest-AttachVolumeNegativeTest-1640336653-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:05:09.353020 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.objects.instance [None req-2406c3a9-ac07-4e01-bf55-523f3800f9e1 tempest-AttachVolumeNegativeTest-1640336653 tempest-AttachVolumeNegativeTest-1640336653-project] Lazy-loading 'services' on Instance uuid 4923355f-95d6-443d-9487-574f56b87f66 {{(pid=116157) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Dec 15 03:05:09.382250 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi [None req-c7de09dc-e19d-459e-99ee-e40fd334f96d tempest-ServerRescueNegativeTestJSON-2061875223 tempest-ServerRescueNegativeTestJSON-2061875223-project] Calling method '>' {{(pid=116156) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:05:09.386537 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.compute.api [None req-c7de09dc-e19d-459e-99ee-e40fd334f96d tempest-ServerRescueNegativeTestJSON-2061875223 tempest-ServerRescueNegativeTestJSON-2061875223-project] [instance: 9bbb0abf-72a3-4fbc-8235-7a3ecfc8d006] Fetching instance by UUID {{(pid=116156) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:05:09.394266 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-c7de09dc-e19d-459e-99ee-e40fd334f96d tempest-ServerRescueNegativeTestJSON-2061875223 tempest-ServerRescueNegativeTestJSON-2061875223-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:05:09.395019 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-c7de09dc-e19d-459e-99ee-e40fd334f96d tempest-ServerRescueNegativeTestJSON-2061875223 tempest-ServerRescueNegativeTestJSON-2061875223-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:05:09.396051 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-c7de09dc-e19d-459e-99ee-e40fd334f96d tempest-ServerRescueNegativeTestJSON-2061875223 tempest-ServerRescueNegativeTestJSON-2061875223-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:05:09.396710 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-c7de09dc-e19d-459e-99ee-e40fd334f96d tempest-ServerRescueNegativeTestJSON-2061875223 tempest-ServerRescueNegativeTestJSON-2061875223-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:05:09.525478 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: INFO nova.api.openstack.requestlog [None req-2406c3a9-ac07-4e01-bf55-523f3800f9e1 tempest-AttachVolumeNegativeTest-1640336653 tempest-AttachVolumeNegativeTest-1640336653-project] 10.222.0.18 "DELETE /compute/v2.1/servers/4923355f-95d6-443d-9487-574f56b87f66/os-volume_attachments/62001670-a8d1-401f-8a9a-bf61da09791d" status: 202 len: 0 microversion: 2.1 time: 0.334579 Dec 15 03:05:09.530917 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: [pid: 116157|app: 0|req: 135/303] 10.222.0.18 () {58 vars in 1415 bytes} [Wed Dec 15 03:05:09 2021] DELETE /compute/v2.1/servers/4923355f-95d6-443d-9487-574f56b87f66/os-volume_attachments/62001670-a8d1-401f-8a9a-bf61da09791d => generated 0 bytes in 341 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Dec 15 03:05:09.542098 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi [None req-2638c109-1d2c-4158-8b70-af2f0815d7ae tempest-AttachVolumeNegativeTest-1640336653 tempest-AttachVolumeNegativeTest-1640336653-project] Calling method '>' {{(pid=116157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:05:09.544200 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.compute.api [None req-2638c109-1d2c-4158-8b70-af2f0815d7ae tempest-AttachVolumeNegativeTest-1640336653 tempest-AttachVolumeNegativeTest-1640336653-project] [instance: 4923355f-95d6-443d-9487-574f56b87f66] Fetching instance by UUID {{(pid=116157) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:05:09.554254 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-2638c109-1d2c-4158-8b70-af2f0815d7ae tempest-AttachVolumeNegativeTest-1640336653 tempest-AttachVolumeNegativeTest-1640336653-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:05:09.555052 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-2638c109-1d2c-4158-8b70-af2f0815d7ae tempest-AttachVolumeNegativeTest-1640336653 tempest-AttachVolumeNegativeTest-1640336653-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:05:09.556076 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-2638c109-1d2c-4158-8b70-af2f0815d7ae tempest-AttachVolumeNegativeTest-1640336653 tempest-AttachVolumeNegativeTest-1640336653-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:05:09.557291 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-2638c109-1d2c-4158-8b70-af2f0815d7ae tempest-AttachVolumeNegativeTest-1640336653 tempest-AttachVolumeNegativeTest-1640336653-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:05:09.606742 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.policy [None req-c7de09dc-e19d-459e-99ee-e40fd334f96d tempest-ServerRescueNegativeTestJSON-2061875223 tempest-ServerRescueNegativeTestJSON-2061875223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ea02b6e8f1548a1bd78952cb7337403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5e8a958d4bf43868502b13728b9583b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116156) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:05:09.607276 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: INFO nova.api.openstack.requestlog [None req-2638c109-1d2c-4158-8b70-af2f0815d7ae tempest-AttachVolumeNegativeTest-1640336653 tempest-AttachVolumeNegativeTest-1640336653-project] 10.222.0.18 "GET /compute/v2.1/servers/4923355f-95d6-443d-9487-574f56b87f66/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.070733 Dec 15 03:05:09.611795 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: [pid: 116157|app: 0|req: 136/304] 10.222.0.18 () {58 vars in 1301 bytes} [Wed Dec 15 03:05:09 2021] GET /compute/v2.1/servers/4923355f-95d6-443d-9487-574f56b87f66/os-volume_attachments => generated 197 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 15 03:05:09.621474 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: INFO nova.api.openstack.requestlog [None req-c7de09dc-e19d-459e-99ee-e40fd334f96d tempest-ServerRescueNegativeTestJSON-2061875223 tempest-ServerRescueNegativeTestJSON-2061875223-project] 10.222.0.18 "GET /compute/v2.1/servers/9bbb0abf-72a3-4fbc-8235-7a3ecfc8d006" status: 200 len: 1521 microversion: 2.1 time: 0.242373 Dec 15 03:05:09.622088 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: [pid: 116156|app: 0|req: 169/305] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 03:05:09 2021] GET /compute/v2.1/servers/9bbb0abf-72a3-4fbc-8235-7a3ecfc8d006 => generated 1521 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 03:05:10.041494 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi [None req-0bbc9d81-e6d4-42d2-8366-1b4c8292ec5b tempest-VolumesActionsTest-1837279088 tempest-VolumesActionsTest-1837279088-project] Calling method '>' {{(pid=116157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:05:10.042152 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.compute.api [None req-0bbc9d81-e6d4-42d2-8366-1b4c8292ec5b tempest-VolumesActionsTest-1837279088 tempest-VolumesActionsTest-1837279088-project] [instance: 0c1f5052-62a2-4847-ab40-6e1a9df040ca] Fetching instance by UUID {{(pid=116157) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:05:10.048291 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-0bbc9d81-e6d4-42d2-8366-1b4c8292ec5b tempest-VolumesActionsTest-1837279088 tempest-VolumesActionsTest-1837279088-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:05:10.048835 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-0bbc9d81-e6d4-42d2-8366-1b4c8292ec5b tempest-VolumesActionsTest-1837279088 tempest-VolumesActionsTest-1837279088-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:05:10.049763 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-0bbc9d81-e6d4-42d2-8366-1b4c8292ec5b tempest-VolumesActionsTest-1837279088 tempest-VolumesActionsTest-1837279088-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:05:10.050353 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-0bbc9d81-e6d4-42d2-8366-1b4c8292ec5b tempest-VolumesActionsTest-1837279088 tempest-VolumesActionsTest-1837279088-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:05:10.326544 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi [None req-62961d62-7c82-4c81-8d53-5839b76f6d76 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116156) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 03:05:10.327775 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.compute.api [None req-62961d62-7c82-4c81-8d53-5839b76f6d76 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] [instance: b89094ac-aee1-4bd6-a33d-8c4347cebfc7] Fetching instance by UUID {{(pid=116156) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:05:10.334901 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-62961d62-7c82-4c81-8d53-5839b76f6d76 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:05:10.336038 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-62961d62-7c82-4c81-8d53-5839b76f6d76 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:05:10.337027 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-62961d62-7c82-4c81-8d53-5839b76f6d76 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:05:10.337602 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-62961d62-7c82-4c81-8d53-5839b76f6d76 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:05:10.386086 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.policy [None req-0bbc9d81-e6d4-42d2-8366-1b4c8292ec5b tempest-VolumesActionsTest-1837279088 tempest-VolumesActionsTest-1837279088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e440754469c4407840a651d560ce08a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6eaf458d3c84ba59b078dc0a3bf1763', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116157) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:05:10.394921 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: INFO nova.api.openstack.requestlog [None req-0bbc9d81-e6d4-42d2-8366-1b4c8292ec5b tempest-VolumesActionsTest-1837279088 tempest-VolumesActionsTest-1837279088-project] 10.222.0.18 "GET /compute/v2.1/servers/0c1f5052-62a2-4847-ab40-6e1a9df040ca" status: 200 len: 1502 microversion: 2.1 time: 0.356899 Dec 15 03:05:10.395525 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: [pid: 116157|app: 0|req: 137/306] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 03:05:10 2021] GET /compute/v2.1/servers/0c1f5052-62a2-4847-ab40-6e1a9df040ca => generated 1502 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 03:05:10.400190 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi [req-bbcd2b46-e8e8-416f-98de-c868521b31d3 req-87bf76f5-2b99-4ca1-a408-8168edfacb3c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b89094ac-aee1-4bd6-a33d-8c4347cebfc7", "tag": "455e429c-96fb-4858-b8fe-cf282ae96b72"}]} {{(pid=116157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 03:05:10.401752 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 15 03:05:10.401752 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: warnings.warn(msg) Dec 15 03:05:10.408964 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [req-bbcd2b46-e8e8-416f-98de-c868521b31d3 req-87bf76f5-2b99-4ca1-a408-8168edfacb3c service nova] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:05:10.409538 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [req-bbcd2b46-e8e8-416f-98de-c868521b31d3 req-87bf76f5-2b99-4ca1-a408-8168edfacb3c service nova] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:05:10.420542 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: INFO nova.api.openstack.compute.server_external_events [req-bbcd2b46-e8e8-416f-98de-c868521b31d3 req-87bf76f5-2b99-4ca1-a408-8168edfacb3c service nova] Creating event network-changed:455e429c-96fb-4858-b8fe-cf282ae96b72 for instance b89094ac-aee1-4bd6-a33d-8c4347cebfc7 on hv-cinder-81803 Dec 15 03:05:10.425888 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: INFO nova.api.openstack.requestlog [req-bbcd2b46-e8e8-416f-98de-c868521b31d3 req-87bf76f5-2b99-4ca1-a408-8168edfacb3c service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029052 Dec 15 03:05:10.426502 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: [pid: 116157|app: 0|req: 138/307] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Dec 15 03:05:10 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 03:05:10.581520 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: INFO nova.api.openstack.requestlog [None req-62961d62-7c82-4c81-8d53-5839b76f6d76 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] 10.222.0.18 "POST /compute/v2.1/servers/b89094ac-aee1-4bd6-a33d-8c4347cebfc7/action" status: 200 len: 14 microversion: 2.20 time: 0.258592 Dec 15 03:05:10.582084 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: [pid: 116156|app: 0|req: 170/308] 10.222.0.18 () {62 vars in 1318 bytes} [Wed Dec 15 03:05:10 2021] POST /compute/v2.1/servers/b89094ac-aee1-4bd6-a33d-8c4347cebfc7/action => generated 14 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 03:05:10.619881 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi [None req-38ca43b5-5cb2-406a-8e03-534ac26128f9 tempest-AttachVolumeNegativeTest-1640336653 tempest-AttachVolumeNegativeTest-1640336653-project] Calling method '>' {{(pid=116157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:05:10.621006 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.compute.api [None req-38ca43b5-5cb2-406a-8e03-534ac26128f9 tempest-AttachVolumeNegativeTest-1640336653 tempest-AttachVolumeNegativeTest-1640336653-project] [instance: 4923355f-95d6-443d-9487-574f56b87f66] Fetching instance by UUID {{(pid=116157) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:05:10.628600 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-38ca43b5-5cb2-406a-8e03-534ac26128f9 tempest-AttachVolumeNegativeTest-1640336653 tempest-AttachVolumeNegativeTest-1640336653-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:05:10.629259 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-38ca43b5-5cb2-406a-8e03-534ac26128f9 tempest-AttachVolumeNegativeTest-1640336653 tempest-AttachVolumeNegativeTest-1640336653-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:05:10.630033 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-38ca43b5-5cb2-406a-8e03-534ac26128f9 tempest-AttachVolumeNegativeTest-1640336653 tempest-AttachVolumeNegativeTest-1640336653-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:05:10.630548 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-38ca43b5-5cb2-406a-8e03-534ac26128f9 tempest-AttachVolumeNegativeTest-1640336653 tempest-AttachVolumeNegativeTest-1640336653-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:05:10.639924 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi [None req-1d79122c-b5cf-4d34-9ae1-11437e9322aa tempest-ServerRescueNegativeTestJSON-2061875223 tempest-ServerRescueNegativeTestJSON-2061875223-project] Calling method '>' {{(pid=116156) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:05:10.640747 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.compute.api [None req-1d79122c-b5cf-4d34-9ae1-11437e9322aa tempest-ServerRescueNegativeTestJSON-2061875223 tempest-ServerRescueNegativeTestJSON-2061875223-project] [instance: 9bbb0abf-72a3-4fbc-8235-7a3ecfc8d006] Fetching instance by UUID {{(pid=116156) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:05:10.656605 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-1d79122c-b5cf-4d34-9ae1-11437e9322aa tempest-ServerRescueNegativeTestJSON-2061875223 tempest-ServerRescueNegativeTestJSON-2061875223-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:05:10.657141 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-1d79122c-b5cf-4d34-9ae1-11437e9322aa tempest-ServerRescueNegativeTestJSON-2061875223 tempest-ServerRescueNegativeTestJSON-2061875223-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:05:10.658132 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-1d79122c-b5cf-4d34-9ae1-11437e9322aa tempest-ServerRescueNegativeTestJSON-2061875223 tempest-ServerRescueNegativeTestJSON-2061875223-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:05:10.658616 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-1d79122c-b5cf-4d34-9ae1-11437e9322aa tempest-ServerRescueNegativeTestJSON-2061875223 tempest-ServerRescueNegativeTestJSON-2061875223-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:05:10.711257 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: INFO nova.api.openstack.requestlog [None req-38ca43b5-5cb2-406a-8e03-534ac26128f9 tempest-AttachVolumeNegativeTest-1640336653 tempest-AttachVolumeNegativeTest-1640336653-project] 10.222.0.18 "GET /compute/v2.1/servers/4923355f-95d6-443d-9487-574f56b87f66/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.095394 Dec 15 03:05:10.714175 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: [pid: 116157|app: 0|req: 139/309] 10.222.0.18 () {58 vars in 1301 bytes} [Wed Dec 15 03:05:10 2021] GET /compute/v2.1/servers/4923355f-95d6-443d-9487-574f56b87f66/os-volume_attachments => generated 197 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 03:05:10.824642 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.policy [None req-1d79122c-b5cf-4d34-9ae1-11437e9322aa tempest-ServerRescueNegativeTestJSON-2061875223 tempest-ServerRescueNegativeTestJSON-2061875223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ea02b6e8f1548a1bd78952cb7337403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5e8a958d4bf43868502b13728b9583b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116156) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:05:10.832995 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: INFO nova.api.openstack.requestlog [None req-1d79122c-b5cf-4d34-9ae1-11437e9322aa tempest-ServerRescueNegativeTestJSON-2061875223 tempest-ServerRescueNegativeTestJSON-2061875223-project] 10.222.0.18 "GET /compute/v2.1/servers/9bbb0abf-72a3-4fbc-8235-7a3ecfc8d006" status: 200 len: 1501 microversion: 2.1 time: 0.196856 Dec 15 03:05:10.833494 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: [pid: 116156|app: 0|req: 171/310] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 03:05:10 2021] GET /compute/v2.1/servers/9bbb0abf-72a3-4fbc-8235-7a3ecfc8d006 => generated 1501 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 03:05:10.849354 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi [None req-ccd9eaf8-e776-43b7-b96d-8e54abe2a06a tempest-ServerRescueNegativeTestJSON-2061875223 tempest-ServerRescueNegativeTestJSON-2061875223-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "cbf1dd92-17dd-4cc4-be40-3a9234ff0ff4"}} {{(pid=116157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 03:05:10.850450 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.compute.api [None req-ccd9eaf8-e776-43b7-b96d-8e54abe2a06a tempest-ServerRescueNegativeTestJSON-2061875223 tempest-ServerRescueNegativeTestJSON-2061875223-project] [instance: 9bbb0abf-72a3-4fbc-8235-7a3ecfc8d006] Fetching instance by UUID {{(pid=116157) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:05:10.856385 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-ccd9eaf8-e776-43b7-b96d-8e54abe2a06a tempest-ServerRescueNegativeTestJSON-2061875223 tempest-ServerRescueNegativeTestJSON-2061875223-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:05:10.856841 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-ccd9eaf8-e776-43b7-b96d-8e54abe2a06a tempest-ServerRescueNegativeTestJSON-2061875223 tempest-ServerRescueNegativeTestJSON-2061875223-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:05:10.857642 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-ccd9eaf8-e776-43b7-b96d-8e54abe2a06a tempest-ServerRescueNegativeTestJSON-2061875223 tempest-ServerRescueNegativeTestJSON-2061875223-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:05:10.858112 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-ccd9eaf8-e776-43b7-b96d-8e54abe2a06a tempest-ServerRescueNegativeTestJSON-2061875223 tempest-ServerRescueNegativeTestJSON-2061875223-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:05:10.887210 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: INFO nova.api.openstack.wsgi [None req-ccd9eaf8-e776-43b7-b96d-8e54abe2a06a tempest-ServerRescueNegativeTestJSON-2061875223 tempest-ServerRescueNegativeTestJSON-2061875223-project] HTTP exception thrown: Cannot 'attach_volume' instance 9bbb0abf-72a3-4fbc-8235-7a3ecfc8d006 while it is in vm_state rescued Dec 15 03:05:10.888146 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi [None req-ccd9eaf8-e776-43b7-b96d-8e54abe2a06a tempest-ServerRescueNegativeTestJSON-2061875223 tempest-ServerRescueNegativeTestJSON-2061875223-project] Returning 409 to user: Cannot 'attach_volume' instance 9bbb0abf-72a3-4fbc-8235-7a3ecfc8d006 while it is in vm_state rescued {{(pid=116157) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 15 03:05:10.889205 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: INFO nova.api.openstack.requestlog [None req-ccd9eaf8-e776-43b7-b96d-8e54abe2a06a tempest-ServerRescueNegativeTestJSON-2061875223 tempest-ServerRescueNegativeTestJSON-2061875223-project] 10.222.0.18 "POST /compute/v2.1/servers/9bbb0abf-72a3-4fbc-8235-7a3ecfc8d006/os-volume_attachments" status: 409 len: 152 microversion: 2.1 time: 0.043704 Dec 15 03:05:10.898806 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi [None req-2876dd46-9d25-472b-8039-35a47a39a04d tempest-ServerRescueNegativeTestJSON-2061875223 tempest-ServerRescueNegativeTestJSON-2061875223-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=116156) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 03:05:10.899818 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.compute.api [None req-2876dd46-9d25-472b-8039-35a47a39a04d tempest-ServerRescueNegativeTestJSON-2061875223 tempest-ServerRescueNegativeTestJSON-2061875223-project] [instance: 9bbb0abf-72a3-4fbc-8235-7a3ecfc8d006] Fetching instance by UUID {{(pid=116156) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:05:10.904068 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: [pid: 116157|app: 0|req: 140/311] 10.222.0.18 () {60 vars in 1322 bytes} [Wed Dec 15 03:05:10 2021] POST /compute/v2.1/servers/9bbb0abf-72a3-4fbc-8235-7a3ecfc8d006/os-volume_attachments => generated 152 bytes in 58 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Dec 15 03:05:10.906899 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-2876dd46-9d25-472b-8039-35a47a39a04d tempest-ServerRescueNegativeTestJSON-2061875223 tempest-ServerRescueNegativeTestJSON-2061875223-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:05:10.907744 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-2876dd46-9d25-472b-8039-35a47a39a04d tempest-ServerRescueNegativeTestJSON-2061875223 tempest-ServerRescueNegativeTestJSON-2061875223-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:05:10.909573 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-2876dd46-9d25-472b-8039-35a47a39a04d tempest-ServerRescueNegativeTestJSON-2061875223 tempest-ServerRescueNegativeTestJSON-2061875223-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:05:10.910208 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-2876dd46-9d25-472b-8039-35a47a39a04d tempest-ServerRescueNegativeTestJSON-2061875223 tempest-ServerRescueNegativeTestJSON-2061875223-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:05:11.023726 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: INFO nova.api.openstack.requestlog [None req-2876dd46-9d25-472b-8039-35a47a39a04d tempest-ServerRescueNegativeTestJSON-2061875223 tempest-ServerRescueNegativeTestJSON-2061875223-project] 10.222.0.18 "POST /compute/v2.1/servers/9bbb0abf-72a3-4fbc-8235-7a3ecfc8d006/action" status: 202 len: 0 microversion: 2.1 time: 0.128508 Dec 15 03:05:11.025404 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: [pid: 116156|app: 0|req: 172/312] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Dec 15 03:05:10 2021] POST /compute/v2.1/servers/9bbb0abf-72a3-4fbc-8235-7a3ecfc8d006/action => generated 0 bytes in 131 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Dec 15 03:05:11.034088 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi [None req-a60bd840-00ea-4199-b66d-5278391c1a7c tempest-ServerRescueNegativeTestJSON-2061875223 tempest-ServerRescueNegativeTestJSON-2061875223-project] Calling method '>' {{(pid=116157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:05:11.035148 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.compute.api [None req-a60bd840-00ea-4199-b66d-5278391c1a7c tempest-ServerRescueNegativeTestJSON-2061875223 tempest-ServerRescueNegativeTestJSON-2061875223-project] [instance: 9bbb0abf-72a3-4fbc-8235-7a3ecfc8d006] Fetching instance by UUID {{(pid=116157) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:05:11.046655 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-a60bd840-00ea-4199-b66d-5278391c1a7c tempest-ServerRescueNegativeTestJSON-2061875223 tempest-ServerRescueNegativeTestJSON-2061875223-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:05:11.048329 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-a60bd840-00ea-4199-b66d-5278391c1a7c tempest-ServerRescueNegativeTestJSON-2061875223 tempest-ServerRescueNegativeTestJSON-2061875223-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:05:11.050149 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-a60bd840-00ea-4199-b66d-5278391c1a7c tempest-ServerRescueNegativeTestJSON-2061875223 tempest-ServerRescueNegativeTestJSON-2061875223-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:05:11.050955 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-a60bd840-00ea-4199-b66d-5278391c1a7c tempest-ServerRescueNegativeTestJSON-2061875223 tempest-ServerRescueNegativeTestJSON-2061875223-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:05:11.241094 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.policy [None req-a60bd840-00ea-4199-b66d-5278391c1a7c tempest-ServerRescueNegativeTestJSON-2061875223 tempest-ServerRescueNegativeTestJSON-2061875223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ea02b6e8f1548a1bd78952cb7337403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5e8a958d4bf43868502b13728b9583b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116157) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:05:11.250571 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: INFO nova.api.openstack.requestlog [None req-a60bd840-00ea-4199-b66d-5278391c1a7c tempest-ServerRescueNegativeTestJSON-2061875223 tempest-ServerRescueNegativeTestJSON-2061875223-project] 10.222.0.18 "GET /compute/v2.1/servers/9bbb0abf-72a3-4fbc-8235-7a3ecfc8d006" status: 200 len: 1509 microversion: 2.1 time: 0.221120 Dec 15 03:05:11.251358 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: [pid: 116157|app: 0|req: 141/313] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 03:05:11 2021] GET /compute/v2.1/servers/9bbb0abf-72a3-4fbc-8235-7a3ecfc8d006 => generated 1509 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 03:05:11.416402 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi [None req-c8b50af9-cb95-49aa-968b-62f5eecc383c tempest-VolumesActionsTest-1837279088 tempest-VolumesActionsTest-1837279088-project] Calling method '>' {{(pid=116156) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:05:11.417367 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.compute.api [None req-c8b50af9-cb95-49aa-968b-62f5eecc383c tempest-VolumesActionsTest-1837279088 tempest-VolumesActionsTest-1837279088-project] [instance: 0c1f5052-62a2-4847-ab40-6e1a9df040ca] Fetching instance by UUID {{(pid=116156) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:05:11.425356 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-c8b50af9-cb95-49aa-968b-62f5eecc383c tempest-VolumesActionsTest-1837279088 tempest-VolumesActionsTest-1837279088-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:05:11.426039 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-c8b50af9-cb95-49aa-968b-62f5eecc383c tempest-VolumesActionsTest-1837279088 tempest-VolumesActionsTest-1837279088-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:05:11.427025 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-c8b50af9-cb95-49aa-968b-62f5eecc383c tempest-VolumesActionsTest-1837279088 tempest-VolumesActionsTest-1837279088-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:05:11.427653 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-c8b50af9-cb95-49aa-968b-62f5eecc383c tempest-VolumesActionsTest-1837279088 tempest-VolumesActionsTest-1837279088-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:05:11.592186 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi [None req-8ae58af6-fb53-4be1-a4a8-c0f14b8e5ef5 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 03:05:11.593159 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.compute.api [None req-8ae58af6-fb53-4be1-a4a8-c0f14b8e5ef5 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] [instance: b89094ac-aee1-4bd6-a33d-8c4347cebfc7] Fetching instance by UUID {{(pid=116157) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:05:11.601467 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-8ae58af6-fb53-4be1-a4a8-c0f14b8e5ef5 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:05:11.601843 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-8ae58af6-fb53-4be1-a4a8-c0f14b8e5ef5 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:05:11.602690 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-8ae58af6-fb53-4be1-a4a8-c0f14b8e5ef5 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:05:11.603133 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-8ae58af6-fb53-4be1-a4a8-c0f14b8e5ef5 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:05:11.730360 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: INFO nova.api.openstack.requestlog [None req-8ae58af6-fb53-4be1-a4a8-c0f14b8e5ef5 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] 10.222.0.18 "POST /compute/v2.1/servers/b89094ac-aee1-4bd6-a33d-8c4347cebfc7/action" status: 200 len: 14 microversion: 2.20 time: 0.140899 Dec 15 03:05:11.735854 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: [pid: 116157|app: 0|req: 142/314] 10.222.0.18 () {62 vars in 1318 bytes} [Wed Dec 15 03:05:11 2021] POST /compute/v2.1/servers/b89094ac-aee1-4bd6-a33d-8c4347cebfc7/action => generated 14 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 03:05:11.748106 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi [None req-d7220f2d-5fd1-4143-a617-77d3fa8c3932 tempest-AttachVolumeNegativeTest-1640336653 tempest-AttachVolumeNegativeTest-1640336653-project] Calling method '>' {{(pid=116157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:05:11.749431 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.compute.api [None req-d7220f2d-5fd1-4143-a617-77d3fa8c3932 tempest-AttachVolumeNegativeTest-1640336653 tempest-AttachVolumeNegativeTest-1640336653-project] [instance: 4923355f-95d6-443d-9487-574f56b87f66] Fetching instance by UUID {{(pid=116157) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:05:11.759063 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-d7220f2d-5fd1-4143-a617-77d3fa8c3932 tempest-AttachVolumeNegativeTest-1640336653 tempest-AttachVolumeNegativeTest-1640336653-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:05:11.759750 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-d7220f2d-5fd1-4143-a617-77d3fa8c3932 tempest-AttachVolumeNegativeTest-1640336653 tempest-AttachVolumeNegativeTest-1640336653-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:05:11.760728 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-d7220f2d-5fd1-4143-a617-77d3fa8c3932 tempest-AttachVolumeNegativeTest-1640336653 tempest-AttachVolumeNegativeTest-1640336653-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:05:11.762068 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-d7220f2d-5fd1-4143-a617-77d3fa8c3932 tempest-AttachVolumeNegativeTest-1640336653 tempest-AttachVolumeNegativeTest-1640336653-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:05:11.768868 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.policy [None req-c8b50af9-cb95-49aa-968b-62f5eecc383c tempest-VolumesActionsTest-1837279088 tempest-VolumesActionsTest-1837279088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e440754469c4407840a651d560ce08a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6eaf458d3c84ba59b078dc0a3bf1763', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116156) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:05:11.775369 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: INFO nova.api.openstack.requestlog [None req-c8b50af9-cb95-49aa-968b-62f5eecc383c tempest-VolumesActionsTest-1837279088 tempest-VolumesActionsTest-1837279088-project] 10.222.0.18 "GET /compute/v2.1/servers/0c1f5052-62a2-4847-ab40-6e1a9df040ca" status: 200 len: 1502 microversion: 2.1 time: 0.365558 Dec 15 03:05:11.776124 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: [pid: 116156|app: 0|req: 173/315] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 03:05:11 2021] GET /compute/v2.1/servers/0c1f5052-62a2-4847-ab40-6e1a9df040ca => generated 1502 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 03:05:11.811966 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: INFO nova.api.openstack.requestlog [None req-d7220f2d-5fd1-4143-a617-77d3fa8c3932 tempest-AttachVolumeNegativeTest-1640336653 tempest-AttachVolumeNegativeTest-1640336653-project] 10.222.0.18 "GET /compute/v2.1/servers/4923355f-95d6-443d-9487-574f56b87f66/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.074356 Dec 15 03:05:11.813311 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: [pid: 116157|app: 0|req: 143/316] 10.222.0.18 () {58 vars in 1301 bytes} [Wed Dec 15 03:05:11 2021] GET /compute/v2.1/servers/4923355f-95d6-443d-9487-574f56b87f66/os-volume_attachments => generated 25 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Dec 15 03:05:11.979428 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi [None req-8686d66f-8925-449a-b794-dce4a38d3307 tempest-AttachVolumeNegativeTest-1640336653 tempest-AttachVolumeNegativeTest-1640336653-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1610830369", "imageRef": "5195b034-9fa4-468b-a94d-ef3ee79ce449", "flavorRef": "452", "networks": [{"uuid": "b0713a87-683c-42de-a9a0-98522d8ec589"}]}} {{(pid=116156) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 03:05:12.041934 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.network.neutron [None req-8686d66f-8925-449a-b794-dce4a38d3307 tempest-AttachVolumeNegativeTest-1640336653 tempest-AttachVolumeNegativeTest-1640336653-project] validate_networks() for [('b0713a87-683c-42de-a9a0-98522d8ec589', None, None, None, None, None)] {{(pid=116156) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Dec 15 03:05:12.268840 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi [None req-45468199-cbb7-4cd8-b932-1dcdb7694312 tempest-ServerRescueNegativeTestJSON-2061875223 tempest-ServerRescueNegativeTestJSON-2061875223-project] Calling method '>' {{(pid=116157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:05:12.269516 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.compute.api [None req-45468199-cbb7-4cd8-b932-1dcdb7694312 tempest-ServerRescueNegativeTestJSON-2061875223 tempest-ServerRescueNegativeTestJSON-2061875223-project] [instance: 9bbb0abf-72a3-4fbc-8235-7a3ecfc8d006] Fetching instance by UUID {{(pid=116157) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:05:12.278603 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-45468199-cbb7-4cd8-b932-1dcdb7694312 tempest-ServerRescueNegativeTestJSON-2061875223 tempest-ServerRescueNegativeTestJSON-2061875223-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:05:12.280851 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-45468199-cbb7-4cd8-b932-1dcdb7694312 tempest-ServerRescueNegativeTestJSON-2061875223 tempest-ServerRescueNegativeTestJSON-2061875223-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:05:12.281817 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-45468199-cbb7-4cd8-b932-1dcdb7694312 tempest-ServerRescueNegativeTestJSON-2061875223 tempest-ServerRescueNegativeTestJSON-2061875223-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:05:12.282681 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-45468199-cbb7-4cd8-b932-1dcdb7694312 tempest-ServerRescueNegativeTestJSON-2061875223 tempest-ServerRescueNegativeTestJSON-2061875223-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:05:12.468423 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.policy [None req-45468199-cbb7-4cd8-b932-1dcdb7694312 tempest-ServerRescueNegativeTestJSON-2061875223 tempest-ServerRescueNegativeTestJSON-2061875223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ea02b6e8f1548a1bd78952cb7337403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5e8a958d4bf43868502b13728b9583b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116157) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:05:12.476447 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: INFO nova.api.openstack.requestlog [None req-45468199-cbb7-4cd8-b932-1dcdb7694312 tempest-ServerRescueNegativeTestJSON-2061875223 tempest-ServerRescueNegativeTestJSON-2061875223-project] 10.222.0.18 "GET /compute/v2.1/servers/9bbb0abf-72a3-4fbc-8235-7a3ecfc8d006" status: 200 len: 1509 microversion: 2.1 time: 0.211412 Dec 15 03:05:12.477006 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: [pid: 116157|app: 0|req: 144/317] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 03:05:12 2021] GET /compute/v2.1/servers/9bbb0abf-72a3-4fbc-8235-7a3ecfc8d006 => generated 1509 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 03:05:12.481697 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi [req-7239d2ca-944d-4247-8da9-e492152464e2 req-2ae98e1f-a635-4538-ab06-0d782e2b7c3f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0c1f5052-62a2-4847-ab40-6e1a9df040ca", "name": "network-vif-deleted", "tag": "337016c2-5d41-4e99-80d1-0be601ec8027"}]} {{(pid=116157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 03:05:12.483272 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 15 03:05:12.483272 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: warnings.warn(msg) Dec 15 03:05:12.489438 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.virt.hardware [None req-8686d66f-8925-449a-b794-dce4a38d3307 tempest-AttachVolumeNegativeTest-1640336653 tempest-AttachVolumeNegativeTest-1640336653-project] Flavor limits 0:0:0 {{(pid=116156) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Dec 15 03:05:12.489854 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.virt.hardware [None req-8686d66f-8925-449a-b794-dce4a38d3307 tempest-AttachVolumeNegativeTest-1640336653 tempest-AttachVolumeNegativeTest-1640336653-project] Image limits 0:0:0 {{(pid=116156) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Dec 15 03:05:12.490572 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.virt.hardware [None req-8686d66f-8925-449a-b794-dce4a38d3307 tempest-AttachVolumeNegativeTest-1640336653 tempest-AttachVolumeNegativeTest-1640336653-project] Flavor pref 0:0:0 {{(pid=116156) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Dec 15 03:05:12.491185 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.virt.hardware [None req-8686d66f-8925-449a-b794-dce4a38d3307 tempest-AttachVolumeNegativeTest-1640336653 tempest-AttachVolumeNegativeTest-1640336653-project] Image pref 0:0:0 {{(pid=116156) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Dec 15 03:05:12.491658 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.virt.hardware [None req-8686d66f-8925-449a-b794-dce4a38d3307 tempest-AttachVolumeNegativeTest-1640336653 tempest-AttachVolumeNegativeTest-1640336653-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116156) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Dec 15 03:05:12.491845 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [req-7239d2ca-944d-4247-8da9-e492152464e2 req-2ae98e1f-a635-4538-ab06-0d782e2b7c3f service nova] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:05:12.492289 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [req-7239d2ca-944d-4247-8da9-e492152464e2 req-2ae98e1f-a635-4538-ab06-0d782e2b7c3f service nova] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:05:12.502094 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-8686d66f-8925-449a-b794-dce4a38d3307 tempest-AttachVolumeNegativeTest-1640336653 tempest-AttachVolumeNegativeTest-1640336653-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:05:12.502617 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-8686d66f-8925-449a-b794-dce4a38d3307 tempest-AttachVolumeNegativeTest-1640336653 tempest-AttachVolumeNegativeTest-1640336653-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:05:12.503431 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-8686d66f-8925-449a-b794-dce4a38d3307 tempest-AttachVolumeNegativeTest-1640336653 tempest-AttachVolumeNegativeTest-1640336653-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:05:12.503864 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-8686d66f-8925-449a-b794-dce4a38d3307 tempest-AttachVolumeNegativeTest-1640336653 tempest-AttachVolumeNegativeTest-1640336653-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:05:12.504077 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: INFO nova.api.openstack.compute.server_external_events [req-7239d2ca-944d-4247-8da9-e492152464e2 req-2ae98e1f-a635-4538-ab06-0d782e2b7c3f service nova] Creating event network-vif-deleted:337016c2-5d41-4e99-80d1-0be601ec8027 for instance 0c1f5052-62a2-4847-ab40-6e1a9df040ca on hv-cinder-81803 Dec 15 03:05:12.509185 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: INFO nova.api.openstack.requestlog [req-7239d2ca-944d-4247-8da9-e492152464e2 req-2ae98e1f-a635-4538-ab06-0d782e2b7c3f service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030749 Dec 15 03:05:12.510009 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: [pid: 116157|app: 0|req: 145/318] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Dec 15 03:05:12 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 03:05:12.520251 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.quota [None req-8686d66f-8925-449a-b794-dce4a38d3307 tempest-AttachVolumeNegativeTest-1640336653 tempest-AttachVolumeNegativeTest-1640336653-project] Getting quotas for project 409b41637da94c469444954258444b4b. Resources: {'cores', 'instances', 'ram'} {{(pid=116156) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 15 03:05:12.524318 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.quota [None req-8686d66f-8925-449a-b794-dce4a38d3307 tempest-AttachVolumeNegativeTest-1640336653 tempest-AttachVolumeNegativeTest-1640336653-project] Getting quotas for user 35d37a3d8e504b8186182468b77dd114 and project 409b41637da94c469444954258444b4b. Resources: {'cores', 'instances', 'ram'} {{(pid=116156) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 15 03:05:12.535459 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.compute.api [None req-8686d66f-8925-449a-b794-dce4a38d3307 tempest-AttachVolumeNegativeTest-1640336653 tempest-AttachVolumeNegativeTest-1640336653-project] Going to run 1 instances... {{(pid=116156) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Dec 15 03:05:12.537764 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.compute.api [None req-8686d66f-8925-449a-b794-dce4a38d3307 tempest-AttachVolumeNegativeTest-1640336653 tempest-AttachVolumeNegativeTest-1640336653-project] [instance: c3d5f143-e994-4098-989b-660411a8dd8f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='5195b034-9fa4-468b-a94d-ef3ee79ce449',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=116156) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Dec 15 03:05:12.583449 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: INFO nova.api.openstack.requestlog [None req-8686d66f-8925-449a-b794-dce4a38d3307 tempest-AttachVolumeNegativeTest-1640336653 tempest-AttachVolumeNegativeTest-1640336653-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.607864 Dec 15 03:05:12.584376 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: [pid: 116156|app: 0|req: 174/319] 10.222.0.18 () {60 vars in 1146 bytes} [Wed Dec 15 03:05:11 2021] POST /compute/v2.1/servers => generated 380 bytes in 609 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Dec 15 03:05:12.595693 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi [None req-91a9040b-1eb2-4183-8b1a-0662e81dfc7e tempest-AttachVolumeNegativeTest-1640336653 tempest-AttachVolumeNegativeTest-1640336653-project] Calling method '>' {{(pid=116157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:05:12.597161 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.compute.api [None req-91a9040b-1eb2-4183-8b1a-0662e81dfc7e tempest-AttachVolumeNegativeTest-1640336653 tempest-AttachVolumeNegativeTest-1640336653-project] [instance: c3d5f143-e994-4098-989b-660411a8dd8f] Fetching instance by UUID {{(pid=116157) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:05:12.677099 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.policy [None req-91a9040b-1eb2-4183-8b1a-0662e81dfc7e tempest-AttachVolumeNegativeTest-1640336653 tempest-AttachVolumeNegativeTest-1640336653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35d37a3d8e504b8186182468b77dd114', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '409b41637da94c469444954258444b4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116157) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:05:12.687018 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: INFO nova.api.openstack.requestlog [None req-91a9040b-1eb2-4183-8b1a-0662e81dfc7e tempest-AttachVolumeNegativeTest-1640336653 tempest-AttachVolumeNegativeTest-1640336653-project] 10.222.0.18 "GET /compute/v2.1/servers/c3d5f143-e994-4098-989b-660411a8dd8f" status: 200 len: 1218 microversion: 2.1 time: 0.096031 Dec 15 03:05:12.688666 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: [pid: 116157|app: 0|req: 146/320] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 03:05:12 2021] GET /compute/v2.1/servers/c3d5f143-e994-4098-989b-660411a8dd8f => generated 1218 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 03:05:12.744822 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi [None req-be9e1053-8c9a-404e-84d9-5bb2684db29b tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116156) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 03:05:12.746289 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.compute.api [None req-be9e1053-8c9a-404e-84d9-5bb2684db29b tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] [instance: b89094ac-aee1-4bd6-a33d-8c4347cebfc7] Fetching instance by UUID {{(pid=116156) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:05:12.760368 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-be9e1053-8c9a-404e-84d9-5bb2684db29b tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:05:12.760828 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-be9e1053-8c9a-404e-84d9-5bb2684db29b tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:05:12.762342 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-be9e1053-8c9a-404e-84d9-5bb2684db29b tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:05:12.763149 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-be9e1053-8c9a-404e-84d9-5bb2684db29b tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:05:12.799154 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi [None req-2343f37c-7812-4e8d-bdad-1234e67443f0 tempest-VolumesActionsTest-1837279088 tempest-VolumesActionsTest-1837279088-project] Calling method '>' {{(pid=116157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:05:12.802569 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.compute.api [None req-2343f37c-7812-4e8d-bdad-1234e67443f0 tempest-VolumesActionsTest-1837279088 tempest-VolumesActionsTest-1837279088-project] [instance: 0c1f5052-62a2-4847-ab40-6e1a9df040ca] Fetching instance by UUID {{(pid=116157) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:05:12.811746 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-2343f37c-7812-4e8d-bdad-1234e67443f0 tempest-VolumesActionsTest-1837279088 tempest-VolumesActionsTest-1837279088-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:05:12.813213 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-2343f37c-7812-4e8d-bdad-1234e67443f0 tempest-VolumesActionsTest-1837279088 tempest-VolumesActionsTest-1837279088-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:05:12.815375 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-2343f37c-7812-4e8d-bdad-1234e67443f0 tempest-VolumesActionsTest-1837279088 tempest-VolumesActionsTest-1837279088-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:05:12.816901 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-2343f37c-7812-4e8d-bdad-1234e67443f0 tempest-VolumesActionsTest-1837279088 tempest-VolumesActionsTest-1837279088-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:05:12.833900 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: INFO nova.api.openstack.wsgi [None req-2343f37c-7812-4e8d-bdad-1234e67443f0 tempest-VolumesActionsTest-1837279088 tempest-VolumesActionsTest-1837279088-project] HTTP exception thrown: Instance 0c1f5052-62a2-4847-ab40-6e1a9df040ca could not be found. Dec 15 03:05:12.834857 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi [None req-2343f37c-7812-4e8d-bdad-1234e67443f0 tempest-VolumesActionsTest-1837279088 tempest-VolumesActionsTest-1837279088-project] Returning 404 to user: Instance 0c1f5052-62a2-4847-ab40-6e1a9df040ca could not be found. {{(pid=116157) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 15 03:05:12.835803 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: INFO nova.api.openstack.requestlog [None req-2343f37c-7812-4e8d-bdad-1234e67443f0 tempest-VolumesActionsTest-1837279088 tempest-VolumesActionsTest-1837279088-project] 10.222.0.18 "GET /compute/v2.1/servers/0c1f5052-62a2-4847-ab40-6e1a9df040ca" status: 404 len: 111 microversion: 2.1 time: 0.046394 Dec 15 03:05:12.837221 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: [pid: 116157|app: 0|req: 147/321] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 03:05:12 2021] GET /compute/v2.1/servers/0c1f5052-62a2-4847-ab40-6e1a9df040ca => generated 111 bytes in 49 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Dec 15 03:05:12.883756 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: INFO nova.api.openstack.requestlog [None req-be9e1053-8c9a-404e-84d9-5bb2684db29b tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] 10.222.0.18 "POST /compute/v2.1/servers/b89094ac-aee1-4bd6-a33d-8c4347cebfc7/action" status: 200 len: 14 microversion: 2.20 time: 0.144158 Dec 15 03:05:12.888254 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: [pid: 116156|app: 0|req: 175/322] 10.222.0.18 () {62 vars in 1318 bytes} [Wed Dec 15 03:05:12 2021] POST /compute/v2.1/servers/b89094ac-aee1-4bd6-a33d-8c4347cebfc7/action => generated 14 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 03:05:12.965148 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi [None req-122a524b-04b3-498d-9464-9d469e9021ee tempest-VolumesActionsTest-1837279088 tempest-VolumesActionsTest-1837279088-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1835044587", "imageRef": "5195b034-9fa4-468b-a94d-ef3ee79ce449", "flavorRef": "452", "networks": [{"uuid": "0789cf04-9022-405f-9413-73b756ea9873"}]}} {{(pid=116157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 03:05:13.028773 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.network.neutron [None req-122a524b-04b3-498d-9464-9d469e9021ee tempest-VolumesActionsTest-1837279088 tempest-VolumesActionsTest-1837279088-project] validate_networks() for [('0789cf04-9022-405f-9413-73b756ea9873', None, None, None, None, None)] {{(pid=116157) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Dec 15 03:05:13.435235 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.virt.hardware [None req-122a524b-04b3-498d-9464-9d469e9021ee tempest-VolumesActionsTest-1837279088 tempest-VolumesActionsTest-1837279088-project] Flavor limits 0:0:0 {{(pid=116157) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Dec 15 03:05:13.435910 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.virt.hardware [None req-122a524b-04b3-498d-9464-9d469e9021ee tempest-VolumesActionsTest-1837279088 tempest-VolumesActionsTest-1837279088-project] Image limits 0:0:0 {{(pid=116157) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Dec 15 03:05:13.436564 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.virt.hardware [None req-122a524b-04b3-498d-9464-9d469e9021ee tempest-VolumesActionsTest-1837279088 tempest-VolumesActionsTest-1837279088-project] Flavor pref 0:0:0 {{(pid=116157) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Dec 15 03:05:13.437030 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.virt.hardware [None req-122a524b-04b3-498d-9464-9d469e9021ee tempest-VolumesActionsTest-1837279088 tempest-VolumesActionsTest-1837279088-project] Image pref 0:0:0 {{(pid=116157) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Dec 15 03:05:13.438158 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.virt.hardware [None req-122a524b-04b3-498d-9464-9d469e9021ee tempest-VolumesActionsTest-1837279088 tempest-VolumesActionsTest-1837279088-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116157) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Dec 15 03:05:13.447214 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-122a524b-04b3-498d-9464-9d469e9021ee tempest-VolumesActionsTest-1837279088 tempest-VolumesActionsTest-1837279088-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:05:13.447772 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-122a524b-04b3-498d-9464-9d469e9021ee tempest-VolumesActionsTest-1837279088 tempest-VolumesActionsTest-1837279088-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:05:13.448870 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-122a524b-04b3-498d-9464-9d469e9021ee tempest-VolumesActionsTest-1837279088 tempest-VolumesActionsTest-1837279088-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:05:13.449118 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-122a524b-04b3-498d-9464-9d469e9021ee tempest-VolumesActionsTest-1837279088 tempest-VolumesActionsTest-1837279088-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:05:13.473658 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.quota [None req-122a524b-04b3-498d-9464-9d469e9021ee tempest-VolumesActionsTest-1837279088 tempest-VolumesActionsTest-1837279088-project] Getting quotas for project b6eaf458d3c84ba59b078dc0a3bf1763. Resources: {'cores', 'instances', 'ram'} {{(pid=116157) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 15 03:05:13.477791 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.quota [None req-122a524b-04b3-498d-9464-9d469e9021ee tempest-VolumesActionsTest-1837279088 tempest-VolumesActionsTest-1837279088-project] Getting quotas for user 0e440754469c4407840a651d560ce08a and project b6eaf458d3c84ba59b078dc0a3bf1763. Resources: {'cores', 'instances', 'ram'} {{(pid=116157) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 15 03:05:13.491681 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.compute.api [None req-122a524b-04b3-498d-9464-9d469e9021ee tempest-VolumesActionsTest-1837279088 tempest-VolumesActionsTest-1837279088-project] Going to run 1 instances... {{(pid=116157) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Dec 15 03:05:13.494086 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.compute.api [None req-122a524b-04b3-498d-9464-9d469e9021ee tempest-VolumesActionsTest-1837279088 tempest-VolumesActionsTest-1837279088-project] [instance: 41e95883-9297-4d1d-b0aa-33068fb973cd] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='5195b034-9fa4-468b-a94d-ef3ee79ce449',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=116157) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Dec 15 03:05:13.498071 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi [None req-16851581-f27d-498e-b045-95d2b823c316 tempest-ServerRescueNegativeTestJSON-2061875223 tempest-ServerRescueNegativeTestJSON-2061875223-project] Calling method '>' {{(pid=116156) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:05:13.498896 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.compute.api [None req-16851581-f27d-498e-b045-95d2b823c316 tempest-ServerRescueNegativeTestJSON-2061875223 tempest-ServerRescueNegativeTestJSON-2061875223-project] [instance: 9bbb0abf-72a3-4fbc-8235-7a3ecfc8d006] Fetching instance by UUID {{(pid=116156) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:05:13.516983 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-16851581-f27d-498e-b045-95d2b823c316 tempest-ServerRescueNegativeTestJSON-2061875223 tempest-ServerRescueNegativeTestJSON-2061875223-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:05:13.517542 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-16851581-f27d-498e-b045-95d2b823c316 tempest-ServerRescueNegativeTestJSON-2061875223 tempest-ServerRescueNegativeTestJSON-2061875223-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:05:13.518489 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-16851581-f27d-498e-b045-95d2b823c316 tempest-ServerRescueNegativeTestJSON-2061875223 tempest-ServerRescueNegativeTestJSON-2061875223-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:05:13.519027 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-16851581-f27d-498e-b045-95d2b823c316 tempest-ServerRescueNegativeTestJSON-2061875223 tempest-ServerRescueNegativeTestJSON-2061875223-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:05:13.556104 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: INFO nova.api.openstack.requestlog [None req-122a524b-04b3-498d-9464-9d469e9021ee tempest-VolumesActionsTest-1837279088 tempest-VolumesActionsTest-1837279088-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.594446 Dec 15 03:05:13.556780 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: [pid: 116157|app: 0|req: 148/323] 10.222.0.18 () {60 vars in 1146 bytes} [Wed Dec 15 03:05:12 2021] POST /compute/v2.1/servers => generated 380 bytes in 596 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Dec 15 03:05:13.567359 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi [None req-364b13ab-5c97-44d9-b76f-0cf92637b163 tempest-VolumesActionsTest-1837279088 tempest-VolumesActionsTest-1837279088-project] Calling method '>' {{(pid=116157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:05:13.567985 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.compute.api [None req-364b13ab-5c97-44d9-b76f-0cf92637b163 tempest-VolumesActionsTest-1837279088 tempest-VolumesActionsTest-1837279088-project] [instance: 41e95883-9297-4d1d-b0aa-33068fb973cd] Fetching instance by UUID {{(pid=116157) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:05:13.638784 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.policy [None req-364b13ab-5c97-44d9-b76f-0cf92637b163 tempest-VolumesActionsTest-1837279088 tempest-VolumesActionsTest-1837279088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e440754469c4407840a651d560ce08a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6eaf458d3c84ba59b078dc0a3bf1763', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116157) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:05:13.648817 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: INFO nova.api.openstack.requestlog [None req-364b13ab-5c97-44d9-b76f-0cf92637b163 tempest-VolumesActionsTest-1837279088 tempest-VolumesActionsTest-1837279088-project] 10.222.0.18 "GET /compute/v2.1/servers/41e95883-9297-4d1d-b0aa-33068fb973cd" status: 200 len: 1214 microversion: 2.1 time: 0.085956 Dec 15 03:05:13.655104 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: [pid: 116157|app: 0|req: 149/324] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 03:05:13 2021] GET /compute/v2.1/servers/41e95883-9297-4d1d-b0aa-33068fb973cd => generated 1214 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 03:05:13.681894 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.policy [None req-16851581-f27d-498e-b045-95d2b823c316 tempest-ServerRescueNegativeTestJSON-2061875223 tempest-ServerRescueNegativeTestJSON-2061875223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ea02b6e8f1548a1bd78952cb7337403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5e8a958d4bf43868502b13728b9583b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116156) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:05:13.692287 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: INFO nova.api.openstack.requestlog [None req-16851581-f27d-498e-b045-95d2b823c316 tempest-ServerRescueNegativeTestJSON-2061875223 tempest-ServerRescueNegativeTestJSON-2061875223-project] 10.222.0.18 "GET /compute/v2.1/servers/9bbb0abf-72a3-4fbc-8235-7a3ecfc8d006" status: 200 len: 1509 microversion: 2.1 time: 0.201114 Dec 15 03:05:13.692707 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: [pid: 116156|app: 0|req: 176/325] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 03:05:13 2021] GET /compute/v2.1/servers/9bbb0abf-72a3-4fbc-8235-7a3ecfc8d006 => generated 1509 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 03:05:13.710200 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi [None req-49574b84-6b7c-4872-a39c-3d5c6164c0b8 tempest-AttachVolumeNegativeTest-1640336653 tempest-AttachVolumeNegativeTest-1640336653-project] Calling method '>' {{(pid=116157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:05:13.711247 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.compute.api [None req-49574b84-6b7c-4872-a39c-3d5c6164c0b8 tempest-AttachVolumeNegativeTest-1640336653 tempest-AttachVolumeNegativeTest-1640336653-project] [instance: c3d5f143-e994-4098-989b-660411a8dd8f] Fetching instance by UUID {{(pid=116157) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:05:13.719782 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-49574b84-6b7c-4872-a39c-3d5c6164c0b8 tempest-AttachVolumeNegativeTest-1640336653 tempest-AttachVolumeNegativeTest-1640336653-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:05:13.720413 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-49574b84-6b7c-4872-a39c-3d5c6164c0b8 tempest-AttachVolumeNegativeTest-1640336653 tempest-AttachVolumeNegativeTest-1640336653-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:05:13.721211 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-49574b84-6b7c-4872-a39c-3d5c6164c0b8 tempest-AttachVolumeNegativeTest-1640336653 tempest-AttachVolumeNegativeTest-1640336653-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:05:13.721641 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-49574b84-6b7c-4872-a39c-3d5c6164c0b8 tempest-AttachVolumeNegativeTest-1640336653 tempest-AttachVolumeNegativeTest-1640336653-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:05:13.787572 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.policy [None req-49574b84-6b7c-4872-a39c-3d5c6164c0b8 tempest-AttachVolumeNegativeTest-1640336653 tempest-AttachVolumeNegativeTest-1640336653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35d37a3d8e504b8186182468b77dd114', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '409b41637da94c469444954258444b4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116157) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:05:13.795065 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: INFO nova.api.openstack.requestlog [None req-49574b84-6b7c-4872-a39c-3d5c6164c0b8 tempest-AttachVolumeNegativeTest-1640336653 tempest-AttachVolumeNegativeTest-1640336653-project] 10.222.0.18 "GET /compute/v2.1/servers/c3d5f143-e994-4098-989b-660411a8dd8f" status: 200 len: 1270 microversion: 2.1 time: 0.089899 Dec 15 03:05:13.796120 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: [pid: 116157|app: 0|req: 150/326] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 03:05:13 2021] GET /compute/v2.1/servers/c3d5f143-e994-4098-989b-660411a8dd8f => generated 1270 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 03:05:13.895398 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi [None req-6d50bf98-dc18-47ae-8478-f5e37b5c1f4f tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116156) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 03:05:13.897123 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.compute.api [None req-6d50bf98-dc18-47ae-8478-f5e37b5c1f4f tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] [instance: b89094ac-aee1-4bd6-a33d-8c4347cebfc7] Fetching instance by UUID {{(pid=116156) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:05:13.908160 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-6d50bf98-dc18-47ae-8478-f5e37b5c1f4f tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:05:13.908617 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-6d50bf98-dc18-47ae-8478-f5e37b5c1f4f tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:05:13.909423 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-6d50bf98-dc18-47ae-8478-f5e37b5c1f4f tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:05:13.912142 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-6d50bf98-dc18-47ae-8478-f5e37b5c1f4f tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:05:14.054605 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: INFO nova.api.openstack.requestlog [None req-6d50bf98-dc18-47ae-8478-f5e37b5c1f4f tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] 10.222.0.18 "POST /compute/v2.1/servers/b89094ac-aee1-4bd6-a33d-8c4347cebfc7/action" status: 200 len: 14 microversion: 2.20 time: 0.163265 Dec 15 03:05:14.055257 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: [pid: 116156|app: 0|req: 177/327] 10.222.0.18 () {62 vars in 1318 bytes} [Wed Dec 15 03:05:13 2021] POST /compute/v2.1/servers/b89094ac-aee1-4bd6-a33d-8c4347cebfc7/action => generated 14 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 03:05:14.665528 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi [None req-f76e71d7-1f56-4a0d-b865-1e3f7d52cc89 tempest-VolumesActionsTest-1837279088 tempest-VolumesActionsTest-1837279088-project] Calling method '>' {{(pid=116157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:05:14.666171 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.compute.api [None req-f76e71d7-1f56-4a0d-b865-1e3f7d52cc89 tempest-VolumesActionsTest-1837279088 tempest-VolumesActionsTest-1837279088-project] [instance: 41e95883-9297-4d1d-b0aa-33068fb973cd] Fetching instance by UUID {{(pid=116157) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:05:14.673943 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-f76e71d7-1f56-4a0d-b865-1e3f7d52cc89 tempest-VolumesActionsTest-1837279088 tempest-VolumesActionsTest-1837279088-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:05:14.674655 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-f76e71d7-1f56-4a0d-b865-1e3f7d52cc89 tempest-VolumesActionsTest-1837279088 tempest-VolumesActionsTest-1837279088-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:05:14.675611 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-f76e71d7-1f56-4a0d-b865-1e3f7d52cc89 tempest-VolumesActionsTest-1837279088 tempest-VolumesActionsTest-1837279088-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:05:14.676209 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-f76e71d7-1f56-4a0d-b865-1e3f7d52cc89 tempest-VolumesActionsTest-1837279088 tempest-VolumesActionsTest-1837279088-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:05:14.710340 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi [None req-484c10e5-d16f-4cf0-9f0c-84c602bd5207 tempest-ServerRescueNegativeTestJSON-2061875223 tempest-ServerRescueNegativeTestJSON-2061875223-project] Calling method '>' {{(pid=116156) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:05:14.712149 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.compute.api [None req-484c10e5-d16f-4cf0-9f0c-84c602bd5207 tempest-ServerRescueNegativeTestJSON-2061875223 tempest-ServerRescueNegativeTestJSON-2061875223-project] [instance: 9bbb0abf-72a3-4fbc-8235-7a3ecfc8d006] Fetching instance by UUID {{(pid=116156) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:05:14.720387 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-484c10e5-d16f-4cf0-9f0c-84c602bd5207 tempest-ServerRescueNegativeTestJSON-2061875223 tempest-ServerRescueNegativeTestJSON-2061875223-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:05:14.721109 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-484c10e5-d16f-4cf0-9f0c-84c602bd5207 tempest-ServerRescueNegativeTestJSON-2061875223 tempest-ServerRescueNegativeTestJSON-2061875223-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:05:14.722986 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-484c10e5-d16f-4cf0-9f0c-84c602bd5207 tempest-ServerRescueNegativeTestJSON-2061875223 tempest-ServerRescueNegativeTestJSON-2061875223-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:05:14.723635 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-484c10e5-d16f-4cf0-9f0c-84c602bd5207 tempest-ServerRescueNegativeTestJSON-2061875223 tempest-ServerRescueNegativeTestJSON-2061875223-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:05:14.788948 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.policy [None req-f76e71d7-1f56-4a0d-b865-1e3f7d52cc89 tempest-VolumesActionsTest-1837279088 tempest-VolumesActionsTest-1837279088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e440754469c4407840a651d560ce08a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6eaf458d3c84ba59b078dc0a3bf1763', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116157) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:05:14.801485 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: INFO nova.api.openstack.requestlog [None req-f76e71d7-1f56-4a0d-b865-1e3f7d52cc89 tempest-VolumesActionsTest-1837279088 tempest-VolumesActionsTest-1837279088-project] 10.222.0.18 "GET /compute/v2.1/servers/41e95883-9297-4d1d-b0aa-33068fb973cd" status: 200 len: 1266 microversion: 2.1 time: 0.139071 Dec 15 03:05:14.801936 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: [pid: 116157|app: 0|req: 151/328] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 03:05:14 2021] GET /compute/v2.1/servers/41e95883-9297-4d1d-b0aa-33068fb973cd => generated 1266 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 03:05:14.813417 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi [None req-3f0d4d33-2890-44f6-a39e-587c8f98794f tempest-AttachVolumeNegativeTest-1640336653 tempest-AttachVolumeNegativeTest-1640336653-project] Calling method '>' {{(pid=116157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:05:14.814408 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.compute.api [None req-3f0d4d33-2890-44f6-a39e-587c8f98794f tempest-AttachVolumeNegativeTest-1640336653 tempest-AttachVolumeNegativeTest-1640336653-project] [instance: c3d5f143-e994-4098-989b-660411a8dd8f] Fetching instance by UUID {{(pid=116157) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:05:14.821954 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-3f0d4d33-2890-44f6-a39e-587c8f98794f tempest-AttachVolumeNegativeTest-1640336653 tempest-AttachVolumeNegativeTest-1640336653-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:05:14.822730 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-3f0d4d33-2890-44f6-a39e-587c8f98794f tempest-AttachVolumeNegativeTest-1640336653 tempest-AttachVolumeNegativeTest-1640336653-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:05:14.823531 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-3f0d4d33-2890-44f6-a39e-587c8f98794f tempest-AttachVolumeNegativeTest-1640336653 tempest-AttachVolumeNegativeTest-1640336653-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:05:14.824112 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-3f0d4d33-2890-44f6-a39e-587c8f98794f tempest-AttachVolumeNegativeTest-1640336653 tempest-AttachVolumeNegativeTest-1640336653-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:05:15.054813 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.policy [None req-484c10e5-d16f-4cf0-9f0c-84c602bd5207 tempest-ServerRescueNegativeTestJSON-2061875223 tempest-ServerRescueNegativeTestJSON-2061875223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ea02b6e8f1548a1bd78952cb7337403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5e8a958d4bf43868502b13728b9583b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116156) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:05:15.063709 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: INFO nova.api.openstack.requestlog [None req-484c10e5-d16f-4cf0-9f0c-84c602bd5207 tempest-ServerRescueNegativeTestJSON-2061875223 tempest-ServerRescueNegativeTestJSON-2061875223-project] 10.222.0.18 "GET /compute/v2.1/servers/9bbb0abf-72a3-4fbc-8235-7a3ecfc8d006" status: 200 len: 1515 microversion: 2.1 time: 0.357562 Dec 15 03:05:15.064285 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: [pid: 116156|app: 0|req: 178/329] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 03:05:14 2021] GET /compute/v2.1/servers/9bbb0abf-72a3-4fbc-8235-7a3ecfc8d006 => generated 1515 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 03:05:15.069831 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.policy [None req-3f0d4d33-2890-44f6-a39e-587c8f98794f tempest-AttachVolumeNegativeTest-1640336653 tempest-AttachVolumeNegativeTest-1640336653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35d37a3d8e504b8186182468b77dd114', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '409b41637da94c469444954258444b4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116157) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:05:15.086700 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: INFO nova.api.openstack.requestlog [None req-3f0d4d33-2890-44f6-a39e-587c8f98794f tempest-AttachVolumeNegativeTest-1640336653 tempest-AttachVolumeNegativeTest-1640336653-project] 10.222.0.18 "GET /compute/v2.1/servers/c3d5f143-e994-4098-989b-660411a8dd8f" status: 200 len: 1318 microversion: 2.1 time: 0.273427 Dec 15 03:05:15.087432 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: [pid: 116157|app: 0|req: 152/330] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 03:05:14 2021] GET /compute/v2.1/servers/c3d5f143-e994-4098-989b-660411a8dd8f => generated 1318 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 03:05:15.088226 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi [None req-338a329c-0156-4211-9656-40a4677ee827 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116156) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 03:05:15.092164 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.compute.api [None req-338a329c-0156-4211-9656-40a4677ee827 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] [instance: b89094ac-aee1-4bd6-a33d-8c4347cebfc7] Fetching instance by UUID {{(pid=116156) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:05:15.108700 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-338a329c-0156-4211-9656-40a4677ee827 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:05:15.109161 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-338a329c-0156-4211-9656-40a4677ee827 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:05:15.113240 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-338a329c-0156-4211-9656-40a4677ee827 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:05:15.113775 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-338a329c-0156-4211-9656-40a4677ee827 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:05:15.244552 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: INFO nova.api.openstack.requestlog [None req-338a329c-0156-4211-9656-40a4677ee827 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] 10.222.0.18 "POST /compute/v2.1/servers/b89094ac-aee1-4bd6-a33d-8c4347cebfc7/action" status: 200 len: 14 microversion: 2.20 time: 0.178931 Dec 15 03:05:15.245506 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: [pid: 116156|app: 0|req: 179/331] 10.222.0.18 () {62 vars in 1318 bytes} [Wed Dec 15 03:05:15 2021] POST /compute/v2.1/servers/b89094ac-aee1-4bd6-a33d-8c4347cebfc7/action => generated 14 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 03:05:15.819119 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi [None req-c927c7a6-73e9-41af-83a9-9f47c19c182a tempest-VolumesActionsTest-1837279088 tempest-VolumesActionsTest-1837279088-project] Calling method '>' {{(pid=116157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:05:15.819723 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.compute.api [None req-c927c7a6-73e9-41af-83a9-9f47c19c182a tempest-VolumesActionsTest-1837279088 tempest-VolumesActionsTest-1837279088-project] [instance: 41e95883-9297-4d1d-b0aa-33068fb973cd] Fetching instance by UUID {{(pid=116157) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:05:15.827643 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-c927c7a6-73e9-41af-83a9-9f47c19c182a tempest-VolumesActionsTest-1837279088 tempest-VolumesActionsTest-1837279088-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:05:15.828408 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-c927c7a6-73e9-41af-83a9-9f47c19c182a tempest-VolumesActionsTest-1837279088 tempest-VolumesActionsTest-1837279088-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:05:15.829395 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-c927c7a6-73e9-41af-83a9-9f47c19c182a tempest-VolumesActionsTest-1837279088 tempest-VolumesActionsTest-1837279088-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:05:15.830076 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-c927c7a6-73e9-41af-83a9-9f47c19c182a tempest-VolumesActionsTest-1837279088 tempest-VolumesActionsTest-1837279088-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:05:15.949218 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.policy [None req-c927c7a6-73e9-41af-83a9-9f47c19c182a tempest-VolumesActionsTest-1837279088 tempest-VolumesActionsTest-1837279088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e440754469c4407840a651d560ce08a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6eaf458d3c84ba59b078dc0a3bf1763', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116157) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:05:15.967368 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: INFO nova.api.openstack.requestlog [None req-c927c7a6-73e9-41af-83a9-9f47c19c182a tempest-VolumesActionsTest-1837279088 tempest-VolumesActionsTest-1837279088-project] 10.222.0.18 "GET /compute/v2.1/servers/41e95883-9297-4d1d-b0aa-33068fb973cd" status: 200 len: 1272 microversion: 2.1 time: 0.150584 Dec 15 03:05:15.968566 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: [pid: 116157|app: 0|req: 153/332] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 03:05:15 2021] GET /compute/v2.1/servers/41e95883-9297-4d1d-b0aa-33068fb973cd => generated 1272 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 03:05:16.108012 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi [None req-d2b8a5c9-2d1f-42cb-a37f-4d461e788229 tempest-AttachVolumeNegativeTest-1640336653 tempest-AttachVolumeNegativeTest-1640336653-project] Calling method '>' {{(pid=116156) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:05:16.110217 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.compute.api [None req-d2b8a5c9-2d1f-42cb-a37f-4d461e788229 tempest-AttachVolumeNegativeTest-1640336653 tempest-AttachVolumeNegativeTest-1640336653-project] [instance: c3d5f143-e994-4098-989b-660411a8dd8f] Fetching instance by UUID {{(pid=116156) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:05:16.117669 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-d2b8a5c9-2d1f-42cb-a37f-4d461e788229 tempest-AttachVolumeNegativeTest-1640336653 tempest-AttachVolumeNegativeTest-1640336653-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:05:16.118438 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-d2b8a5c9-2d1f-42cb-a37f-4d461e788229 tempest-AttachVolumeNegativeTest-1640336653 tempest-AttachVolumeNegativeTest-1640336653-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:05:16.119606 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-d2b8a5c9-2d1f-42cb-a37f-4d461e788229 tempest-AttachVolumeNegativeTest-1640336653 tempest-AttachVolumeNegativeTest-1640336653-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:05:16.121239 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-d2b8a5c9-2d1f-42cb-a37f-4d461e788229 tempest-AttachVolumeNegativeTest-1640336653 tempest-AttachVolumeNegativeTest-1640336653-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:05:16.263374 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi [None req-db738b08-9238-4c6a-8dd4-4016e5a640ce tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 03:05:16.264690 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.compute.api [None req-db738b08-9238-4c6a-8dd4-4016e5a640ce tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] [instance: b89094ac-aee1-4bd6-a33d-8c4347cebfc7] Fetching instance by UUID {{(pid=116157) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:05:16.272125 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-db738b08-9238-4c6a-8dd4-4016e5a640ce tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:05:16.272962 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-db738b08-9238-4c6a-8dd4-4016e5a640ce tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:05:16.274047 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-db738b08-9238-4c6a-8dd4-4016e5a640ce tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:05:16.274760 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-db738b08-9238-4c6a-8dd4-4016e5a640ce tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:05:16.397117 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: INFO nova.api.openstack.requestlog [None req-db738b08-9238-4c6a-8dd4-4016e5a640ce tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] 10.222.0.18 "POST /compute/v2.1/servers/b89094ac-aee1-4bd6-a33d-8c4347cebfc7/action" status: 200 len: 14 microversion: 2.20 time: 0.138013 Dec 15 03:05:16.397770 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: [pid: 116157|app: 0|req: 154/333] 10.222.0.18 () {62 vars in 1318 bytes} [Wed Dec 15 03:05:16 2021] POST /compute/v2.1/servers/b89094ac-aee1-4bd6-a33d-8c4347cebfc7/action => generated 14 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 03:05:16.428541 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi [req-d9c57e0d-a921-4e11-9d3b-f8f1daa9dc97 req-e5637a7c-2da0-4575-a3a8-609291c2a476 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c3d5f143-e994-4098-989b-660411a8dd8f", "tag": "aef969b5-d8c1-47b9-b0d3-730bcdaaea83"}]} {{(pid=116157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 03:05:16.430087 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 15 03:05:16.430087 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: warnings.warn(msg) Dec 15 03:05:16.440006 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [req-d9c57e0d-a921-4e11-9d3b-f8f1daa9dc97 req-e5637a7c-2da0-4575-a3a8-609291c2a476 service nova] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:05:16.440707 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [req-d9c57e0d-a921-4e11-9d3b-f8f1daa9dc97 req-e5637a7c-2da0-4575-a3a8-609291c2a476 service nova] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:05:16.465660 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: INFO nova.api.openstack.compute.server_external_events [req-d9c57e0d-a921-4e11-9d3b-f8f1daa9dc97 req-e5637a7c-2da0-4575-a3a8-609291c2a476 service nova] Creating event network-changed:aef969b5-d8c1-47b9-b0d3-730bcdaaea83 for instance c3d5f143-e994-4098-989b-660411a8dd8f on hv-cinder-81803 Dec 15 03:05:16.472368 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: INFO nova.api.openstack.requestlog [req-d9c57e0d-a921-4e11-9d3b-f8f1daa9dc97 req-e5637a7c-2da0-4575-a3a8-609291c2a476 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.050107 Dec 15 03:05:16.472983 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: [pid: 116157|app: 0|req: 155/334] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Dec 15 03:05:16 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 03:05:16.573205 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.policy [None req-d2b8a5c9-2d1f-42cb-a37f-4d461e788229 tempest-AttachVolumeNegativeTest-1640336653 tempest-AttachVolumeNegativeTest-1640336653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35d37a3d8e504b8186182468b77dd114', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '409b41637da94c469444954258444b4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116156) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:05:16.576118 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi [None req-daaa750e-a469-4796-b363-92216a3f4fdf tempest-ServerRescueNegativeTestJSON-2061875223 tempest-ServerRescueNegativeTestJSON-2061875223-project] Calling method '>' {{(pid=116157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:05:16.576812 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.compute.api [None req-daaa750e-a469-4796-b363-92216a3f4fdf tempest-ServerRescueNegativeTestJSON-2061875223 tempest-ServerRescueNegativeTestJSON-2061875223-project] [instance: 9bbb0abf-72a3-4fbc-8235-7a3ecfc8d006] Fetching instance by UUID {{(pid=116157) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:05:16.581503 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: INFO nova.api.openstack.requestlog [None req-d2b8a5c9-2d1f-42cb-a37f-4d461e788229 tempest-AttachVolumeNegativeTest-1640336653 tempest-AttachVolumeNegativeTest-1640336653-project] 10.222.0.18 "GET /compute/v2.1/servers/c3d5f143-e994-4098-989b-660411a8dd8f" status: 200 len: 1318 microversion: 2.1 time: 0.480235 Dec 15 03:05:16.591111 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-daaa750e-a469-4796-b363-92216a3f4fdf tempest-ServerRescueNegativeTestJSON-2061875223 tempest-ServerRescueNegativeTestJSON-2061875223-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:05:16.591111 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-daaa750e-a469-4796-b363-92216a3f4fdf tempest-ServerRescueNegativeTestJSON-2061875223 tempest-ServerRescueNegativeTestJSON-2061875223-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:05:16.591111 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-daaa750e-a469-4796-b363-92216a3f4fdf tempest-ServerRescueNegativeTestJSON-2061875223 tempest-ServerRescueNegativeTestJSON-2061875223-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:05:16.591111 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-daaa750e-a469-4796-b363-92216a3f4fdf tempest-ServerRescueNegativeTestJSON-2061875223 tempest-ServerRescueNegativeTestJSON-2061875223-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:05:16.592049 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: [pid: 116156|app: 0|req: 180/335] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 03:05:16 2021] GET /compute/v2.1/servers/c3d5f143-e994-4098-989b-660411a8dd8f => generated 1318 bytes in 492 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 03:05:16.833011 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.policy [None req-daaa750e-a469-4796-b363-92216a3f4fdf tempest-ServerRescueNegativeTestJSON-2061875223 tempest-ServerRescueNegativeTestJSON-2061875223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ea02b6e8f1548a1bd78952cb7337403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5e8a958d4bf43868502b13728b9583b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116157) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:05:16.843372 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: INFO nova.api.openstack.requestlog [None req-daaa750e-a469-4796-b363-92216a3f4fdf tempest-ServerRescueNegativeTestJSON-2061875223 tempest-ServerRescueNegativeTestJSON-2061875223-project] 10.222.0.18 "GET /compute/v2.1/servers/9bbb0abf-72a3-4fbc-8235-7a3ecfc8d006" status: 200 len: 1515 microversion: 2.1 time: 0.272450 Dec 15 03:05:16.844758 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: [pid: 116157|app: 0|req: 156/336] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 03:05:16 2021] GET /compute/v2.1/servers/9bbb0abf-72a3-4fbc-8235-7a3ecfc8d006 => generated 1515 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 03:05:16.862457 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi [None req-756dc67e-22cd-4e1c-9866-dfe77f0c2783 tempest-ServerRescueNegativeTestJSON-2061875223 tempest-ServerRescueNegativeTestJSON-2061875223-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "7302346f-6ff9-4a17-b652-4ae95283118d"}} {{(pid=116156) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 03:05:16.863866 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.compute.api [None req-756dc67e-22cd-4e1c-9866-dfe77f0c2783 tempest-ServerRescueNegativeTestJSON-2061875223 tempest-ServerRescueNegativeTestJSON-2061875223-project] [instance: 9bbb0abf-72a3-4fbc-8235-7a3ecfc8d006] Fetching instance by UUID {{(pid=116156) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:05:16.984728 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi [None req-82a88ab6-e139-4057-93d4-082d33688f10 tempest-VolumesActionsTest-1837279088 tempest-VolumesActionsTest-1837279088-project] Calling method '>' {{(pid=116157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:05:16.986234 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.compute.api [None req-82a88ab6-e139-4057-93d4-082d33688f10 tempest-VolumesActionsTest-1837279088 tempest-VolumesActionsTest-1837279088-project] [instance: 41e95883-9297-4d1d-b0aa-33068fb973cd] Fetching instance by UUID {{(pid=116157) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:05:16.995072 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-82a88ab6-e139-4057-93d4-082d33688f10 tempest-VolumesActionsTest-1837279088 tempest-VolumesActionsTest-1837279088-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:05:16.995572 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-82a88ab6-e139-4057-93d4-082d33688f10 tempest-VolumesActionsTest-1837279088 tempest-VolumesActionsTest-1837279088-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:05:17.006082 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-82a88ab6-e139-4057-93d4-082d33688f10 tempest-VolumesActionsTest-1837279088 tempest-VolumesActionsTest-1837279088-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:05:17.007416 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-82a88ab6-e139-4057-93d4-082d33688f10 tempest-VolumesActionsTest-1837279088 tempest-VolumesActionsTest-1837279088-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:05:17.021306 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-756dc67e-22cd-4e1c-9866-dfe77f0c2783 tempest-ServerRescueNegativeTestJSON-2061875223 tempest-ServerRescueNegativeTestJSON-2061875223-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:05:17.021663 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-756dc67e-22cd-4e1c-9866-dfe77f0c2783 tempest-ServerRescueNegativeTestJSON-2061875223 tempest-ServerRescueNegativeTestJSON-2061875223-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:05:17.022724 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-756dc67e-22cd-4e1c-9866-dfe77f0c2783 tempest-ServerRescueNegativeTestJSON-2061875223 tempest-ServerRescueNegativeTestJSON-2061875223-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:05:17.023353 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-756dc67e-22cd-4e1c-9866-dfe77f0c2783 tempest-ServerRescueNegativeTestJSON-2061875223 tempest-ServerRescueNegativeTestJSON-2061875223-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:05:17.356138 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.policy [None req-82a88ab6-e139-4057-93d4-082d33688f10 tempest-VolumesActionsTest-1837279088 tempest-VolumesActionsTest-1837279088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e440754469c4407840a651d560ce08a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6eaf458d3c84ba59b078dc0a3bf1763', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116157) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:05:17.368219 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: INFO nova.api.openstack.requestlog [None req-82a88ab6-e139-4057-93d4-082d33688f10 tempest-VolumesActionsTest-1837279088 tempest-VolumesActionsTest-1837279088-project] 10.222.0.18 "GET /compute/v2.1/servers/41e95883-9297-4d1d-b0aa-33068fb973cd" status: 200 len: 1314 microversion: 2.1 time: 0.387181 Dec 15 03:05:17.369453 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: [pid: 116157|app: 0|req: 157/337] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 03:05:16 2021] GET /compute/v2.1/servers/41e95883-9297-4d1d-b0aa-33068fb973cd => generated 1314 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 03:05:17.378440 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi [req-f8afa6ff-9312-4b2d-9075-a030b8184101 req-276ac62e-f7f7-4247-8ea4-31200bb51377 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "41e95883-9297-4d1d-b0aa-33068fb973cd", "tag": "76776ba9-43a4-48a7-a30a-4a65d48d1ce7"}]} {{(pid=116157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 03:05:17.380427 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 15 03:05:17.380427 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: warnings.warn(msg) Dec 15 03:05:17.396586 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [req-f8afa6ff-9312-4b2d-9075-a030b8184101 req-276ac62e-f7f7-4247-8ea4-31200bb51377 service nova] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:05:17.397340 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [req-f8afa6ff-9312-4b2d-9075-a030b8184101 req-276ac62e-f7f7-4247-8ea4-31200bb51377 service nova] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:05:17.405166 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: INFO nova.api.openstack.requestlog [None req-756dc67e-22cd-4e1c-9866-dfe77f0c2783 tempest-ServerRescueNegativeTestJSON-2061875223 tempest-ServerRescueNegativeTestJSON-2061875223-project] 10.222.0.18 "POST /compute/v2.1/servers/9bbb0abf-72a3-4fbc-8235-7a3ecfc8d006/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.547970 Dec 15 03:05:17.407709 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: [pid: 116156|app: 0|req: 181/338] 10.222.0.18 () {60 vars in 1322 bytes} [Wed Dec 15 03:05:16 2021] POST /compute/v2.1/servers/9bbb0abf-72a3-4fbc-8235-7a3ecfc8d006/os-volume_attachments => generated 194 bytes in 551 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 03:05:17.416859 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi [None req-6e172b19-3615-423d-ae9c-6cc4ccb923aa tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116156) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 03:05:17.418363 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.compute.api [None req-6e172b19-3615-423d-ae9c-6cc4ccb923aa tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] [instance: b89094ac-aee1-4bd6-a33d-8c4347cebfc7] Fetching instance by UUID {{(pid=116156) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:05:17.432357 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-6e172b19-3615-423d-ae9c-6cc4ccb923aa tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:05:17.435028 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-6e172b19-3615-423d-ae9c-6cc4ccb923aa tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:05:17.438236 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-6e172b19-3615-423d-ae9c-6cc4ccb923aa tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:05:17.441443 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-6e172b19-3615-423d-ae9c-6cc4ccb923aa tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:05:17.443880 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: INFO nova.api.openstack.compute.server_external_events [req-f8afa6ff-9312-4b2d-9075-a030b8184101 req-276ac62e-f7f7-4247-8ea4-31200bb51377 service nova] Creating event network-changed:76776ba9-43a4-48a7-a30a-4a65d48d1ce7 for instance 41e95883-9297-4d1d-b0aa-33068fb973cd on hv-cinder-81803 Dec 15 03:05:17.465431 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: INFO nova.api.openstack.requestlog [req-f8afa6ff-9312-4b2d-9075-a030b8184101 req-276ac62e-f7f7-4247-8ea4-31200bb51377 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.092300 Dec 15 03:05:17.469698 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: [pid: 116157|app: 0|req: 158/339] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Dec 15 03:05:17 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 03:05:17.603380 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: INFO nova.api.openstack.requestlog [None req-6e172b19-3615-423d-ae9c-6cc4ccb923aa tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] 10.222.0.18 "POST /compute/v2.1/servers/b89094ac-aee1-4bd6-a33d-8c4347cebfc7/action" status: 200 len: 14 microversion: 2.20 time: 0.193767 Dec 15 03:05:17.606610 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: [pid: 116156|app: 0|req: 182/340] 10.222.0.18 () {62 vars in 1318 bytes} [Wed Dec 15 03:05:17 2021] POST /compute/v2.1/servers/b89094ac-aee1-4bd6-a33d-8c4347cebfc7/action => generated 14 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 03:05:17.624205 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi [None req-dd934a68-fcef-4af0-9296-050162192ab2 tempest-AttachVolumeNegativeTest-1640336653 tempest-AttachVolumeNegativeTest-1640336653-project] Calling method '>' {{(pid=116157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:05:17.631728 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.compute.api [None req-dd934a68-fcef-4af0-9296-050162192ab2 tempest-AttachVolumeNegativeTest-1640336653 tempest-AttachVolumeNegativeTest-1640336653-project] [instance: c3d5f143-e994-4098-989b-660411a8dd8f] Fetching instance by UUID {{(pid=116157) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:05:17.655093 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-dd934a68-fcef-4af0-9296-050162192ab2 tempest-AttachVolumeNegativeTest-1640336653 tempest-AttachVolumeNegativeTest-1640336653-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:05:17.655885 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-dd934a68-fcef-4af0-9296-050162192ab2 tempest-AttachVolumeNegativeTest-1640336653 tempest-AttachVolumeNegativeTest-1640336653-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:05:17.657253 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-dd934a68-fcef-4af0-9296-050162192ab2 tempest-AttachVolumeNegativeTest-1640336653 tempest-AttachVolumeNegativeTest-1640336653-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:05:17.663566 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-dd934a68-fcef-4af0-9296-050162192ab2 tempest-AttachVolumeNegativeTest-1640336653 tempest-AttachVolumeNegativeTest-1640336653-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:05:17.917102 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.policy [None req-dd934a68-fcef-4af0-9296-050162192ab2 tempest-AttachVolumeNegativeTest-1640336653 tempest-AttachVolumeNegativeTest-1640336653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35d37a3d8e504b8186182468b77dd114', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '409b41637da94c469444954258444b4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116157) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:05:17.927181 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: INFO nova.api.openstack.requestlog [None req-dd934a68-fcef-4af0-9296-050162192ab2 tempest-AttachVolumeNegativeTest-1640336653 tempest-AttachVolumeNegativeTest-1640336653-project] 10.222.0.18 "GET /compute/v2.1/servers/c3d5f143-e994-4098-989b-660411a8dd8f" status: 200 len: 1318 microversion: 2.1 time: 0.331130 Dec 15 03:05:17.927844 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: [pid: 116157|app: 0|req: 159/341] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 03:05:17 2021] GET /compute/v2.1/servers/c3d5f143-e994-4098-989b-660411a8dd8f => generated 1318 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 03:05:18.386650 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi [None req-07bcc07f-1ed7-4649-a6cc-02118c11a0c1 tempest-VolumesActionsTest-1837279088 tempest-VolumesActionsTest-1837279088-project] Calling method '>' {{(pid=116156) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:05:18.387354 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.compute.api [None req-07bcc07f-1ed7-4649-a6cc-02118c11a0c1 tempest-VolumesActionsTest-1837279088 tempest-VolumesActionsTest-1837279088-project] [instance: 41e95883-9297-4d1d-b0aa-33068fb973cd] Fetching instance by UUID {{(pid=116156) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:05:18.394814 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-07bcc07f-1ed7-4649-a6cc-02118c11a0c1 tempest-VolumesActionsTest-1837279088 tempest-VolumesActionsTest-1837279088-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:05:18.395266 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-07bcc07f-1ed7-4649-a6cc-02118c11a0c1 tempest-VolumesActionsTest-1837279088 tempest-VolumesActionsTest-1837279088-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:05:18.396107 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-07bcc07f-1ed7-4649-a6cc-02118c11a0c1 tempest-VolumesActionsTest-1837279088 tempest-VolumesActionsTest-1837279088-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:05:18.396540 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-07bcc07f-1ed7-4649-a6cc-02118c11a0c1 tempest-VolumesActionsTest-1837279088 tempest-VolumesActionsTest-1837279088-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:05:18.614209 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi [None req-ff2de359-7ac7-46f6-9ac6-19db4d641e59 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 03:05:18.615446 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.compute.api [None req-ff2de359-7ac7-46f6-9ac6-19db4d641e59 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] [instance: b89094ac-aee1-4bd6-a33d-8c4347cebfc7] Fetching instance by UUID {{(pid=116157) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:05:18.628330 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-ff2de359-7ac7-46f6-9ac6-19db4d641e59 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:05:18.631543 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-ff2de359-7ac7-46f6-9ac6-19db4d641e59 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:05:18.635068 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-ff2de359-7ac7-46f6-9ac6-19db4d641e59 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:05:18.635571 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-ff2de359-7ac7-46f6-9ac6-19db4d641e59 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:05:18.661751 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.policy [None req-07bcc07f-1ed7-4649-a6cc-02118c11a0c1 tempest-VolumesActionsTest-1837279088 tempest-VolumesActionsTest-1837279088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e440754469c4407840a651d560ce08a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6eaf458d3c84ba59b078dc0a3bf1763', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116156) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:05:18.673749 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: INFO nova.api.openstack.requestlog [None req-07bcc07f-1ed7-4649-a6cc-02118c11a0c1 tempest-VolumesActionsTest-1837279088 tempest-VolumesActionsTest-1837279088-project] 10.222.0.18 "GET /compute/v2.1/servers/41e95883-9297-4d1d-b0aa-33068fb973cd" status: 200 len: 1314 microversion: 2.1 time: 0.290657 Dec 15 03:05:18.674293 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: [pid: 116156|app: 0|req: 183/342] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 03:05:18 2021] GET /compute/v2.1/servers/41e95883-9297-4d1d-b0aa-33068fb973cd => generated 1314 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 03:05:18.776689 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: INFO nova.api.openstack.requestlog [None req-ff2de359-7ac7-46f6-9ac6-19db4d641e59 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] 10.222.0.18 "POST /compute/v2.1/servers/b89094ac-aee1-4bd6-a33d-8c4347cebfc7/action" status: 200 len: 14 microversion: 2.20 time: 0.165826 Dec 15 03:05:18.779134 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: [pid: 116157|app: 0|req: 160/343] 10.222.0.18 () {62 vars in 1318 bytes} [Wed Dec 15 03:05:18 2021] POST /compute/v2.1/servers/b89094ac-aee1-4bd6-a33d-8c4347cebfc7/action => generated 14 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 03:05:18.943908 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi [None req-8656184c-d87d-4b06-9a4c-c5fb73c459a5 tempest-AttachVolumeNegativeTest-1640336653 tempest-AttachVolumeNegativeTest-1640336653-project] Calling method '>' {{(pid=116156) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:05:18.944438 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.compute.api [None req-8656184c-d87d-4b06-9a4c-c5fb73c459a5 tempest-AttachVolumeNegativeTest-1640336653 tempest-AttachVolumeNegativeTest-1640336653-project] [instance: c3d5f143-e994-4098-989b-660411a8dd8f] Fetching instance by UUID {{(pid=116156) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:05:18.951372 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-8656184c-d87d-4b06-9a4c-c5fb73c459a5 tempest-AttachVolumeNegativeTest-1640336653 tempest-AttachVolumeNegativeTest-1640336653-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:05:18.951840 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-8656184c-d87d-4b06-9a4c-c5fb73c459a5 tempest-AttachVolumeNegativeTest-1640336653 tempest-AttachVolumeNegativeTest-1640336653-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:05:18.952629 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-8656184c-d87d-4b06-9a4c-c5fb73c459a5 tempest-AttachVolumeNegativeTest-1640336653 tempest-AttachVolumeNegativeTest-1640336653-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:05:18.953067 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-8656184c-d87d-4b06-9a4c-c5fb73c459a5 tempest-AttachVolumeNegativeTest-1640336653 tempest-AttachVolumeNegativeTest-1640336653-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:05:19.097422 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.policy [None req-8656184c-d87d-4b06-9a4c-c5fb73c459a5 tempest-AttachVolumeNegativeTest-1640336653 tempest-AttachVolumeNegativeTest-1640336653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35d37a3d8e504b8186182468b77dd114', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '409b41637da94c469444954258444b4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116156) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:05:19.104946 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: INFO nova.api.openstack.requestlog [None req-8656184c-d87d-4b06-9a4c-c5fb73c459a5 tempest-AttachVolumeNegativeTest-1640336653 tempest-AttachVolumeNegativeTest-1640336653-project] 10.222.0.18 "GET /compute/v2.1/servers/c3d5f143-e994-4098-989b-660411a8dd8f" status: 200 len: 1318 microversion: 2.1 time: 0.164869 Dec 15 03:05:19.105530 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: [pid: 116156|app: 0|req: 184/344] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 03:05:18 2021] GET /compute/v2.1/servers/c3d5f143-e994-4098-989b-660411a8dd8f => generated 1318 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 03:05:19.690791 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi [None req-36a9526e-b8dc-4dd3-a277-914b0eaa1675 tempest-VolumesActionsTest-1837279088 tempest-VolumesActionsTest-1837279088-project] Calling method '>' {{(pid=116157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:05:19.691557 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.compute.api [None req-36a9526e-b8dc-4dd3-a277-914b0eaa1675 tempest-VolumesActionsTest-1837279088 tempest-VolumesActionsTest-1837279088-project] [instance: 41e95883-9297-4d1d-b0aa-33068fb973cd] Fetching instance by UUID {{(pid=116157) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:05:19.700460 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-36a9526e-b8dc-4dd3-a277-914b0eaa1675 tempest-VolumesActionsTest-1837279088 tempest-VolumesActionsTest-1837279088-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:05:19.700805 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-36a9526e-b8dc-4dd3-a277-914b0eaa1675 tempest-VolumesActionsTest-1837279088 tempest-VolumesActionsTest-1837279088-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:05:19.701604 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-36a9526e-b8dc-4dd3-a277-914b0eaa1675 tempest-VolumesActionsTest-1837279088 tempest-VolumesActionsTest-1837279088-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:05:19.702071 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-36a9526e-b8dc-4dd3-a277-914b0eaa1675 tempest-VolumesActionsTest-1837279088 tempest-VolumesActionsTest-1837279088-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:05:19.794248 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi [None req-3790abc8-9cd1-4b66-987e-59c8c086ab5f tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116156) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 03:05:19.795471 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.compute.api [None req-3790abc8-9cd1-4b66-987e-59c8c086ab5f tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] [instance: b89094ac-aee1-4bd6-a33d-8c4347cebfc7] Fetching instance by UUID {{(pid=116156) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:05:19.808030 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-3790abc8-9cd1-4b66-987e-59c8c086ab5f tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:05:19.808487 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-3790abc8-9cd1-4b66-987e-59c8c086ab5f tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:05:19.809287 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-3790abc8-9cd1-4b66-987e-59c8c086ab5f tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:05:19.809730 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-3790abc8-9cd1-4b66-987e-59c8c086ab5f tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:05:19.864347 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.policy [None req-36a9526e-b8dc-4dd3-a277-914b0eaa1675 tempest-VolumesActionsTest-1837279088 tempest-VolumesActionsTest-1837279088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e440754469c4407840a651d560ce08a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6eaf458d3c84ba59b078dc0a3bf1763', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116157) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:05:19.872201 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: INFO nova.api.openstack.requestlog [None req-36a9526e-b8dc-4dd3-a277-914b0eaa1675 tempest-VolumesActionsTest-1837279088 tempest-VolumesActionsTest-1837279088-project] 10.222.0.18 "GET /compute/v2.1/servers/41e95883-9297-4d1d-b0aa-33068fb973cd" status: 200 len: 1314 microversion: 2.1 time: 0.185434 Dec 15 03:05:19.872767 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: [pid: 116157|app: 0|req: 161/345] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 03:05:19 2021] GET /compute/v2.1/servers/41e95883-9297-4d1d-b0aa-33068fb973cd => generated 1314 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 03:05:19.917108 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: INFO nova.api.openstack.requestlog [None req-3790abc8-9cd1-4b66-987e-59c8c086ab5f tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] 10.222.0.18 "POST /compute/v2.1/servers/b89094ac-aee1-4bd6-a33d-8c4347cebfc7/action" status: 200 len: 14 microversion: 2.20 time: 0.131806 Dec 15 03:05:19.917650 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: [pid: 116156|app: 0|req: 185/346] 10.222.0.18 () {62 vars in 1318 bytes} [Wed Dec 15 03:05:19 2021] POST /compute/v2.1/servers/b89094ac-aee1-4bd6-a33d-8c4347cebfc7/action => generated 14 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 03:05:20.122823 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi [None req-b68d7c40-bce5-460e-8ac2-8d12a11a835e tempest-AttachVolumeNegativeTest-1640336653 tempest-AttachVolumeNegativeTest-1640336653-project] Calling method '>' {{(pid=116157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:05:20.123435 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.compute.api [None req-b68d7c40-bce5-460e-8ac2-8d12a11a835e tempest-AttachVolumeNegativeTest-1640336653 tempest-AttachVolumeNegativeTest-1640336653-project] [instance: c3d5f143-e994-4098-989b-660411a8dd8f] Fetching instance by UUID {{(pid=116157) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:05:20.130210 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-b68d7c40-bce5-460e-8ac2-8d12a11a835e tempest-AttachVolumeNegativeTest-1640336653 tempest-AttachVolumeNegativeTest-1640336653-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:05:20.130664 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-b68d7c40-bce5-460e-8ac2-8d12a11a835e tempest-AttachVolumeNegativeTest-1640336653 tempest-AttachVolumeNegativeTest-1640336653-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:05:20.131460 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-b68d7c40-bce5-460e-8ac2-8d12a11a835e tempest-AttachVolumeNegativeTest-1640336653 tempest-AttachVolumeNegativeTest-1640336653-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:05:20.131900 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-b68d7c40-bce5-460e-8ac2-8d12a11a835e tempest-AttachVolumeNegativeTest-1640336653 tempest-AttachVolumeNegativeTest-1640336653-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:05:20.260468 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.policy [None req-b68d7c40-bce5-460e-8ac2-8d12a11a835e tempest-AttachVolumeNegativeTest-1640336653 tempest-AttachVolumeNegativeTest-1640336653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35d37a3d8e504b8186182468b77dd114', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '409b41637da94c469444954258444b4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116157) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:05:20.268208 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: INFO nova.api.openstack.requestlog [None req-b68d7c40-bce5-460e-8ac2-8d12a11a835e tempest-AttachVolumeNegativeTest-1640336653 tempest-AttachVolumeNegativeTest-1640336653-project] 10.222.0.18 "GET /compute/v2.1/servers/c3d5f143-e994-4098-989b-660411a8dd8f" status: 200 len: 1318 microversion: 2.1 time: 0.149825 Dec 15 03:05:20.268770 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: [pid: 116157|app: 0|req: 162/347] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 03:05:20 2021] GET /compute/v2.1/servers/c3d5f143-e994-4098-989b-660411a8dd8f => generated 1318 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 03:05:20.888661 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi [None req-0e991fcd-0d44-4c2e-9e5f-049af298820f tempest-VolumesActionsTest-1837279088 tempest-VolumesActionsTest-1837279088-project] Calling method '>' {{(pid=116156) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:05:20.889359 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.compute.api [None req-0e991fcd-0d44-4c2e-9e5f-049af298820f tempest-VolumesActionsTest-1837279088 tempest-VolumesActionsTest-1837279088-project] [instance: 41e95883-9297-4d1d-b0aa-33068fb973cd] Fetching instance by UUID {{(pid=116156) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:05:20.896067 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-0e991fcd-0d44-4c2e-9e5f-049af298820f tempest-VolumesActionsTest-1837279088 tempest-VolumesActionsTest-1837279088-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:05:20.896518 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-0e991fcd-0d44-4c2e-9e5f-049af298820f tempest-VolumesActionsTest-1837279088 tempest-VolumesActionsTest-1837279088-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:05:20.897294 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-0e991fcd-0d44-4c2e-9e5f-049af298820f tempest-VolumesActionsTest-1837279088 tempest-VolumesActionsTest-1837279088-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:05:20.897734 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-0e991fcd-0d44-4c2e-9e5f-049af298820f tempest-VolumesActionsTest-1837279088 tempest-VolumesActionsTest-1837279088-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:05:20.928084 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi [None req-05ed8cc8-789e-4fdf-9d58-52a880373ccf tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 03:05:20.929015 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.compute.api [None req-05ed8cc8-789e-4fdf-9d58-52a880373ccf tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] [instance: b89094ac-aee1-4bd6-a33d-8c4347cebfc7] Fetching instance by UUID {{(pid=116157) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:05:20.935247 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-05ed8cc8-789e-4fdf-9d58-52a880373ccf tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:05:20.935698 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-05ed8cc8-789e-4fdf-9d58-52a880373ccf tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:05:20.936479 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-05ed8cc8-789e-4fdf-9d58-52a880373ccf tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:05:20.936908 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-05ed8cc8-789e-4fdf-9d58-52a880373ccf tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:05:21.029560 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.policy [None req-0e991fcd-0d44-4c2e-9e5f-049af298820f tempest-VolumesActionsTest-1837279088 tempest-VolumesActionsTest-1837279088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e440754469c4407840a651d560ce08a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6eaf458d3c84ba59b078dc0a3bf1763', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116156) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:05:21.037088 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: INFO nova.api.openstack.requestlog [None req-0e991fcd-0d44-4c2e-9e5f-049af298820f tempest-VolumesActionsTest-1837279088 tempest-VolumesActionsTest-1837279088-project] 10.222.0.18 "GET /compute/v2.1/servers/41e95883-9297-4d1d-b0aa-33068fb973cd" status: 200 len: 1314 microversion: 2.1 time: 0.152335 Dec 15 03:05:21.037645 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: [pid: 116156|app: 0|req: 186/348] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 03:05:20 2021] GET /compute/v2.1/servers/41e95883-9297-4d1d-b0aa-33068fb973cd => generated 1314 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 03:05:21.284529 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi [None req-adcb45fb-0fe6-491a-acc7-9f8273d4d4d7 tempest-AttachVolumeNegativeTest-1640336653 tempest-AttachVolumeNegativeTest-1640336653-project] Calling method '>' {{(pid=116156) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:05:21.285140 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.compute.api [None req-adcb45fb-0fe6-491a-acc7-9f8273d4d4d7 tempest-AttachVolumeNegativeTest-1640336653 tempest-AttachVolumeNegativeTest-1640336653-project] [instance: c3d5f143-e994-4098-989b-660411a8dd8f] Fetching instance by UUID {{(pid=116156) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:05:21.291400 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-adcb45fb-0fe6-491a-acc7-9f8273d4d4d7 tempest-AttachVolumeNegativeTest-1640336653 tempest-AttachVolumeNegativeTest-1640336653-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:05:21.291848 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-adcb45fb-0fe6-491a-acc7-9f8273d4d4d7 tempest-AttachVolumeNegativeTest-1640336653 tempest-AttachVolumeNegativeTest-1640336653-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:05:21.292623 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-adcb45fb-0fe6-491a-acc7-9f8273d4d4d7 tempest-AttachVolumeNegativeTest-1640336653 tempest-AttachVolumeNegativeTest-1640336653-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:05:21.293060 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-adcb45fb-0fe6-491a-acc7-9f8273d4d4d7 tempest-AttachVolumeNegativeTest-1640336653 tempest-AttachVolumeNegativeTest-1640336653-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:05:21.425211 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.policy [None req-adcb45fb-0fe6-491a-acc7-9f8273d4d4d7 tempest-AttachVolumeNegativeTest-1640336653 tempest-AttachVolumeNegativeTest-1640336653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35d37a3d8e504b8186182468b77dd114', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '409b41637da94c469444954258444b4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116156) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:05:21.432259 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: INFO nova.api.openstack.requestlog [None req-adcb45fb-0fe6-491a-acc7-9f8273d4d4d7 tempest-AttachVolumeNegativeTest-1640336653 tempest-AttachVolumeNegativeTest-1640336653-project] 10.222.0.18 "GET /compute/v2.1/servers/c3d5f143-e994-4098-989b-660411a8dd8f" status: 200 len: 1318 microversion: 2.1 time: 0.151468 Dec 15 03:05:21.432807 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: [pid: 116156|app: 0|req: 187/349] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 03:05:21 2021] GET /compute/v2.1/servers/c3d5f143-e994-4098-989b-660411a8dd8f => generated 1318 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 03:05:22.053160 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi [None req-0ebf9d5a-449c-4877-882c-67a806d3a271 tempest-VolumesActionsTest-1837279088 tempest-VolumesActionsTest-1837279088-project] Calling method '>' {{(pid=116156) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:05:22.053768 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.compute.api [None req-0ebf9d5a-449c-4877-882c-67a806d3a271 tempest-VolumesActionsTest-1837279088 tempest-VolumesActionsTest-1837279088-project] [instance: 41e95883-9297-4d1d-b0aa-33068fb973cd] Fetching instance by UUID {{(pid=116156) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:05:22.059869 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-0ebf9d5a-449c-4877-882c-67a806d3a271 tempest-VolumesActionsTest-1837279088 tempest-VolumesActionsTest-1837279088-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:05:22.060317 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-0ebf9d5a-449c-4877-882c-67a806d3a271 tempest-VolumesActionsTest-1837279088 tempest-VolumesActionsTest-1837279088-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:05:22.061081 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-0ebf9d5a-449c-4877-882c-67a806d3a271 tempest-VolumesActionsTest-1837279088 tempest-VolumesActionsTest-1837279088-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:05:22.061509 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-0ebf9d5a-449c-4877-882c-67a806d3a271 tempest-VolumesActionsTest-1837279088 tempest-VolumesActionsTest-1837279088-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:05:22.190584 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.policy [None req-0ebf9d5a-449c-4877-882c-67a806d3a271 tempest-VolumesActionsTest-1837279088 tempest-VolumesActionsTest-1837279088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e440754469c4407840a651d560ce08a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6eaf458d3c84ba59b078dc0a3bf1763', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116156) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:05:22.202328 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: INFO nova.api.openstack.requestlog [None req-0ebf9d5a-449c-4877-882c-67a806d3a271 tempest-VolumesActionsTest-1837279088 tempest-VolumesActionsTest-1837279088-project] 10.222.0.18 "GET /compute/v2.1/servers/41e95883-9297-4d1d-b0aa-33068fb973cd" status: 200 len: 1314 microversion: 2.1 time: 0.148366 Dec 15 03:05:22.202328 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: [pid: 116156|app: 0|req: 188/350] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 03:05:22 2021] GET /compute/v2.1/servers/41e95883-9297-4d1d-b0aa-33068fb973cd => generated 1314 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 03:05:22.448988 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi [None req-74ed43e2-a8e9-4bc0-9f49-6e41e39b0691 tempest-AttachVolumeNegativeTest-1640336653 tempest-AttachVolumeNegativeTest-1640336653-project] Calling method '>' {{(pid=116156) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:05:22.449502 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.compute.api [None req-74ed43e2-a8e9-4bc0-9f49-6e41e39b0691 tempest-AttachVolumeNegativeTest-1640336653 tempest-AttachVolumeNegativeTest-1640336653-project] [instance: c3d5f143-e994-4098-989b-660411a8dd8f] Fetching instance by UUID {{(pid=116156) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:05:22.455923 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-74ed43e2-a8e9-4bc0-9f49-6e41e39b0691 tempest-AttachVolumeNegativeTest-1640336653 tempest-AttachVolumeNegativeTest-1640336653-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:05:22.456369 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-74ed43e2-a8e9-4bc0-9f49-6e41e39b0691 tempest-AttachVolumeNegativeTest-1640336653 tempest-AttachVolumeNegativeTest-1640336653-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:05:22.457138 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-74ed43e2-a8e9-4bc0-9f49-6e41e39b0691 tempest-AttachVolumeNegativeTest-1640336653 tempest-AttachVolumeNegativeTest-1640336653-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:05:22.457567 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-74ed43e2-a8e9-4bc0-9f49-6e41e39b0691 tempest-AttachVolumeNegativeTest-1640336653 tempest-AttachVolumeNegativeTest-1640336653-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:05:22.585698 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.policy [None req-74ed43e2-a8e9-4bc0-9f49-6e41e39b0691 tempest-AttachVolumeNegativeTest-1640336653 tempest-AttachVolumeNegativeTest-1640336653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35d37a3d8e504b8186182468b77dd114', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '409b41637da94c469444954258444b4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116156) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:05:22.592796 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: INFO nova.api.openstack.requestlog [None req-74ed43e2-a8e9-4bc0-9f49-6e41e39b0691 tempest-AttachVolumeNegativeTest-1640336653 tempest-AttachVolumeNegativeTest-1640336653-project] 10.222.0.18 "GET /compute/v2.1/servers/c3d5f143-e994-4098-989b-660411a8dd8f" status: 200 len: 1318 microversion: 2.1 time: 0.147553 Dec 15 03:05:22.593376 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: [pid: 116156|app: 0|req: 189/351] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 03:05:22 2021] GET /compute/v2.1/servers/c3d5f143-e994-4098-989b-660411a8dd8f => generated 1318 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 03:05:23.214556 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi [None req-d384a855-7280-4bc3-bd4d-b52108ee8beb tempest-VolumesActionsTest-1837279088 tempest-VolumesActionsTest-1837279088-project] Calling method '>' {{(pid=116156) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:05:23.215170 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.compute.api [None req-d384a855-7280-4bc3-bd4d-b52108ee8beb tempest-VolumesActionsTest-1837279088 tempest-VolumesActionsTest-1837279088-project] [instance: 41e95883-9297-4d1d-b0aa-33068fb973cd] Fetching instance by UUID {{(pid=116156) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:05:23.220821 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-d384a855-7280-4bc3-bd4d-b52108ee8beb tempest-VolumesActionsTest-1837279088 tempest-VolumesActionsTest-1837279088-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:05:23.221277 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-d384a855-7280-4bc3-bd4d-b52108ee8beb tempest-VolumesActionsTest-1837279088 tempest-VolumesActionsTest-1837279088-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:05:23.222080 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-d384a855-7280-4bc3-bd4d-b52108ee8beb tempest-VolumesActionsTest-1837279088 tempest-VolumesActionsTest-1837279088-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:05:23.222519 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-d384a855-7280-4bc3-bd4d-b52108ee8beb tempest-VolumesActionsTest-1837279088 tempest-VolumesActionsTest-1837279088-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:05:23.347129 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.policy [None req-d384a855-7280-4bc3-bd4d-b52108ee8beb tempest-VolumesActionsTest-1837279088 tempest-VolumesActionsTest-1837279088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e440754469c4407840a651d560ce08a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6eaf458d3c84ba59b078dc0a3bf1763', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116156) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:05:23.354152 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: INFO nova.api.openstack.requestlog [None req-d384a855-7280-4bc3-bd4d-b52108ee8beb tempest-VolumesActionsTest-1837279088 tempest-VolumesActionsTest-1837279088-project] 10.222.0.18 "GET /compute/v2.1/servers/41e95883-9297-4d1d-b0aa-33068fb973cd" status: 200 len: 1314 microversion: 2.1 time: 0.143196 Dec 15 03:05:23.354713 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: [pid: 116156|app: 0|req: 190/352] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 03:05:23 2021] GET /compute/v2.1/servers/41e95883-9297-4d1d-b0aa-33068fb973cd => generated 1314 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 03:05:23.425771 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: INFO nova.api.openstack.requestlog [None req-05ed8cc8-789e-4fdf-9d58-52a880373ccf tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] 10.222.0.18 "POST /compute/v2.1/servers/b89094ac-aee1-4bd6-a33d-8c4347cebfc7/action" status: 200 len: 14 microversion: 2.20 time: 2.501079 Dec 15 03:05:23.426514 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: [pid: 116157|app: 0|req: 163/353] 10.222.0.18 () {62 vars in 1318 bytes} [Wed Dec 15 03:05:20 2021] POST /compute/v2.1/servers/b89094ac-aee1-4bd6-a33d-8c4347cebfc7/action => generated 14 bytes in 2503 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 03:05:23.609065 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi [None req-50216dfb-706e-4cba-8795-48d242c8b93d tempest-AttachVolumeNegativeTest-1640336653 tempest-AttachVolumeNegativeTest-1640336653-project] Calling method '>' {{(pid=116156) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:05:23.609683 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.compute.api [None req-50216dfb-706e-4cba-8795-48d242c8b93d tempest-AttachVolumeNegativeTest-1640336653 tempest-AttachVolumeNegativeTest-1640336653-project] [instance: c3d5f143-e994-4098-989b-660411a8dd8f] Fetching instance by UUID {{(pid=116156) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:05:23.615869 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-50216dfb-706e-4cba-8795-48d242c8b93d tempest-AttachVolumeNegativeTest-1640336653 tempest-AttachVolumeNegativeTest-1640336653-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:05:23.616327 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-50216dfb-706e-4cba-8795-48d242c8b93d tempest-AttachVolumeNegativeTest-1640336653 tempest-AttachVolumeNegativeTest-1640336653-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:05:23.617114 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-50216dfb-706e-4cba-8795-48d242c8b93d tempest-AttachVolumeNegativeTest-1640336653 tempest-AttachVolumeNegativeTest-1640336653-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:05:23.617551 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-50216dfb-706e-4cba-8795-48d242c8b93d tempest-AttachVolumeNegativeTest-1640336653 tempest-AttachVolumeNegativeTest-1640336653-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:05:23.749060 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.policy [None req-50216dfb-706e-4cba-8795-48d242c8b93d tempest-AttachVolumeNegativeTest-1640336653 tempest-AttachVolumeNegativeTest-1640336653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35d37a3d8e504b8186182468b77dd114', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '409b41637da94c469444954258444b4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116156) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:05:23.756811 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: INFO nova.api.openstack.requestlog [None req-50216dfb-706e-4cba-8795-48d242c8b93d tempest-AttachVolumeNegativeTest-1640336653 tempest-AttachVolumeNegativeTest-1640336653-project] 10.222.0.18 "GET /compute/v2.1/servers/c3d5f143-e994-4098-989b-660411a8dd8f" status: 200 len: 1318 microversion: 2.1 time: 0.151421 Dec 15 03:05:23.757381 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: [pid: 116156|app: 0|req: 191/354] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 03:05:23 2021] GET /compute/v2.1/servers/c3d5f143-e994-4098-989b-660411a8dd8f => generated 1318 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 03:05:24.371657 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi [None req-6d0c18a8-87c3-4e6c-9274-b8fc5e2fff46 tempest-VolumesActionsTest-1837279088 tempest-VolumesActionsTest-1837279088-project] Calling method '>' {{(pid=116157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:05:24.372360 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.compute.api [None req-6d0c18a8-87c3-4e6c-9274-b8fc5e2fff46 tempest-VolumesActionsTest-1837279088 tempest-VolumesActionsTest-1837279088-project] [instance: 41e95883-9297-4d1d-b0aa-33068fb973cd] Fetching instance by UUID {{(pid=116157) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:05:24.385509 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-6d0c18a8-87c3-4e6c-9274-b8fc5e2fff46 tempest-VolumesActionsTest-1837279088 tempest-VolumesActionsTest-1837279088-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:05:24.385965 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-6d0c18a8-87c3-4e6c-9274-b8fc5e2fff46 tempest-VolumesActionsTest-1837279088 tempest-VolumesActionsTest-1837279088-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:05:24.386795 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-6d0c18a8-87c3-4e6c-9274-b8fc5e2fff46 tempest-VolumesActionsTest-1837279088 tempest-VolumesActionsTest-1837279088-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:05:24.387522 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-6d0c18a8-87c3-4e6c-9274-b8fc5e2fff46 tempest-VolumesActionsTest-1837279088 tempest-VolumesActionsTest-1837279088-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:05:24.437092 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi [None req-f9c4dc88-6736-49b1-81cb-1c3dc2980c3c tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116156) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 03:05:24.438150 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.compute.api [None req-f9c4dc88-6736-49b1-81cb-1c3dc2980c3c tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] [instance: b89094ac-aee1-4bd6-a33d-8c4347cebfc7] Fetching instance by UUID {{(pid=116156) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:05:24.448517 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-f9c4dc88-6736-49b1-81cb-1c3dc2980c3c tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:05:24.449264 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-f9c4dc88-6736-49b1-81cb-1c3dc2980c3c tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:05:24.450125 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-f9c4dc88-6736-49b1-81cb-1c3dc2980c3c tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:05:24.450575 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-f9c4dc88-6736-49b1-81cb-1c3dc2980c3c tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:05:24.619292 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.policy [None req-6d0c18a8-87c3-4e6c-9274-b8fc5e2fff46 tempest-VolumesActionsTest-1837279088 tempest-VolumesActionsTest-1837279088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e440754469c4407840a651d560ce08a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6eaf458d3c84ba59b078dc0a3bf1763', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116157) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:05:24.629923 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: INFO nova.api.openstack.requestlog [None req-f9c4dc88-6736-49b1-81cb-1c3dc2980c3c tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] 10.222.0.18 "POST /compute/v2.1/servers/b89094ac-aee1-4bd6-a33d-8c4347cebfc7/action" status: 200 len: 14 microversion: 2.20 time: 0.191460 Dec 15 03:05:24.629923 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: [pid: 116156|app: 0|req: 192/355] 10.222.0.18 () {62 vars in 1318 bytes} [Wed Dec 15 03:05:24 2021] POST /compute/v2.1/servers/b89094ac-aee1-4bd6-a33d-8c4347cebfc7/action => generated 14 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 03:05:24.635262 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: INFO nova.api.openstack.requestlog [None req-6d0c18a8-87c3-4e6c-9274-b8fc5e2fff46 tempest-VolumesActionsTest-1837279088 tempest-VolumesActionsTest-1837279088-project] 10.222.0.18 "GET /compute/v2.1/servers/41e95883-9297-4d1d-b0aa-33068fb973cd" status: 200 len: 1314 microversion: 2.1 time: 0.267866 Dec 15 03:05:24.636205 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: [pid: 116157|app: 0|req: 164/356] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 03:05:24 2021] GET /compute/v2.1/servers/41e95883-9297-4d1d-b0aa-33068fb973cd => generated 1314 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 03:05:24.774434 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi [None req-d269cf85-a7a9-4164-9a9f-940cd6d97b33 tempest-AttachVolumeNegativeTest-1640336653 tempest-AttachVolumeNegativeTest-1640336653-project] Calling method '>' {{(pid=116156) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:05:24.775140 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.compute.api [None req-d269cf85-a7a9-4164-9a9f-940cd6d97b33 tempest-AttachVolumeNegativeTest-1640336653 tempest-AttachVolumeNegativeTest-1640336653-project] [instance: c3d5f143-e994-4098-989b-660411a8dd8f] Fetching instance by UUID {{(pid=116156) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:05:24.782532 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-d269cf85-a7a9-4164-9a9f-940cd6d97b33 tempest-AttachVolumeNegativeTest-1640336653 tempest-AttachVolumeNegativeTest-1640336653-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:05:24.782986 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-d269cf85-a7a9-4164-9a9f-940cd6d97b33 tempest-AttachVolumeNegativeTest-1640336653 tempest-AttachVolumeNegativeTest-1640336653-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:05:24.783768 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-d269cf85-a7a9-4164-9a9f-940cd6d97b33 tempest-AttachVolumeNegativeTest-1640336653 tempest-AttachVolumeNegativeTest-1640336653-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:05:24.784206 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-d269cf85-a7a9-4164-9a9f-940cd6d97b33 tempest-AttachVolumeNegativeTest-1640336653 tempest-AttachVolumeNegativeTest-1640336653-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:05:24.913240 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.policy [None req-d269cf85-a7a9-4164-9a9f-940cd6d97b33 tempest-AttachVolumeNegativeTest-1640336653 tempest-AttachVolumeNegativeTest-1640336653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35d37a3d8e504b8186182468b77dd114', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '409b41637da94c469444954258444b4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116156) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:05:24.921438 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: INFO nova.api.openstack.requestlog [None req-d269cf85-a7a9-4164-9a9f-940cd6d97b33 tempest-AttachVolumeNegativeTest-1640336653 tempest-AttachVolumeNegativeTest-1640336653-project] 10.222.0.18 "GET /compute/v2.1/servers/c3d5f143-e994-4098-989b-660411a8dd8f" status: 200 len: 1318 microversion: 2.1 time: 0.150902 Dec 15 03:05:24.922108 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: [pid: 116156|app: 0|req: 193/357] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 03:05:24 2021] GET /compute/v2.1/servers/c3d5f143-e994-4098-989b-660411a8dd8f => generated 1318 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 03:05:25.636750 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi [None req-2c934539-2187-42aa-a239-7bd8fe9ade30 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 03:05:25.637660 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.compute.api [None req-2c934539-2187-42aa-a239-7bd8fe9ade30 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] [instance: b89094ac-aee1-4bd6-a33d-8c4347cebfc7] Fetching instance by UUID {{(pid=116157) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:05:25.645315 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-2c934539-2187-42aa-a239-7bd8fe9ade30 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:05:25.645762 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-2c934539-2187-42aa-a239-7bd8fe9ade30 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:05:25.646603 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-2c934539-2187-42aa-a239-7bd8fe9ade30 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:05:25.647037 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-2c934539-2187-42aa-a239-7bd8fe9ade30 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:05:25.652212 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi [None req-c42198d9-43c9-4098-b2e1-5aa932020ac1 tempest-VolumesActionsTest-1837279088 tempest-VolumesActionsTest-1837279088-project] Calling method '>' {{(pid=116156) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:05:25.652851 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.compute.api [None req-c42198d9-43c9-4098-b2e1-5aa932020ac1 tempest-VolumesActionsTest-1837279088 tempest-VolumesActionsTest-1837279088-project] [instance: 41e95883-9297-4d1d-b0aa-33068fb973cd] Fetching instance by UUID {{(pid=116156) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:05:25.659626 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-c42198d9-43c9-4098-b2e1-5aa932020ac1 tempest-VolumesActionsTest-1837279088 tempest-VolumesActionsTest-1837279088-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:05:25.660196 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-c42198d9-43c9-4098-b2e1-5aa932020ac1 tempest-VolumesActionsTest-1837279088 tempest-VolumesActionsTest-1837279088-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:05:25.660989 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-c42198d9-43c9-4098-b2e1-5aa932020ac1 tempest-VolumesActionsTest-1837279088 tempest-VolumesActionsTest-1837279088-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:05:25.661426 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-c42198d9-43c9-4098-b2e1-5aa932020ac1 tempest-VolumesActionsTest-1837279088 tempest-VolumesActionsTest-1837279088-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:05:25.795008 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.policy [None req-c42198d9-43c9-4098-b2e1-5aa932020ac1 tempest-VolumesActionsTest-1837279088 tempest-VolumesActionsTest-1837279088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e440754469c4407840a651d560ce08a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6eaf458d3c84ba59b078dc0a3bf1763', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116156) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:05:25.802581 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: INFO nova.api.openstack.requestlog [None req-c42198d9-43c9-4098-b2e1-5aa932020ac1 tempest-VolumesActionsTest-1837279088 tempest-VolumesActionsTest-1837279088-project] 10.222.0.18 "GET /compute/v2.1/servers/41e95883-9297-4d1d-b0aa-33068fb973cd" status: 200 len: 1314 microversion: 2.1 time: 0.153986 Dec 15 03:05:25.803140 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: [pid: 116156|app: 0|req: 194/358] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 03:05:25 2021] GET /compute/v2.1/servers/41e95883-9297-4d1d-b0aa-33068fb973cd => generated 1314 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 03:05:25.938256 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi [None req-25d222ae-9dd7-45a2-9b74-4c684c551800 tempest-AttachVolumeNegativeTest-1640336653 tempest-AttachVolumeNegativeTest-1640336653-project] Calling method '>' {{(pid=116156) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:05:25.938783 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.compute.api [None req-25d222ae-9dd7-45a2-9b74-4c684c551800 tempest-AttachVolumeNegativeTest-1640336653 tempest-AttachVolumeNegativeTest-1640336653-project] [instance: c3d5f143-e994-4098-989b-660411a8dd8f] Fetching instance by UUID {{(pid=116156) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:05:25.945254 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-25d222ae-9dd7-45a2-9b74-4c684c551800 tempest-AttachVolumeNegativeTest-1640336653 tempest-AttachVolumeNegativeTest-1640336653-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:05:25.945701 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-25d222ae-9dd7-45a2-9b74-4c684c551800 tempest-AttachVolumeNegativeTest-1640336653 tempest-AttachVolumeNegativeTest-1640336653-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:05:25.946499 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-25d222ae-9dd7-45a2-9b74-4c684c551800 tempest-AttachVolumeNegativeTest-1640336653 tempest-AttachVolumeNegativeTest-1640336653-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:05:25.946929 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-25d222ae-9dd7-45a2-9b74-4c684c551800 tempest-AttachVolumeNegativeTest-1640336653 tempest-AttachVolumeNegativeTest-1640336653-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:05:26.079056 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.policy [None req-25d222ae-9dd7-45a2-9b74-4c684c551800 tempest-AttachVolumeNegativeTest-1640336653 tempest-AttachVolumeNegativeTest-1640336653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35d37a3d8e504b8186182468b77dd114', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '409b41637da94c469444954258444b4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116156) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:05:26.086397 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: INFO nova.api.openstack.requestlog [None req-25d222ae-9dd7-45a2-9b74-4c684c551800 tempest-AttachVolumeNegativeTest-1640336653 tempest-AttachVolumeNegativeTest-1640336653-project] 10.222.0.18 "GET /compute/v2.1/servers/c3d5f143-e994-4098-989b-660411a8dd8f" status: 200 len: 1318 microversion: 2.1 time: 0.151750 Dec 15 03:05:26.086951 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: [pid: 116156|app: 0|req: 195/359] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 03:05:25 2021] GET /compute/v2.1/servers/c3d5f143-e994-4098-989b-660411a8dd8f => generated 1318 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 03:05:26.095774 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi [None req-92f224bf-c066-4dd8-848a-3862f1f07c3f tempest-ServerRescueNegativeTestJSON-2061875223 tempest-ServerRescueNegativeTestJSON-2061875223-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=116156) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 03:05:26.095774 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.compute.api [None req-92f224bf-c066-4dd8-848a-3862f1f07c3f tempest-ServerRescueNegativeTestJSON-2061875223 tempest-ServerRescueNegativeTestJSON-2061875223-project] [instance: 9bbb0abf-72a3-4fbc-8235-7a3ecfc8d006] Fetching instance by UUID {{(pid=116156) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:05:26.097716 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-92f224bf-c066-4dd8-848a-3862f1f07c3f tempest-ServerRescueNegativeTestJSON-2061875223 tempest-ServerRescueNegativeTestJSON-2061875223-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:05:26.098202 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-92f224bf-c066-4dd8-848a-3862f1f07c3f tempest-ServerRescueNegativeTestJSON-2061875223 tempest-ServerRescueNegativeTestJSON-2061875223-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:05:26.098976 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-92f224bf-c066-4dd8-848a-3862f1f07c3f tempest-ServerRescueNegativeTestJSON-2061875223 tempest-ServerRescueNegativeTestJSON-2061875223-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:05:26.099408 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-92f224bf-c066-4dd8-848a-3862f1f07c3f tempest-ServerRescueNegativeTestJSON-2061875223 tempest-ServerRescueNegativeTestJSON-2061875223-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:05:26.121921 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.objects.instance [None req-92f224bf-c066-4dd8-848a-3862f1f07c3f tempest-ServerRescueNegativeTestJSON-2061875223 tempest-ServerRescueNegativeTestJSON-2061875223-project] Lazy-loading 'flavor' on Instance uuid 9bbb0abf-72a3-4fbc-8235-7a3ecfc8d006 {{(pid=116156) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Dec 15 03:05:26.282778 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: INFO nova.api.openstack.requestlog [None req-92f224bf-c066-4dd8-848a-3862f1f07c3f tempest-ServerRescueNegativeTestJSON-2061875223 tempest-ServerRescueNegativeTestJSON-2061875223-project] 10.222.0.18 "POST /compute/v2.1/servers/9bbb0abf-72a3-4fbc-8235-7a3ecfc8d006/action" status: 200 len: 32 microversion: 2.1 time: 0.194642 Dec 15 03:05:26.283370 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: [pid: 116156|app: 0|req: 196/360] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Dec 15 03:05:26 2021] POST /compute/v2.1/servers/9bbb0abf-72a3-4fbc-8235-7a3ecfc8d006/action => generated 32 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Dec 15 03:05:26.292203 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi [None req-795e3afc-1a50-4848-a8d6-32a1da03898a tempest-ServerRescueNegativeTestJSON-2061875223 tempest-ServerRescueNegativeTestJSON-2061875223-project] Calling method '>' {{(pid=116156) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:05:26.292890 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.compute.api [None req-795e3afc-1a50-4848-a8d6-32a1da03898a tempest-ServerRescueNegativeTestJSON-2061875223 tempest-ServerRescueNegativeTestJSON-2061875223-project] [instance: 9bbb0abf-72a3-4fbc-8235-7a3ecfc8d006] Fetching instance by UUID {{(pid=116156) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:05:26.298739 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-795e3afc-1a50-4848-a8d6-32a1da03898a tempest-ServerRescueNegativeTestJSON-2061875223 tempest-ServerRescueNegativeTestJSON-2061875223-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:05:26.299187 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-795e3afc-1a50-4848-a8d6-32a1da03898a tempest-ServerRescueNegativeTestJSON-2061875223 tempest-ServerRescueNegativeTestJSON-2061875223-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:05:26.299955 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-795e3afc-1a50-4848-a8d6-32a1da03898a tempest-ServerRescueNegativeTestJSON-2061875223 tempest-ServerRescueNegativeTestJSON-2061875223-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:05:26.300389 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-795e3afc-1a50-4848-a8d6-32a1da03898a tempest-ServerRescueNegativeTestJSON-2061875223 tempest-ServerRescueNegativeTestJSON-2061875223-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:05:26.430929 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.policy [None req-795e3afc-1a50-4848-a8d6-32a1da03898a tempest-ServerRescueNegativeTestJSON-2061875223 tempest-ServerRescueNegativeTestJSON-2061875223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ea02b6e8f1548a1bd78952cb7337403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5e8a958d4bf43868502b13728b9583b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116156) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:05:26.439163 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: INFO nova.api.openstack.requestlog [None req-795e3afc-1a50-4848-a8d6-32a1da03898a tempest-ServerRescueNegativeTestJSON-2061875223 tempest-ServerRescueNegativeTestJSON-2061875223-project] 10.222.0.18 "GET /compute/v2.1/servers/9bbb0abf-72a3-4fbc-8235-7a3ecfc8d006" status: 200 len: 1567 microversion: 2.1 time: 0.150667 Dec 15 03:05:26.439722 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: [pid: 116156|app: 0|req: 197/361] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 03:05:26 2021] GET /compute/v2.1/servers/9bbb0abf-72a3-4fbc-8235-7a3ecfc8d006 => generated 1567 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 03:05:26.818794 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi [None req-0e95d637-b842-4a2d-b3b2-e4036967607f tempest-VolumesActionsTest-1837279088 tempest-VolumesActionsTest-1837279088-project] Calling method '>' {{(pid=116156) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:05:26.819423 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.compute.api [None req-0e95d637-b842-4a2d-b3b2-e4036967607f tempest-VolumesActionsTest-1837279088 tempest-VolumesActionsTest-1837279088-project] [instance: 41e95883-9297-4d1d-b0aa-33068fb973cd] Fetching instance by UUID {{(pid=116156) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:05:26.825523 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-0e95d637-b842-4a2d-b3b2-e4036967607f tempest-VolumesActionsTest-1837279088 tempest-VolumesActionsTest-1837279088-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:05:26.825973 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-0e95d637-b842-4a2d-b3b2-e4036967607f tempest-VolumesActionsTest-1837279088 tempest-VolumesActionsTest-1837279088-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:05:26.826776 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-0e95d637-b842-4a2d-b3b2-e4036967607f tempest-VolumesActionsTest-1837279088 tempest-VolumesActionsTest-1837279088-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:05:26.827213 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-0e95d637-b842-4a2d-b3b2-e4036967607f tempest-VolumesActionsTest-1837279088 tempest-VolumesActionsTest-1837279088-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:05:26.958378 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.policy [None req-0e95d637-b842-4a2d-b3b2-e4036967607f tempest-VolumesActionsTest-1837279088 tempest-VolumesActionsTest-1837279088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e440754469c4407840a651d560ce08a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6eaf458d3c84ba59b078dc0a3bf1763', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116156) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:05:26.965437 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: INFO nova.api.openstack.requestlog [None req-0e95d637-b842-4a2d-b3b2-e4036967607f tempest-VolumesActionsTest-1837279088 tempest-VolumesActionsTest-1837279088-project] 10.222.0.18 "GET /compute/v2.1/servers/41e95883-9297-4d1d-b0aa-33068fb973cd" status: 200 len: 1314 microversion: 2.1 time: 0.150227 Dec 15 03:05:26.966020 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: [pid: 116156|app: 0|req: 198/362] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 03:05:26 2021] GET /compute/v2.1/servers/41e95883-9297-4d1d-b0aa-33068fb973cd => generated 1314 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 03:05:27.102609 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi [None req-30e27f44-d51e-4fbd-8f6f-3d99b98d8793 tempest-AttachVolumeNegativeTest-1640336653 tempest-AttachVolumeNegativeTest-1640336653-project] Calling method '>' {{(pid=116156) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:05:27.103209 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.compute.api [None req-30e27f44-d51e-4fbd-8f6f-3d99b98d8793 tempest-AttachVolumeNegativeTest-1640336653 tempest-AttachVolumeNegativeTest-1640336653-project] [instance: c3d5f143-e994-4098-989b-660411a8dd8f] Fetching instance by UUID {{(pid=116156) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:05:27.108773 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-30e27f44-d51e-4fbd-8f6f-3d99b98d8793 tempest-AttachVolumeNegativeTest-1640336653 tempest-AttachVolumeNegativeTest-1640336653-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:05:27.109836 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-30e27f44-d51e-4fbd-8f6f-3d99b98d8793 tempest-AttachVolumeNegativeTest-1640336653 tempest-AttachVolumeNegativeTest-1640336653-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:05:27.110620 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-30e27f44-d51e-4fbd-8f6f-3d99b98d8793 tempest-AttachVolumeNegativeTest-1640336653 tempest-AttachVolumeNegativeTest-1640336653-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:05:27.111051 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-30e27f44-d51e-4fbd-8f6f-3d99b98d8793 tempest-AttachVolumeNegativeTest-1640336653 tempest-AttachVolumeNegativeTest-1640336653-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:05:27.240193 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.policy [None req-30e27f44-d51e-4fbd-8f6f-3d99b98d8793 tempest-AttachVolumeNegativeTest-1640336653 tempest-AttachVolumeNegativeTest-1640336653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35d37a3d8e504b8186182468b77dd114', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '409b41637da94c469444954258444b4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116156) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:05:27.247603 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: INFO nova.api.openstack.requestlog [None req-30e27f44-d51e-4fbd-8f6f-3d99b98d8793 tempest-AttachVolumeNegativeTest-1640336653 tempest-AttachVolumeNegativeTest-1640336653-project] 10.222.0.18 "GET /compute/v2.1/servers/c3d5f143-e994-4098-989b-660411a8dd8f" status: 200 len: 1318 microversion: 2.1 time: 0.148489 Dec 15 03:05:27.248157 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: [pid: 116156|app: 0|req: 199/363] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 03:05:27 2021] GET /compute/v2.1/servers/c3d5f143-e994-4098-989b-660411a8dd8f => generated 1318 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 03:05:27.456084 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi [None req-cd034b9a-0c1e-4adb-9c93-a12436530c93 tempest-ServerRescueNegativeTestJSON-2061875223 tempest-ServerRescueNegativeTestJSON-2061875223-project] Calling method '>' {{(pid=116156) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:05:27.456690 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.compute.api [None req-cd034b9a-0c1e-4adb-9c93-a12436530c93 tempest-ServerRescueNegativeTestJSON-2061875223 tempest-ServerRescueNegativeTestJSON-2061875223-project] [instance: 9bbb0abf-72a3-4fbc-8235-7a3ecfc8d006] Fetching instance by UUID {{(pid=116156) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:05:27.462496 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-cd034b9a-0c1e-4adb-9c93-a12436530c93 tempest-ServerRescueNegativeTestJSON-2061875223 tempest-ServerRescueNegativeTestJSON-2061875223-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:05:27.462950 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-cd034b9a-0c1e-4adb-9c93-a12436530c93 tempest-ServerRescueNegativeTestJSON-2061875223 tempest-ServerRescueNegativeTestJSON-2061875223-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:05:27.463761 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-cd034b9a-0c1e-4adb-9c93-a12436530c93 tempest-ServerRescueNegativeTestJSON-2061875223 tempest-ServerRescueNegativeTestJSON-2061875223-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:05:27.464211 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-cd034b9a-0c1e-4adb-9c93-a12436530c93 tempest-ServerRescueNegativeTestJSON-2061875223 tempest-ServerRescueNegativeTestJSON-2061875223-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:05:27.592246 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.policy [None req-cd034b9a-0c1e-4adb-9c93-a12436530c93 tempest-ServerRescueNegativeTestJSON-2061875223 tempest-ServerRescueNegativeTestJSON-2061875223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ea02b6e8f1548a1bd78952cb7337403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5e8a958d4bf43868502b13728b9583b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116156) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:05:27.600514 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: INFO nova.api.openstack.requestlog [None req-cd034b9a-0c1e-4adb-9c93-a12436530c93 tempest-ServerRescueNegativeTestJSON-2061875223 tempest-ServerRescueNegativeTestJSON-2061875223-project] 10.222.0.18 "GET /compute/v2.1/servers/9bbb0abf-72a3-4fbc-8235-7a3ecfc8d006" status: 200 len: 1567 microversion: 2.1 time: 0.148126 Dec 15 03:05:27.601065 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: [pid: 116156|app: 0|req: 200/364] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 03:05:27 2021] GET /compute/v2.1/servers/9bbb0abf-72a3-4fbc-8235-7a3ecfc8d006 => generated 1567 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 03:05:27.610104 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi [req-3723ef66-7146-4b69-a703-277cb8f0f289 req-dd352214-ab74-433b-8f58-781e917e7d15 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c3d5f143-e994-4098-989b-660411a8dd8f", "name": "network-vif-plugged", "status": "completed", "tag": "aef969b5-d8c1-47b9-b0d3-730bcdaaea83"}]} {{(pid=116156) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 03:05:27.611672 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 15 03:05:27.611672 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: warnings.warn(msg) Dec 15 03:05:27.618247 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [req-3723ef66-7146-4b69-a703-277cb8f0f289 req-dd352214-ab74-433b-8f58-781e917e7d15 service nova] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:05:27.618689 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [req-3723ef66-7146-4b69-a703-277cb8f0f289 req-dd352214-ab74-433b-8f58-781e917e7d15 service nova] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:05:27.629619 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: INFO nova.api.openstack.compute.server_external_events [req-3723ef66-7146-4b69-a703-277cb8f0f289 req-dd352214-ab74-433b-8f58-781e917e7d15 service nova] Creating event network-vif-plugged:aef969b5-d8c1-47b9-b0d3-730bcdaaea83 for instance c3d5f143-e994-4098-989b-660411a8dd8f on hv-cinder-81803 Dec 15 03:05:27.634266 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: INFO nova.api.openstack.requestlog [req-3723ef66-7146-4b69-a703-277cb8f0f289 req-dd352214-ab74-433b-8f58-781e917e7d15 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028059 Dec 15 03:05:27.634830 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: [pid: 116156|app: 0|req: 201/365] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Dec 15 03:05:27 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 03:05:27.983174 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi [None req-be86763b-cc28-43d0-a06e-78bcbe3cbe5b tempest-VolumesActionsTest-1837279088 tempest-VolumesActionsTest-1837279088-project] Calling method '>' {{(pid=116156) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:05:27.983867 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.compute.api [None req-be86763b-cc28-43d0-a06e-78bcbe3cbe5b tempest-VolumesActionsTest-1837279088 tempest-VolumesActionsTest-1837279088-project] [instance: 41e95883-9297-4d1d-b0aa-33068fb973cd] Fetching instance by UUID {{(pid=116156) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:05:27.990155 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-be86763b-cc28-43d0-a06e-78bcbe3cbe5b tempest-VolumesActionsTest-1837279088 tempest-VolumesActionsTest-1837279088-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:05:27.990612 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-be86763b-cc28-43d0-a06e-78bcbe3cbe5b tempest-VolumesActionsTest-1837279088 tempest-VolumesActionsTest-1837279088-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:05:27.991396 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-be86763b-cc28-43d0-a06e-78bcbe3cbe5b tempest-VolumesActionsTest-1837279088 tempest-VolumesActionsTest-1837279088-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:05:27.991856 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-be86763b-cc28-43d0-a06e-78bcbe3cbe5b tempest-VolumesActionsTest-1837279088 tempest-VolumesActionsTest-1837279088-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:05:28.121057 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.policy [None req-be86763b-cc28-43d0-a06e-78bcbe3cbe5b tempest-VolumesActionsTest-1837279088 tempest-VolumesActionsTest-1837279088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e440754469c4407840a651d560ce08a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6eaf458d3c84ba59b078dc0a3bf1763', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116156) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:05:28.128576 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: INFO nova.api.openstack.requestlog [None req-be86763b-cc28-43d0-a06e-78bcbe3cbe5b tempest-VolumesActionsTest-1837279088 tempest-VolumesActionsTest-1837279088-project] 10.222.0.18 "GET /compute/v2.1/servers/41e95883-9297-4d1d-b0aa-33068fb973cd" status: 200 len: 1314 microversion: 2.1 time: 0.149742 Dec 15 03:05:28.129145 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: [pid: 116156|app: 0|req: 202/366] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 03:05:27 2021] GET /compute/v2.1/servers/41e95883-9297-4d1d-b0aa-33068fb973cd => generated 1314 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 03:05:28.266397 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi [None req-e57420a6-e2de-4ec9-bb3c-63b1ee518e7e tempest-AttachVolumeNegativeTest-1640336653 tempest-AttachVolumeNegativeTest-1640336653-project] Calling method '>' {{(pid=116156) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:05:28.267011 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.compute.api [None req-e57420a6-e2de-4ec9-bb3c-63b1ee518e7e tempest-AttachVolumeNegativeTest-1640336653 tempest-AttachVolumeNegativeTest-1640336653-project] [instance: c3d5f143-e994-4098-989b-660411a8dd8f] Fetching instance by UUID {{(pid=116156) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:05:28.272787 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-e57420a6-e2de-4ec9-bb3c-63b1ee518e7e tempest-AttachVolumeNegativeTest-1640336653 tempest-AttachVolumeNegativeTest-1640336653-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:05:28.273239 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-e57420a6-e2de-4ec9-bb3c-63b1ee518e7e tempest-AttachVolumeNegativeTest-1640336653 tempest-AttachVolumeNegativeTest-1640336653-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:05:28.274042 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-e57420a6-e2de-4ec9-bb3c-63b1ee518e7e tempest-AttachVolumeNegativeTest-1640336653 tempest-AttachVolumeNegativeTest-1640336653-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:05:28.274477 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-e57420a6-e2de-4ec9-bb3c-63b1ee518e7e tempest-AttachVolumeNegativeTest-1640336653 tempest-AttachVolumeNegativeTest-1640336653-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:05:28.402424 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.policy [None req-e57420a6-e2de-4ec9-bb3c-63b1ee518e7e tempest-AttachVolumeNegativeTest-1640336653 tempest-AttachVolumeNegativeTest-1640336653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35d37a3d8e504b8186182468b77dd114', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '409b41637da94c469444954258444b4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116156) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:05:28.409562 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: INFO nova.api.openstack.requestlog [None req-e57420a6-e2de-4ec9-bb3c-63b1ee518e7e tempest-AttachVolumeNegativeTest-1640336653 tempest-AttachVolumeNegativeTest-1640336653-project] 10.222.0.18 "GET /compute/v2.1/servers/c3d5f143-e994-4098-989b-660411a8dd8f" status: 200 len: 1318 microversion: 2.1 time: 0.147499 Dec 15 03:05:28.410155 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: [pid: 116156|app: 0|req: 203/367] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 03:05:28 2021] GET /compute/v2.1/servers/c3d5f143-e994-4098-989b-660411a8dd8f => generated 1318 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 03:05:28.575144 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: INFO nova.api.openstack.requestlog [None req-2c934539-2187-42aa-a239-7bd8fe9ade30 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] 10.222.0.18 "POST /compute/v2.1/servers/b89094ac-aee1-4bd6-a33d-8c4347cebfc7/action" status: 200 len: 15025 microversion: 2.20 time: 2.941815 Dec 15 03:05:28.576001 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: [pid: 116157|app: 0|req: 165/368] 10.222.0.18 () {62 vars in 1318 bytes} [Wed Dec 15 03:05:25 2021] POST /compute/v2.1/servers/b89094ac-aee1-4bd6-a33d-8c4347cebfc7/action => generated 15025 bytes in 2944 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 15 03:05:28.617278 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi [None req-f92efb31-125c-41c6-a08c-528b219a3e67 tempest-ServerRescueNegativeTestJSON-2061875223 tempest-ServerRescueNegativeTestJSON-2061875223-project] Calling method '>' {{(pid=116156) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:05:28.618046 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.compute.api [None req-f92efb31-125c-41c6-a08c-528b219a3e67 tempest-ServerRescueNegativeTestJSON-2061875223 tempest-ServerRescueNegativeTestJSON-2061875223-project] [instance: 9bbb0abf-72a3-4fbc-8235-7a3ecfc8d006] Fetching instance by UUID {{(pid=116156) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:05:28.624379 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-f92efb31-125c-41c6-a08c-528b219a3e67 tempest-ServerRescueNegativeTestJSON-2061875223 tempest-ServerRescueNegativeTestJSON-2061875223-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:05:28.625473 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-f92efb31-125c-41c6-a08c-528b219a3e67 tempest-ServerRescueNegativeTestJSON-2061875223 tempest-ServerRescueNegativeTestJSON-2061875223-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:05:28.626285 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-f92efb31-125c-41c6-a08c-528b219a3e67 tempest-ServerRescueNegativeTestJSON-2061875223 tempest-ServerRescueNegativeTestJSON-2061875223-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:05:28.627260 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-f92efb31-125c-41c6-a08c-528b219a3e67 tempest-ServerRescueNegativeTestJSON-2061875223 tempest-ServerRescueNegativeTestJSON-2061875223-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:05:28.822498 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.policy [None req-f92efb31-125c-41c6-a08c-528b219a3e67 tempest-ServerRescueNegativeTestJSON-2061875223 tempest-ServerRescueNegativeTestJSON-2061875223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ea02b6e8f1548a1bd78952cb7337403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5e8a958d4bf43868502b13728b9583b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116156) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:05:28.830851 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: INFO nova.api.openstack.requestlog [None req-f92efb31-125c-41c6-a08c-528b219a3e67 tempest-ServerRescueNegativeTestJSON-2061875223 tempest-ServerRescueNegativeTestJSON-2061875223-project] 10.222.0.18 "GET /compute/v2.1/servers/9bbb0abf-72a3-4fbc-8235-7a3ecfc8d006" status: 200 len: 1567 microversion: 2.1 time: 0.217340 Dec 15 03:05:28.831371 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: [pid: 116156|app: 0|req: 204/369] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 03:05:28 2021] GET /compute/v2.1/servers/9bbb0abf-72a3-4fbc-8235-7a3ecfc8d006 => generated 1567 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 03:05:29.145247 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi [None req-6c6b7ed0-5f04-45d1-b68f-1af71527a677 tempest-VolumesActionsTest-1837279088 tempest-VolumesActionsTest-1837279088-project] Calling method '>' {{(pid=116157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:05:29.145865 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.compute.api [None req-6c6b7ed0-5f04-45d1-b68f-1af71527a677 tempest-VolumesActionsTest-1837279088 tempest-VolumesActionsTest-1837279088-project] [instance: 41e95883-9297-4d1d-b0aa-33068fb973cd] Fetching instance by UUID {{(pid=116157) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:05:29.152629 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-6c6b7ed0-5f04-45d1-b68f-1af71527a677 tempest-VolumesActionsTest-1837279088 tempest-VolumesActionsTest-1837279088-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:05:29.153086 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-6c6b7ed0-5f04-45d1-b68f-1af71527a677 tempest-VolumesActionsTest-1837279088 tempest-VolumesActionsTest-1837279088-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:05:29.153870 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-6c6b7ed0-5f04-45d1-b68f-1af71527a677 tempest-VolumesActionsTest-1837279088 tempest-VolumesActionsTest-1837279088-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:05:29.154336 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-6c6b7ed0-5f04-45d1-b68f-1af71527a677 tempest-VolumesActionsTest-1837279088 tempest-VolumesActionsTest-1837279088-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:05:29.288524 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.policy [None req-6c6b7ed0-5f04-45d1-b68f-1af71527a677 tempest-VolumesActionsTest-1837279088 tempest-VolumesActionsTest-1837279088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e440754469c4407840a651d560ce08a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6eaf458d3c84ba59b078dc0a3bf1763', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116157) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:05:29.295728 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: INFO nova.api.openstack.requestlog [None req-6c6b7ed0-5f04-45d1-b68f-1af71527a677 tempest-VolumesActionsTest-1837279088 tempest-VolumesActionsTest-1837279088-project] 10.222.0.18 "GET /compute/v2.1/servers/41e95883-9297-4d1d-b0aa-33068fb973cd" status: 200 len: 1314 microversion: 2.1 time: 0.154593 Dec 15 03:05:29.296296 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: [pid: 116157|app: 0|req: 166/370] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 03:05:29 2021] GET /compute/v2.1/servers/41e95883-9297-4d1d-b0aa-33068fb973cd => generated 1314 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 03:05:29.428423 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi [None req-0558eaa5-51b3-4443-8034-b8d39db4ed3f tempest-AttachVolumeNegativeTest-1640336653 tempest-AttachVolumeNegativeTest-1640336653-project] Calling method '>' {{(pid=116156) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:05:29.429173 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.compute.api [None req-0558eaa5-51b3-4443-8034-b8d39db4ed3f tempest-AttachVolumeNegativeTest-1640336653 tempest-AttachVolumeNegativeTest-1640336653-project] [instance: c3d5f143-e994-4098-989b-660411a8dd8f] Fetching instance by UUID {{(pid=116156) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:05:29.436123 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-0558eaa5-51b3-4443-8034-b8d39db4ed3f tempest-AttachVolumeNegativeTest-1640336653 tempest-AttachVolumeNegativeTest-1640336653-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:05:29.436589 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-0558eaa5-51b3-4443-8034-b8d39db4ed3f tempest-AttachVolumeNegativeTest-1640336653 tempest-AttachVolumeNegativeTest-1640336653-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:05:29.437553 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-0558eaa5-51b3-4443-8034-b8d39db4ed3f tempest-AttachVolumeNegativeTest-1640336653 tempest-AttachVolumeNegativeTest-1640336653-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:05:29.438128 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-0558eaa5-51b3-4443-8034-b8d39db4ed3f tempest-AttachVolumeNegativeTest-1640336653 tempest-AttachVolumeNegativeTest-1640336653-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:05:29.587526 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi [None req-13c95781-8832-4f2a-84ed-f999db68be9f tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 03:05:29.588405 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.compute.api [None req-13c95781-8832-4f2a-84ed-f999db68be9f tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] [instance: b89094ac-aee1-4bd6-a33d-8c4347cebfc7] Fetching instance by UUID {{(pid=116157) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:05:29.588783 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.policy [None req-0558eaa5-51b3-4443-8034-b8d39db4ed3f tempest-AttachVolumeNegativeTest-1640336653 tempest-AttachVolumeNegativeTest-1640336653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35d37a3d8e504b8186182468b77dd114', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '409b41637da94c469444954258444b4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116156) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:05:29.596246 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-13c95781-8832-4f2a-84ed-f999db68be9f tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:05:29.596977 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-13c95781-8832-4f2a-84ed-f999db68be9f tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:05:29.597104 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: INFO nova.api.openstack.requestlog [None req-0558eaa5-51b3-4443-8034-b8d39db4ed3f tempest-AttachVolumeNegativeTest-1640336653 tempest-AttachVolumeNegativeTest-1640336653-project] 10.222.0.18 "GET /compute/v2.1/servers/c3d5f143-e994-4098-989b-660411a8dd8f" status: 200 len: 1318 microversion: 2.1 time: 0.173881 Dec 15 03:05:29.597880 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: [pid: 116156|app: 0|req: 205/371] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 03:05:29 2021] GET /compute/v2.1/servers/c3d5f143-e994-4098-989b-660411a8dd8f => generated 1318 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 03:05:29.598411 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-13c95781-8832-4f2a-84ed-f999db68be9f tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:05:29.598859 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-13c95781-8832-4f2a-84ed-f999db68be9f tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:05:29.738757 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: INFO nova.api.openstack.requestlog [None req-13c95781-8832-4f2a-84ed-f999db68be9f tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] 10.222.0.18 "POST /compute/v2.1/servers/b89094ac-aee1-4bd6-a33d-8c4347cebfc7/action" status: 200 len: 17808 microversion: 2.20 time: 0.155120 Dec 15 03:05:29.739678 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: [pid: 116157|app: 0|req: 167/372] 10.222.0.18 () {62 vars in 1318 bytes} [Wed Dec 15 03:05:29 2021] POST /compute/v2.1/servers/b89094ac-aee1-4bd6-a33d-8c4347cebfc7/action => generated 17808 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 15 03:05:29.848192 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi [None req-34e99776-6b45-4361-b4a1-1c1b222905a0 tempest-ServerRescueNegativeTestJSON-2061875223 tempest-ServerRescueNegativeTestJSON-2061875223-project] Calling method '>' {{(pid=116156) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:05:29.848807 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.compute.api [None req-34e99776-6b45-4361-b4a1-1c1b222905a0 tempest-ServerRescueNegativeTestJSON-2061875223 tempest-ServerRescueNegativeTestJSON-2061875223-project] [instance: 9bbb0abf-72a3-4fbc-8235-7a3ecfc8d006] Fetching instance by UUID {{(pid=116156) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:05:29.854494 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-34e99776-6b45-4361-b4a1-1c1b222905a0 tempest-ServerRescueNegativeTestJSON-2061875223 tempest-ServerRescueNegativeTestJSON-2061875223-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:05:29.854944 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-34e99776-6b45-4361-b4a1-1c1b222905a0 tempest-ServerRescueNegativeTestJSON-2061875223 tempest-ServerRescueNegativeTestJSON-2061875223-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:05:29.855719 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-34e99776-6b45-4361-b4a1-1c1b222905a0 tempest-ServerRescueNegativeTestJSON-2061875223 tempest-ServerRescueNegativeTestJSON-2061875223-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:05:29.856151 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-34e99776-6b45-4361-b4a1-1c1b222905a0 tempest-ServerRescueNegativeTestJSON-2061875223 tempest-ServerRescueNegativeTestJSON-2061875223-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:05:29.987396 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.policy [None req-34e99776-6b45-4361-b4a1-1c1b222905a0 tempest-ServerRescueNegativeTestJSON-2061875223 tempest-ServerRescueNegativeTestJSON-2061875223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ea02b6e8f1548a1bd78952cb7337403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5e8a958d4bf43868502b13728b9583b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116156) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:05:29.996585 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: INFO nova.api.openstack.requestlog [None req-34e99776-6b45-4361-b4a1-1c1b222905a0 tempest-ServerRescueNegativeTestJSON-2061875223 tempest-ServerRescueNegativeTestJSON-2061875223-project] 10.222.0.18 "GET /compute/v2.1/servers/9bbb0abf-72a3-4fbc-8235-7a3ecfc8d006" status: 200 len: 1567 microversion: 2.1 time: 0.152169 Dec 15 03:05:29.997234 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: [pid: 116156|app: 0|req: 206/373] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 03:05:29 2021] GET /compute/v2.1/servers/9bbb0abf-72a3-4fbc-8235-7a3ecfc8d006 => generated 1567 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 03:05:30.314283 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi [None req-8739675c-4f93-4c72-b593-f822e868ed54 tempest-VolumesActionsTest-1837279088 tempest-VolumesActionsTest-1837279088-project] Calling method '>' {{(pid=116157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:05:30.322206 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.compute.api [None req-8739675c-4f93-4c72-b593-f822e868ed54 tempest-VolumesActionsTest-1837279088 tempest-VolumesActionsTest-1837279088-project] [instance: 41e95883-9297-4d1d-b0aa-33068fb973cd] Fetching instance by UUID {{(pid=116157) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:05:30.329727 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-8739675c-4f93-4c72-b593-f822e868ed54 tempest-VolumesActionsTest-1837279088 tempest-VolumesActionsTest-1837279088-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:05:30.330614 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-8739675c-4f93-4c72-b593-f822e868ed54 tempest-VolumesActionsTest-1837279088 tempest-VolumesActionsTest-1837279088-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:05:30.331632 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-8739675c-4f93-4c72-b593-f822e868ed54 tempest-VolumesActionsTest-1837279088 tempest-VolumesActionsTest-1837279088-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:05:30.332384 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-8739675c-4f93-4c72-b593-f822e868ed54 tempest-VolumesActionsTest-1837279088 tempest-VolumesActionsTest-1837279088-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:05:30.541207 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.policy [None req-8739675c-4f93-4c72-b593-f822e868ed54 tempest-VolumesActionsTest-1837279088 tempest-VolumesActionsTest-1837279088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e440754469c4407840a651d560ce08a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6eaf458d3c84ba59b078dc0a3bf1763', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116157) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:05:30.550611 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: INFO nova.api.openstack.requestlog [None req-8739675c-4f93-4c72-b593-f822e868ed54 tempest-VolumesActionsTest-1837279088 tempest-VolumesActionsTest-1837279088-project] 10.222.0.18 "GET /compute/v2.1/servers/41e95883-9297-4d1d-b0aa-33068fb973cd" status: 200 len: 1314 microversion: 2.1 time: 0.241673 Dec 15 03:05:30.551195 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: [pid: 116157|app: 0|req: 168/374] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 03:05:30 2021] GET /compute/v2.1/servers/41e95883-9297-4d1d-b0aa-33068fb973cd => generated 1314 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 03:05:30.614452 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi [None req-954da539-4649-45cd-9dba-2cd3de553dd5 tempest-AttachVolumeNegativeTest-1640336653 tempest-AttachVolumeNegativeTest-1640336653-project] Calling method '>' {{(pid=116156) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:05:30.615062 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.compute.api [None req-954da539-4649-45cd-9dba-2cd3de553dd5 tempest-AttachVolumeNegativeTest-1640336653 tempest-AttachVolumeNegativeTest-1640336653-project] [instance: c3d5f143-e994-4098-989b-660411a8dd8f] Fetching instance by UUID {{(pid=116156) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:05:30.623402 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-954da539-4649-45cd-9dba-2cd3de553dd5 tempest-AttachVolumeNegativeTest-1640336653 tempest-AttachVolumeNegativeTest-1640336653-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:05:30.623784 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-954da539-4649-45cd-9dba-2cd3de553dd5 tempest-AttachVolumeNegativeTest-1640336653 tempest-AttachVolumeNegativeTest-1640336653-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:05:30.624616 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-954da539-4649-45cd-9dba-2cd3de553dd5 tempest-AttachVolumeNegativeTest-1640336653 tempest-AttachVolumeNegativeTest-1640336653-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:05:30.625049 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-954da539-4649-45cd-9dba-2cd3de553dd5 tempest-AttachVolumeNegativeTest-1640336653 tempest-AttachVolumeNegativeTest-1640336653-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:05:30.757210 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi [None req-f67f86c4-0dcb-4b60-ac06-e7e998c98df3 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 03:05:30.761654 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.compute.api [None req-f67f86c4-0dcb-4b60-ac06-e7e998c98df3 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] [instance: b89094ac-aee1-4bd6-a33d-8c4347cebfc7] Fetching instance by UUID {{(pid=116157) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:05:30.770879 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-f67f86c4-0dcb-4b60-ac06-e7e998c98df3 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:05:30.771323 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-f67f86c4-0dcb-4b60-ac06-e7e998c98df3 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:05:30.772103 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-f67f86c4-0dcb-4b60-ac06-e7e998c98df3 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:05:30.772531 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-f67f86c4-0dcb-4b60-ac06-e7e998c98df3 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:05:30.802788 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.policy [None req-954da539-4649-45cd-9dba-2cd3de553dd5 tempest-AttachVolumeNegativeTest-1640336653 tempest-AttachVolumeNegativeTest-1640336653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35d37a3d8e504b8186182468b77dd114', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '409b41637da94c469444954258444b4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116156) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:05:30.810339 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: INFO nova.api.openstack.requestlog [None req-954da539-4649-45cd-9dba-2cd3de553dd5 tempest-AttachVolumeNegativeTest-1640336653 tempest-AttachVolumeNegativeTest-1640336653-project] 10.222.0.18 "GET /compute/v2.1/servers/c3d5f143-e994-4098-989b-660411a8dd8f" status: 200 len: 1507 microversion: 2.1 time: 0.199471 Dec 15 03:05:30.822928 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: [pid: 116156|app: 0|req: 207/375] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 03:05:30 2021] GET /compute/v2.1/servers/c3d5f143-e994-4098-989b-660411a8dd8f => generated 1507 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 03:05:30.876064 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi [req-ab1c2126-7362-40cb-b6f0-28b5fe7ae474 req-0f1a911a-c6e0-4bdf-8fc1-0cdae6fd1cf5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "41e95883-9297-4d1d-b0aa-33068fb973cd", "name": "network-vif-plugged", "status": "completed", "tag": "76776ba9-43a4-48a7-a30a-4a65d48d1ce7"}]} {{(pid=116156) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 03:05:30.878646 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 15 03:05:30.878646 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: warnings.warn(msg) Dec 15 03:05:30.889554 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [req-ab1c2126-7362-40cb-b6f0-28b5fe7ae474 req-0f1a911a-c6e0-4bdf-8fc1-0cdae6fd1cf5 service nova] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:05:30.892388 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [req-ab1c2126-7362-40cb-b6f0-28b5fe7ae474 req-0f1a911a-c6e0-4bdf-8fc1-0cdae6fd1cf5 service nova] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:05:30.911667 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: INFO nova.api.openstack.compute.server_external_events [req-ab1c2126-7362-40cb-b6f0-28b5fe7ae474 req-0f1a911a-c6e0-4bdf-8fc1-0cdae6fd1cf5 service nova] Creating event network-vif-plugged:76776ba9-43a4-48a7-a30a-4a65d48d1ce7 for instance 41e95883-9297-4d1d-b0aa-33068fb973cd on hv-cinder-81803 Dec 15 03:05:30.921216 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: INFO nova.api.openstack.requestlog [req-ab1c2126-7362-40cb-b6f0-28b5fe7ae474 req-0f1a911a-c6e0-4bdf-8fc1-0cdae6fd1cf5 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.051898 Dec 15 03:05:30.926422 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: [pid: 116156|app: 0|req: 208/376] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Dec 15 03:05:30 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 03:05:30.943690 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: INFO nova.api.openstack.requestlog [None req-f67f86c4-0dcb-4b60-ac06-e7e998c98df3 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] 10.222.0.18 "POST /compute/v2.1/servers/b89094ac-aee1-4bd6-a33d-8c4347cebfc7/action" status: 200 len: 18013 microversion: 2.20 time: 0.194051 Dec 15 03:05:30.947264 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: [pid: 116157|app: 0|req: 169/377] 10.222.0.18 () {62 vars in 1318 bytes} [Wed Dec 15 03:05:30 2021] POST /compute/v2.1/servers/b89094ac-aee1-4bd6-a33d-8c4347cebfc7/action => generated 18013 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 15 03:05:31.016624 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi [None req-65736ffa-c530-4451-a907-9273b3935ac8 tempest-ServerRescueNegativeTestJSON-2061875223 tempest-ServerRescueNegativeTestJSON-2061875223-project] Calling method '>' {{(pid=116156) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:05:31.017362 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.compute.api [None req-65736ffa-c530-4451-a907-9273b3935ac8 tempest-ServerRescueNegativeTestJSON-2061875223 tempest-ServerRescueNegativeTestJSON-2061875223-project] [instance: 9bbb0abf-72a3-4fbc-8235-7a3ecfc8d006] Fetching instance by UUID {{(pid=116156) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:05:31.023459 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-65736ffa-c530-4451-a907-9273b3935ac8 tempest-ServerRescueNegativeTestJSON-2061875223 tempest-ServerRescueNegativeTestJSON-2061875223-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:05:31.023916 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-65736ffa-c530-4451-a907-9273b3935ac8 tempest-ServerRescueNegativeTestJSON-2061875223 tempest-ServerRescueNegativeTestJSON-2061875223-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:05:31.024948 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-65736ffa-c530-4451-a907-9273b3935ac8 tempest-ServerRescueNegativeTestJSON-2061875223 tempest-ServerRescueNegativeTestJSON-2061875223-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:05:31.025398 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-65736ffa-c530-4451-a907-9273b3935ac8 tempest-ServerRescueNegativeTestJSON-2061875223 tempest-ServerRescueNegativeTestJSON-2061875223-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:05:31.223994 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.policy [None req-65736ffa-c530-4451-a907-9273b3935ac8 tempest-ServerRescueNegativeTestJSON-2061875223 tempest-ServerRescueNegativeTestJSON-2061875223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ea02b6e8f1548a1bd78952cb7337403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5e8a958d4bf43868502b13728b9583b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116156) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:05:31.233064 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: INFO nova.api.openstack.requestlog [None req-65736ffa-c530-4451-a907-9273b3935ac8 tempest-ServerRescueNegativeTestJSON-2061875223 tempest-ServerRescueNegativeTestJSON-2061875223-project] 10.222.0.18 "GET /compute/v2.1/servers/9bbb0abf-72a3-4fbc-8235-7a3ecfc8d006" status: 200 len: 1567 microversion: 2.1 time: 0.222443 Dec 15 03:05:31.233632 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: [pid: 116156|app: 0|req: 209/378] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 03:05:31 2021] GET /compute/v2.1/servers/9bbb0abf-72a3-4fbc-8235-7a3ecfc8d006 => generated 1567 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 03:05:31.568312 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi [None req-ba387e3a-75b1-4b61-84b4-74036eb2314f tempest-VolumesActionsTest-1837279088 tempest-VolumesActionsTest-1837279088-project] Calling method '>' {{(pid=116157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:05:31.569080 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.compute.api [None req-ba387e3a-75b1-4b61-84b4-74036eb2314f tempest-VolumesActionsTest-1837279088 tempest-VolumesActionsTest-1837279088-project] [instance: 41e95883-9297-4d1d-b0aa-33068fb973cd] Fetching instance by UUID {{(pid=116157) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:05:31.575915 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-ba387e3a-75b1-4b61-84b4-74036eb2314f tempest-VolumesActionsTest-1837279088 tempest-VolumesActionsTest-1837279088-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:05:31.576360 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-ba387e3a-75b1-4b61-84b4-74036eb2314f tempest-VolumesActionsTest-1837279088 tempest-VolumesActionsTest-1837279088-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:05:31.577137 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-ba387e3a-75b1-4b61-84b4-74036eb2314f tempest-VolumesActionsTest-1837279088 tempest-VolumesActionsTest-1837279088-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:05:31.577571 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-ba387e3a-75b1-4b61-84b4-74036eb2314f tempest-VolumesActionsTest-1837279088 tempest-VolumesActionsTest-1837279088-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:05:31.707909 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.policy [None req-ba387e3a-75b1-4b61-84b4-74036eb2314f tempest-VolumesActionsTest-1837279088 tempest-VolumesActionsTest-1837279088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e440754469c4407840a651d560ce08a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6eaf458d3c84ba59b078dc0a3bf1763', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116157) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:05:31.716030 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: INFO nova.api.openstack.requestlog [None req-ba387e3a-75b1-4b61-84b4-74036eb2314f tempest-VolumesActionsTest-1837279088 tempest-VolumesActionsTest-1837279088-project] 10.222.0.18 "GET /compute/v2.1/servers/41e95883-9297-4d1d-b0aa-33068fb973cd" status: 200 len: 1314 microversion: 2.1 time: 0.151723 Dec 15 03:05:31.716597 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: [pid: 116157|app: 0|req: 170/379] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 03:05:31 2021] GET /compute/v2.1/servers/41e95883-9297-4d1d-b0aa-33068fb973cd => generated 1314 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 03:05:31.955420 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi [None req-a95eab97-e0a6-4d93-be87-9b4497e45ac2 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116156) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 03:05:31.956334 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.compute.api [None req-a95eab97-e0a6-4d93-be87-9b4497e45ac2 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] [instance: b89094ac-aee1-4bd6-a33d-8c4347cebfc7] Fetching instance by UUID {{(pid=116156) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:05:31.962509 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-a95eab97-e0a6-4d93-be87-9b4497e45ac2 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:05:31.962964 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-a95eab97-e0a6-4d93-be87-9b4497e45ac2 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:05:31.963746 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-a95eab97-e0a6-4d93-be87-9b4497e45ac2 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:05:31.964185 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-a95eab97-e0a6-4d93-be87-9b4497e45ac2 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:05:32.250624 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi [None req-baadc654-852c-42b2-846c-02a9373a169a tempest-ServerRescueNegativeTestJSON-2061875223 tempest-ServerRescueNegativeTestJSON-2061875223-project] Calling method '>' {{(pid=116157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:05:32.251163 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.compute.api [None req-baadc654-852c-42b2-846c-02a9373a169a tempest-ServerRescueNegativeTestJSON-2061875223 tempest-ServerRescueNegativeTestJSON-2061875223-project] [instance: 9bbb0abf-72a3-4fbc-8235-7a3ecfc8d006] Fetching instance by UUID {{(pid=116157) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:05:32.257316 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-baadc654-852c-42b2-846c-02a9373a169a tempest-ServerRescueNegativeTestJSON-2061875223 tempest-ServerRescueNegativeTestJSON-2061875223-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:05:32.257770 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-baadc654-852c-42b2-846c-02a9373a169a tempest-ServerRescueNegativeTestJSON-2061875223 tempest-ServerRescueNegativeTestJSON-2061875223-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:05:32.258585 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-baadc654-852c-42b2-846c-02a9373a169a tempest-ServerRescueNegativeTestJSON-2061875223 tempest-ServerRescueNegativeTestJSON-2061875223-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:05:32.259027 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-baadc654-852c-42b2-846c-02a9373a169a tempest-ServerRescueNegativeTestJSON-2061875223 tempest-ServerRescueNegativeTestJSON-2061875223-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:05:32.387918 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.policy [None req-baadc654-852c-42b2-846c-02a9373a169a tempest-ServerRescueNegativeTestJSON-2061875223 tempest-ServerRescueNegativeTestJSON-2061875223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ea02b6e8f1548a1bd78952cb7337403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5e8a958d4bf43868502b13728b9583b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116157) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:05:32.395686 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: INFO nova.api.openstack.requestlog [None req-baadc654-852c-42b2-846c-02a9373a169a tempest-ServerRescueNegativeTestJSON-2061875223 tempest-ServerRescueNegativeTestJSON-2061875223-project] 10.222.0.18 "GET /compute/v2.1/servers/9bbb0abf-72a3-4fbc-8235-7a3ecfc8d006" status: 200 len: 1567 microversion: 2.1 time: 0.149353 Dec 15 03:05:32.396239 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: [pid: 116157|app: 0|req: 171/380] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 03:05:32 2021] GET /compute/v2.1/servers/9bbb0abf-72a3-4fbc-8235-7a3ecfc8d006 => generated 1567 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 03:05:32.732953 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi [None req-27ce2681-8db7-4749-bdf2-70263db52f99 tempest-VolumesActionsTest-1837279088 tempest-VolumesActionsTest-1837279088-project] Calling method '>' {{(pid=116157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:05:32.733497 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.compute.api [None req-27ce2681-8db7-4749-bdf2-70263db52f99 tempest-VolumesActionsTest-1837279088 tempest-VolumesActionsTest-1837279088-project] [instance: 41e95883-9297-4d1d-b0aa-33068fb973cd] Fetching instance by UUID {{(pid=116157) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:05:32.740243 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-27ce2681-8db7-4749-bdf2-70263db52f99 tempest-VolumesActionsTest-1837279088 tempest-VolumesActionsTest-1837279088-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:05:32.740686 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-27ce2681-8db7-4749-bdf2-70263db52f99 tempest-VolumesActionsTest-1837279088 tempest-VolumesActionsTest-1837279088-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:05:32.741452 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-27ce2681-8db7-4749-bdf2-70263db52f99 tempest-VolumesActionsTest-1837279088 tempest-VolumesActionsTest-1837279088-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:05:32.741884 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-27ce2681-8db7-4749-bdf2-70263db52f99 tempest-VolumesActionsTest-1837279088 tempest-VolumesActionsTest-1837279088-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:05:32.867784 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.policy [None req-27ce2681-8db7-4749-bdf2-70263db52f99 tempest-VolumesActionsTest-1837279088 tempest-VolumesActionsTest-1837279088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e440754469c4407840a651d560ce08a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6eaf458d3c84ba59b078dc0a3bf1763', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116157) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:05:32.875063 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: INFO nova.api.openstack.requestlog [None req-27ce2681-8db7-4749-bdf2-70263db52f99 tempest-VolumesActionsTest-1837279088 tempest-VolumesActionsTest-1837279088-project] 10.222.0.18 "GET /compute/v2.1/servers/41e95883-9297-4d1d-b0aa-33068fb973cd" status: 200 len: 1314 microversion: 2.1 time: 0.145776 Dec 15 03:05:32.875628 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: [pid: 116157|app: 0|req: 172/381] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 03:05:32 2021] GET /compute/v2.1/servers/41e95883-9297-4d1d-b0aa-33068fb973cd => generated 1314 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 03:05:33.412326 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi [None req-fcaf7614-9b1b-4cde-8f44-523074e1f1e1 tempest-ServerRescueNegativeTestJSON-2061875223 tempest-ServerRescueNegativeTestJSON-2061875223-project] Calling method '>' {{(pid=116157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:05:33.413077 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.compute.api [None req-fcaf7614-9b1b-4cde-8f44-523074e1f1e1 tempest-ServerRescueNegativeTestJSON-2061875223 tempest-ServerRescueNegativeTestJSON-2061875223-project] [instance: 9bbb0abf-72a3-4fbc-8235-7a3ecfc8d006] Fetching instance by UUID {{(pid=116157) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:05:33.419320 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-fcaf7614-9b1b-4cde-8f44-523074e1f1e1 tempest-ServerRescueNegativeTestJSON-2061875223 tempest-ServerRescueNegativeTestJSON-2061875223-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:05:33.419774 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-fcaf7614-9b1b-4cde-8f44-523074e1f1e1 tempest-ServerRescueNegativeTestJSON-2061875223 tempest-ServerRescueNegativeTestJSON-2061875223-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:05:33.420554 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-fcaf7614-9b1b-4cde-8f44-523074e1f1e1 tempest-ServerRescueNegativeTestJSON-2061875223 tempest-ServerRescueNegativeTestJSON-2061875223-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:05:33.420993 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-fcaf7614-9b1b-4cde-8f44-523074e1f1e1 tempest-ServerRescueNegativeTestJSON-2061875223 tempest-ServerRescueNegativeTestJSON-2061875223-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:05:33.551894 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.policy [None req-fcaf7614-9b1b-4cde-8f44-523074e1f1e1 tempest-ServerRescueNegativeTestJSON-2061875223 tempest-ServerRescueNegativeTestJSON-2061875223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ea02b6e8f1548a1bd78952cb7337403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5e8a958d4bf43868502b13728b9583b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116157) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:05:33.559479 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: INFO nova.api.openstack.requestlog [None req-fcaf7614-9b1b-4cde-8f44-523074e1f1e1 tempest-ServerRescueNegativeTestJSON-2061875223 tempest-ServerRescueNegativeTestJSON-2061875223-project] 10.222.0.18 "GET /compute/v2.1/servers/9bbb0abf-72a3-4fbc-8235-7a3ecfc8d006" status: 200 len: 1567 microversion: 2.1 time: 0.150825 Dec 15 03:05:33.560041 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: [pid: 116157|app: 0|req: 173/382] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 03:05:33 2021] GET /compute/v2.1/servers/9bbb0abf-72a3-4fbc-8235-7a3ecfc8d006 => generated 1567 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 03:05:33.891298 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi [None req-c55d95e5-891f-4194-b479-e34c4d8b168d tempest-VolumesActionsTest-1837279088 tempest-VolumesActionsTest-1837279088-project] Calling method '>' {{(pid=116157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:05:33.891908 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.compute.api [None req-c55d95e5-891f-4194-b479-e34c4d8b168d tempest-VolumesActionsTest-1837279088 tempest-VolumesActionsTest-1837279088-project] [instance: 41e95883-9297-4d1d-b0aa-33068fb973cd] Fetching instance by UUID {{(pid=116157) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:05:33.897590 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-c55d95e5-891f-4194-b479-e34c4d8b168d tempest-VolumesActionsTest-1837279088 tempest-VolumesActionsTest-1837279088-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:05:33.898071 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-c55d95e5-891f-4194-b479-e34c4d8b168d tempest-VolumesActionsTest-1837279088 tempest-VolumesActionsTest-1837279088-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:05:33.898855 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-c55d95e5-891f-4194-b479-e34c4d8b168d tempest-VolumesActionsTest-1837279088 tempest-VolumesActionsTest-1837279088-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:05:33.899287 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-c55d95e5-891f-4194-b479-e34c4d8b168d tempest-VolumesActionsTest-1837279088 tempest-VolumesActionsTest-1837279088-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:05:34.024591 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.policy [None req-c55d95e5-891f-4194-b479-e34c4d8b168d tempest-VolumesActionsTest-1837279088 tempest-VolumesActionsTest-1837279088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e440754469c4407840a651d560ce08a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6eaf458d3c84ba59b078dc0a3bf1763', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116157) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:05:34.031697 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: INFO nova.api.openstack.requestlog [None req-c55d95e5-891f-4194-b479-e34c4d8b168d tempest-VolumesActionsTest-1837279088 tempest-VolumesActionsTest-1837279088-project] 10.222.0.18 "GET /compute/v2.1/servers/41e95883-9297-4d1d-b0aa-33068fb973cd" status: 200 len: 1314 microversion: 2.1 time: 0.144247 Dec 15 03:05:34.032253 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: [pid: 116157|app: 0|req: 174/383] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 03:05:33 2021] GET /compute/v2.1/servers/41e95883-9297-4d1d-b0aa-33068fb973cd => generated 1314 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 03:05:34.576468 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi [None req-fba6715c-dda4-4e4b-97fb-88e0e47aa8a7 tempest-ServerRescueNegativeTestJSON-2061875223 tempest-ServerRescueNegativeTestJSON-2061875223-project] Calling method '>' {{(pid=116157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:05:34.577115 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.compute.api [None req-fba6715c-dda4-4e4b-97fb-88e0e47aa8a7 tempest-ServerRescueNegativeTestJSON-2061875223 tempest-ServerRescueNegativeTestJSON-2061875223-project] [instance: 9bbb0abf-72a3-4fbc-8235-7a3ecfc8d006] Fetching instance by UUID {{(pid=116157) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:05:34.583253 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-fba6715c-dda4-4e4b-97fb-88e0e47aa8a7 tempest-ServerRescueNegativeTestJSON-2061875223 tempest-ServerRescueNegativeTestJSON-2061875223-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:05:34.583707 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-fba6715c-dda4-4e4b-97fb-88e0e47aa8a7 tempest-ServerRescueNegativeTestJSON-2061875223 tempest-ServerRescueNegativeTestJSON-2061875223-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:05:34.584485 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-fba6715c-dda4-4e4b-97fb-88e0e47aa8a7 tempest-ServerRescueNegativeTestJSON-2061875223 tempest-ServerRescueNegativeTestJSON-2061875223-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:05:34.584920 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-fba6715c-dda4-4e4b-97fb-88e0e47aa8a7 tempest-ServerRescueNegativeTestJSON-2061875223 tempest-ServerRescueNegativeTestJSON-2061875223-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:05:34.601341 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: INFO nova.api.openstack.requestlog [None req-a95eab97-e0a6-4d93-be87-9b4497e45ac2 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] 10.222.0.18 "POST /compute/v2.1/servers/b89094ac-aee1-4bd6-a33d-8c4347cebfc7/action" status: 200 len: 23224 microversion: 2.20 time: 2.650007 Dec 15 03:05:34.602566 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: [pid: 116156|app: 0|req: 210/384] 10.222.0.18 () {62 vars in 1318 bytes} [Wed Dec 15 03:05:31 2021] POST /compute/v2.1/servers/b89094ac-aee1-4bd6-a33d-8c4347cebfc7/action => generated 23224 bytes in 2652 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 15 03:05:34.717648 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.policy [None req-fba6715c-dda4-4e4b-97fb-88e0e47aa8a7 tempest-ServerRescueNegativeTestJSON-2061875223 tempest-ServerRescueNegativeTestJSON-2061875223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ea02b6e8f1548a1bd78952cb7337403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5e8a958d4bf43868502b13728b9583b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116157) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:05:34.725958 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: INFO nova.api.openstack.requestlog [None req-fba6715c-dda4-4e4b-97fb-88e0e47aa8a7 tempest-ServerRescueNegativeTestJSON-2061875223 tempest-ServerRescueNegativeTestJSON-2061875223-project] 10.222.0.18 "GET /compute/v2.1/servers/9bbb0abf-72a3-4fbc-8235-7a3ecfc8d006" status: 200 len: 1567 microversion: 2.1 time: 0.153130 Dec 15 03:05:34.726543 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: [pid: 116157|app: 0|req: 175/385] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 03:05:34 2021] GET /compute/v2.1/servers/9bbb0abf-72a3-4fbc-8235-7a3ecfc8d006 => generated 1567 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 03:05:35.020967 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi [None req-96c914bc-5d65-4a08-837d-d0bf944fa9ec tempest-VolumesNegativeTest-1333024728 tempest-VolumesNegativeTest-1333024728-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesNegativeTest-instance-1001758631", "imageRef": "5195b034-9fa4-468b-a94d-ef3ee79ce449", "flavorRef": "452"}} {{(pid=116156) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 03:05:35.047396 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi [None req-252ac143-459e-4ba1-9a8a-67a58404af05 tempest-VolumesActionsTest-1837279088 tempest-VolumesActionsTest-1837279088-project] Calling method '>' {{(pid=116157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:05:35.048120 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.compute.api [None req-252ac143-459e-4ba1-9a8a-67a58404af05 tempest-VolumesActionsTest-1837279088 tempest-VolumesActionsTest-1837279088-project] [instance: 41e95883-9297-4d1d-b0aa-33068fb973cd] Fetching instance by UUID {{(pid=116157) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:05:35.054333 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-252ac143-459e-4ba1-9a8a-67a58404af05 tempest-VolumesActionsTest-1837279088 tempest-VolumesActionsTest-1837279088-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:05:35.054972 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-252ac143-459e-4ba1-9a8a-67a58404af05 tempest-VolumesActionsTest-1837279088 tempest-VolumesActionsTest-1837279088-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:05:35.055936 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-252ac143-459e-4ba1-9a8a-67a58404af05 tempest-VolumesActionsTest-1837279088 tempest-VolumesActionsTest-1837279088-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:05:35.056380 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-252ac143-459e-4ba1-9a8a-67a58404af05 tempest-VolumesActionsTest-1837279088 tempest-VolumesActionsTest-1837279088-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:05:35.080817 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.network.neutron [None req-96c914bc-5d65-4a08-837d-d0bf944fa9ec tempest-VolumesNegativeTest-1333024728 tempest-VolumesNegativeTest-1333024728-project] validate_networks() for None {{(pid=116156) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Dec 15 03:05:35.193014 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.policy [None req-252ac143-459e-4ba1-9a8a-67a58404af05 tempest-VolumesActionsTest-1837279088 tempest-VolumesActionsTest-1837279088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e440754469c4407840a651d560ce08a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6eaf458d3c84ba59b078dc0a3bf1763', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116157) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:05:35.204261 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: INFO nova.api.openstack.requestlog [None req-252ac143-459e-4ba1-9a8a-67a58404af05 tempest-VolumesActionsTest-1837279088 tempest-VolumesActionsTest-1837279088-project] 10.222.0.18 "GET /compute/v2.1/servers/41e95883-9297-4d1d-b0aa-33068fb973cd" status: 200 len: 1314 microversion: 2.1 time: 0.160755 Dec 15 03:05:35.214882 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: [pid: 116157|app: 0|req: 176/386] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 03:05:35 2021] GET /compute/v2.1/servers/41e95883-9297-4d1d-b0aa-33068fb973cd => generated 1314 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 03:05:35.327147 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi [None req-2cb2ef92-5aa2-4e79-bf51-e95011046621 tempest-AttachVolumeNegativeTest-1640336653 tempest-AttachVolumeNegativeTest-1640336653-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "04684fcf-6c26-472a-9602-0fcd90ca9df8"}} {{(pid=116157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 03:05:35.328853 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.compute.api [None req-2cb2ef92-5aa2-4e79-bf51-e95011046621 tempest-AttachVolumeNegativeTest-1640336653 tempest-AttachVolumeNegativeTest-1640336653-project] [instance: c3d5f143-e994-4098-989b-660411a8dd8f] Fetching instance by UUID {{(pid=116157) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:05:35.334737 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-2cb2ef92-5aa2-4e79-bf51-e95011046621 tempest-AttachVolumeNegativeTest-1640336653 tempest-AttachVolumeNegativeTest-1640336653-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:05:35.335179 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-2cb2ef92-5aa2-4e79-bf51-e95011046621 tempest-AttachVolumeNegativeTest-1640336653 tempest-AttachVolumeNegativeTest-1640336653-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:05:35.335954 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-2cb2ef92-5aa2-4e79-bf51-e95011046621 tempest-AttachVolumeNegativeTest-1640336653 tempest-AttachVolumeNegativeTest-1640336653-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:05:35.336382 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-2cb2ef92-5aa2-4e79-bf51-e95011046621 tempest-AttachVolumeNegativeTest-1640336653 tempest-AttachVolumeNegativeTest-1640336653-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:05:35.374224 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.virt.hardware [None req-96c914bc-5d65-4a08-837d-d0bf944fa9ec tempest-VolumesNegativeTest-1333024728 tempest-VolumesNegativeTest-1333024728-project] Flavor limits 0:0:0 {{(pid=116156) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Dec 15 03:05:35.374723 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.virt.hardware [None req-96c914bc-5d65-4a08-837d-d0bf944fa9ec tempest-VolumesNegativeTest-1333024728 tempest-VolumesNegativeTest-1333024728-project] Image limits 0:0:0 {{(pid=116156) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Dec 15 03:05:35.375272 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.virt.hardware [None req-96c914bc-5d65-4a08-837d-d0bf944fa9ec tempest-VolumesNegativeTest-1333024728 tempest-VolumesNegativeTest-1333024728-project] Flavor pref 0:0:0 {{(pid=116156) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Dec 15 03:05:35.375759 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.virt.hardware [None req-96c914bc-5d65-4a08-837d-d0bf944fa9ec tempest-VolumesNegativeTest-1333024728 tempest-VolumesNegativeTest-1333024728-project] Image pref 0:0:0 {{(pid=116156) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Dec 15 03:05:35.376262 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.virt.hardware [None req-96c914bc-5d65-4a08-837d-d0bf944fa9ec tempest-VolumesNegativeTest-1333024728 tempest-VolumesNegativeTest-1333024728-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116156) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Dec 15 03:05:35.384821 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-96c914bc-5d65-4a08-837d-d0bf944fa9ec tempest-VolumesNegativeTest-1333024728 tempest-VolumesNegativeTest-1333024728-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:05:35.385275 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-96c914bc-5d65-4a08-837d-d0bf944fa9ec tempest-VolumesNegativeTest-1333024728 tempest-VolumesNegativeTest-1333024728-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:05:35.386135 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-96c914bc-5d65-4a08-837d-d0bf944fa9ec tempest-VolumesNegativeTest-1333024728 tempest-VolumesNegativeTest-1333024728-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:05:35.386576 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-96c914bc-5d65-4a08-837d-d0bf944fa9ec tempest-VolumesNegativeTest-1333024728 tempest-VolumesNegativeTest-1333024728-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:05:35.403336 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.quota [None req-96c914bc-5d65-4a08-837d-d0bf944fa9ec tempest-VolumesNegativeTest-1333024728 tempest-VolumesNegativeTest-1333024728-project] Getting quotas for project b28917c863104bbe9abc5f7e87803f9e. Resources: {'cores', 'instances', 'ram'} {{(pid=116156) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 15 03:05:35.407870 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.quota [None req-96c914bc-5d65-4a08-837d-d0bf944fa9ec tempest-VolumesNegativeTest-1333024728 tempest-VolumesNegativeTest-1333024728-project] Getting quotas for user 2249449813ef41928c52b2d66314b89d and project b28917c863104bbe9abc5f7e87803f9e. Resources: {'cores', 'instances', 'ram'} {{(pid=116156) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 15 03:05:35.419589 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.compute.api [None req-96c914bc-5d65-4a08-837d-d0bf944fa9ec tempest-VolumesNegativeTest-1333024728 tempest-VolumesNegativeTest-1333024728-project] Going to run 1 instances... {{(pid=116156) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Dec 15 03:05:35.422058 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.compute.api [None req-96c914bc-5d65-4a08-837d-d0bf944fa9ec tempest-VolumesNegativeTest-1333024728 tempest-VolumesNegativeTest-1333024728-project] [instance: 2365eae1-dcfc-4a4b-ad6b-8716ad710496] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='5195b034-9fa4-468b-a94d-ef3ee79ce449',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=116156) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Dec 15 03:05:35.463987 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: INFO nova.api.openstack.requestlog [None req-96c914bc-5d65-4a08-837d-d0bf944fa9ec tempest-VolumesNegativeTest-1333024728 tempest-VolumesNegativeTest-1333024728-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.446892 Dec 15 03:05:35.464542 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: [pid: 116156|app: 0|req: 211/387] 10.222.0.18 () {60 vars in 1146 bytes} [Wed Dec 15 03:05:35 2021] POST /compute/v2.1/servers => generated 380 bytes in 449 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Dec 15 03:05:35.474797 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi [None req-a49c9be0-1639-4bed-b12f-e342b67efd01 tempest-VolumesNegativeTest-1333024728 tempest-VolumesNegativeTest-1333024728-project] Calling method '>' {{(pid=116156) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:05:35.475403 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.compute.api [None req-a49c9be0-1639-4bed-b12f-e342b67efd01 tempest-VolumesNegativeTest-1333024728 tempest-VolumesNegativeTest-1333024728-project] [instance: 2365eae1-dcfc-4a4b-ad6b-8716ad710496] Fetching instance by UUID {{(pid=116156) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:05:35.525670 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.policy [None req-a49c9be0-1639-4bed-b12f-e342b67efd01 tempest-VolumesNegativeTest-1333024728 tempest-VolumesNegativeTest-1333024728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2249449813ef41928c52b2d66314b89d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b28917c863104bbe9abc5f7e87803f9e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116156) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:05:35.532738 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: INFO nova.api.openstack.requestlog [None req-a49c9be0-1639-4bed-b12f-e342b67efd01 tempest-VolumesNegativeTest-1333024728 tempest-VolumesNegativeTest-1333024728-project] 10.222.0.18 "GET /compute/v2.1/servers/2365eae1-dcfc-4a4b-ad6b-8716ad710496" status: 200 len: 1215 microversion: 2.1 time: 0.061479 Dec 15 03:05:35.533296 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: [pid: 116156|app: 0|req: 212/388] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 03:05:35 2021] GET /compute/v2.1/servers/2365eae1-dcfc-4a4b-ad6b-8716ad710496 => generated 1215 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 03:05:35.613242 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi [None req-026adbc5-daf4-4fc8-9e95-7668d95edf67 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116156) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 03:05:35.615135 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.compute.api [None req-026adbc5-daf4-4fc8-9e95-7668d95edf67 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] [instance: b89094ac-aee1-4bd6-a33d-8c4347cebfc7] Fetching instance by UUID {{(pid=116156) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:05:35.624851 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-026adbc5-daf4-4fc8-9e95-7668d95edf67 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:05:35.625289 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-026adbc5-daf4-4fc8-9e95-7668d95edf67 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:05:35.626403 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-026adbc5-daf4-4fc8-9e95-7668d95edf67 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:05:35.626860 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-026adbc5-daf4-4fc8-9e95-7668d95edf67 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:05:35.750775 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: INFO nova.api.openstack.requestlog [None req-026adbc5-daf4-4fc8-9e95-7668d95edf67 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] 10.222.0.18 "POST /compute/v2.1/servers/b89094ac-aee1-4bd6-a33d-8c4347cebfc7/action" status: 200 len: 23800 microversion: 2.20 time: 0.141723 Dec 15 03:05:35.752813 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: [pid: 116156|app: 0|req: 213/389] 10.222.0.18 () {62 vars in 1318 bytes} [Wed Dec 15 03:05:35 2021] POST /compute/v2.1/servers/b89094ac-aee1-4bd6-a33d-8c4347cebfc7/action => generated 23800 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Dec 15 03:05:35.757078 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: INFO nova.api.openstack.requestlog [None req-2cb2ef92-5aa2-4e79-bf51-e95011046621 tempest-AttachVolumeNegativeTest-1640336653 tempest-AttachVolumeNegativeTest-1640336653-project] 10.222.0.18 "POST /compute/v2.1/servers/c3d5f143-e994-4098-989b-660411a8dd8f/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.433382 Dec 15 03:05:35.758992 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi [None req-87106cfe-1d99-4089-8235-6fff56aad762 tempest-ServerRescueNegativeTestJSON-2061875223 tempest-ServerRescueNegativeTestJSON-2061875223-project] Calling method '>' {{(pid=116156) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:05:35.759415 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: [pid: 116157|app: 0|req: 177/390] 10.222.0.18 () {60 vars in 1322 bytes} [Wed Dec 15 03:05:35 2021] POST /compute/v2.1/servers/c3d5f143-e994-4098-989b-660411a8dd8f/os-volume_attachments => generated 194 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 15 03:05:35.759898 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.compute.api [None req-87106cfe-1d99-4089-8235-6fff56aad762 tempest-ServerRescueNegativeTestJSON-2061875223 tempest-ServerRescueNegativeTestJSON-2061875223-project] [instance: 9bbb0abf-72a3-4fbc-8235-7a3ecfc8d006] Fetching instance by UUID {{(pid=116156) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:05:35.768234 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-87106cfe-1d99-4089-8235-6fff56aad762 tempest-ServerRescueNegativeTestJSON-2061875223 tempest-ServerRescueNegativeTestJSON-2061875223-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:05:35.769589 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-87106cfe-1d99-4089-8235-6fff56aad762 tempest-ServerRescueNegativeTestJSON-2061875223 tempest-ServerRescueNegativeTestJSON-2061875223-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:05:35.770818 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-87106cfe-1d99-4089-8235-6fff56aad762 tempest-ServerRescueNegativeTestJSON-2061875223 tempest-ServerRescueNegativeTestJSON-2061875223-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:05:35.771478 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-87106cfe-1d99-4089-8235-6fff56aad762 tempest-ServerRescueNegativeTestJSON-2061875223 tempest-ServerRescueNegativeTestJSON-2061875223-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:05:35.940545 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.policy [None req-87106cfe-1d99-4089-8235-6fff56aad762 tempest-ServerRescueNegativeTestJSON-2061875223 tempest-ServerRescueNegativeTestJSON-2061875223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ea02b6e8f1548a1bd78952cb7337403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5e8a958d4bf43868502b13728b9583b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116156) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:05:35.948365 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: INFO nova.api.openstack.requestlog [None req-87106cfe-1d99-4089-8235-6fff56aad762 tempest-ServerRescueNegativeTestJSON-2061875223 tempest-ServerRescueNegativeTestJSON-2061875223-project] 10.222.0.18 "GET /compute/v2.1/servers/9bbb0abf-72a3-4fbc-8235-7a3ecfc8d006" status: 200 len: 1567 microversion: 2.1 time: 0.194129 Dec 15 03:05:35.948928 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: [pid: 116156|app: 0|req: 214/391] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 03:05:35 2021] GET /compute/v2.1/servers/9bbb0abf-72a3-4fbc-8235-7a3ecfc8d006 => generated 1567 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 03:05:36.222327 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi [None req-f5d8d470-b6d7-41d2-9832-5dfd563ef931 tempest-VolumesActionsTest-1837279088 tempest-VolumesActionsTest-1837279088-project] Calling method '>' {{(pid=116157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:05:36.223045 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.compute.api [None req-f5d8d470-b6d7-41d2-9832-5dfd563ef931 tempest-VolumesActionsTest-1837279088 tempest-VolumesActionsTest-1837279088-project] [instance: 41e95883-9297-4d1d-b0aa-33068fb973cd] Fetching instance by UUID {{(pid=116157) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:05:36.229759 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-f5d8d470-b6d7-41d2-9832-5dfd563ef931 tempest-VolumesActionsTest-1837279088 tempest-VolumesActionsTest-1837279088-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:05:36.230227 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-f5d8d470-b6d7-41d2-9832-5dfd563ef931 tempest-VolumesActionsTest-1837279088 tempest-VolumesActionsTest-1837279088-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:05:36.231106 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-f5d8d470-b6d7-41d2-9832-5dfd563ef931 tempest-VolumesActionsTest-1837279088 tempest-VolumesActionsTest-1837279088-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:05:36.231620 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-f5d8d470-b6d7-41d2-9832-5dfd563ef931 tempest-VolumesActionsTest-1837279088 tempest-VolumesActionsTest-1837279088-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:05:36.377958 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.policy [None req-f5d8d470-b6d7-41d2-9832-5dfd563ef931 tempest-VolumesActionsTest-1837279088 tempest-VolumesActionsTest-1837279088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e440754469c4407840a651d560ce08a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6eaf458d3c84ba59b078dc0a3bf1763', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116157) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:05:36.385310 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: INFO nova.api.openstack.requestlog [None req-f5d8d470-b6d7-41d2-9832-5dfd563ef931 tempest-VolumesActionsTest-1837279088 tempest-VolumesActionsTest-1837279088-project] 10.222.0.18 "GET /compute/v2.1/servers/41e95883-9297-4d1d-b0aa-33068fb973cd" status: 200 len: 1497 microversion: 2.1 time: 0.168167 Dec 15 03:05:36.386101 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: [pid: 116157|app: 0|req: 178/392] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 03:05:36 2021] GET /compute/v2.1/servers/41e95883-9297-4d1d-b0aa-33068fb973cd => generated 1497 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 03:05:36.550573 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi [None req-33f40ea6-9e0f-433a-997c-79446e610afe tempest-VolumesNegativeTest-1333024728 tempest-VolumesNegativeTest-1333024728-project] Calling method '>' {{(pid=116156) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:05:36.551187 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.compute.api [None req-33f40ea6-9e0f-433a-997c-79446e610afe tempest-VolumesNegativeTest-1333024728 tempest-VolumesNegativeTest-1333024728-project] [instance: 2365eae1-dcfc-4a4b-ad6b-8716ad710496] Fetching instance by UUID {{(pid=116156) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:05:36.558026 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-33f40ea6-9e0f-433a-997c-79446e610afe tempest-VolumesNegativeTest-1333024728 tempest-VolumesNegativeTest-1333024728-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:05:36.558485 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-33f40ea6-9e0f-433a-997c-79446e610afe tempest-VolumesNegativeTest-1333024728 tempest-VolumesNegativeTest-1333024728-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:05:36.559264 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-33f40ea6-9e0f-433a-997c-79446e610afe tempest-VolumesNegativeTest-1333024728 tempest-VolumesNegativeTest-1333024728-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:05:36.559698 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-33f40ea6-9e0f-433a-997c-79446e610afe tempest-VolumesNegativeTest-1333024728 tempest-VolumesNegativeTest-1333024728-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:05:36.617758 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.policy [None req-33f40ea6-9e0f-433a-997c-79446e610afe tempest-VolumesNegativeTest-1333024728 tempest-VolumesNegativeTest-1333024728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2249449813ef41928c52b2d66314b89d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b28917c863104bbe9abc5f7e87803f9e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116156) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:05:36.625497 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: INFO nova.api.openstack.requestlog [None req-33f40ea6-9e0f-433a-997c-79446e610afe tempest-VolumesNegativeTest-1333024728 tempest-VolumesNegativeTest-1333024728-project] 10.222.0.18 "GET /compute/v2.1/servers/2365eae1-dcfc-4a4b-ad6b-8716ad710496" status: 200 len: 1267 microversion: 2.1 time: 0.079578 Dec 15 03:05:36.626069 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: [pid: 116156|app: 0|req: 215/393] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 03:05:36 2021] GET /compute/v2.1/servers/2365eae1-dcfc-4a4b-ad6b-8716ad710496 => generated 1267 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 03:05:36.763415 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi [None req-f36ac3fd-47e0-4b1b-9827-5bd2bdafd607 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 03:05:36.764392 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.compute.api [None req-f36ac3fd-47e0-4b1b-9827-5bd2bdafd607 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] [instance: b89094ac-aee1-4bd6-a33d-8c4347cebfc7] Fetching instance by UUID {{(pid=116157) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:05:36.770625 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-f36ac3fd-47e0-4b1b-9827-5bd2bdafd607 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:05:36.771082 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-f36ac3fd-47e0-4b1b-9827-5bd2bdafd607 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:05:36.771869 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-f36ac3fd-47e0-4b1b-9827-5bd2bdafd607 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:05:36.772305 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-f36ac3fd-47e0-4b1b-9827-5bd2bdafd607 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:05:36.931746 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: INFO nova.api.openstack.requestlog [None req-f36ac3fd-47e0-4b1b-9827-5bd2bdafd607 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] 10.222.0.18 "POST /compute/v2.1/servers/b89094ac-aee1-4bd6-a33d-8c4347cebfc7/action" status: 200 len: 24642 microversion: 2.20 time: 0.171976 Dec 15 03:05:36.933226 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: [pid: 116157|app: 0|req: 179/394] 10.222.0.18 () {62 vars in 1318 bytes} [Wed Dec 15 03:05:36 2021] POST /compute/v2.1/servers/b89094ac-aee1-4bd6-a33d-8c4347cebfc7/action => generated 24642 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 15 03:05:36.967300 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi [None req-dc68bd36-de59-48e6-baa7-f49c3fe479ea tempest-ServerRescueNegativeTestJSON-2061875223 tempest-ServerRescueNegativeTestJSON-2061875223-project] Calling method '>' {{(pid=116156) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:05:36.967980 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.compute.api [None req-dc68bd36-de59-48e6-baa7-f49c3fe479ea tempest-ServerRescueNegativeTestJSON-2061875223 tempest-ServerRescueNegativeTestJSON-2061875223-project] [instance: 9bbb0abf-72a3-4fbc-8235-7a3ecfc8d006] Fetching instance by UUID {{(pid=116156) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:05:36.983207 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-dc68bd36-de59-48e6-baa7-f49c3fe479ea tempest-ServerRescueNegativeTestJSON-2061875223 tempest-ServerRescueNegativeTestJSON-2061875223-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:05:36.986187 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-dc68bd36-de59-48e6-baa7-f49c3fe479ea tempest-ServerRescueNegativeTestJSON-2061875223 tempest-ServerRescueNegativeTestJSON-2061875223-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:05:36.988031 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-dc68bd36-de59-48e6-baa7-f49c3fe479ea tempest-ServerRescueNegativeTestJSON-2061875223 tempest-ServerRescueNegativeTestJSON-2061875223-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:05:36.988470 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-dc68bd36-de59-48e6-baa7-f49c3fe479ea tempest-ServerRescueNegativeTestJSON-2061875223 tempest-ServerRescueNegativeTestJSON-2061875223-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:05:37.217551 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.policy [None req-dc68bd36-de59-48e6-baa7-f49c3fe479ea tempest-ServerRescueNegativeTestJSON-2061875223 tempest-ServerRescueNegativeTestJSON-2061875223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ea02b6e8f1548a1bd78952cb7337403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5e8a958d4bf43868502b13728b9583b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116156) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:05:37.228136 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: INFO nova.api.openstack.requestlog [None req-dc68bd36-de59-48e6-baa7-f49c3fe479ea tempest-ServerRescueNegativeTestJSON-2061875223 tempest-ServerRescueNegativeTestJSON-2061875223-project] 10.222.0.18 "GET /compute/v2.1/servers/9bbb0abf-72a3-4fbc-8235-7a3ecfc8d006" status: 200 len: 1567 microversion: 2.1 time: 0.266829 Dec 15 03:05:37.230674 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: [pid: 116156|app: 0|req: 216/395] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 03:05:36 2021] GET /compute/v2.1/servers/9bbb0abf-72a3-4fbc-8235-7a3ecfc8d006 => generated 1567 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 03:05:37.255137 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi [None req-7bd757d2-87b4-4343-af24-a17d6b2c9a10 tempest-VolumesActionsTest-1837279088 tempest-VolumesActionsTest-1837279088-project] Calling method '>' {{(pid=116157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:05:37.255742 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.compute.api [None req-7bd757d2-87b4-4343-af24-a17d6b2c9a10 tempest-VolumesActionsTest-1837279088 tempest-VolumesActionsTest-1837279088-project] [instance: 41e95883-9297-4d1d-b0aa-33068fb973cd] Fetching instance by UUID {{(pid=116157) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:05:37.262091 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-7bd757d2-87b4-4343-af24-a17d6b2c9a10 tempest-VolumesActionsTest-1837279088 tempest-VolumesActionsTest-1837279088-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:05:37.262870 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-7bd757d2-87b4-4343-af24-a17d6b2c9a10 tempest-VolumesActionsTest-1837279088 tempest-VolumesActionsTest-1837279088-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:05:37.263712 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-7bd757d2-87b4-4343-af24-a17d6b2c9a10 tempest-VolumesActionsTest-1837279088 tempest-VolumesActionsTest-1837279088-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:05:37.264143 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-7bd757d2-87b4-4343-af24-a17d6b2c9a10 tempest-VolumesActionsTest-1837279088 tempest-VolumesActionsTest-1837279088-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:05:37.292514 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.compute.api [None req-7bd757d2-87b4-4343-af24-a17d6b2c9a10 tempest-VolumesActionsTest-1837279088 tempest-VolumesActionsTest-1837279088-project] [instance: 41e95883-9297-4d1d-b0aa-33068fb973cd] Going to try to terminate instance {{(pid=116157) delete /opt/stack/nova/nova/compute/api.py:2614}} Dec 15 03:05:37.379951 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: INFO nova.api.openstack.requestlog [None req-7bd757d2-87b4-4343-af24-a17d6b2c9a10 tempest-VolumesActionsTest-1837279088 tempest-VolumesActionsTest-1837279088-project] 10.222.0.18 "DELETE /compute/v2.1/servers/41e95883-9297-4d1d-b0aa-33068fb973cd" status: 204 len: 0 microversion: 2.1 time: 0.129413 Dec 15 03:05:37.380780 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: [pid: 116157|app: 0|req: 180/396] 10.222.0.18 () {58 vars in 1238 bytes} [Wed Dec 15 03:05:37 2021] DELETE /compute/v2.1/servers/41e95883-9297-4d1d-b0aa-33068fb973cd => generated 0 bytes in 131 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Dec 15 03:05:37.388740 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi [None req-49f71476-d873-498f-b25e-04a57797c559 tempest-VolumesActionsTest-1837279088 tempest-VolumesActionsTest-1837279088-project] Calling method '>' {{(pid=116156) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:05:37.389272 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.compute.api [None req-49f71476-d873-498f-b25e-04a57797c559 tempest-VolumesActionsTest-1837279088 tempest-VolumesActionsTest-1837279088-project] [instance: 41e95883-9297-4d1d-b0aa-33068fb973cd] Fetching instance by UUID {{(pid=116156) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:05:37.396806 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-49f71476-d873-498f-b25e-04a57797c559 tempest-VolumesActionsTest-1837279088 tempest-VolumesActionsTest-1837279088-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:05:37.397904 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-49f71476-d873-498f-b25e-04a57797c559 tempest-VolumesActionsTest-1837279088 tempest-VolumesActionsTest-1837279088-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:05:37.399441 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-49f71476-d873-498f-b25e-04a57797c559 tempest-VolumesActionsTest-1837279088 tempest-VolumesActionsTest-1837279088-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:05:37.400838 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-49f71476-d873-498f-b25e-04a57797c559 tempest-VolumesActionsTest-1837279088 tempest-VolumesActionsTest-1837279088-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:05:37.639143 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.policy [None req-49f71476-d873-498f-b25e-04a57797c559 tempest-VolumesActionsTest-1837279088 tempest-VolumesActionsTest-1837279088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e440754469c4407840a651d560ce08a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6eaf458d3c84ba59b078dc0a3bf1763', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116156) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:05:37.642769 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi [None req-88b17c3f-4003-49a6-ad9f-a3851e472ee8 tempest-VolumesNegativeTest-1333024728 tempest-VolumesNegativeTest-1333024728-project] Calling method '>' {{(pid=116157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:05:37.643468 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.compute.api [None req-88b17c3f-4003-49a6-ad9f-a3851e472ee8 tempest-VolumesNegativeTest-1333024728 tempest-VolumesNegativeTest-1333024728-project] [instance: 2365eae1-dcfc-4a4b-ad6b-8716ad710496] Fetching instance by UUID {{(pid=116157) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:05:37.648126 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: INFO nova.api.openstack.requestlog [None req-49f71476-d873-498f-b25e-04a57797c559 tempest-VolumesActionsTest-1837279088 tempest-VolumesActionsTest-1837279088-project] 10.222.0.18 "GET /compute/v2.1/servers/41e95883-9297-4d1d-b0aa-33068fb973cd" status: 200 len: 1503 microversion: 2.1 time: 0.262991 Dec 15 03:05:37.649023 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: [pid: 116156|app: 0|req: 217/397] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 03:05:37 2021] GET /compute/v2.1/servers/41e95883-9297-4d1d-b0aa-33068fb973cd => generated 1503 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 03:05:37.651366 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-88b17c3f-4003-49a6-ad9f-a3851e472ee8 tempest-VolumesNegativeTest-1333024728 tempest-VolumesNegativeTest-1333024728-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:05:37.651950 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-88b17c3f-4003-49a6-ad9f-a3851e472ee8 tempest-VolumesNegativeTest-1333024728 tempest-VolumesNegativeTest-1333024728-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:05:37.652689 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-88b17c3f-4003-49a6-ad9f-a3851e472ee8 tempest-VolumesNegativeTest-1333024728 tempest-VolumesNegativeTest-1333024728-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:05:37.653122 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-88b17c3f-4003-49a6-ad9f-a3851e472ee8 tempest-VolumesNegativeTest-1333024728 tempest-VolumesNegativeTest-1333024728-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:05:37.716396 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.policy [None req-88b17c3f-4003-49a6-ad9f-a3851e472ee8 tempest-VolumesNegativeTest-1333024728 tempest-VolumesNegativeTest-1333024728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2249449813ef41928c52b2d66314b89d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b28917c863104bbe9abc5f7e87803f9e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116157) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:05:37.724357 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: INFO nova.api.openstack.requestlog [None req-88b17c3f-4003-49a6-ad9f-a3851e472ee8 tempest-VolumesNegativeTest-1333024728 tempest-VolumesNegativeTest-1333024728-project] 10.222.0.18 "GET /compute/v2.1/servers/2365eae1-dcfc-4a4b-ad6b-8716ad710496" status: 200 len: 1273 microversion: 2.1 time: 0.086378 Dec 15 03:05:37.725005 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: [pid: 116157|app: 0|req: 181/398] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 03:05:37 2021] GET /compute/v2.1/servers/2365eae1-dcfc-4a4b-ad6b-8716ad710496 => generated 1273 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 03:05:37.955170 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi [None req-b0bbe0f9-ef58-4da7-a300-34c2b5293ae6 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116156) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 03:05:37.956539 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.compute.api [None req-b0bbe0f9-ef58-4da7-a300-34c2b5293ae6 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] [instance: b89094ac-aee1-4bd6-a33d-8c4347cebfc7] Fetching instance by UUID {{(pid=116156) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:05:37.969873 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-b0bbe0f9-ef58-4da7-a300-34c2b5293ae6 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:05:37.970583 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-b0bbe0f9-ef58-4da7-a300-34c2b5293ae6 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:05:37.971468 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-b0bbe0f9-ef58-4da7-a300-34c2b5293ae6 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:05:37.972834 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-b0bbe0f9-ef58-4da7-a300-34c2b5293ae6 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:05:38.117403 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: INFO nova.api.openstack.requestlog [None req-b0bbe0f9-ef58-4da7-a300-34c2b5293ae6 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] 10.222.0.18 "POST /compute/v2.1/servers/b89094ac-aee1-4bd6-a33d-8c4347cebfc7/action" status: 200 len: 25654 microversion: 2.20 time: 0.176549 Dec 15 03:05:38.118128 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: [pid: 116156|app: 0|req: 218/399] 10.222.0.18 () {62 vars in 1318 bytes} [Wed Dec 15 03:05:37 2021] POST /compute/v2.1/servers/b89094ac-aee1-4bd6-a33d-8c4347cebfc7/action => generated 25654 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 15 03:05:38.247063 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi [None req-538b213a-ea59-48a6-9f43-e7a0072cf2da tempest-ServerRescueNegativeTestJSON-2061875223 tempest-ServerRescueNegativeTestJSON-2061875223-project] Calling method '>' {{(pid=116157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:05:38.247671 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.compute.api [None req-538b213a-ea59-48a6-9f43-e7a0072cf2da tempest-ServerRescueNegativeTestJSON-2061875223 tempest-ServerRescueNegativeTestJSON-2061875223-project] [instance: 9bbb0abf-72a3-4fbc-8235-7a3ecfc8d006] Fetching instance by UUID {{(pid=116157) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:05:38.254537 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-538b213a-ea59-48a6-9f43-e7a0072cf2da tempest-ServerRescueNegativeTestJSON-2061875223 tempest-ServerRescueNegativeTestJSON-2061875223-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:05:38.254989 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-538b213a-ea59-48a6-9f43-e7a0072cf2da tempest-ServerRescueNegativeTestJSON-2061875223 tempest-ServerRescueNegativeTestJSON-2061875223-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:05:38.255774 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-538b213a-ea59-48a6-9f43-e7a0072cf2da tempest-ServerRescueNegativeTestJSON-2061875223 tempest-ServerRescueNegativeTestJSON-2061875223-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:05:38.256344 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-538b213a-ea59-48a6-9f43-e7a0072cf2da tempest-ServerRescueNegativeTestJSON-2061875223 tempest-ServerRescueNegativeTestJSON-2061875223-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:05:38.407060 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.policy [None req-538b213a-ea59-48a6-9f43-e7a0072cf2da tempest-ServerRescueNegativeTestJSON-2061875223 tempest-ServerRescueNegativeTestJSON-2061875223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ea02b6e8f1548a1bd78952cb7337403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5e8a958d4bf43868502b13728b9583b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116157) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:05:38.419532 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: INFO nova.api.openstack.requestlog [None req-538b213a-ea59-48a6-9f43-e7a0072cf2da tempest-ServerRescueNegativeTestJSON-2061875223 tempest-ServerRescueNegativeTestJSON-2061875223-project] 10.222.0.18 "GET /compute/v2.1/servers/9bbb0abf-72a3-4fbc-8235-7a3ecfc8d006" status: 200 len: 1567 microversion: 2.1 time: 0.176160 Dec 15 03:05:38.430524 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: [pid: 116157|app: 0|req: 182/400] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 03:05:38 2021] GET /compute/v2.1/servers/9bbb0abf-72a3-4fbc-8235-7a3ecfc8d006 => generated 1567 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 03:05:38.607908 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi [req-d21a5ceb-9d2f-4405-b19d-3343f36a559c req-65a173b4-0212-46c1-be48-a88bfc878fef service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2365eae1-dcfc-4a4b-ad6b-8716ad710496", "tag": "22ba3072-6295-4211-ab35-5e0cd72571c9"}]} {{(pid=116156) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 03:05:38.609501 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 15 03:05:38.609501 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: warnings.warn(msg) Dec 15 03:05:38.620100 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [req-d21a5ceb-9d2f-4405-b19d-3343f36a559c req-65a173b4-0212-46c1-be48-a88bfc878fef service nova] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:05:38.620793 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [req-d21a5ceb-9d2f-4405-b19d-3343f36a559c req-65a173b4-0212-46c1-be48-a88bfc878fef service nova] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:05:38.634274 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: INFO nova.api.openstack.compute.server_external_events [req-d21a5ceb-9d2f-4405-b19d-3343f36a559c req-65a173b4-0212-46c1-be48-a88bfc878fef service nova] Creating event network-changed:22ba3072-6295-4211-ab35-5e0cd72571c9 for instance 2365eae1-dcfc-4a4b-ad6b-8716ad710496 on hv-cinder-81803 Dec 15 03:05:38.640280 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: INFO nova.api.openstack.requestlog [req-d21a5ceb-9d2f-4405-b19d-3343f36a559c req-65a173b4-0212-46c1-be48-a88bfc878fef service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045282 Dec 15 03:05:38.641555 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: [pid: 116156|app: 0|req: 219/401] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Dec 15 03:05:38 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 03:05:38.666329 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi [None req-1846dda0-d41c-48e4-8485-5d7c9cd175bf tempest-VolumesActionsTest-1837279088 tempest-VolumesActionsTest-1837279088-project] Calling method '>' {{(pid=116157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:05:38.667094 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.compute.api [None req-1846dda0-d41c-48e4-8485-5d7c9cd175bf tempest-VolumesActionsTest-1837279088 tempest-VolumesActionsTest-1837279088-project] [instance: 41e95883-9297-4d1d-b0aa-33068fb973cd] Fetching instance by UUID {{(pid=116157) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:05:38.674205 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-1846dda0-d41c-48e4-8485-5d7c9cd175bf tempest-VolumesActionsTest-1837279088 tempest-VolumesActionsTest-1837279088-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:05:38.674747 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-1846dda0-d41c-48e4-8485-5d7c9cd175bf tempest-VolumesActionsTest-1837279088 tempest-VolumesActionsTest-1837279088-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:05:38.675623 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-1846dda0-d41c-48e4-8485-5d7c9cd175bf tempest-VolumesActionsTest-1837279088 tempest-VolumesActionsTest-1837279088-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:05:38.676131 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-1846dda0-d41c-48e4-8485-5d7c9cd175bf tempest-VolumesActionsTest-1837279088 tempest-VolumesActionsTest-1837279088-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:05:38.742512 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi [None req-6f945965-d1b7-4a87-bc78-a6a7ccb8c583 tempest-VolumesNegativeTest-1333024728 tempest-VolumesNegativeTest-1333024728-project] Calling method '>' {{(pid=116156) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:05:38.743210 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.compute.api [None req-6f945965-d1b7-4a87-bc78-a6a7ccb8c583 tempest-VolumesNegativeTest-1333024728 tempest-VolumesNegativeTest-1333024728-project] [instance: 2365eae1-dcfc-4a4b-ad6b-8716ad710496] Fetching instance by UUID {{(pid=116156) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:05:38.749933 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-6f945965-d1b7-4a87-bc78-a6a7ccb8c583 tempest-VolumesNegativeTest-1333024728 tempest-VolumesNegativeTest-1333024728-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:05:38.750650 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-6f945965-d1b7-4a87-bc78-a6a7ccb8c583 tempest-VolumesNegativeTest-1333024728 tempest-VolumesNegativeTest-1333024728-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:05:38.751556 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-6f945965-d1b7-4a87-bc78-a6a7ccb8c583 tempest-VolumesNegativeTest-1333024728 tempest-VolumesNegativeTest-1333024728-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:05:38.752229 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-6f945965-d1b7-4a87-bc78-a6a7ccb8c583 tempest-VolumesNegativeTest-1333024728 tempest-VolumesNegativeTest-1333024728-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:05:38.820123 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.policy [None req-1846dda0-d41c-48e4-8485-5d7c9cd175bf tempest-VolumesActionsTest-1837279088 tempest-VolumesActionsTest-1837279088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e440754469c4407840a651d560ce08a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6eaf458d3c84ba59b078dc0a3bf1763', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116157) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:05:38.827364 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: INFO nova.api.openstack.requestlog [None req-1846dda0-d41c-48e4-8485-5d7c9cd175bf tempest-VolumesActionsTest-1837279088 tempest-VolumesActionsTest-1837279088-project] 10.222.0.18 "GET /compute/v2.1/servers/41e95883-9297-4d1d-b0aa-33068fb973cd" status: 200 len: 1503 microversion: 2.1 time: 0.164699 Dec 15 03:05:38.827923 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: [pid: 116157|app: 0|req: 183/402] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 03:05:38 2021] GET /compute/v2.1/servers/41e95883-9297-4d1d-b0aa-33068fb973cd => generated 1503 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 03:05:38.961897 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.policy [None req-6f945965-d1b7-4a87-bc78-a6a7ccb8c583 tempest-VolumesNegativeTest-1333024728 tempest-VolumesNegativeTest-1333024728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2249449813ef41928c52b2d66314b89d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b28917c863104bbe9abc5f7e87803f9e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116156) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:05:38.969442 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: INFO nova.api.openstack.requestlog [None req-6f945965-d1b7-4a87-bc78-a6a7ccb8c583 tempest-VolumesNegativeTest-1333024728 tempest-VolumesNegativeTest-1333024728-project] 10.222.0.18 "GET /compute/v2.1/servers/2365eae1-dcfc-4a4b-ad6b-8716ad710496" status: 200 len: 1315 microversion: 2.1 time: 0.231570 Dec 15 03:05:38.970051 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: [pid: 116156|app: 0|req: 220/403] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 03:05:38 2021] GET /compute/v2.1/servers/2365eae1-dcfc-4a4b-ad6b-8716ad710496 => generated 1315 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 03:05:39.129323 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi [None req-4259cab5-3e82-45a7-bb5f-82469aca43f7 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 03:05:39.130367 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.compute.api [None req-4259cab5-3e82-45a7-bb5f-82469aca43f7 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] [instance: b89094ac-aee1-4bd6-a33d-8c4347cebfc7] Fetching instance by UUID {{(pid=116157) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:05:39.136655 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-4259cab5-3e82-45a7-bb5f-82469aca43f7 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:05:39.137097 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-4259cab5-3e82-45a7-bb5f-82469aca43f7 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:05:39.137886 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-4259cab5-3e82-45a7-bb5f-82469aca43f7 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:05:39.138343 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-4259cab5-3e82-45a7-bb5f-82469aca43f7 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:05:39.251358 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: INFO nova.api.openstack.requestlog [None req-4259cab5-3e82-45a7-bb5f-82469aca43f7 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] 10.222.0.18 "POST /compute/v2.1/servers/b89094ac-aee1-4bd6-a33d-8c4347cebfc7/action" status: 200 len: 26309 microversion: 2.20 time: 0.125396 Dec 15 03:05:39.252010 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: [pid: 116157|app: 0|req: 184/404] 10.222.0.18 () {62 vars in 1318 bytes} [Wed Dec 15 03:05:39 2021] POST /compute/v2.1/servers/b89094ac-aee1-4bd6-a33d-8c4347cebfc7/action => generated 26309 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 15 03:05:39.437780 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi [None req-f03e8892-7bb5-4f26-ba5a-ab0ad5c32a52 tempest-ServerRescueNegativeTestJSON-2061875223 tempest-ServerRescueNegativeTestJSON-2061875223-project] Calling method '>' {{(pid=116156) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:05:39.438482 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.compute.api [None req-f03e8892-7bb5-4f26-ba5a-ab0ad5c32a52 tempest-ServerRescueNegativeTestJSON-2061875223 tempest-ServerRescueNegativeTestJSON-2061875223-project] [instance: 9bbb0abf-72a3-4fbc-8235-7a3ecfc8d006] Fetching instance by UUID {{(pid=116156) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:05:39.444747 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-f03e8892-7bb5-4f26-ba5a-ab0ad5c32a52 tempest-ServerRescueNegativeTestJSON-2061875223 tempest-ServerRescueNegativeTestJSON-2061875223-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:05:39.445203 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-f03e8892-7bb5-4f26-ba5a-ab0ad5c32a52 tempest-ServerRescueNegativeTestJSON-2061875223 tempest-ServerRescueNegativeTestJSON-2061875223-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:05:39.445993 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-f03e8892-7bb5-4f26-ba5a-ab0ad5c32a52 tempest-ServerRescueNegativeTestJSON-2061875223 tempest-ServerRescueNegativeTestJSON-2061875223-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:05:39.446461 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-f03e8892-7bb5-4f26-ba5a-ab0ad5c32a52 tempest-ServerRescueNegativeTestJSON-2061875223 tempest-ServerRescueNegativeTestJSON-2061875223-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:05:39.613741 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.policy [None req-f03e8892-7bb5-4f26-ba5a-ab0ad5c32a52 tempest-ServerRescueNegativeTestJSON-2061875223 tempest-ServerRescueNegativeTestJSON-2061875223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ea02b6e8f1548a1bd78952cb7337403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5e8a958d4bf43868502b13728b9583b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116156) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:05:39.621905 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: INFO nova.api.openstack.requestlog [None req-f03e8892-7bb5-4f26-ba5a-ab0ad5c32a52 tempest-ServerRescueNegativeTestJSON-2061875223 tempest-ServerRescueNegativeTestJSON-2061875223-project] 10.222.0.18 "GET /compute/v2.1/servers/9bbb0abf-72a3-4fbc-8235-7a3ecfc8d006" status: 200 len: 1567 microversion: 2.1 time: 0.187885 Dec 15 03:05:39.622495 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: [pid: 116156|app: 0|req: 221/405] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 03:05:39 2021] GET /compute/v2.1/servers/9bbb0abf-72a3-4fbc-8235-7a3ecfc8d006 => generated 1567 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 03:05:39.845167 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi [None req-fca09091-3730-4865-92a7-07e6d681a79a tempest-VolumesActionsTest-1837279088 tempest-VolumesActionsTest-1837279088-project] Calling method '>' {{(pid=116157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:05:39.845861 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.compute.api [None req-fca09091-3730-4865-92a7-07e6d681a79a tempest-VolumesActionsTest-1837279088 tempest-VolumesActionsTest-1837279088-project] [instance: 41e95883-9297-4d1d-b0aa-33068fb973cd] Fetching instance by UUID {{(pid=116157) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:05:39.855098 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-fca09091-3730-4865-92a7-07e6d681a79a tempest-VolumesActionsTest-1837279088 tempest-VolumesActionsTest-1837279088-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:05:39.855098 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-fca09091-3730-4865-92a7-07e6d681a79a tempest-VolumesActionsTest-1837279088 tempest-VolumesActionsTest-1837279088-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:05:39.855098 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-fca09091-3730-4865-92a7-07e6d681a79a tempest-VolumesActionsTest-1837279088 tempest-VolumesActionsTest-1837279088-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:05:39.855098 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-fca09091-3730-4865-92a7-07e6d681a79a tempest-VolumesActionsTest-1837279088 tempest-VolumesActionsTest-1837279088-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:05:39.986578 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi [None req-25d07ae5-fff0-4697-a2a7-df8c4f0a5f50 tempest-VolumesNegativeTest-1333024728 tempest-VolumesNegativeTest-1333024728-project] Calling method '>' {{(pid=116156) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:05:39.987769 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.compute.api [None req-25d07ae5-fff0-4697-a2a7-df8c4f0a5f50 tempest-VolumesNegativeTest-1333024728 tempest-VolumesNegativeTest-1333024728-project] [instance: 2365eae1-dcfc-4a4b-ad6b-8716ad710496] Fetching instance by UUID {{(pid=116156) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:05:39.994035 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-25d07ae5-fff0-4697-a2a7-df8c4f0a5f50 tempest-VolumesNegativeTest-1333024728 tempest-VolumesNegativeTest-1333024728-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:05:39.994611 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-25d07ae5-fff0-4697-a2a7-df8c4f0a5f50 tempest-VolumesNegativeTest-1333024728 tempest-VolumesNegativeTest-1333024728-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:05:39.995421 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-25d07ae5-fff0-4697-a2a7-df8c4f0a5f50 tempest-VolumesNegativeTest-1333024728 tempest-VolumesNegativeTest-1333024728-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:05:39.996409 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-25d07ae5-fff0-4697-a2a7-df8c4f0a5f50 tempest-VolumesNegativeTest-1333024728 tempest-VolumesNegativeTest-1333024728-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:05:40.067820 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.policy [None req-fca09091-3730-4865-92a7-07e6d681a79a tempest-VolumesActionsTest-1837279088 tempest-VolumesActionsTest-1837279088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e440754469c4407840a651d560ce08a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6eaf458d3c84ba59b078dc0a3bf1763', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116157) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:05:40.081253 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: INFO nova.api.openstack.requestlog [None req-fca09091-3730-4865-92a7-07e6d681a79a tempest-VolumesActionsTest-1837279088 tempest-VolumesActionsTest-1837279088-project] 10.222.0.18 "GET /compute/v2.1/servers/41e95883-9297-4d1d-b0aa-33068fb973cd" status: 200 len: 1503 microversion: 2.1 time: 0.240485 Dec 15 03:05:40.093158 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: [pid: 116157|app: 0|req: 185/406] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 03:05:39 2021] GET /compute/v2.1/servers/41e95883-9297-4d1d-b0aa-33068fb973cd => generated 1503 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 03:05:40.219244 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.policy [None req-25d07ae5-fff0-4697-a2a7-df8c4f0a5f50 tempest-VolumesNegativeTest-1333024728 tempest-VolumesNegativeTest-1333024728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2249449813ef41928c52b2d66314b89d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b28917c863104bbe9abc5f7e87803f9e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116156) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:05:40.227630 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: INFO nova.api.openstack.requestlog [None req-25d07ae5-fff0-4697-a2a7-df8c4f0a5f50 tempest-VolumesNegativeTest-1333024728 tempest-VolumesNegativeTest-1333024728-project] 10.222.0.18 "GET /compute/v2.1/servers/2365eae1-dcfc-4a4b-ad6b-8716ad710496" status: 200 len: 1315 microversion: 2.1 time: 0.244495 Dec 15 03:05:40.237433 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: [pid: 116156|app: 0|req: 222/407] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 03:05:39 2021] GET /compute/v2.1/servers/2365eae1-dcfc-4a4b-ad6b-8716ad710496 => generated 1315 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 03:05:40.268023 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi [None req-c1bbef19-dd50-47ab-a54d-27034b668093 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 03:05:40.270091 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.compute.api [None req-c1bbef19-dd50-47ab-a54d-27034b668093 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] [instance: b89094ac-aee1-4bd6-a33d-8c4347cebfc7] Fetching instance by UUID {{(pid=116157) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:05:40.277110 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-c1bbef19-dd50-47ab-a54d-27034b668093 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:05:40.278226 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-c1bbef19-dd50-47ab-a54d-27034b668093 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:05:40.279523 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-c1bbef19-dd50-47ab-a54d-27034b668093 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:05:40.280447 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-c1bbef19-dd50-47ab-a54d-27034b668093 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:05:40.417926 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: INFO nova.api.openstack.requestlog [None req-c1bbef19-dd50-47ab-a54d-27034b668093 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] 10.222.0.18 "POST /compute/v2.1/servers/b89094ac-aee1-4bd6-a33d-8c4347cebfc7/action" status: 200 len: 26898 microversion: 2.20 time: 0.158830 Dec 15 03:05:40.419010 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: [pid: 116157|app: 0|req: 186/408] 10.222.0.18 () {62 vars in 1318 bytes} [Wed Dec 15 03:05:40 2021] POST /compute/v2.1/servers/b89094ac-aee1-4bd6-a33d-8c4347cebfc7/action => generated 26898 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 15 03:05:40.441267 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi [req-2d4ae40a-524f-40ac-b8d9-1af438f6cde2 req-fd98971f-e890-4947-b19d-b1502b292c12 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "41e95883-9297-4d1d-b0aa-33068fb973cd", "name": "network-vif-deleted", "tag": "76776ba9-43a4-48a7-a30a-4a65d48d1ce7"}]} {{(pid=116156) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 03:05:40.443117 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 15 03:05:40.443117 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: warnings.warn(msg) Dec 15 03:05:40.451777 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [req-2d4ae40a-524f-40ac-b8d9-1af438f6cde2 req-fd98971f-e890-4947-b19d-b1502b292c12 service nova] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:05:40.452590 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [req-2d4ae40a-524f-40ac-b8d9-1af438f6cde2 req-fd98971f-e890-4947-b19d-b1502b292c12 service nova] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:05:40.465551 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: INFO nova.api.openstack.compute.server_external_events [req-2d4ae40a-524f-40ac-b8d9-1af438f6cde2 req-fd98971f-e890-4947-b19d-b1502b292c12 service nova] Creating event network-vif-deleted:76776ba9-43a4-48a7-a30a-4a65d48d1ce7 for instance 41e95883-9297-4d1d-b0aa-33068fb973cd on hv-cinder-81803 Dec 15 03:05:40.472773 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: INFO nova.api.openstack.requestlog [req-2d4ae40a-524f-40ac-b8d9-1af438f6cde2 req-fd98971f-e890-4947-b19d-b1502b292c12 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035867 Dec 15 03:05:40.473928 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: [pid: 116156|app: 0|req: 223/409] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Dec 15 03:05:40 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 03:05:40.639779 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi [None req-40f11180-2f1c-41c1-864a-e403708b9fa7 tempest-ServerRescueNegativeTestJSON-2061875223 tempest-ServerRescueNegativeTestJSON-2061875223-project] Calling method '>' {{(pid=116157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:05:40.640707 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.compute.api [None req-40f11180-2f1c-41c1-864a-e403708b9fa7 tempest-ServerRescueNegativeTestJSON-2061875223 tempest-ServerRescueNegativeTestJSON-2061875223-project] [instance: 9bbb0abf-72a3-4fbc-8235-7a3ecfc8d006] Fetching instance by UUID {{(pid=116157) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:05:40.649839 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-40f11180-2f1c-41c1-864a-e403708b9fa7 tempest-ServerRescueNegativeTestJSON-2061875223 tempest-ServerRescueNegativeTestJSON-2061875223-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:05:40.650877 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-40f11180-2f1c-41c1-864a-e403708b9fa7 tempest-ServerRescueNegativeTestJSON-2061875223 tempest-ServerRescueNegativeTestJSON-2061875223-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:05:40.651987 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-40f11180-2f1c-41c1-864a-e403708b9fa7 tempest-ServerRescueNegativeTestJSON-2061875223 tempest-ServerRescueNegativeTestJSON-2061875223-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:05:40.652631 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-40f11180-2f1c-41c1-864a-e403708b9fa7 tempest-ServerRescueNegativeTestJSON-2061875223 tempest-ServerRescueNegativeTestJSON-2061875223-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:05:40.843305 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.policy [None req-40f11180-2f1c-41c1-864a-e403708b9fa7 tempest-ServerRescueNegativeTestJSON-2061875223 tempest-ServerRescueNegativeTestJSON-2061875223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ea02b6e8f1548a1bd78952cb7337403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5e8a958d4bf43868502b13728b9583b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116157) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:05:40.851345 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: INFO nova.api.openstack.requestlog [None req-40f11180-2f1c-41c1-864a-e403708b9fa7 tempest-ServerRescueNegativeTestJSON-2061875223 tempest-ServerRescueNegativeTestJSON-2061875223-project] 10.222.0.18 "GET /compute/v2.1/servers/9bbb0abf-72a3-4fbc-8235-7a3ecfc8d006" status: 200 len: 1567 microversion: 2.1 time: 0.216354 Dec 15 03:05:40.851912 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: [pid: 116157|app: 0|req: 187/410] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 03:05:40 2021] GET /compute/v2.1/servers/9bbb0abf-72a3-4fbc-8235-7a3ecfc8d006 => generated 1567 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 03:05:41.098983 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi [None req-1d7bb93f-f817-45ec-b98a-23cf8c8a7b7c tempest-VolumesActionsTest-1837279088 tempest-VolumesActionsTest-1837279088-project] Calling method '>' {{(pid=116156) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:05:41.099805 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.compute.api [None req-1d7bb93f-f817-45ec-b98a-23cf8c8a7b7c tempest-VolumesActionsTest-1837279088 tempest-VolumesActionsTest-1837279088-project] [instance: 41e95883-9297-4d1d-b0aa-33068fb973cd] Fetching instance by UUID {{(pid=116156) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:05:41.108136 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-1d7bb93f-f817-45ec-b98a-23cf8c8a7b7c tempest-VolumesActionsTest-1837279088 tempest-VolumesActionsTest-1837279088-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:05:41.108766 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-1d7bb93f-f817-45ec-b98a-23cf8c8a7b7c tempest-VolumesActionsTest-1837279088 tempest-VolumesActionsTest-1837279088-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:05:41.109789 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-1d7bb93f-f817-45ec-b98a-23cf8c8a7b7c tempest-VolumesActionsTest-1837279088 tempest-VolumesActionsTest-1837279088-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:05:41.111182 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-1d7bb93f-f817-45ec-b98a-23cf8c8a7b7c tempest-VolumesActionsTest-1837279088 tempest-VolumesActionsTest-1837279088-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:05:41.125393 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: INFO nova.api.openstack.wsgi [None req-1d7bb93f-f817-45ec-b98a-23cf8c8a7b7c tempest-VolumesActionsTest-1837279088 tempest-VolumesActionsTest-1837279088-project] HTTP exception thrown: Instance 41e95883-9297-4d1d-b0aa-33068fb973cd could not be found. Dec 15 03:05:41.126206 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi [None req-1d7bb93f-f817-45ec-b98a-23cf8c8a7b7c tempest-VolumesActionsTest-1837279088 tempest-VolumesActionsTest-1837279088-project] Returning 404 to user: Instance 41e95883-9297-4d1d-b0aa-33068fb973cd could not be found. {{(pid=116156) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 15 03:05:41.127040 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: INFO nova.api.openstack.requestlog [None req-1d7bb93f-f817-45ec-b98a-23cf8c8a7b7c tempest-VolumesActionsTest-1837279088 tempest-VolumesActionsTest-1837279088-project] 10.222.0.18 "GET /compute/v2.1/servers/41e95883-9297-4d1d-b0aa-33068fb973cd" status: 404 len: 111 microversion: 2.1 time: 0.033180 Dec 15 03:05:41.130714 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: [pid: 116156|app: 0|req: 224/411] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 03:05:41 2021] GET /compute/v2.1/servers/41e95883-9297-4d1d-b0aa-33068fb973cd => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 15 03:05:41.244505 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi [None req-52f3c5a9-9b56-40bf-bf3e-13d9d7a42d91 tempest-VolumesNegativeTest-1333024728 tempest-VolumesNegativeTest-1333024728-project] Calling method '>' {{(pid=116157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:05:41.245349 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.compute.api [None req-52f3c5a9-9b56-40bf-bf3e-13d9d7a42d91 tempest-VolumesNegativeTest-1333024728 tempest-VolumesNegativeTest-1333024728-project] [instance: 2365eae1-dcfc-4a4b-ad6b-8716ad710496] Fetching instance by UUID {{(pid=116157) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:05:41.253236 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-52f3c5a9-9b56-40bf-bf3e-13d9d7a42d91 tempest-VolumesNegativeTest-1333024728 tempest-VolumesNegativeTest-1333024728-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:05:41.253930 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-52f3c5a9-9b56-40bf-bf3e-13d9d7a42d91 tempest-VolumesNegativeTest-1333024728 tempest-VolumesNegativeTest-1333024728-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:05:41.255094 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-52f3c5a9-9b56-40bf-bf3e-13d9d7a42d91 tempest-VolumesNegativeTest-1333024728 tempest-VolumesNegativeTest-1333024728-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:05:41.255662 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-52f3c5a9-9b56-40bf-bf3e-13d9d7a42d91 tempest-VolumesNegativeTest-1333024728 tempest-VolumesNegativeTest-1333024728-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:05:41.432711 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi [None req-92ead350-093d-4cf6-9069-6d1cfd4a63fc tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116156) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 03:05:41.433562 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.compute.api [None req-92ead350-093d-4cf6-9069-6d1cfd4a63fc tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] [instance: b89094ac-aee1-4bd6-a33d-8c4347cebfc7] Fetching instance by UUID {{(pid=116156) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:05:41.441491 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-92ead350-093d-4cf6-9069-6d1cfd4a63fc tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:05:41.442674 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-92ead350-093d-4cf6-9069-6d1cfd4a63fc tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:05:41.444270 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-92ead350-093d-4cf6-9069-6d1cfd4a63fc tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:05:41.446231 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-92ead350-093d-4cf6-9069-6d1cfd4a63fc tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:05:41.587001 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: INFO nova.api.openstack.requestlog [None req-92ead350-093d-4cf6-9069-6d1cfd4a63fc tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] 10.222.0.18 "POST /compute/v2.1/servers/b89094ac-aee1-4bd6-a33d-8c4347cebfc7/action" status: 200 len: 27408 microversion: 2.20 time: 0.157818 Dec 15 03:05:41.592045 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: [pid: 116156|app: 0|req: 225/412] 10.222.0.18 () {62 vars in 1318 bytes} [Wed Dec 15 03:05:41 2021] POST /compute/v2.1/servers/b89094ac-aee1-4bd6-a33d-8c4347cebfc7/action => generated 27408 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 15 03:05:41.647378 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.policy [None req-52f3c5a9-9b56-40bf-bf3e-13d9d7a42d91 tempest-VolumesNegativeTest-1333024728 tempest-VolumesNegativeTest-1333024728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2249449813ef41928c52b2d66314b89d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b28917c863104bbe9abc5f7e87803f9e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116157) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:05:41.659159 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: INFO nova.api.openstack.requestlog [None req-52f3c5a9-9b56-40bf-bf3e-13d9d7a42d91 tempest-VolumesNegativeTest-1333024728 tempest-VolumesNegativeTest-1333024728-project] 10.222.0.18 "GET /compute/v2.1/servers/2365eae1-dcfc-4a4b-ad6b-8716ad710496" status: 200 len: 1315 microversion: 2.1 time: 0.418596 Dec 15 03:05:41.668721 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: [pid: 116157|app: 0|req: 188/413] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 03:05:41 2021] GET /compute/v2.1/servers/2365eae1-dcfc-4a4b-ad6b-8716ad710496 => generated 1315 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 03:05:41.871102 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi [None req-75633b70-da69-4868-a88a-3cc02e403583 tempest-ServerRescueNegativeTestJSON-2061875223 tempest-ServerRescueNegativeTestJSON-2061875223-project] Calling method '>' {{(pid=116156) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:05:41.872001 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.compute.api [None req-75633b70-da69-4868-a88a-3cc02e403583 tempest-ServerRescueNegativeTestJSON-2061875223 tempest-ServerRescueNegativeTestJSON-2061875223-project] [instance: 9bbb0abf-72a3-4fbc-8235-7a3ecfc8d006] Fetching instance by UUID {{(pid=116156) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:05:41.878759 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-75633b70-da69-4868-a88a-3cc02e403583 tempest-ServerRescueNegativeTestJSON-2061875223 tempest-ServerRescueNegativeTestJSON-2061875223-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:05:41.879208 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-75633b70-da69-4868-a88a-3cc02e403583 tempest-ServerRescueNegativeTestJSON-2061875223 tempest-ServerRescueNegativeTestJSON-2061875223-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:05:41.879992 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-75633b70-da69-4868-a88a-3cc02e403583 tempest-ServerRescueNegativeTestJSON-2061875223 tempest-ServerRescueNegativeTestJSON-2061875223-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:05:41.880427 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-75633b70-da69-4868-a88a-3cc02e403583 tempest-ServerRescueNegativeTestJSON-2061875223 tempest-ServerRescueNegativeTestJSON-2061875223-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:05:42.091338 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.policy [None req-75633b70-da69-4868-a88a-3cc02e403583 tempest-ServerRescueNegativeTestJSON-2061875223 tempest-ServerRescueNegativeTestJSON-2061875223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ea02b6e8f1548a1bd78952cb7337403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5e8a958d4bf43868502b13728b9583b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116156) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:05:42.100104 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: INFO nova.api.openstack.requestlog [None req-75633b70-da69-4868-a88a-3cc02e403583 tempest-ServerRescueNegativeTestJSON-2061875223 tempest-ServerRescueNegativeTestJSON-2061875223-project] 10.222.0.18 "GET /compute/v2.1/servers/9bbb0abf-72a3-4fbc-8235-7a3ecfc8d006" status: 200 len: 1567 microversion: 2.1 time: 0.234788 Dec 15 03:05:42.100743 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: [pid: 116156|app: 0|req: 226/414] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 03:05:41 2021] GET /compute/v2.1/servers/9bbb0abf-72a3-4fbc-8235-7a3ecfc8d006 => generated 1567 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 03:05:42.599473 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi [None req-a7b364fd-8185-449c-9f65-eeeaa4824d88 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 03:05:42.600588 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.compute.api [None req-a7b364fd-8185-449c-9f65-eeeaa4824d88 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] [instance: b89094ac-aee1-4bd6-a33d-8c4347cebfc7] Fetching instance by UUID {{(pid=116157) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:05:42.607056 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-a7b364fd-8185-449c-9f65-eeeaa4824d88 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:05:42.607624 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-a7b364fd-8185-449c-9f65-eeeaa4824d88 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:05:42.608495 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-a7b364fd-8185-449c-9f65-eeeaa4824d88 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:05:42.609009 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-a7b364fd-8185-449c-9f65-eeeaa4824d88 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:05:42.676198 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi [None req-47c0c9e0-e3eb-4bec-8b37-3a77a3a3b74b tempest-VolumesNegativeTest-1333024728 tempest-VolumesNegativeTest-1333024728-project] Calling method '>' {{(pid=116156) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:05:42.676978 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.compute.api [None req-47c0c9e0-e3eb-4bec-8b37-3a77a3a3b74b tempest-VolumesNegativeTest-1333024728 tempest-VolumesNegativeTest-1333024728-project] [instance: 2365eae1-dcfc-4a4b-ad6b-8716ad710496] Fetching instance by UUID {{(pid=116156) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:05:42.685097 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-47c0c9e0-e3eb-4bec-8b37-3a77a3a3b74b tempest-VolumesNegativeTest-1333024728 tempest-VolumesNegativeTest-1333024728-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:05:42.685551 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-47c0c9e0-e3eb-4bec-8b37-3a77a3a3b74b tempest-VolumesNegativeTest-1333024728 tempest-VolumesNegativeTest-1333024728-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:05:42.686382 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-47c0c9e0-e3eb-4bec-8b37-3a77a3a3b74b tempest-VolumesNegativeTest-1333024728 tempest-VolumesNegativeTest-1333024728-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:05:42.686967 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-47c0c9e0-e3eb-4bec-8b37-3a77a3a3b74b tempest-VolumesNegativeTest-1333024728 tempest-VolumesNegativeTest-1333024728-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:05:42.857446 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.policy [None req-47c0c9e0-e3eb-4bec-8b37-3a77a3a3b74b tempest-VolumesNegativeTest-1333024728 tempest-VolumesNegativeTest-1333024728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2249449813ef41928c52b2d66314b89d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b28917c863104bbe9abc5f7e87803f9e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116156) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:05:42.865384 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: INFO nova.api.openstack.requestlog [None req-47c0c9e0-e3eb-4bec-8b37-3a77a3a3b74b tempest-VolumesNegativeTest-1333024728 tempest-VolumesNegativeTest-1333024728-project] 10.222.0.18 "GET /compute/v2.1/servers/2365eae1-dcfc-4a4b-ad6b-8716ad710496" status: 200 len: 1315 microversion: 2.1 time: 0.193312 Dec 15 03:05:42.866046 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: [pid: 116156|app: 0|req: 227/415] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 03:05:42 2021] GET /compute/v2.1/servers/2365eae1-dcfc-4a4b-ad6b-8716ad710496 => generated 1315 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 03:05:43.118079 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi [None req-5094bd54-edf8-46d4-bb68-17bf08756a49 tempest-ServerRescueNegativeTestJSON-2061875223 tempest-ServerRescueNegativeTestJSON-2061875223-project] Calling method '>' {{(pid=116156) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:05:43.118700 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.compute.api [None req-5094bd54-edf8-46d4-bb68-17bf08756a49 tempest-ServerRescueNegativeTestJSON-2061875223 tempest-ServerRescueNegativeTestJSON-2061875223-project] [instance: 9bbb0abf-72a3-4fbc-8235-7a3ecfc8d006] Fetching instance by UUID {{(pid=116156) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:05:43.128696 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-5094bd54-edf8-46d4-bb68-17bf08756a49 tempest-ServerRescueNegativeTestJSON-2061875223 tempest-ServerRescueNegativeTestJSON-2061875223-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:05:43.129156 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-5094bd54-edf8-46d4-bb68-17bf08756a49 tempest-ServerRescueNegativeTestJSON-2061875223 tempest-ServerRescueNegativeTestJSON-2061875223-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:05:43.129959 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-5094bd54-edf8-46d4-bb68-17bf08756a49 tempest-ServerRescueNegativeTestJSON-2061875223 tempest-ServerRescueNegativeTestJSON-2061875223-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:05:43.130429 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-5094bd54-edf8-46d4-bb68-17bf08756a49 tempest-ServerRescueNegativeTestJSON-2061875223 tempest-ServerRescueNegativeTestJSON-2061875223-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:05:43.308280 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.policy [None req-5094bd54-edf8-46d4-bb68-17bf08756a49 tempest-ServerRescueNegativeTestJSON-2061875223 tempest-ServerRescueNegativeTestJSON-2061875223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ea02b6e8f1548a1bd78952cb7337403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5e8a958d4bf43868502b13728b9583b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116156) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:05:43.317099 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: INFO nova.api.openstack.requestlog [None req-5094bd54-edf8-46d4-bb68-17bf08756a49 tempest-ServerRescueNegativeTestJSON-2061875223 tempest-ServerRescueNegativeTestJSON-2061875223-project] 10.222.0.18 "GET /compute/v2.1/servers/9bbb0abf-72a3-4fbc-8235-7a3ecfc8d006" status: 200 len: 1567 microversion: 2.1 time: 0.202715 Dec 15 03:05:43.317597 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: [pid: 116156|app: 0|req: 228/416] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 03:05:43 2021] GET /compute/v2.1/servers/9bbb0abf-72a3-4fbc-8235-7a3ecfc8d006 => generated 1567 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 03:05:43.882825 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi [None req-cbaa151d-700e-4cd7-963a-6f6fd07414ba tempest-VolumesNegativeTest-1333024728 tempest-VolumesNegativeTest-1333024728-project] Calling method '>' {{(pid=116156) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:05:43.884290 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.compute.api [None req-cbaa151d-700e-4cd7-963a-6f6fd07414ba tempest-VolumesNegativeTest-1333024728 tempest-VolumesNegativeTest-1333024728-project] [instance: 2365eae1-dcfc-4a4b-ad6b-8716ad710496] Fetching instance by UUID {{(pid=116156) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:05:43.893110 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-cbaa151d-700e-4cd7-963a-6f6fd07414ba tempest-VolumesNegativeTest-1333024728 tempest-VolumesNegativeTest-1333024728-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:05:43.893898 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-cbaa151d-700e-4cd7-963a-6f6fd07414ba tempest-VolumesNegativeTest-1333024728 tempest-VolumesNegativeTest-1333024728-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:05:43.895352 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-cbaa151d-700e-4cd7-963a-6f6fd07414ba tempest-VolumesNegativeTest-1333024728 tempest-VolumesNegativeTest-1333024728-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:05:43.896062 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-cbaa151d-700e-4cd7-963a-6f6fd07414ba tempest-VolumesNegativeTest-1333024728 tempest-VolumesNegativeTest-1333024728-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:05:44.103726 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.policy [None req-cbaa151d-700e-4cd7-963a-6f6fd07414ba tempest-VolumesNegativeTest-1333024728 tempest-VolumesNegativeTest-1333024728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2249449813ef41928c52b2d66314b89d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b28917c863104bbe9abc5f7e87803f9e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116156) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:05:44.115604 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: INFO nova.api.openstack.requestlog [None req-cbaa151d-700e-4cd7-963a-6f6fd07414ba tempest-VolumesNegativeTest-1333024728 tempest-VolumesNegativeTest-1333024728-project] 10.222.0.18 "GET /compute/v2.1/servers/2365eae1-dcfc-4a4b-ad6b-8716ad710496" status: 200 len: 1315 microversion: 2.1 time: 0.236082 Dec 15 03:05:44.124303 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: [pid: 116156|app: 0|req: 229/417] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 03:05:43 2021] GET /compute/v2.1/servers/2365eae1-dcfc-4a4b-ad6b-8716ad710496 => generated 1315 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 03:05:44.347997 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi [None req-1a68e263-f5cf-4dad-833f-7b95a6b990f9 tempest-ServerRescueNegativeTestJSON-2061875223 tempest-ServerRescueNegativeTestJSON-2061875223-project] Calling method '>' {{(pid=116156) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:05:44.348612 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.compute.api [None req-1a68e263-f5cf-4dad-833f-7b95a6b990f9 tempest-ServerRescueNegativeTestJSON-2061875223 tempest-ServerRescueNegativeTestJSON-2061875223-project] [instance: 9bbb0abf-72a3-4fbc-8235-7a3ecfc8d006] Fetching instance by UUID {{(pid=116156) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:05:44.357308 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-1a68e263-f5cf-4dad-833f-7b95a6b990f9 tempest-ServerRescueNegativeTestJSON-2061875223 tempest-ServerRescueNegativeTestJSON-2061875223-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:05:44.357765 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-1a68e263-f5cf-4dad-833f-7b95a6b990f9 tempest-ServerRescueNegativeTestJSON-2061875223 tempest-ServerRescueNegativeTestJSON-2061875223-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:05:44.358627 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-1a68e263-f5cf-4dad-833f-7b95a6b990f9 tempest-ServerRescueNegativeTestJSON-2061875223 tempest-ServerRescueNegativeTestJSON-2061875223-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:05:44.361337 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-1a68e263-f5cf-4dad-833f-7b95a6b990f9 tempest-ServerRescueNegativeTestJSON-2061875223 tempest-ServerRescueNegativeTestJSON-2061875223-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:05:44.584227 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.policy [None req-1a68e263-f5cf-4dad-833f-7b95a6b990f9 tempest-ServerRescueNegativeTestJSON-2061875223 tempest-ServerRescueNegativeTestJSON-2061875223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ea02b6e8f1548a1bd78952cb7337403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5e8a958d4bf43868502b13728b9583b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116156) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:05:44.596642 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: INFO nova.api.openstack.requestlog [None req-1a68e263-f5cf-4dad-833f-7b95a6b990f9 tempest-ServerRescueNegativeTestJSON-2061875223 tempest-ServerRescueNegativeTestJSON-2061875223-project] 10.222.0.18 "GET /compute/v2.1/servers/9bbb0abf-72a3-4fbc-8235-7a3ecfc8d006" status: 200 len: 1567 microversion: 2.1 time: 0.258912 Dec 15 03:05:44.606402 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: [pid: 116156|app: 0|req: 230/418] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 03:05:44 2021] GET /compute/v2.1/servers/9bbb0abf-72a3-4fbc-8235-7a3ecfc8d006 => generated 1567 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 03:05:45.100923 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: INFO nova.api.openstack.requestlog [None req-a7b364fd-8185-449c-9f65-eeeaa4824d88 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] 10.222.0.18 "POST /compute/v2.1/servers/b89094ac-aee1-4bd6-a33d-8c4347cebfc7/action" status: 200 len: 27821 microversion: 2.20 time: 2.504833 Dec 15 03:05:45.102651 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: [pid: 116157|app: 0|req: 189/419] 10.222.0.18 () {62 vars in 1318 bytes} [Wed Dec 15 03:05:42 2021] POST /compute/v2.1/servers/b89094ac-aee1-4bd6-a33d-8c4347cebfc7/action => generated 27821 bytes in 2508 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 15 03:05:45.137554 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi [None req-ef35ca1b-64f0-4ed8-9013-1c86d729fdbc tempest-VolumesNegativeTest-1333024728 tempest-VolumesNegativeTest-1333024728-project] Calling method '>' {{(pid=116156) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:05:45.138340 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.compute.api [None req-ef35ca1b-64f0-4ed8-9013-1c86d729fdbc tempest-VolumesNegativeTest-1333024728 tempest-VolumesNegativeTest-1333024728-project] [instance: 2365eae1-dcfc-4a4b-ad6b-8716ad710496] Fetching instance by UUID {{(pid=116156) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:05:45.145317 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-ef35ca1b-64f0-4ed8-9013-1c86d729fdbc tempest-VolumesNegativeTest-1333024728 tempest-VolumesNegativeTest-1333024728-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:05:45.145760 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-ef35ca1b-64f0-4ed8-9013-1c86d729fdbc tempest-VolumesNegativeTest-1333024728 tempest-VolumesNegativeTest-1333024728-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:05:45.146657 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-ef35ca1b-64f0-4ed8-9013-1c86d729fdbc tempest-VolumesNegativeTest-1333024728 tempest-VolumesNegativeTest-1333024728-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:05:45.147479 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-ef35ca1b-64f0-4ed8-9013-1c86d729fdbc tempest-VolumesNegativeTest-1333024728 tempest-VolumesNegativeTest-1333024728-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:05:45.327471 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.policy [None req-ef35ca1b-64f0-4ed8-9013-1c86d729fdbc tempest-VolumesNegativeTest-1333024728 tempest-VolumesNegativeTest-1333024728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2249449813ef41928c52b2d66314b89d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b28917c863104bbe9abc5f7e87803f9e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116156) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:05:45.334913 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: INFO nova.api.openstack.requestlog [None req-ef35ca1b-64f0-4ed8-9013-1c86d729fdbc tempest-VolumesNegativeTest-1333024728 tempest-VolumesNegativeTest-1333024728-project] 10.222.0.18 "GET /compute/v2.1/servers/2365eae1-dcfc-4a4b-ad6b-8716ad710496" status: 200 len: 1315 microversion: 2.1 time: 0.205643 Dec 15 03:05:45.335698 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: [pid: 116156|app: 0|req: 231/420] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 03:05:45 2021] GET /compute/v2.1/servers/2365eae1-dcfc-4a4b-ad6b-8716ad710496 => generated 1315 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 03:05:45.615182 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi [None req-1550d24d-9380-4322-b294-526ddec5b485 tempest-ServerRescueNegativeTestJSON-2061875223 tempest-ServerRescueNegativeTestJSON-2061875223-project] Calling method '>' {{(pid=116157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:05:45.616172 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.compute.api [None req-1550d24d-9380-4322-b294-526ddec5b485 tempest-ServerRescueNegativeTestJSON-2061875223 tempest-ServerRescueNegativeTestJSON-2061875223-project] [instance: 9bbb0abf-72a3-4fbc-8235-7a3ecfc8d006] Fetching instance by UUID {{(pid=116157) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:05:45.637747 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-1550d24d-9380-4322-b294-526ddec5b485 tempest-ServerRescueNegativeTestJSON-2061875223 tempest-ServerRescueNegativeTestJSON-2061875223-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:05:45.638598 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-1550d24d-9380-4322-b294-526ddec5b485 tempest-ServerRescueNegativeTestJSON-2061875223 tempest-ServerRescueNegativeTestJSON-2061875223-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:05:45.640940 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-1550d24d-9380-4322-b294-526ddec5b485 tempest-ServerRescueNegativeTestJSON-2061875223 tempest-ServerRescueNegativeTestJSON-2061875223-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:05:45.642141 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-1550d24d-9380-4322-b294-526ddec5b485 tempest-ServerRescueNegativeTestJSON-2061875223 tempest-ServerRescueNegativeTestJSON-2061875223-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:05:46.104627 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.policy [None req-1550d24d-9380-4322-b294-526ddec5b485 tempest-ServerRescueNegativeTestJSON-2061875223 tempest-ServerRescueNegativeTestJSON-2061875223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ea02b6e8f1548a1bd78952cb7337403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5e8a958d4bf43868502b13728b9583b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116157) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:05:46.116597 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi [None req-92522347-5957-4665-a9c6-4ccd710abe0a tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116156) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 03:05:46.119652 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.compute.api [None req-92522347-5957-4665-a9c6-4ccd710abe0a tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] [instance: b89094ac-aee1-4bd6-a33d-8c4347cebfc7] Fetching instance by UUID {{(pid=116156) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:05:46.126802 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: INFO nova.api.openstack.requestlog [None req-1550d24d-9380-4322-b294-526ddec5b485 tempest-ServerRescueNegativeTestJSON-2061875223 tempest-ServerRescueNegativeTestJSON-2061875223-project] 10.222.0.18 "GET /compute/v2.1/servers/9bbb0abf-72a3-4fbc-8235-7a3ecfc8d006" status: 200 len: 1567 microversion: 2.1 time: 0.516459 Dec 15 03:05:46.127961 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: [pid: 116157|app: 0|req: 190/421] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 03:05:45 2021] GET /compute/v2.1/servers/9bbb0abf-72a3-4fbc-8235-7a3ecfc8d006 => generated 1567 bytes in 518 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 03:05:46.131244 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-92522347-5957-4665-a9c6-4ccd710abe0a tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:05:46.131804 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-92522347-5957-4665-a9c6-4ccd710abe0a tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:05:46.132938 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-92522347-5957-4665-a9c6-4ccd710abe0a tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:05:46.133504 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-92522347-5957-4665-a9c6-4ccd710abe0a tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:05:46.257924 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: INFO nova.api.openstack.requestlog [None req-92522347-5957-4665-a9c6-4ccd710abe0a tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] 10.222.0.18 "POST /compute/v2.1/servers/b89094ac-aee1-4bd6-a33d-8c4347cebfc7/action" status: 200 len: 28122 microversion: 2.20 time: 0.147476 Dec 15 03:05:46.259216 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: [pid: 116156|app: 0|req: 232/422] 10.222.0.18 () {62 vars in 1318 bytes} [Wed Dec 15 03:05:46 2021] POST /compute/v2.1/servers/b89094ac-aee1-4bd6-a33d-8c4347cebfc7/action => generated 28122 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 15 03:05:46.355989 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi [None req-ba83ee25-2390-4df6-b38a-08c72f712706 tempest-VolumesNegativeTest-1333024728 tempest-VolumesNegativeTest-1333024728-project] Calling method '>' {{(pid=116157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:05:46.356701 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.compute.api [None req-ba83ee25-2390-4df6-b38a-08c72f712706 tempest-VolumesNegativeTest-1333024728 tempest-VolumesNegativeTest-1333024728-project] [instance: 2365eae1-dcfc-4a4b-ad6b-8716ad710496] Fetching instance by UUID {{(pid=116157) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:05:46.365108 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-ba83ee25-2390-4df6-b38a-08c72f712706 tempest-VolumesNegativeTest-1333024728 tempest-VolumesNegativeTest-1333024728-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:05:46.365853 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-ba83ee25-2390-4df6-b38a-08c72f712706 tempest-VolumesNegativeTest-1333024728 tempest-VolumesNegativeTest-1333024728-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:05:46.366875 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-ba83ee25-2390-4df6-b38a-08c72f712706 tempest-VolumesNegativeTest-1333024728 tempest-VolumesNegativeTest-1333024728-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:05:46.367598 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-ba83ee25-2390-4df6-b38a-08c72f712706 tempest-VolumesNegativeTest-1333024728 tempest-VolumesNegativeTest-1333024728-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:05:46.532731 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.policy [None req-ba83ee25-2390-4df6-b38a-08c72f712706 tempest-VolumesNegativeTest-1333024728 tempest-VolumesNegativeTest-1333024728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2249449813ef41928c52b2d66314b89d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b28917c863104bbe9abc5f7e87803f9e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116157) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:05:46.546597 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: INFO nova.api.openstack.requestlog [None req-ba83ee25-2390-4df6-b38a-08c72f712706 tempest-VolumesNegativeTest-1333024728 tempest-VolumesNegativeTest-1333024728-project] 10.222.0.18 "GET /compute/v2.1/servers/2365eae1-dcfc-4a4b-ad6b-8716ad710496" status: 200 len: 1315 microversion: 2.1 time: 0.192206 Dec 15 03:05:46.547300 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: [pid: 116157|app: 0|req: 191/423] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 03:05:46 2021] GET /compute/v2.1/servers/2365eae1-dcfc-4a4b-ad6b-8716ad710496 => generated 1315 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 03:05:46.591987 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi [None req-86932b8d-2cb4-41ec-b421-06732ffcde33 tempest-AttachVolumeNegativeTest-1640336653 tempest-AttachVolumeNegativeTest-1640336653-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "04684fcf-6c26-472a-9602-0fcd90ca9df8"}} {{(pid=116156) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 03:05:46.594134 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.compute.api [None req-86932b8d-2cb4-41ec-b421-06732ffcde33 tempest-AttachVolumeNegativeTest-1640336653 tempest-AttachVolumeNegativeTest-1640336653-project] [instance: c3d5f143-e994-4098-989b-660411a8dd8f] Fetching instance by UUID {{(pid=116156) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:05:46.601932 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-86932b8d-2cb4-41ec-b421-06732ffcde33 tempest-AttachVolumeNegativeTest-1640336653 tempest-AttachVolumeNegativeTest-1640336653-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:05:46.603939 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-86932b8d-2cb4-41ec-b421-06732ffcde33 tempest-AttachVolumeNegativeTest-1640336653 tempest-AttachVolumeNegativeTest-1640336653-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:05:46.605395 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-86932b8d-2cb4-41ec-b421-06732ffcde33 tempest-AttachVolumeNegativeTest-1640336653 tempest-AttachVolumeNegativeTest-1640336653-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:05:46.605964 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-86932b8d-2cb4-41ec-b421-06732ffcde33 tempest-AttachVolumeNegativeTest-1640336653 tempest-AttachVolumeNegativeTest-1640336653-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:05:46.700399 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: INFO nova.api.openstack.wsgi [None req-86932b8d-2cb4-41ec-b421-06732ffcde33 tempest-AttachVolumeNegativeTest-1640336653 tempest-AttachVolumeNegativeTest-1640336653-project] HTTP exception thrown: Invalid volume: volume 04684fcf-6c26-472a-9602-0fcd90ca9df8 is already attached to instances: c3d5f143-e994-4098-989b-660411a8dd8f Dec 15 03:05:46.701266 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi [None req-86932b8d-2cb4-41ec-b421-06732ffcde33 tempest-AttachVolumeNegativeTest-1640336653 tempest-AttachVolumeNegativeTest-1640336653-project] Returning 400 to user: Invalid volume: volume 04684fcf-6c26-472a-9602-0fcd90ca9df8 is already attached to instances: c3d5f143-e994-4098-989b-660411a8dd8f {{(pid=116156) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 15 03:05:46.702495 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: INFO nova.api.openstack.requestlog [None req-86932b8d-2cb4-41ec-b421-06732ffcde33 tempest-AttachVolumeNegativeTest-1640336653 tempest-AttachVolumeNegativeTest-1640336653-project] 10.222.0.18 "POST /compute/v2.1/servers/c3d5f143-e994-4098-989b-660411a8dd8f/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.116426 Dec 15 03:05:46.703227 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: [pid: 116156|app: 0|req: 233/424] 10.222.0.18 () {60 vars in 1322 bytes} [Wed Dec 15 03:05:46 2021] POST /compute/v2.1/servers/c3d5f143-e994-4098-989b-660411a8dd8f/os-volume_attachments => generated 174 bytes in 119 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Dec 15 03:05:46.798383 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi [None req-80e13cb1-5b76-4272-a9b5-502aa543a38d tempest-AttachVolumeNegativeTest-1640336653 tempest-AttachVolumeNegativeTest-1640336653-project] Calling method '>' {{(pid=116157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:05:46.799297 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.compute.api [None req-80e13cb1-5b76-4272-a9b5-502aa543a38d tempest-AttachVolumeNegativeTest-1640336653 tempest-AttachVolumeNegativeTest-1640336653-project] [instance: c3d5f143-e994-4098-989b-660411a8dd8f] Fetching instance by UUID {{(pid=116157) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:05:46.811536 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-80e13cb1-5b76-4272-a9b5-502aa543a38d tempest-AttachVolumeNegativeTest-1640336653 tempest-AttachVolumeNegativeTest-1640336653-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:05:46.812209 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-80e13cb1-5b76-4272-a9b5-502aa543a38d tempest-AttachVolumeNegativeTest-1640336653 tempest-AttachVolumeNegativeTest-1640336653-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:05:46.813059 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-80e13cb1-5b76-4272-a9b5-502aa543a38d tempest-AttachVolumeNegativeTest-1640336653 tempest-AttachVolumeNegativeTest-1640336653-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:05:46.813507 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-80e13cb1-5b76-4272-a9b5-502aa543a38d tempest-AttachVolumeNegativeTest-1640336653 tempest-AttachVolumeNegativeTest-1640336653-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:05:46.926134 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.objects.instance [None req-80e13cb1-5b76-4272-a9b5-502aa543a38d tempest-AttachVolumeNegativeTest-1640336653 tempest-AttachVolumeNegativeTest-1640336653-project] Lazy-loading 'services' on Instance uuid c3d5f143-e994-4098-989b-660411a8dd8f {{(pid=116157) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Dec 15 03:05:47.048219 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: INFO nova.api.openstack.requestlog [None req-80e13cb1-5b76-4272-a9b5-502aa543a38d tempest-AttachVolumeNegativeTest-1640336653 tempest-AttachVolumeNegativeTest-1640336653-project] 10.222.0.18 "DELETE /compute/v2.1/servers/c3d5f143-e994-4098-989b-660411a8dd8f/os-volume_attachments/04684fcf-6c26-472a-9602-0fcd90ca9df8" status: 202 len: 0 microversion: 2.1 time: 0.253551 Dec 15 03:05:47.053373 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: [pid: 116157|app: 0|req: 192/425] 10.222.0.18 () {58 vars in 1415 bytes} [Wed Dec 15 03:05:46 2021] DELETE /compute/v2.1/servers/c3d5f143-e994-4098-989b-660411a8dd8f/os-volume_attachments/04684fcf-6c26-472a-9602-0fcd90ca9df8 => generated 0 bytes in 260 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Dec 15 03:05:47.060911 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi [None req-938c7a2e-5523-48d6-8f38-cea0fe6c8616 tempest-AttachVolumeNegativeTest-1640336653 tempest-AttachVolumeNegativeTest-1640336653-project] Calling method '>' {{(pid=116156) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:05:47.063513 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.compute.api [None req-938c7a2e-5523-48d6-8f38-cea0fe6c8616 tempest-AttachVolumeNegativeTest-1640336653 tempest-AttachVolumeNegativeTest-1640336653-project] [instance: c3d5f143-e994-4098-989b-660411a8dd8f] Fetching instance by UUID {{(pid=116156) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:05:47.081470 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-938c7a2e-5523-48d6-8f38-cea0fe6c8616 tempest-AttachVolumeNegativeTest-1640336653 tempest-AttachVolumeNegativeTest-1640336653-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:05:47.084019 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-938c7a2e-5523-48d6-8f38-cea0fe6c8616 tempest-AttachVolumeNegativeTest-1640336653 tempest-AttachVolumeNegativeTest-1640336653-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:05:47.087046 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-938c7a2e-5523-48d6-8f38-cea0fe6c8616 tempest-AttachVolumeNegativeTest-1640336653 tempest-AttachVolumeNegativeTest-1640336653-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:05:47.088738 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-938c7a2e-5523-48d6-8f38-cea0fe6c8616 tempest-AttachVolumeNegativeTest-1640336653 tempest-AttachVolumeNegativeTest-1640336653-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:05:47.146799 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi [None req-df2ab124-cac6-4ebf-9945-591eb911e792 tempest-ServerRescueNegativeTestJSON-2061875223 tempest-ServerRescueNegativeTestJSON-2061875223-project] Calling method '>' {{(pid=116157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:05:47.147674 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.compute.api [None req-df2ab124-cac6-4ebf-9945-591eb911e792 tempest-ServerRescueNegativeTestJSON-2061875223 tempest-ServerRescueNegativeTestJSON-2061875223-project] [instance: 9bbb0abf-72a3-4fbc-8235-7a3ecfc8d006] Fetching instance by UUID {{(pid=116157) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:05:47.167112 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: INFO nova.api.openstack.requestlog [None req-938c7a2e-5523-48d6-8f38-cea0fe6c8616 tempest-AttachVolumeNegativeTest-1640336653 tempest-AttachVolumeNegativeTest-1640336653-project] 10.222.0.18 "GET /compute/v2.1/servers/c3d5f143-e994-4098-989b-660411a8dd8f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.112648 Dec 15 03:05:47.170652 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-df2ab124-cac6-4ebf-9945-591eb911e792 tempest-ServerRescueNegativeTestJSON-2061875223 tempest-ServerRescueNegativeTestJSON-2061875223-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:05:47.174105 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: [pid: 116156|app: 0|req: 234/426] 10.222.0.18 () {58 vars in 1301 bytes} [Wed Dec 15 03:05:47 2021] GET /compute/v2.1/servers/c3d5f143-e994-4098-989b-660411a8dd8f/os-volume_attachments => generated 197 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 15 03:05:47.183533 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-df2ab124-cac6-4ebf-9945-591eb911e792 tempest-ServerRescueNegativeTestJSON-2061875223 tempest-ServerRescueNegativeTestJSON-2061875223-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:05:47.184448 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-df2ab124-cac6-4ebf-9945-591eb911e792 tempest-ServerRescueNegativeTestJSON-2061875223 tempest-ServerRescueNegativeTestJSON-2061875223-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:05:47.185039 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-df2ab124-cac6-4ebf-9945-591eb911e792 tempest-ServerRescueNegativeTestJSON-2061875223 tempest-ServerRescueNegativeTestJSON-2061875223-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:05:47.270641 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi [None req-163eeb71-f145-4864-af2b-6bc0aed19c66 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116156) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 03:05:47.272467 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.compute.api [None req-163eeb71-f145-4864-af2b-6bc0aed19c66 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] [instance: b89094ac-aee1-4bd6-a33d-8c4347cebfc7] Fetching instance by UUID {{(pid=116156) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:05:47.281809 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-163eeb71-f145-4864-af2b-6bc0aed19c66 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:05:47.282491 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-163eeb71-f145-4864-af2b-6bc0aed19c66 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:05:47.283469 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-163eeb71-f145-4864-af2b-6bc0aed19c66 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:05:47.284042 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-163eeb71-f145-4864-af2b-6bc0aed19c66 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:05:47.543279 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.policy [None req-df2ab124-cac6-4ebf-9945-591eb911e792 tempest-ServerRescueNegativeTestJSON-2061875223 tempest-ServerRescueNegativeTestJSON-2061875223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ea02b6e8f1548a1bd78952cb7337403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5e8a958d4bf43868502b13728b9583b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116157) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:05:47.554895 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: INFO nova.api.openstack.requestlog [None req-df2ab124-cac6-4ebf-9945-591eb911e792 tempest-ServerRescueNegativeTestJSON-2061875223 tempest-ServerRescueNegativeTestJSON-2061875223-project] 10.222.0.18 "GET /compute/v2.1/servers/9bbb0abf-72a3-4fbc-8235-7a3ecfc8d006" status: 200 len: 1567 microversion: 2.1 time: 0.414431 Dec 15 03:05:47.555880 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: [pid: 116157|app: 0|req: 193/427] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 03:05:47 2021] GET /compute/v2.1/servers/9bbb0abf-72a3-4fbc-8235-7a3ecfc8d006 => generated 1567 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 03:05:47.567770 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi [None req-7fc8a1fb-ab64-4870-a95c-532df9e4a56d tempest-VolumesNegativeTest-1333024728 tempest-VolumesNegativeTest-1333024728-project] Calling method '>' {{(pid=116157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:05:47.578089 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.compute.api [None req-7fc8a1fb-ab64-4870-a95c-532df9e4a56d tempest-VolumesNegativeTest-1333024728 tempest-VolumesNegativeTest-1333024728-project] [instance: 2365eae1-dcfc-4a4b-ad6b-8716ad710496] Fetching instance by UUID {{(pid=116157) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:05:47.581787 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: INFO nova.api.openstack.requestlog [None req-163eeb71-f145-4864-af2b-6bc0aed19c66 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] 10.222.0.18 "POST /compute/v2.1/servers/b89094ac-aee1-4bd6-a33d-8c4347cebfc7/action" status: 200 len: 28182 microversion: 2.20 time: 0.316051 Dec 15 03:05:47.587147 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: [pid: 116156|app: 0|req: 235/428] 10.222.0.18 () {62 vars in 1318 bytes} [Wed Dec 15 03:05:47 2021] POST /compute/v2.1/servers/b89094ac-aee1-4bd6-a33d-8c4347cebfc7/action => generated 28182 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 15 03:05:47.593556 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-7fc8a1fb-ab64-4870-a95c-532df9e4a56d tempest-VolumesNegativeTest-1333024728 tempest-VolumesNegativeTest-1333024728-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:05:47.594023 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-7fc8a1fb-ab64-4870-a95c-532df9e4a56d tempest-VolumesNegativeTest-1333024728 tempest-VolumesNegativeTest-1333024728-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:05:47.602503 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-7fc8a1fb-ab64-4870-a95c-532df9e4a56d tempest-VolumesNegativeTest-1333024728 tempest-VolumesNegativeTest-1333024728-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:05:47.603026 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-7fc8a1fb-ab64-4870-a95c-532df9e4a56d tempest-VolumesNegativeTest-1333024728 tempest-VolumesNegativeTest-1333024728-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:05:47.851196 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.policy [None req-7fc8a1fb-ab64-4870-a95c-532df9e4a56d tempest-VolumesNegativeTest-1333024728 tempest-VolumesNegativeTest-1333024728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2249449813ef41928c52b2d66314b89d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b28917c863104bbe9abc5f7e87803f9e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116157) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:05:47.859849 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: INFO nova.api.openstack.requestlog [None req-7fc8a1fb-ab64-4870-a95c-532df9e4a56d tempest-VolumesNegativeTest-1333024728 tempest-VolumesNegativeTest-1333024728-project] 10.222.0.18 "GET /compute/v2.1/servers/2365eae1-dcfc-4a4b-ad6b-8716ad710496" status: 200 len: 1315 microversion: 2.1 time: 0.299524 Dec 15 03:05:47.862101 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: [pid: 116157|app: 0|req: 194/429] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 03:05:47 2021] GET /compute/v2.1/servers/2365eae1-dcfc-4a4b-ad6b-8716ad710496 => generated 1315 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 03:05:47.972724 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi [req-b93964f7-8756-47c0-a300-d2af1fc48bf2 req-a752dda1-be69-4e7b-bd37-142881d35ac8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2365eae1-dcfc-4a4b-ad6b-8716ad710496", "name": "network-vif-plugged", "status": "completed", "tag": "22ba3072-6295-4211-ab35-5e0cd72571c9"}]} {{(pid=116156) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 03:05:47.974280 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 15 03:05:47.974280 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: warnings.warn(msg) Dec 15 03:05:47.989000 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [req-b93964f7-8756-47c0-a300-d2af1fc48bf2 req-a752dda1-be69-4e7b-bd37-142881d35ac8 service nova] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:05:47.989453 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [req-b93964f7-8756-47c0-a300-d2af1fc48bf2 req-a752dda1-be69-4e7b-bd37-142881d35ac8 service nova] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:05:48.004609 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: INFO nova.api.openstack.compute.server_external_events [req-b93964f7-8756-47c0-a300-d2af1fc48bf2 req-a752dda1-be69-4e7b-bd37-142881d35ac8 service nova] Creating event network-vif-plugged:22ba3072-6295-4211-ab35-5e0cd72571c9 for instance 2365eae1-dcfc-4a4b-ad6b-8716ad710496 on hv-cinder-81803 Dec 15 03:05:48.010285 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: INFO nova.api.openstack.requestlog [req-b93964f7-8756-47c0-a300-d2af1fc48bf2 req-a752dda1-be69-4e7b-bd37-142881d35ac8 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042944 Dec 15 03:05:48.011448 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: [pid: 116156|app: 0|req: 236/430] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Dec 15 03:05:47 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 03:05:48.186814 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi [None req-0c0ea711-7386-446a-b7da-e224476f5151 tempest-AttachVolumeNegativeTest-1640336653 tempest-AttachVolumeNegativeTest-1640336653-project] Calling method '>' {{(pid=116157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:05:48.187840 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.compute.api [None req-0c0ea711-7386-446a-b7da-e224476f5151 tempest-AttachVolumeNegativeTest-1640336653 tempest-AttachVolumeNegativeTest-1640336653-project] [instance: c3d5f143-e994-4098-989b-660411a8dd8f] Fetching instance by UUID {{(pid=116157) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:05:48.208024 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-0c0ea711-7386-446a-b7da-e224476f5151 tempest-AttachVolumeNegativeTest-1640336653 tempest-AttachVolumeNegativeTest-1640336653-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:05:48.208742 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-0c0ea711-7386-446a-b7da-e224476f5151 tempest-AttachVolumeNegativeTest-1640336653 tempest-AttachVolumeNegativeTest-1640336653-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:05:48.209727 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-0c0ea711-7386-446a-b7da-e224476f5151 tempest-AttachVolumeNegativeTest-1640336653 tempest-AttachVolumeNegativeTest-1640336653-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:05:48.210397 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-0c0ea711-7386-446a-b7da-e224476f5151 tempest-AttachVolumeNegativeTest-1640336653 tempest-AttachVolumeNegativeTest-1640336653-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:05:48.268505 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: INFO nova.api.openstack.requestlog [None req-0c0ea711-7386-446a-b7da-e224476f5151 tempest-AttachVolumeNegativeTest-1640336653 tempest-AttachVolumeNegativeTest-1640336653-project] 10.222.0.18 "GET /compute/v2.1/servers/c3d5f143-e994-4098-989b-660411a8dd8f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.085411 Dec 15 03:05:48.270474 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: [pid: 116157|app: 0|req: 195/431] 10.222.0.18 () {58 vars in 1301 bytes} [Wed Dec 15 03:05:48 2021] GET /compute/v2.1/servers/c3d5f143-e994-4098-989b-660411a8dd8f/os-volume_attachments => generated 197 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 03:05:48.577479 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi [None req-05c41c1a-08db-434c-b800-9dc49ed11232 tempest-ServerRescueNegativeTestJSON-2061875223 tempest-ServerRescueNegativeTestJSON-2061875223-project] Calling method '>' {{(pid=116156) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:05:48.580937 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.compute.api [None req-05c41c1a-08db-434c-b800-9dc49ed11232 tempest-ServerRescueNegativeTestJSON-2061875223 tempest-ServerRescueNegativeTestJSON-2061875223-project] [instance: 9bbb0abf-72a3-4fbc-8235-7a3ecfc8d006] Fetching instance by UUID {{(pid=116156) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:05:48.595939 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi [None req-cff8052b-351c-467d-855a-6a11824f9e63 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 03:05:48.597397 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.compute.api [None req-cff8052b-351c-467d-855a-6a11824f9e63 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] [instance: b89094ac-aee1-4bd6-a33d-8c4347cebfc7] Fetching instance by UUID {{(pid=116157) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:05:48.606180 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-cff8052b-351c-467d-855a-6a11824f9e63 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:05:48.607481 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-cff8052b-351c-467d-855a-6a11824f9e63 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:05:48.607939 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-05c41c1a-08db-434c-b800-9dc49ed11232 tempest-ServerRescueNegativeTestJSON-2061875223 tempest-ServerRescueNegativeTestJSON-2061875223-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:05:48.611642 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-05c41c1a-08db-434c-b800-9dc49ed11232 tempest-ServerRescueNegativeTestJSON-2061875223 tempest-ServerRescueNegativeTestJSON-2061875223-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:05:48.612453 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-cff8052b-351c-467d-855a-6a11824f9e63 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:05:48.612869 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-cff8052b-351c-467d-855a-6a11824f9e63 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:05:48.613018 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-05c41c1a-08db-434c-b800-9dc49ed11232 tempest-ServerRescueNegativeTestJSON-2061875223 tempest-ServerRescueNegativeTestJSON-2061875223-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:05:48.614519 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-05c41c1a-08db-434c-b800-9dc49ed11232 tempest-ServerRescueNegativeTestJSON-2061875223 tempest-ServerRescueNegativeTestJSON-2061875223-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:05:49.026427 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.policy [None req-05c41c1a-08db-434c-b800-9dc49ed11232 tempest-ServerRescueNegativeTestJSON-2061875223 tempest-ServerRescueNegativeTestJSON-2061875223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ea02b6e8f1548a1bd78952cb7337403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5e8a958d4bf43868502b13728b9583b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116156) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:05:49.039945 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: INFO nova.api.openstack.requestlog [None req-05c41c1a-08db-434c-b800-9dc49ed11232 tempest-ServerRescueNegativeTestJSON-2061875223 tempest-ServerRescueNegativeTestJSON-2061875223-project] 10.222.0.18 "GET /compute/v2.1/servers/9bbb0abf-72a3-4fbc-8235-7a3ecfc8d006" status: 200 len: 1567 microversion: 2.1 time: 0.470364 Dec 15 03:05:49.054142 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: [pid: 116156|app: 0|req: 237/432] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 03:05:48 2021] GET /compute/v2.1/servers/9bbb0abf-72a3-4fbc-8235-7a3ecfc8d006 => generated 1567 bytes in 485 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 03:05:49.061409 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi [None req-795c5293-96a0-4a11-8fac-741f623cabad tempest-VolumesNegativeTest-1333024728 tempest-VolumesNegativeTest-1333024728-project] Calling method '>' {{(pid=116156) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:05:49.062057 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.compute.api [None req-795c5293-96a0-4a11-8fac-741f623cabad tempest-VolumesNegativeTest-1333024728 tempest-VolumesNegativeTest-1333024728-project] [instance: 2365eae1-dcfc-4a4b-ad6b-8716ad710496] Fetching instance by UUID {{(pid=116156) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:05:49.071046 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-795c5293-96a0-4a11-8fac-741f623cabad tempest-VolumesNegativeTest-1333024728 tempest-VolumesNegativeTest-1333024728-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:05:49.071835 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-795c5293-96a0-4a11-8fac-741f623cabad tempest-VolumesNegativeTest-1333024728 tempest-VolumesNegativeTest-1333024728-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:05:49.073049 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-795c5293-96a0-4a11-8fac-741f623cabad tempest-VolumesNegativeTest-1333024728 tempest-VolumesNegativeTest-1333024728-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:05:49.073445 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-795c5293-96a0-4a11-8fac-741f623cabad tempest-VolumesNegativeTest-1333024728 tempest-VolumesNegativeTest-1333024728-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:05:49.112120 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: INFO nova.api.openstack.requestlog [None req-cff8052b-351c-467d-855a-6a11824f9e63 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] 10.222.0.18 "POST /compute/v2.1/servers/b89094ac-aee1-4bd6-a33d-8c4347cebfc7/action" status: 200 len: 28182 microversion: 2.20 time: 0.520859 Dec 15 03:05:49.113049 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: [pid: 116157|app: 0|req: 196/433] 10.222.0.18 () {62 vars in 1318 bytes} [Wed Dec 15 03:05:48 2021] POST /compute/v2.1/servers/b89094ac-aee1-4bd6-a33d-8c4347cebfc7/action => generated 28182 bytes in 522 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Dec 15 03:05:49.282597 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi [None req-1ac2d745-6ecf-4f84-9283-a72ff2c137c3 tempest-AttachVolumeNegativeTest-1640336653 tempest-AttachVolumeNegativeTest-1640336653-project] Calling method '>' {{(pid=116157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:05:49.283646 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.compute.api [None req-1ac2d745-6ecf-4f84-9283-a72ff2c137c3 tempest-AttachVolumeNegativeTest-1640336653 tempest-AttachVolumeNegativeTest-1640336653-project] [instance: c3d5f143-e994-4098-989b-660411a8dd8f] Fetching instance by UUID {{(pid=116157) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:05:49.293748 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-1ac2d745-6ecf-4f84-9283-a72ff2c137c3 tempest-AttachVolumeNegativeTest-1640336653 tempest-AttachVolumeNegativeTest-1640336653-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:05:49.294237 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-1ac2d745-6ecf-4f84-9283-a72ff2c137c3 tempest-AttachVolumeNegativeTest-1640336653 tempest-AttachVolumeNegativeTest-1640336653-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:05:49.299228 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-1ac2d745-6ecf-4f84-9283-a72ff2c137c3 tempest-AttachVolumeNegativeTest-1640336653 tempest-AttachVolumeNegativeTest-1640336653-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:05:49.299787 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-1ac2d745-6ecf-4f84-9283-a72ff2c137c3 tempest-AttachVolumeNegativeTest-1640336653 tempest-AttachVolumeNegativeTest-1640336653-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:05:49.342299 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.policy [None req-795c5293-96a0-4a11-8fac-741f623cabad tempest-VolumesNegativeTest-1333024728 tempest-VolumesNegativeTest-1333024728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2249449813ef41928c52b2d66314b89d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b28917c863104bbe9abc5f7e87803f9e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116156) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:05:49.352535 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: INFO nova.api.openstack.requestlog [None req-795c5293-96a0-4a11-8fac-741f623cabad tempest-VolumesNegativeTest-1333024728 tempest-VolumesNegativeTest-1333024728-project] 10.222.0.18 "GET /compute/v2.1/servers/2365eae1-dcfc-4a4b-ad6b-8716ad710496" status: 200 len: 1315 microversion: 2.1 time: 0.296700 Dec 15 03:05:49.363237 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: [pid: 116156|app: 0|req: 238/434] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 03:05:49 2021] GET /compute/v2.1/servers/2365eae1-dcfc-4a4b-ad6b-8716ad710496 => generated 1315 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 03:05:49.371731 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: INFO nova.api.openstack.requestlog [None req-1ac2d745-6ecf-4f84-9283-a72ff2c137c3 tempest-AttachVolumeNegativeTest-1640336653 tempest-AttachVolumeNegativeTest-1640336653-project] 10.222.0.18 "GET /compute/v2.1/servers/c3d5f143-e994-4098-989b-660411a8dd8f/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.094125 Dec 15 03:05:49.377916 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: [pid: 116157|app: 0|req: 197/435] 10.222.0.18 () {58 vars in 1301 bytes} [Wed Dec 15 03:05:49 2021] GET /compute/v2.1/servers/c3d5f143-e994-4098-989b-660411a8dd8f/os-volume_attachments => generated 25 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Dec 15 03:05:49.678933 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi [None req-089c8aa4-697f-4b4e-a452-381c3f5c1988 tempest-AttachVolumeNegativeTest-1640336653 tempest-AttachVolumeNegativeTest-1640336653-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1532482574", "imageRef": "5195b034-9fa4-468b-a94d-ef3ee79ce449", "flavorRef": "452", "networks": [{"uuid": "b0713a87-683c-42de-a9a0-98522d8ec589"}]}} {{(pid=116156) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 03:05:50.059606 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi [None req-e7e18a19-5787-46ce-9d89-a9f4184b6978 tempest-ServerRescueNegativeTestJSON-2061875223 tempest-ServerRescueNegativeTestJSON-2061875223-project] Calling method '>' {{(pid=116157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:05:50.060283 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.compute.api [None req-e7e18a19-5787-46ce-9d89-a9f4184b6978 tempest-ServerRescueNegativeTestJSON-2061875223 tempest-ServerRescueNegativeTestJSON-2061875223-project] [instance: 9bbb0abf-72a3-4fbc-8235-7a3ecfc8d006] Fetching instance by UUID {{(pid=116157) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:05:50.084282 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-e7e18a19-5787-46ce-9d89-a9f4184b6978 tempest-ServerRescueNegativeTestJSON-2061875223 tempest-ServerRescueNegativeTestJSON-2061875223-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:05:50.085123 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-e7e18a19-5787-46ce-9d89-a9f4184b6978 tempest-ServerRescueNegativeTestJSON-2061875223 tempest-ServerRescueNegativeTestJSON-2061875223-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:05:50.086199 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-e7e18a19-5787-46ce-9d89-a9f4184b6978 tempest-ServerRescueNegativeTestJSON-2061875223 tempest-ServerRescueNegativeTestJSON-2061875223-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:05:50.086848 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-e7e18a19-5787-46ce-9d89-a9f4184b6978 tempest-ServerRescueNegativeTestJSON-2061875223 tempest-ServerRescueNegativeTestJSON-2061875223-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:05:50.424536 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.policy [None req-e7e18a19-5787-46ce-9d89-a9f4184b6978 tempest-ServerRescueNegativeTestJSON-2061875223 tempest-ServerRescueNegativeTestJSON-2061875223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ea02b6e8f1548a1bd78952cb7337403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5e8a958d4bf43868502b13728b9583b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116157) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:05:50.437784 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: INFO nova.api.openstack.requestlog [None req-e7e18a19-5787-46ce-9d89-a9f4184b6978 tempest-ServerRescueNegativeTestJSON-2061875223 tempest-ServerRescueNegativeTestJSON-2061875223-project] 10.222.0.18 "GET /compute/v2.1/servers/9bbb0abf-72a3-4fbc-8235-7a3ecfc8d006" status: 200 len: 1547 microversion: 2.1 time: 0.381724 Dec 15 03:05:50.450424 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: [pid: 116157|app: 0|req: 198/436] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 03:05:50 2021] GET /compute/v2.1/servers/9bbb0abf-72a3-4fbc-8235-7a3ecfc8d006 => generated 1547 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 03:05:50.460962 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi [None req-c12fda5a-ef71-485b-a69e-4cdb914c4fc3 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 03:05:50.462407 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.compute.api [None req-c12fda5a-ef71-485b-a69e-4cdb914c4fc3 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] [instance: b89094ac-aee1-4bd6-a33d-8c4347cebfc7] Fetching instance by UUID {{(pid=116157) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:05:50.469970 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-c12fda5a-ef71-485b-a69e-4cdb914c4fc3 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:05:50.471127 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-c12fda5a-ef71-485b-a69e-4cdb914c4fc3 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:05:50.472423 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-c12fda5a-ef71-485b-a69e-4cdb914c4fc3 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:05:50.473115 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-c12fda5a-ef71-485b-a69e-4cdb914c4fc3 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:05:50.601201 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: INFO nova.api.openstack.requestlog [None req-c12fda5a-ef71-485b-a69e-4cdb914c4fc3 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] 10.222.0.18 "POST /compute/v2.1/servers/b89094ac-aee1-4bd6-a33d-8c4347cebfc7/action" status: 200 len: 28470 microversion: 2.20 time: 0.148834 Dec 15 03:05:50.602582 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: [pid: 116157|app: 0|req: 199/437] 10.222.0.18 () {62 vars in 1318 bytes} [Wed Dec 15 03:05:50 2021] POST /compute/v2.1/servers/b89094ac-aee1-4bd6-a33d-8c4347cebfc7/action => generated 28470 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 15 03:05:50.612187 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi [None req-893880a0-a3fa-4a29-b5c5-4f4285f76ad1 tempest-VolumesNegativeTest-1333024728 tempest-VolumesNegativeTest-1333024728-project] Calling method '>' {{(pid=116157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:05:50.614151 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.compute.api [None req-893880a0-a3fa-4a29-b5c5-4f4285f76ad1 tempest-VolumesNegativeTest-1333024728 tempest-VolumesNegativeTest-1333024728-project] [instance: 2365eae1-dcfc-4a4b-ad6b-8716ad710496] Fetching instance by UUID {{(pid=116157) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:05:50.631151 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-893880a0-a3fa-4a29-b5c5-4f4285f76ad1 tempest-VolumesNegativeTest-1333024728 tempest-VolumesNegativeTest-1333024728-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:05:50.635369 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-893880a0-a3fa-4a29-b5c5-4f4285f76ad1 tempest-VolumesNegativeTest-1333024728 tempest-VolumesNegativeTest-1333024728-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:05:50.636505 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-893880a0-a3fa-4a29-b5c5-4f4285f76ad1 tempest-VolumesNegativeTest-1333024728 tempest-VolumesNegativeTest-1333024728-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:05:50.637186 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-893880a0-a3fa-4a29-b5c5-4f4285f76ad1 tempest-VolumesNegativeTest-1333024728 tempest-VolumesNegativeTest-1333024728-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:05:51.003996 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.policy [None req-893880a0-a3fa-4a29-b5c5-4f4285f76ad1 tempest-VolumesNegativeTest-1333024728 tempest-VolumesNegativeTest-1333024728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2249449813ef41928c52b2d66314b89d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b28917c863104bbe9abc5f7e87803f9e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116157) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:05:51.020215 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: INFO nova.api.openstack.requestlog [None req-893880a0-a3fa-4a29-b5c5-4f4285f76ad1 tempest-VolumesNegativeTest-1333024728 tempest-VolumesNegativeTest-1333024728-project] 10.222.0.18 "GET /compute/v2.1/servers/2365eae1-dcfc-4a4b-ad6b-8716ad710496" status: 200 len: 1464 microversion: 2.1 time: 0.415364 Dec 15 03:05:51.021221 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: [pid: 116157|app: 0|req: 200/438] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 03:05:50 2021] GET /compute/v2.1/servers/2365eae1-dcfc-4a4b-ad6b-8716ad710496 => generated 1464 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 03:05:51.038787 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi [None req-32acb835-6ec4-4dae-ae34-b7539723158e tempest-ServerRescueNegativeTestJSON-2061875223 tempest-ServerRescueNegativeTestJSON-2061875223-project] Calling method '>' {{(pid=116157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:05:51.039594 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.compute.api [None req-32acb835-6ec4-4dae-ae34-b7539723158e tempest-ServerRescueNegativeTestJSON-2061875223 tempest-ServerRescueNegativeTestJSON-2061875223-project] [instance: 9bbb0abf-72a3-4fbc-8235-7a3ecfc8d006] Fetching instance by UUID {{(pid=116157) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:05:51.052675 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-32acb835-6ec4-4dae-ae34-b7539723158e tempest-ServerRescueNegativeTestJSON-2061875223 tempest-ServerRescueNegativeTestJSON-2061875223-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:05:51.053128 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-32acb835-6ec4-4dae-ae34-b7539723158e tempest-ServerRescueNegativeTestJSON-2061875223 tempest-ServerRescueNegativeTestJSON-2061875223-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:05:51.054773 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-32acb835-6ec4-4dae-ae34-b7539723158e tempest-ServerRescueNegativeTestJSON-2061875223 tempest-ServerRescueNegativeTestJSON-2061875223-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:05:51.055214 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-32acb835-6ec4-4dae-ae34-b7539723158e tempest-ServerRescueNegativeTestJSON-2061875223 tempest-ServerRescueNegativeTestJSON-2061875223-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:05:51.205298 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: INFO nova.api.openstack.wsgi [None req-32acb835-6ec4-4dae-ae34-b7539723158e tempest-ServerRescueNegativeTestJSON-2061875223 tempest-ServerRescueNegativeTestJSON-2061875223-project] HTTP exception thrown: Cannot 'detach_volume' instance 9bbb0abf-72a3-4fbc-8235-7a3ecfc8d006 while it is in vm_state rescued Dec 15 03:05:51.206230 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi [None req-32acb835-6ec4-4dae-ae34-b7539723158e tempest-ServerRescueNegativeTestJSON-2061875223 tempest-ServerRescueNegativeTestJSON-2061875223-project] Returning 409 to user: Cannot 'detach_volume' instance 9bbb0abf-72a3-4fbc-8235-7a3ecfc8d006 while it is in vm_state rescued {{(pid=116157) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 15 03:05:51.209869 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: INFO nova.api.openstack.requestlog [None req-32acb835-6ec4-4dae-ae34-b7539723158e tempest-ServerRescueNegativeTestJSON-2061875223 tempest-ServerRescueNegativeTestJSON-2061875223-project] 10.222.0.18 "DELETE /compute/v2.1/servers/9bbb0abf-72a3-4fbc-8235-7a3ecfc8d006/os-volume_attachments/7302346f-6ff9-4a17-b652-4ae95283118d" status: 409 len: 152 microversion: 2.1 time: 0.184529 Dec 15 03:05:51.209869 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: [pid: 116157|app: 0|req: 201/439] 10.222.0.18 () {58 vars in 1415 bytes} [Wed Dec 15 03:05:51 2021] DELETE /compute/v2.1/servers/9bbb0abf-72a3-4fbc-8235-7a3ecfc8d006/os-volume_attachments/7302346f-6ff9-4a17-b652-4ae95283118d => generated 152 bytes in 186 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Dec 15 03:05:51.213099 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi [None req-1be4f7a0-b2fa-4233-b138-3132cbad524b tempest-VolumesNegativeTest-1333024728 tempest-VolumesNegativeTest-1333024728-project] Calling method '>' {{(pid=116157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:05:51.215817 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.compute.api [None req-1be4f7a0-b2fa-4233-b138-3132cbad524b tempest-VolumesNegativeTest-1333024728 tempest-VolumesNegativeTest-1333024728-project] [instance: 2365eae1-dcfc-4a4b-ad6b-8716ad710496] Fetching instance by UUID {{(pid=116157) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:05:51.227090 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-1be4f7a0-b2fa-4233-b138-3132cbad524b tempest-VolumesNegativeTest-1333024728 tempest-VolumesNegativeTest-1333024728-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:05:51.231105 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-1be4f7a0-b2fa-4233-b138-3132cbad524b tempest-VolumesNegativeTest-1333024728 tempest-VolumesNegativeTest-1333024728-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:05:51.236179 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-1be4f7a0-b2fa-4233-b138-3132cbad524b tempest-VolumesNegativeTest-1333024728 tempest-VolumesNegativeTest-1333024728-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:05:51.236774 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-1be4f7a0-b2fa-4233-b138-3132cbad524b tempest-VolumesNegativeTest-1333024728 tempest-VolumesNegativeTest-1333024728-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:05:51.284514 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.compute.api [None req-1be4f7a0-b2fa-4233-b138-3132cbad524b tempest-VolumesNegativeTest-1333024728 tempest-VolumesNegativeTest-1333024728-project] [instance: 2365eae1-dcfc-4a4b-ad6b-8716ad710496] Going to try to terminate instance {{(pid=116157) delete /opt/stack/nova/nova/compute/api.py:2614}} Dec 15 03:05:51.466916 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: INFO nova.api.openstack.requestlog [None req-1be4f7a0-b2fa-4233-b138-3132cbad524b tempest-VolumesNegativeTest-1333024728 tempest-VolumesNegativeTest-1333024728-project] 10.222.0.18 "DELETE /compute/v2.1/servers/2365eae1-dcfc-4a4b-ad6b-8716ad710496" status: 204 len: 0 microversion: 2.1 time: 0.257646 Dec 15 03:05:51.468428 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: [pid: 116157|app: 0|req: 202/440] 10.222.0.18 () {58 vars in 1238 bytes} [Wed Dec 15 03:05:51 2021] DELETE /compute/v2.1/servers/2365eae1-dcfc-4a4b-ad6b-8716ad710496 => generated 0 bytes in 260 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Dec 15 03:05:51.480550 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi [None req-ace487c7-d364-454b-831f-626960c44771 tempest-ServerRescueNegativeTestJSON-2061875223 tempest-ServerRescueNegativeTestJSON-2061875223-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=116157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 03:05:51.481636 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.compute.api [None req-ace487c7-d364-454b-831f-626960c44771 tempest-ServerRescueNegativeTestJSON-2061875223 tempest-ServerRescueNegativeTestJSON-2061875223-project] [instance: 9bbb0abf-72a3-4fbc-8235-7a3ecfc8d006] Fetching instance by UUID {{(pid=116157) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:05:51.502981 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-ace487c7-d364-454b-831f-626960c44771 tempest-ServerRescueNegativeTestJSON-2061875223 tempest-ServerRescueNegativeTestJSON-2061875223-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:05:51.503608 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-ace487c7-d364-454b-831f-626960c44771 tempest-ServerRescueNegativeTestJSON-2061875223 tempest-ServerRescueNegativeTestJSON-2061875223-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:05:51.504444 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-ace487c7-d364-454b-831f-626960c44771 tempest-ServerRescueNegativeTestJSON-2061875223 tempest-ServerRescueNegativeTestJSON-2061875223-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:05:51.504888 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-ace487c7-d364-454b-831f-626960c44771 tempest-ServerRescueNegativeTestJSON-2061875223 tempest-ServerRescueNegativeTestJSON-2061875223-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:05:51.680846 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: INFO nova.api.openstack.requestlog [None req-ace487c7-d364-454b-831f-626960c44771 tempest-ServerRescueNegativeTestJSON-2061875223 tempest-ServerRescueNegativeTestJSON-2061875223-project] 10.222.0.18 "POST /compute/v2.1/servers/9bbb0abf-72a3-4fbc-8235-7a3ecfc8d006/action" status: 202 len: 0 microversion: 2.1 time: 0.209627 Dec 15 03:05:51.681593 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: [pid: 116157|app: 0|req: 203/441] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Dec 15 03:05:51 2021] POST /compute/v2.1/servers/9bbb0abf-72a3-4fbc-8235-7a3ecfc8d006/action => generated 0 bytes in 212 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Dec 15 03:05:51.689072 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi [None req-7a505a20-5fba-42d0-8ed4-a25dc1c9eb16 tempest-VolumesNegativeTest-1333024728 tempest-VolumesNegativeTest-1333024728-project] Calling method '>' {{(pid=116157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:05:51.694458 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.compute.api [None req-7a505a20-5fba-42d0-8ed4-a25dc1c9eb16 tempest-VolumesNegativeTest-1333024728 tempest-VolumesNegativeTest-1333024728-project] [instance: 2365eae1-dcfc-4a4b-ad6b-8716ad710496] Fetching instance by UUID {{(pid=116157) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:05:51.707579 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-7a505a20-5fba-42d0-8ed4-a25dc1c9eb16 tempest-VolumesNegativeTest-1333024728 tempest-VolumesNegativeTest-1333024728-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:05:51.711306 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-7a505a20-5fba-42d0-8ed4-a25dc1c9eb16 tempest-VolumesNegativeTest-1333024728 tempest-VolumesNegativeTest-1333024728-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:05:51.712480 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-7a505a20-5fba-42d0-8ed4-a25dc1c9eb16 tempest-VolumesNegativeTest-1333024728 tempest-VolumesNegativeTest-1333024728-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:05:51.713041 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-7a505a20-5fba-42d0-8ed4-a25dc1c9eb16 tempest-VolumesNegativeTest-1333024728 tempest-VolumesNegativeTest-1333024728-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:05:52.473051 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.policy [None req-7a505a20-5fba-42d0-8ed4-a25dc1c9eb16 tempest-VolumesNegativeTest-1333024728 tempest-VolumesNegativeTest-1333024728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2249449813ef41928c52b2d66314b89d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b28917c863104bbe9abc5f7e87803f9e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116157) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:05:52.487345 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: INFO nova.api.openstack.requestlog [None req-7a505a20-5fba-42d0-8ed4-a25dc1c9eb16 tempest-VolumesNegativeTest-1333024728 tempest-VolumesNegativeTest-1333024728-project] 10.222.0.18 "GET /compute/v2.1/servers/2365eae1-dcfc-4a4b-ad6b-8716ad710496" status: 200 len: 1470 microversion: 2.1 time: 0.799675 Dec 15 03:05:52.488461 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: [pid: 116157|app: 0|req: 204/442] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 03:05:51 2021] GET /compute/v2.1/servers/2365eae1-dcfc-4a4b-ad6b-8716ad710496 => generated 1470 bytes in 806 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 03:05:52.506367 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi [None req-1ccff02d-439f-4ea8-9c00-541790efc801 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 03:05:52.507628 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.compute.api [None req-1ccff02d-439f-4ea8-9c00-541790efc801 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] [instance: b89094ac-aee1-4bd6-a33d-8c4347cebfc7] Fetching instance by UUID {{(pid=116157) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:05:52.523486 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-1ccff02d-439f-4ea8-9c00-541790efc801 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:05:52.523942 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-1ccff02d-439f-4ea8-9c00-541790efc801 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:05:52.524761 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-1ccff02d-439f-4ea8-9c00-541790efc801 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:05:52.530604 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-1ccff02d-439f-4ea8-9c00-541790efc801 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:05:52.709926 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: INFO nova.api.openstack.requestlog [None req-1ccff02d-439f-4ea8-9c00-541790efc801 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] 10.222.0.18 "POST /compute/v2.1/servers/b89094ac-aee1-4bd6-a33d-8c4347cebfc7/action" status: 200 len: 28638 microversion: 2.20 time: 0.220000 Dec 15 03:05:52.710952 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: [pid: 116157|app: 0|req: 205/443] 10.222.0.18 () {62 vars in 1318 bytes} [Wed Dec 15 03:05:52 2021] POST /compute/v2.1/servers/b89094ac-aee1-4bd6-a33d-8c4347cebfc7/action => generated 28638 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 15 03:05:52.716805 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi [None req-a824d329-60f1-4e38-aa41-515d8cf094dc tempest-ServerRescueNegativeTestJSON-2061875223 tempest-ServerRescueNegativeTestJSON-2061875223-project] Calling method '>' {{(pid=116157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:05:52.723965 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.compute.api [None req-a824d329-60f1-4e38-aa41-515d8cf094dc tempest-ServerRescueNegativeTestJSON-2061875223 tempest-ServerRescueNegativeTestJSON-2061875223-project] [instance: 9bbb0abf-72a3-4fbc-8235-7a3ecfc8d006] Fetching instance by UUID {{(pid=116157) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:05:52.763579 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-a824d329-60f1-4e38-aa41-515d8cf094dc tempest-ServerRescueNegativeTestJSON-2061875223 tempest-ServerRescueNegativeTestJSON-2061875223-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:05:52.764293 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-a824d329-60f1-4e38-aa41-515d8cf094dc tempest-ServerRescueNegativeTestJSON-2061875223 tempest-ServerRescueNegativeTestJSON-2061875223-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:05:52.765330 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-a824d329-60f1-4e38-aa41-515d8cf094dc tempest-ServerRescueNegativeTestJSON-2061875223 tempest-ServerRescueNegativeTestJSON-2061875223-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:05:52.766577 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-a824d329-60f1-4e38-aa41-515d8cf094dc tempest-ServerRescueNegativeTestJSON-2061875223 tempest-ServerRescueNegativeTestJSON-2061875223-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:05:53.291200 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.policy [None req-a824d329-60f1-4e38-aa41-515d8cf094dc tempest-ServerRescueNegativeTestJSON-2061875223 tempest-ServerRescueNegativeTestJSON-2061875223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ea02b6e8f1548a1bd78952cb7337403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5e8a958d4bf43868502b13728b9583b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116157) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:05:53.303294 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: INFO nova.api.openstack.requestlog [None req-a824d329-60f1-4e38-aa41-515d8cf094dc tempest-ServerRescueNegativeTestJSON-2061875223 tempest-ServerRescueNegativeTestJSON-2061875223-project] 10.222.0.18 "GET /compute/v2.1/servers/9bbb0abf-72a3-4fbc-8235-7a3ecfc8d006" status: 200 len: 1555 microversion: 2.1 time: 0.591090 Dec 15 03:05:53.304829 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: [pid: 116157|app: 0|req: 206/444] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 03:05:52 2021] GET /compute/v2.1/servers/9bbb0abf-72a3-4fbc-8235-7a3ecfc8d006 => generated 1555 bytes in 593 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 03:05:53.506185 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi [None req-6006ad62-2f79-483c-b3e9-09c3a7c72340 tempest-VolumesNegativeTest-1333024728 tempest-VolumesNegativeTest-1333024728-project] Calling method '>' {{(pid=116157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:05:53.507586 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.compute.api [None req-6006ad62-2f79-483c-b3e9-09c3a7c72340 tempest-VolumesNegativeTest-1333024728 tempest-VolumesNegativeTest-1333024728-project] [instance: 2365eae1-dcfc-4a4b-ad6b-8716ad710496] Fetching instance by UUID {{(pid=116157) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:05:53.515960 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-6006ad62-2f79-483c-b3e9-09c3a7c72340 tempest-VolumesNegativeTest-1333024728 tempest-VolumesNegativeTest-1333024728-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:05:53.525699 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-6006ad62-2f79-483c-b3e9-09c3a7c72340 tempest-VolumesNegativeTest-1333024728 tempest-VolumesNegativeTest-1333024728-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:05:53.533240 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-6006ad62-2f79-483c-b3e9-09c3a7c72340 tempest-VolumesNegativeTest-1333024728 tempest-VolumesNegativeTest-1333024728-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:05:53.533748 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-6006ad62-2f79-483c-b3e9-09c3a7c72340 tempest-VolumesNegativeTest-1333024728 tempest-VolumesNegativeTest-1333024728-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:05:53.936085 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.policy [None req-6006ad62-2f79-483c-b3e9-09c3a7c72340 tempest-VolumesNegativeTest-1333024728 tempest-VolumesNegativeTest-1333024728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2249449813ef41928c52b2d66314b89d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b28917c863104bbe9abc5f7e87803f9e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116157) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:05:53.944058 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: INFO nova.api.openstack.requestlog [None req-6006ad62-2f79-483c-b3e9-09c3a7c72340 tempest-VolumesNegativeTest-1333024728 tempest-VolumesNegativeTest-1333024728-project] 10.222.0.18 "GET /compute/v2.1/servers/2365eae1-dcfc-4a4b-ad6b-8716ad710496" status: 200 len: 1470 microversion: 2.1 time: 0.442273 Dec 15 03:05:53.950348 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: [pid: 116157|app: 0|req: 207/445] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 03:05:53 2021] GET /compute/v2.1/servers/2365eae1-dcfc-4a4b-ad6b-8716ad710496 => generated 1470 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 03:05:53.955908 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi [None req-5fd5e422-afff-4959-9e52-0b00d4c6e678 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 03:05:53.956820 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.compute.api [None req-5fd5e422-afff-4959-9e52-0b00d4c6e678 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] [instance: b89094ac-aee1-4bd6-a33d-8c4347cebfc7] Fetching instance by UUID {{(pid=116157) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:05:53.972960 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-5fd5e422-afff-4959-9e52-0b00d4c6e678 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:05:53.973598 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-5fd5e422-afff-4959-9e52-0b00d4c6e678 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:05:53.974767 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-5fd5e422-afff-4959-9e52-0b00d4c6e678 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:05:53.975361 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-5fd5e422-afff-4959-9e52-0b00d4c6e678 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:05:54.110622 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: INFO nova.api.openstack.requestlog [None req-5fd5e422-afff-4959-9e52-0b00d4c6e678 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] 10.222.0.18 "POST /compute/v2.1/servers/b89094ac-aee1-4bd6-a33d-8c4347cebfc7/action" status: 200 len: 28638 microversion: 2.20 time: 0.158087 Dec 15 03:05:54.111139 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: [pid: 116157|app: 0|req: 208/446] 10.222.0.18 () {62 vars in 1318 bytes} [Wed Dec 15 03:05:53 2021] POST /compute/v2.1/servers/b89094ac-aee1-4bd6-a33d-8c4347cebfc7/action => generated 28638 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 15 03:05:54.324212 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi [None req-7b7763a0-4a87-4c61-a122-e99ed0cd6885 tempest-ServerRescueNegativeTestJSON-2061875223 tempest-ServerRescueNegativeTestJSON-2061875223-project] Calling method '>' {{(pid=116157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:05:54.324933 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.compute.api [None req-7b7763a0-4a87-4c61-a122-e99ed0cd6885 tempest-ServerRescueNegativeTestJSON-2061875223 tempest-ServerRescueNegativeTestJSON-2061875223-project] [instance: 9bbb0abf-72a3-4fbc-8235-7a3ecfc8d006] Fetching instance by UUID {{(pid=116157) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:05:54.340550 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-7b7763a0-4a87-4c61-a122-e99ed0cd6885 tempest-ServerRescueNegativeTestJSON-2061875223 tempest-ServerRescueNegativeTestJSON-2061875223-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:05:54.340999 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-7b7763a0-4a87-4c61-a122-e99ed0cd6885 tempest-ServerRescueNegativeTestJSON-2061875223 tempest-ServerRescueNegativeTestJSON-2061875223-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:05:54.341797 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-7b7763a0-4a87-4c61-a122-e99ed0cd6885 tempest-ServerRescueNegativeTestJSON-2061875223 tempest-ServerRescueNegativeTestJSON-2061875223-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:05:54.342256 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-7b7763a0-4a87-4c61-a122-e99ed0cd6885 tempest-ServerRescueNegativeTestJSON-2061875223 tempest-ServerRescueNegativeTestJSON-2061875223-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:05:54.561172 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.network.neutron [None req-089c8aa4-697f-4b4e-a452-381c3f5c1988 tempest-AttachVolumeNegativeTest-1640336653 tempest-AttachVolumeNegativeTest-1640336653-project] validate_networks() for [('b0713a87-683c-42de-a9a0-98522d8ec589', None, None, None, None, None)] {{(pid=116156) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Dec 15 03:05:54.695861 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.policy [None req-7b7763a0-4a87-4c61-a122-e99ed0cd6885 tempest-ServerRescueNegativeTestJSON-2061875223 tempest-ServerRescueNegativeTestJSON-2061875223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ea02b6e8f1548a1bd78952cb7337403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5e8a958d4bf43868502b13728b9583b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116157) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:05:54.704423 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: INFO nova.api.openstack.requestlog [None req-7b7763a0-4a87-4c61-a122-e99ed0cd6885 tempest-ServerRescueNegativeTestJSON-2061875223 tempest-ServerRescueNegativeTestJSON-2061875223-project] 10.222.0.18 "GET /compute/v2.1/servers/9bbb0abf-72a3-4fbc-8235-7a3ecfc8d006" status: 200 len: 1555 microversion: 2.1 time: 0.384306 Dec 15 03:05:54.704991 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: [pid: 116157|app: 0|req: 209/447] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 03:05:54 2021] GET /compute/v2.1/servers/9bbb0abf-72a3-4fbc-8235-7a3ecfc8d006 => generated 1555 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 03:05:54.964044 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi [None req-0c30888d-56af-4837-b86c-d3b270658121 tempest-VolumesNegativeTest-1333024728 tempest-VolumesNegativeTest-1333024728-project] Calling method '>' {{(pid=116157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:05:54.964820 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.compute.api [None req-0c30888d-56af-4837-b86c-d3b270658121 tempest-VolumesNegativeTest-1333024728 tempest-VolumesNegativeTest-1333024728-project] [instance: 2365eae1-dcfc-4a4b-ad6b-8716ad710496] Fetching instance by UUID {{(pid=116157) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:05:54.983578 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-0c30888d-56af-4837-b86c-d3b270658121 tempest-VolumesNegativeTest-1333024728 tempest-VolumesNegativeTest-1333024728-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:05:54.987890 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-0c30888d-56af-4837-b86c-d3b270658121 tempest-VolumesNegativeTest-1333024728 tempest-VolumesNegativeTest-1333024728-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:05:54.994844 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-0c30888d-56af-4837-b86c-d3b270658121 tempest-VolumesNegativeTest-1333024728 tempest-VolumesNegativeTest-1333024728-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:05:54.999402 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-0c30888d-56af-4837-b86c-d3b270658121 tempest-VolumesNegativeTest-1333024728 tempest-VolumesNegativeTest-1333024728-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:05:55.150047 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.policy [None req-0c30888d-56af-4837-b86c-d3b270658121 tempest-VolumesNegativeTest-1333024728 tempest-VolumesNegativeTest-1333024728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2249449813ef41928c52b2d66314b89d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b28917c863104bbe9abc5f7e87803f9e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116157) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:05:55.162393 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: INFO nova.api.openstack.requestlog [None req-0c30888d-56af-4837-b86c-d3b270658121 tempest-VolumesNegativeTest-1333024728 tempest-VolumesNegativeTest-1333024728-project] 10.222.0.18 "GET /compute/v2.1/servers/2365eae1-dcfc-4a4b-ad6b-8716ad710496" status: 200 len: 1428 microversion: 2.1 time: 0.202096 Dec 15 03:05:55.163790 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: [pid: 116157|app: 0|req: 210/448] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 03:05:54 2021] GET /compute/v2.1/servers/2365eae1-dcfc-4a4b-ad6b-8716ad710496 => generated 1428 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 03:05:55.171840 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi [None req-456b1b79-27a9-44be-b7db-1c5dbbf0001f tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 03:05:55.177754 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.compute.api [None req-456b1b79-27a9-44be-b7db-1c5dbbf0001f tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] [instance: b89094ac-aee1-4bd6-a33d-8c4347cebfc7] Fetching instance by UUID {{(pid=116157) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:05:55.218837 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-456b1b79-27a9-44be-b7db-1c5dbbf0001f tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:05:55.219919 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-456b1b79-27a9-44be-b7db-1c5dbbf0001f tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:05:55.223270 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-456b1b79-27a9-44be-b7db-1c5dbbf0001f tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:05:55.224078 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-456b1b79-27a9-44be-b7db-1c5dbbf0001f tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:05:55.347217 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: INFO nova.api.openstack.requestlog [None req-456b1b79-27a9-44be-b7db-1c5dbbf0001f tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] 10.222.0.18 "POST /compute/v2.1/servers/b89094ac-aee1-4bd6-a33d-8c4347cebfc7/action" status: 200 len: 28638 microversion: 2.20 time: 0.181899 Dec 15 03:05:55.349426 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: [pid: 116157|app: 0|req: 211/449] 10.222.0.18 () {62 vars in 1318 bytes} [Wed Dec 15 03:05:55 2021] POST /compute/v2.1/servers/b89094ac-aee1-4bd6-a33d-8c4347cebfc7/action => generated 28638 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 15 03:05:55.355410 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi [req-09c684b1-06bc-484e-b4a0-5b7106ff0a8b req-76796e10-4803-492d-91df-b341818f790b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2365eae1-dcfc-4a4b-ad6b-8716ad710496", "name": "network-vif-deleted", "tag": "22ba3072-6295-4211-ab35-5e0cd72571c9"}]} {{(pid=116157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 03:05:55.357322 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 15 03:05:55.357322 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: warnings.warn(msg) Dec 15 03:05:55.367357 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [req-09c684b1-06bc-484e-b4a0-5b7106ff0a8b req-76796e10-4803-492d-91df-b341818f790b service nova] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:05:55.367699 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [req-09c684b1-06bc-484e-b4a0-5b7106ff0a8b req-76796e10-4803-492d-91df-b341818f790b service nova] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:05:55.390029 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: INFO nova.api.openstack.compute.server_external_events [req-09c684b1-06bc-484e-b4a0-5b7106ff0a8b req-76796e10-4803-492d-91df-b341818f790b service nova] Creating event network-vif-deleted:22ba3072-6295-4211-ab35-5e0cd72571c9 for instance 2365eae1-dcfc-4a4b-ad6b-8716ad710496 on hv-cinder-81803 Dec 15 03:05:55.400771 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: INFO nova.api.openstack.requestlog [req-09c684b1-06bc-484e-b4a0-5b7106ff0a8b req-76796e10-4803-492d-91df-b341818f790b service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.049187 Dec 15 03:05:55.401602 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: [pid: 116157|app: 0|req: 212/450] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Dec 15 03:05:55 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 03:05:55.567760 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.virt.hardware [None req-089c8aa4-697f-4b4e-a452-381c3f5c1988 tempest-AttachVolumeNegativeTest-1640336653 tempest-AttachVolumeNegativeTest-1640336653-project] Flavor limits 0:0:0 {{(pid=116156) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Dec 15 03:05:55.569193 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.virt.hardware [None req-089c8aa4-697f-4b4e-a452-381c3f5c1988 tempest-AttachVolumeNegativeTest-1640336653 tempest-AttachVolumeNegativeTest-1640336653-project] Image limits 0:0:0 {{(pid=116156) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Dec 15 03:05:55.570188 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.virt.hardware [None req-089c8aa4-697f-4b4e-a452-381c3f5c1988 tempest-AttachVolumeNegativeTest-1640336653 tempest-AttachVolumeNegativeTest-1640336653-project] Flavor pref 0:0:0 {{(pid=116156) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Dec 15 03:05:55.571048 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.virt.hardware [None req-089c8aa4-697f-4b4e-a452-381c3f5c1988 tempest-AttachVolumeNegativeTest-1640336653 tempest-AttachVolumeNegativeTest-1640336653-project] Image pref 0:0:0 {{(pid=116156) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Dec 15 03:05:55.572039 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.virt.hardware [None req-089c8aa4-697f-4b4e-a452-381c3f5c1988 tempest-AttachVolumeNegativeTest-1640336653 tempest-AttachVolumeNegativeTest-1640336653-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116156) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Dec 15 03:05:55.584407 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-089c8aa4-697f-4b4e-a452-381c3f5c1988 tempest-AttachVolumeNegativeTest-1640336653 tempest-AttachVolumeNegativeTest-1640336653-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:05:55.585245 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-089c8aa4-697f-4b4e-a452-381c3f5c1988 tempest-AttachVolumeNegativeTest-1640336653 tempest-AttachVolumeNegativeTest-1640336653-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:05:55.586696 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-089c8aa4-697f-4b4e-a452-381c3f5c1988 tempest-AttachVolumeNegativeTest-1640336653 tempest-AttachVolumeNegativeTest-1640336653-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:05:55.587928 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-089c8aa4-697f-4b4e-a452-381c3f5c1988 tempest-AttachVolumeNegativeTest-1640336653 tempest-AttachVolumeNegativeTest-1640336653-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:05:55.612602 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.quota [None req-089c8aa4-697f-4b4e-a452-381c3f5c1988 tempest-AttachVolumeNegativeTest-1640336653 tempest-AttachVolumeNegativeTest-1640336653-project] Getting quotas for project 409b41637da94c469444954258444b4b. Resources: {'cores', 'instances', 'ram'} {{(pid=116156) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 15 03:05:55.618004 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.quota [None req-089c8aa4-697f-4b4e-a452-381c3f5c1988 tempest-AttachVolumeNegativeTest-1640336653 tempest-AttachVolumeNegativeTest-1640336653-project] Getting quotas for user 35d37a3d8e504b8186182468b77dd114 and project 409b41637da94c469444954258444b4b. Resources: {'cores', 'instances', 'ram'} {{(pid=116156) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 15 03:05:55.632541 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.compute.api [None req-089c8aa4-697f-4b4e-a452-381c3f5c1988 tempest-AttachVolumeNegativeTest-1640336653 tempest-AttachVolumeNegativeTest-1640336653-project] Going to run 1 instances... {{(pid=116156) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Dec 15 03:05:55.634912 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.compute.api [None req-089c8aa4-697f-4b4e-a452-381c3f5c1988 tempest-AttachVolumeNegativeTest-1640336653 tempest-AttachVolumeNegativeTest-1640336653-project] [instance: 46fc96ad-6439-40ca-b2b9-ffe3b3e9bb17] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='5195b034-9fa4-468b-a94d-ef3ee79ce449',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=116156) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Dec 15 03:05:55.690899 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: INFO nova.api.openstack.requestlog [None req-089c8aa4-697f-4b4e-a452-381c3f5c1988 tempest-AttachVolumeNegativeTest-1640336653 tempest-AttachVolumeNegativeTest-1640336653-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 6.015733 Dec 15 03:05:55.697631 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: [pid: 116156|app: 0|req: 239/451] 10.222.0.18 () {60 vars in 1146 bytes} [Wed Dec 15 03:05:49 2021] POST /compute/v2.1/servers => generated 380 bytes in 6023 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Dec 15 03:05:55.705557 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi [None req-b771a32b-3469-4d0e-89e9-d7d191ffb64f tempest-AttachVolumeNegativeTest-1640336653 tempest-AttachVolumeNegativeTest-1640336653-project] Calling method '>' {{(pid=116156) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:05:55.706609 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.compute.api [None req-b771a32b-3469-4d0e-89e9-d7d191ffb64f tempest-AttachVolumeNegativeTest-1640336653 tempest-AttachVolumeNegativeTest-1640336653-project] [instance: 46fc96ad-6439-40ca-b2b9-ffe3b3e9bb17] Fetching instance by UUID {{(pid=116156) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:05:55.778647 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.policy [None req-b771a32b-3469-4d0e-89e9-d7d191ffb64f tempest-AttachVolumeNegativeTest-1640336653 tempest-AttachVolumeNegativeTest-1640336653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35d37a3d8e504b8186182468b77dd114', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '409b41637da94c469444954258444b4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116156) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:05:55.793598 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: INFO nova.api.openstack.requestlog [None req-b771a32b-3469-4d0e-89e9-d7d191ffb64f tempest-AttachVolumeNegativeTest-1640336653 tempest-AttachVolumeNegativeTest-1640336653-project] 10.222.0.18 "GET /compute/v2.1/servers/46fc96ad-6439-40ca-b2b9-ffe3b3e9bb17" status: 200 len: 1218 microversion: 2.1 time: 0.094268 Dec 15 03:05:55.794249 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: [pid: 116156|app: 0|req: 240/452] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 03:05:55 2021] GET /compute/v2.1/servers/46fc96ad-6439-40ca-b2b9-ffe3b3e9bb17 => generated 1218 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 03:05:55.818638 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi [None req-39c08a26-589c-4d0b-a3ca-5479f411a322 tempest-ServerRescueNegativeTestJSON-2061875223 tempest-ServerRescueNegativeTestJSON-2061875223-project] Calling method '>' {{(pid=116156) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:05:55.823279 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.compute.api [None req-39c08a26-589c-4d0b-a3ca-5479f411a322 tempest-ServerRescueNegativeTestJSON-2061875223 tempest-ServerRescueNegativeTestJSON-2061875223-project] [instance: 9bbb0abf-72a3-4fbc-8235-7a3ecfc8d006] Fetching instance by UUID {{(pid=116156) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:05:55.841155 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-39c08a26-589c-4d0b-a3ca-5479f411a322 tempest-ServerRescueNegativeTestJSON-2061875223 tempest-ServerRescueNegativeTestJSON-2061875223-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:05:55.841730 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-39c08a26-589c-4d0b-a3ca-5479f411a322 tempest-ServerRescueNegativeTestJSON-2061875223 tempest-ServerRescueNegativeTestJSON-2061875223-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:05:55.842667 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-39c08a26-589c-4d0b-a3ca-5479f411a322 tempest-ServerRescueNegativeTestJSON-2061875223 tempest-ServerRescueNegativeTestJSON-2061875223-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:05:55.843208 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-39c08a26-589c-4d0b-a3ca-5479f411a322 tempest-ServerRescueNegativeTestJSON-2061875223 tempest-ServerRescueNegativeTestJSON-2061875223-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:05:55.873695 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi [None req-a2850aec-88f1-4422-b740-51e10df0a904 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Action: 'create', calling method: .version_select at 0x7f1269a57550>, body: {"keypair": {"name": "tempest-TestShelveInstance-1219174885"}} {{(pid=116157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 03:05:55.899262 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.quota [None req-a2850aec-88f1-4422-b740-51e10df0a904 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Getting quotas for project 5a093d0bf43046aaa845f3cc115f3f5f. Resources: {'key_pairs'} {{(pid=116157) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 15 03:05:55.903559 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.quota [None req-a2850aec-88f1-4422-b740-51e10df0a904 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Getting quotas for user 6c4c0c82448e40ba801c0b52ec44e74a and project 5a093d0bf43046aaa845f3cc115f3f5f. Resources: {'key_pairs'} {{(pid=116157) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 15 03:05:56.043456 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.policy [None req-39c08a26-589c-4d0b-a3ca-5479f411a322 tempest-ServerRescueNegativeTestJSON-2061875223 tempest-ServerRescueNegativeTestJSON-2061875223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ea02b6e8f1548a1bd78952cb7337403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5e8a958d4bf43868502b13728b9583b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116156) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:05:56.061192 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: INFO nova.api.openstack.requestlog [None req-39c08a26-589c-4d0b-a3ca-5479f411a322 tempest-ServerRescueNegativeTestJSON-2061875223 tempest-ServerRescueNegativeTestJSON-2061875223-project] 10.222.0.18 "GET /compute/v2.1/servers/9bbb0abf-72a3-4fbc-8235-7a3ecfc8d006" status: 200 len: 1555 microversion: 2.1 time: 0.248744 Dec 15 03:05:56.061865 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: [pid: 116156|app: 0|req: 241/453] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 03:05:55 2021] GET /compute/v2.1/servers/9bbb0abf-72a3-4fbc-8235-7a3ecfc8d006 => generated 1555 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 03:05:56.182677 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi [None req-dc75cd9d-94b1-4105-83e9-5e333ada13da tempest-VolumesNegativeTest-1333024728 tempest-VolumesNegativeTest-1333024728-project] Calling method '>' {{(pid=116156) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:05:56.183341 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.compute.api [None req-dc75cd9d-94b1-4105-83e9-5e333ada13da tempest-VolumesNegativeTest-1333024728 tempest-VolumesNegativeTest-1333024728-project] [instance: 2365eae1-dcfc-4a4b-ad6b-8716ad710496] Fetching instance by UUID {{(pid=116156) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:05:56.191034 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-dc75cd9d-94b1-4105-83e9-5e333ada13da tempest-VolumesNegativeTest-1333024728 tempest-VolumesNegativeTest-1333024728-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:05:56.191757 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-dc75cd9d-94b1-4105-83e9-5e333ada13da tempest-VolumesNegativeTest-1333024728 tempest-VolumesNegativeTest-1333024728-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:05:56.192579 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-dc75cd9d-94b1-4105-83e9-5e333ada13da tempest-VolumesNegativeTest-1333024728 tempest-VolumesNegativeTest-1333024728-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:05:56.193016 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-dc75cd9d-94b1-4105-83e9-5e333ada13da tempest-VolumesNegativeTest-1333024728 tempest-VolumesNegativeTest-1333024728-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:05:56.240369 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-dc75cd9d-94b1-4105-83e9-5e333ada13da tempest-VolumesNegativeTest-1333024728 tempest-VolumesNegativeTest-1333024728-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:05:56.240807 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-dc75cd9d-94b1-4105-83e9-5e333ada13da tempest-VolumesNegativeTest-1333024728 tempest-VolumesNegativeTest-1333024728-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:05:56.241503 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.objects.instance [None req-dc75cd9d-94b1-4105-83e9-5e333ada13da tempest-VolumesNegativeTest-1333024728 tempest-VolumesNegativeTest-1333024728-project] Lazy-loading 'fault' on Instance uuid 2365eae1-dcfc-4a4b-ad6b-8716ad710496 {{(pid=116156) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Dec 15 03:05:56.309331 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.policy [None req-dc75cd9d-94b1-4105-83e9-5e333ada13da tempest-VolumesNegativeTest-1333024728 tempest-VolumesNegativeTest-1333024728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2249449813ef41928c52b2d66314b89d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b28917c863104bbe9abc5f7e87803f9e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116156) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:05:56.331973 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: INFO nova.api.openstack.requestlog [None req-dc75cd9d-94b1-4105-83e9-5e333ada13da tempest-VolumesNegativeTest-1333024728 tempest-VolumesNegativeTest-1333024728-project] 10.222.0.18 "GET /compute/v2.1/servers/2365eae1-dcfc-4a4b-ad6b-8716ad710496" status: 200 len: 1305 microversion: 2.1 time: 0.154676 Dec 15 03:05:56.336489 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: [pid: 116156|app: 0|req: 242/454] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 03:05:56 2021] GET /compute/v2.1/servers/2365eae1-dcfc-4a4b-ad6b-8716ad710496 => generated 1305 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 03:05:56.369410 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi [None req-50cb9827-db4a-4677-b158-804b1cd93a4f tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116156) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 03:05:56.371248 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.compute.api [None req-50cb9827-db4a-4677-b158-804b1cd93a4f tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] [instance: b89094ac-aee1-4bd6-a33d-8c4347cebfc7] Fetching instance by UUID {{(pid=116156) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:05:56.403816 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-50cb9827-db4a-4677-b158-804b1cd93a4f tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:05:56.404166 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-50cb9827-db4a-4677-b158-804b1cd93a4f tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:05:56.405119 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-50cb9827-db4a-4677-b158-804b1cd93a4f tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:05:56.405577 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-50cb9827-db4a-4677-b158-804b1cd93a4f tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:05:56.434401 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.quota [None req-a2850aec-88f1-4422-b740-51e10df0a904 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Getting quotas for project 5a093d0bf43046aaa845f3cc115f3f5f. Resources: {'key_pairs'} {{(pid=116157) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 15 03:05:56.439764 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.quota [None req-a2850aec-88f1-4422-b740-51e10df0a904 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Getting quotas for user 6c4c0c82448e40ba801c0b52ec44e74a and project 5a093d0bf43046aaa845f3cc115f3f5f. Resources: {'key_pairs'} {{(pid=116157) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 15 03:05:56.455215 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: INFO nova.api.openstack.requestlog [None req-a2850aec-88f1-4422-b740-51e10df0a904 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] 10.222.0.18 "POST /compute/v2.1/os-keypairs" status: 200 len: 2312 microversion: 2.1 time: 0.901569 Dec 15 03:05:56.455862 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: [pid: 116157|app: 0|req: 213/455] 10.222.0.18 () {60 vars in 1157 bytes} [Wed Dec 15 03:05:55 2021] POST /compute/v2.1/os-keypairs => generated 2312 bytes in 903 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 03:05:56.580990 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: INFO nova.api.openstack.requestlog [None req-50cb9827-db4a-4677-b158-804b1cd93a4f tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] 10.222.0.18 "POST /compute/v2.1/servers/b89094ac-aee1-4bd6-a33d-8c4347cebfc7/action" status: 200 len: 28638 microversion: 2.20 time: 0.222703 Dec 15 03:05:56.582010 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: [pid: 116156|app: 0|req: 243/456] 10.222.0.18 () {62 vars in 1318 bytes} [Wed Dec 15 03:05:56 2021] POST /compute/v2.1/servers/b89094ac-aee1-4bd6-a33d-8c4347cebfc7/action => generated 28638 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 15 03:05:56.811446 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi [None req-450ca875-a56a-47f3-9e2f-54b0b7058a81 tempest-AttachVolumeNegativeTest-1640336653 tempest-AttachVolumeNegativeTest-1640336653-project] Calling method '>' {{(pid=116157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:05:56.812247 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.compute.api [None req-450ca875-a56a-47f3-9e2f-54b0b7058a81 tempest-AttachVolumeNegativeTest-1640336653 tempest-AttachVolumeNegativeTest-1640336653-project] [instance: 46fc96ad-6439-40ca-b2b9-ffe3b3e9bb17] Fetching instance by UUID {{(pid=116157) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:05:56.834217 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-450ca875-a56a-47f3-9e2f-54b0b7058a81 tempest-AttachVolumeNegativeTest-1640336653 tempest-AttachVolumeNegativeTest-1640336653-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:05:56.834603 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-450ca875-a56a-47f3-9e2f-54b0b7058a81 tempest-AttachVolumeNegativeTest-1640336653 tempest-AttachVolumeNegativeTest-1640336653-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:05:56.835429 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-450ca875-a56a-47f3-9e2f-54b0b7058a81 tempest-AttachVolumeNegativeTest-1640336653 tempest-AttachVolumeNegativeTest-1640336653-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:05:56.835866 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-450ca875-a56a-47f3-9e2f-54b0b7058a81 tempest-AttachVolumeNegativeTest-1640336653 tempest-AttachVolumeNegativeTest-1640336653-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:05:57.079895 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi [None req-4b53079a-67a2-4488-a490-e4fd62f17da2 tempest-ServerRescueNegativeTestJSON-2061875223 tempest-ServerRescueNegativeTestJSON-2061875223-project] Calling method '>' {{(pid=116156) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:05:57.080862 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.compute.api [None req-4b53079a-67a2-4488-a490-e4fd62f17da2 tempest-ServerRescueNegativeTestJSON-2061875223 tempest-ServerRescueNegativeTestJSON-2061875223-project] [instance: 9bbb0abf-72a3-4fbc-8235-7a3ecfc8d006] Fetching instance by UUID {{(pid=116156) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:05:57.099305 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-4b53079a-67a2-4488-a490-e4fd62f17da2 tempest-ServerRescueNegativeTestJSON-2061875223 tempest-ServerRescueNegativeTestJSON-2061875223-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:05:57.100052 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-4b53079a-67a2-4488-a490-e4fd62f17da2 tempest-ServerRescueNegativeTestJSON-2061875223 tempest-ServerRescueNegativeTestJSON-2061875223-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:05:57.101681 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-4b53079a-67a2-4488-a490-e4fd62f17da2 tempest-ServerRescueNegativeTestJSON-2061875223 tempest-ServerRescueNegativeTestJSON-2061875223-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:05:57.102303 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-4b53079a-67a2-4488-a490-e4fd62f17da2 tempest-ServerRescueNegativeTestJSON-2061875223 tempest-ServerRescueNegativeTestJSON-2061875223-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:05:57.210924 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.policy [None req-450ca875-a56a-47f3-9e2f-54b0b7058a81 tempest-AttachVolumeNegativeTest-1640336653 tempest-AttachVolumeNegativeTest-1640336653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35d37a3d8e504b8186182468b77dd114', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '409b41637da94c469444954258444b4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116157) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:05:57.221303 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: INFO nova.api.openstack.requestlog [None req-450ca875-a56a-47f3-9e2f-54b0b7058a81 tempest-AttachVolumeNegativeTest-1640336653 tempest-AttachVolumeNegativeTest-1640336653-project] 10.222.0.18 "GET /compute/v2.1/servers/46fc96ad-6439-40ca-b2b9-ffe3b3e9bb17" status: 200 len: 1270 microversion: 2.1 time: 0.414352 Dec 15 03:05:57.231545 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: [pid: 116157|app: 0|req: 214/457] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 03:05:56 2021] GET /compute/v2.1/servers/46fc96ad-6439-40ca-b2b9-ffe3b3e9bb17 => generated 1270 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 03:05:57.332556 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.policy [None req-4b53079a-67a2-4488-a490-e4fd62f17da2 tempest-ServerRescueNegativeTestJSON-2061875223 tempest-ServerRescueNegativeTestJSON-2061875223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ea02b6e8f1548a1bd78952cb7337403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5e8a958d4bf43868502b13728b9583b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116156) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:05:57.341028 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: INFO nova.api.openstack.requestlog [None req-4b53079a-67a2-4488-a490-e4fd62f17da2 tempest-ServerRescueNegativeTestJSON-2061875223 tempest-ServerRescueNegativeTestJSON-2061875223-project] 10.222.0.18 "GET /compute/v2.1/servers/9bbb0abf-72a3-4fbc-8235-7a3ecfc8d006" status: 200 len: 1561 microversion: 2.1 time: 0.265513 Dec 15 03:05:57.342199 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: [pid: 116156|app: 0|req: 244/458] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 03:05:57 2021] GET /compute/v2.1/servers/9bbb0abf-72a3-4fbc-8235-7a3ecfc8d006 => generated 1561 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 03:05:57.356981 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi [None req-afa64908-a564-4941-8529-7e9e6118b6c8 tempest-VolumesNegativeTest-1333024728 tempest-VolumesNegativeTest-1333024728-project] Calling method '>' {{(pid=116157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:05:57.358640 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.compute.api [None req-afa64908-a564-4941-8529-7e9e6118b6c8 tempest-VolumesNegativeTest-1333024728 tempest-VolumesNegativeTest-1333024728-project] [instance: 2365eae1-dcfc-4a4b-ad6b-8716ad710496] Fetching instance by UUID {{(pid=116157) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:05:57.367075 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-afa64908-a564-4941-8529-7e9e6118b6c8 tempest-VolumesNegativeTest-1333024728 tempest-VolumesNegativeTest-1333024728-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:05:57.369127 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-afa64908-a564-4941-8529-7e9e6118b6c8 tempest-VolumesNegativeTest-1333024728 tempest-VolumesNegativeTest-1333024728-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:05:57.370154 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-afa64908-a564-4941-8529-7e9e6118b6c8 tempest-VolumesNegativeTest-1333024728 tempest-VolumesNegativeTest-1333024728-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:05:57.373318 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-afa64908-a564-4941-8529-7e9e6118b6c8 tempest-VolumesNegativeTest-1333024728 tempest-VolumesNegativeTest-1333024728-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:05:57.398951 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: INFO nova.api.openstack.wsgi [None req-afa64908-a564-4941-8529-7e9e6118b6c8 tempest-VolumesNegativeTest-1333024728 tempest-VolumesNegativeTest-1333024728-project] HTTP exception thrown: Instance 2365eae1-dcfc-4a4b-ad6b-8716ad710496 could not be found. Dec 15 03:05:57.399562 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi [None req-afa64908-a564-4941-8529-7e9e6118b6c8 tempest-VolumesNegativeTest-1333024728 tempest-VolumesNegativeTest-1333024728-project] Returning 404 to user: Instance 2365eae1-dcfc-4a4b-ad6b-8716ad710496 could not be found. {{(pid=116157) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 15 03:05:57.409513 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: INFO nova.api.openstack.requestlog [None req-afa64908-a564-4941-8529-7e9e6118b6c8 tempest-VolumesNegativeTest-1333024728 tempest-VolumesNegativeTest-1333024728-project] 10.222.0.18 "GET /compute/v2.1/servers/2365eae1-dcfc-4a4b-ad6b-8716ad710496" status: 404 len: 111 microversion: 2.1 time: 0.060604 Dec 15 03:05:57.422802 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: [pid: 116157|app: 0|req: 215/459] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 03:05:57 2021] GET /compute/v2.1/servers/2365eae1-dcfc-4a4b-ad6b-8716ad710496 => generated 111 bytes in 70 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 15 03:05:57.433050 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi [None req-9661d89e-ccac-4a2b-aee9-f1aa88ed3013 tempest-ServerRescueNegativeTestJSON-2061875223 tempest-ServerRescueNegativeTestJSON-2061875223-project] Calling method '>' {{(pid=116156) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:05:57.433550 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.compute.api [None req-9661d89e-ccac-4a2b-aee9-f1aa88ed3013 tempest-ServerRescueNegativeTestJSON-2061875223 tempest-ServerRescueNegativeTestJSON-2061875223-project] [instance: 9bbb0abf-72a3-4fbc-8235-7a3ecfc8d006] Fetching instance by UUID {{(pid=116156) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:05:57.452356 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-9661d89e-ccac-4a2b-aee9-f1aa88ed3013 tempest-ServerRescueNegativeTestJSON-2061875223 tempest-ServerRescueNegativeTestJSON-2061875223-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:05:57.452566 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-9661d89e-ccac-4a2b-aee9-f1aa88ed3013 tempest-ServerRescueNegativeTestJSON-2061875223 tempest-ServerRescueNegativeTestJSON-2061875223-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:05:57.453319 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-9661d89e-ccac-4a2b-aee9-f1aa88ed3013 tempest-ServerRescueNegativeTestJSON-2061875223 tempest-ServerRescueNegativeTestJSON-2061875223-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:05:57.454812 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-9661d89e-ccac-4a2b-aee9-f1aa88ed3013 tempest-ServerRescueNegativeTestJSON-2061875223 tempest-ServerRescueNegativeTestJSON-2061875223-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:05:57.593751 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi [None req-c3308a26-2372-4a58-bebc-0f4607c1861f tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 03:05:57.595498 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.compute.api [None req-c3308a26-2372-4a58-bebc-0f4607c1861f tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] [instance: b89094ac-aee1-4bd6-a33d-8c4347cebfc7] Fetching instance by UUID {{(pid=116157) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:05:57.605790 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-c3308a26-2372-4a58-bebc-0f4607c1861f tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:05:57.610053 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-c3308a26-2372-4a58-bebc-0f4607c1861f tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:05:57.611285 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-c3308a26-2372-4a58-bebc-0f4607c1861f tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:05:57.612788 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-c3308a26-2372-4a58-bebc-0f4607c1861f tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:05:57.761630 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.objects.instance [None req-9661d89e-ccac-4a2b-aee9-f1aa88ed3013 tempest-ServerRescueNegativeTestJSON-2061875223 tempest-ServerRescueNegativeTestJSON-2061875223-project] Lazy-loading 'services' on Instance uuid 9bbb0abf-72a3-4fbc-8235-7a3ecfc8d006 {{(pid=116156) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Dec 15 03:05:57.793850 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: INFO nova.api.openstack.requestlog [None req-c3308a26-2372-4a58-bebc-0f4607c1861f tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] 10.222.0.18 "POST /compute/v2.1/servers/b89094ac-aee1-4bd6-a33d-8c4347cebfc7/action" status: 200 len: 28638 microversion: 2.20 time: 0.204155 Dec 15 03:05:57.794902 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: [pid: 116157|app: 0|req: 216/460] 10.222.0.18 () {62 vars in 1318 bytes} [Wed Dec 15 03:05:57 2021] POST /compute/v2.1/servers/b89094ac-aee1-4bd6-a33d-8c4347cebfc7/action => generated 28638 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Dec 15 03:05:58.077064 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: INFO nova.api.openstack.requestlog [None req-9661d89e-ccac-4a2b-aee9-f1aa88ed3013 tempest-ServerRescueNegativeTestJSON-2061875223 tempest-ServerRescueNegativeTestJSON-2061875223-project] 10.222.0.18 "DELETE /compute/v2.1/servers/9bbb0abf-72a3-4fbc-8235-7a3ecfc8d006/os-volume_attachments/7302346f-6ff9-4a17-b652-4ae95283118d" status: 202 len: 0 microversion: 2.1 time: 0.647580 Dec 15 03:05:58.079963 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: [pid: 116156|app: 0|req: 245/461] 10.222.0.18 () {58 vars in 1415 bytes} [Wed Dec 15 03:05:57 2021] DELETE /compute/v2.1/servers/9bbb0abf-72a3-4fbc-8235-7a3ecfc8d006/os-volume_attachments/7302346f-6ff9-4a17-b652-4ae95283118d => generated 0 bytes in 651 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Dec 15 03:05:58.094401 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi [None req-c5b4f989-77be-4d85-9fdc-ff18e5f7c582 tempest-ServerRescueNegativeTestJSON-2061875223 tempest-ServerRescueNegativeTestJSON-2061875223-project] Calling method '>' {{(pid=116157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:05:58.097405 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.compute.api [None req-c5b4f989-77be-4d85-9fdc-ff18e5f7c582 tempest-ServerRescueNegativeTestJSON-2061875223 tempest-ServerRescueNegativeTestJSON-2061875223-project] [instance: 9bbb0abf-72a3-4fbc-8235-7a3ecfc8d006] Fetching instance by UUID {{(pid=116157) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:05:58.121191 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-c5b4f989-77be-4d85-9fdc-ff18e5f7c582 tempest-ServerRescueNegativeTestJSON-2061875223 tempest-ServerRescueNegativeTestJSON-2061875223-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:05:58.121897 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-c5b4f989-77be-4d85-9fdc-ff18e5f7c582 tempest-ServerRescueNegativeTestJSON-2061875223 tempest-ServerRescueNegativeTestJSON-2061875223-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:05:58.123668 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-c5b4f989-77be-4d85-9fdc-ff18e5f7c582 tempest-ServerRescueNegativeTestJSON-2061875223 tempest-ServerRescueNegativeTestJSON-2061875223-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:05:58.124472 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-c5b4f989-77be-4d85-9fdc-ff18e5f7c582 tempest-ServerRescueNegativeTestJSON-2061875223 tempest-ServerRescueNegativeTestJSON-2061875223-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:05:58.241895 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi [None req-fd44708c-98ac-4285-926d-81a7800f65db tempest-AttachVolumeNegativeTest-1640336653 tempest-AttachVolumeNegativeTest-1640336653-project] Calling method '>' {{(pid=116156) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:05:58.242638 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.compute.api [None req-fd44708c-98ac-4285-926d-81a7800f65db tempest-AttachVolumeNegativeTest-1640336653 tempest-AttachVolumeNegativeTest-1640336653-project] [instance: 46fc96ad-6439-40ca-b2b9-ffe3b3e9bb17] Fetching instance by UUID {{(pid=116156) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:05:58.250586 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: INFO nova.api.openstack.requestlog [None req-c5b4f989-77be-4d85-9fdc-ff18e5f7c582 tempest-ServerRescueNegativeTestJSON-2061875223 tempest-ServerRescueNegativeTestJSON-2061875223-project] 10.222.0.18 "GET /compute/v2.1/servers/9bbb0abf-72a3-4fbc-8235-7a3ecfc8d006/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.167989 Dec 15 03:05:58.254106 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: [pid: 116157|app: 0|req: 217/462] 10.222.0.18 () {58 vars in 1301 bytes} [Wed Dec 15 03:05:58 2021] GET /compute/v2.1/servers/9bbb0abf-72a3-4fbc-8235-7a3ecfc8d006/os-volume_attachments => generated 197 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 15 03:05:58.274535 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-fd44708c-98ac-4285-926d-81a7800f65db tempest-AttachVolumeNegativeTest-1640336653 tempest-AttachVolumeNegativeTest-1640336653-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:05:58.274989 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-fd44708c-98ac-4285-926d-81a7800f65db tempest-AttachVolumeNegativeTest-1640336653 tempest-AttachVolumeNegativeTest-1640336653-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:05:58.288020 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-fd44708c-98ac-4285-926d-81a7800f65db tempest-AttachVolumeNegativeTest-1640336653 tempest-AttachVolumeNegativeTest-1640336653-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:05:58.288384 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-fd44708c-98ac-4285-926d-81a7800f65db tempest-AttachVolumeNegativeTest-1640336653 tempest-AttachVolumeNegativeTest-1640336653-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:05:58.621138 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.policy [None req-fd44708c-98ac-4285-926d-81a7800f65db tempest-AttachVolumeNegativeTest-1640336653 tempest-AttachVolumeNegativeTest-1640336653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35d37a3d8e504b8186182468b77dd114', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '409b41637da94c469444954258444b4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116156) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:05:58.630098 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: INFO nova.api.openstack.requestlog [None req-fd44708c-98ac-4285-926d-81a7800f65db tempest-AttachVolumeNegativeTest-1640336653 tempest-AttachVolumeNegativeTest-1640336653-project] 10.222.0.18 "GET /compute/v2.1/servers/46fc96ad-6439-40ca-b2b9-ffe3b3e9bb17" status: 200 len: 1276 microversion: 2.1 time: 0.393765 Dec 15 03:05:58.636680 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: [pid: 116156|app: 0|req: 246/463] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 03:05:58 2021] GET /compute/v2.1/servers/46fc96ad-6439-40ca-b2b9-ffe3b3e9bb17 => generated 1276 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 03:05:58.806730 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi [None req-94ca8676-bbd5-4ff3-9dbd-5704a350172a tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 03:05:58.807918 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.compute.api [None req-94ca8676-bbd5-4ff3-9dbd-5704a350172a tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] [instance: b89094ac-aee1-4bd6-a33d-8c4347cebfc7] Fetching instance by UUID {{(pid=116157) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:05:58.821487 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-94ca8676-bbd5-4ff3-9dbd-5704a350172a tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:05:58.822236 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-94ca8676-bbd5-4ff3-9dbd-5704a350172a tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:05:58.823309 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-94ca8676-bbd5-4ff3-9dbd-5704a350172a tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:05:58.823936 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-94ca8676-bbd5-4ff3-9dbd-5704a350172a tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:05:59.030086 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: INFO nova.api.openstack.requestlog [None req-94ca8676-bbd5-4ff3-9dbd-5704a350172a tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] 10.222.0.18 "POST /compute/v2.1/servers/b89094ac-aee1-4bd6-a33d-8c4347cebfc7/action" status: 200 len: 28638 microversion: 2.20 time: 0.226215 Dec 15 03:05:59.031557 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: [pid: 116157|app: 0|req: 218/464] 10.222.0.18 () {62 vars in 1318 bytes} [Wed Dec 15 03:05:58 2021] POST /compute/v2.1/servers/b89094ac-aee1-4bd6-a33d-8c4347cebfc7/action => generated 28638 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 15 03:05:59.267051 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi [None req-bcb7f00e-33c4-40e2-90ed-a738a3bd2558 tempest-ServerRescueNegativeTestJSON-2061875223 tempest-ServerRescueNegativeTestJSON-2061875223-project] Calling method '>' {{(pid=116156) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:05:59.269352 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.compute.api [None req-bcb7f00e-33c4-40e2-90ed-a738a3bd2558 tempest-ServerRescueNegativeTestJSON-2061875223 tempest-ServerRescueNegativeTestJSON-2061875223-project] [instance: 9bbb0abf-72a3-4fbc-8235-7a3ecfc8d006] Fetching instance by UUID {{(pid=116156) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:05:59.302524 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-bcb7f00e-33c4-40e2-90ed-a738a3bd2558 tempest-ServerRescueNegativeTestJSON-2061875223 tempest-ServerRescueNegativeTestJSON-2061875223-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:05:59.305666 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-bcb7f00e-33c4-40e2-90ed-a738a3bd2558 tempest-ServerRescueNegativeTestJSON-2061875223 tempest-ServerRescueNegativeTestJSON-2061875223-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:05:59.306578 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-bcb7f00e-33c4-40e2-90ed-a738a3bd2558 tempest-ServerRescueNegativeTestJSON-2061875223 tempest-ServerRescueNegativeTestJSON-2061875223-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:05:59.307029 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-bcb7f00e-33c4-40e2-90ed-a738a3bd2558 tempest-ServerRescueNegativeTestJSON-2061875223 tempest-ServerRescueNegativeTestJSON-2061875223-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:05:59.380560 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: INFO nova.api.openstack.requestlog [None req-bcb7f00e-33c4-40e2-90ed-a738a3bd2558 tempest-ServerRescueNegativeTestJSON-2061875223 tempest-ServerRescueNegativeTestJSON-2061875223-project] 10.222.0.18 "GET /compute/v2.1/servers/9bbb0abf-72a3-4fbc-8235-7a3ecfc8d006/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.122105 Dec 15 03:05:59.381160 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: [pid: 116156|app: 0|req: 247/465] 10.222.0.18 () {58 vars in 1301 bytes} [Wed Dec 15 03:05:59 2021] GET /compute/v2.1/servers/9bbb0abf-72a3-4fbc-8235-7a3ecfc8d006/os-volume_attachments => generated 197 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 03:05:59.656061 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi [None req-b9b14290-3f5a-4601-acc5-f80ec7b0bc7a tempest-AttachVolumeNegativeTest-1640336653 tempest-AttachVolumeNegativeTest-1640336653-project] Calling method '>' {{(pid=116157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:05:59.659288 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.compute.api [None req-b9b14290-3f5a-4601-acc5-f80ec7b0bc7a tempest-AttachVolumeNegativeTest-1640336653 tempest-AttachVolumeNegativeTest-1640336653-project] [instance: 46fc96ad-6439-40ca-b2b9-ffe3b3e9bb17] Fetching instance by UUID {{(pid=116157) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:05:59.698612 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-b9b14290-3f5a-4601-acc5-f80ec7b0bc7a tempest-AttachVolumeNegativeTest-1640336653 tempest-AttachVolumeNegativeTest-1640336653-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:05:59.699125 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-b9b14290-3f5a-4601-acc5-f80ec7b0bc7a tempest-AttachVolumeNegativeTest-1640336653 tempest-AttachVolumeNegativeTest-1640336653-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:05:59.701089 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-b9b14290-3f5a-4601-acc5-f80ec7b0bc7a tempest-AttachVolumeNegativeTest-1640336653 tempest-AttachVolumeNegativeTest-1640336653-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:05:59.701550 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-b9b14290-3f5a-4601-acc5-f80ec7b0bc7a tempest-AttachVolumeNegativeTest-1640336653 tempest-AttachVolumeNegativeTest-1640336653-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:06:00.047394 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi [None req-ad136d53-ed8c-4dde-92a7-dc9d0ca8d3b2 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116156) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 03:06:00.048653 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.compute.api [None req-ad136d53-ed8c-4dde-92a7-dc9d0ca8d3b2 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] [instance: b89094ac-aee1-4bd6-a33d-8c4347cebfc7] Fetching instance by UUID {{(pid=116156) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:06:00.059199 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-ad136d53-ed8c-4dde-92a7-dc9d0ca8d3b2 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:06:00.059814 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-ad136d53-ed8c-4dde-92a7-dc9d0ca8d3b2 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:06:00.060774 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-ad136d53-ed8c-4dde-92a7-dc9d0ca8d3b2 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:06:00.062559 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-ad136d53-ed8c-4dde-92a7-dc9d0ca8d3b2 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:06:00.120671 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.policy [None req-b9b14290-3f5a-4601-acc5-f80ec7b0bc7a tempest-AttachVolumeNegativeTest-1640336653 tempest-AttachVolumeNegativeTest-1640336653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35d37a3d8e504b8186182468b77dd114', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '409b41637da94c469444954258444b4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116157) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:06:00.131027 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: INFO nova.api.openstack.requestlog [None req-b9b14290-3f5a-4601-acc5-f80ec7b0bc7a tempest-AttachVolumeNegativeTest-1640336653 tempest-AttachVolumeNegativeTest-1640336653-project] 10.222.0.18 "GET /compute/v2.1/servers/46fc96ad-6439-40ca-b2b9-ffe3b3e9bb17" status: 200 len: 1318 microversion: 2.1 time: 0.480045 Dec 15 03:06:00.136353 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: [pid: 116157|app: 0|req: 219/466] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 03:05:59 2021] GET /compute/v2.1/servers/46fc96ad-6439-40ca-b2b9-ffe3b3e9bb17 => generated 1318 bytes in 487 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 03:06:00.295999 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: INFO nova.api.openstack.requestlog [None req-ad136d53-ed8c-4dde-92a7-dc9d0ca8d3b2 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] 10.222.0.18 "POST /compute/v2.1/servers/b89094ac-aee1-4bd6-a33d-8c4347cebfc7/action" status: 200 len: 29307 microversion: 2.20 time: 0.257642 Dec 15 03:06:00.300608 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: [pid: 116156|app: 0|req: 248/467] 10.222.0.18 () {62 vars in 1318 bytes} [Wed Dec 15 03:06:00 2021] POST /compute/v2.1/servers/b89094ac-aee1-4bd6-a33d-8c4347cebfc7/action => generated 29307 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Dec 15 03:06:00.394333 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi [None req-41f08b50-061c-414b-bc2f-b3984d583c94 tempest-ServerRescueNegativeTestJSON-2061875223 tempest-ServerRescueNegativeTestJSON-2061875223-project] Calling method '>' {{(pid=116157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:06:00.396131 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.compute.api [None req-41f08b50-061c-414b-bc2f-b3984d583c94 tempest-ServerRescueNegativeTestJSON-2061875223 tempest-ServerRescueNegativeTestJSON-2061875223-project] [instance: 9bbb0abf-72a3-4fbc-8235-7a3ecfc8d006] Fetching instance by UUID {{(pid=116157) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:06:00.409312 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-41f08b50-061c-414b-bc2f-b3984d583c94 tempest-ServerRescueNegativeTestJSON-2061875223 tempest-ServerRescueNegativeTestJSON-2061875223-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:06:00.416785 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-41f08b50-061c-414b-bc2f-b3984d583c94 tempest-ServerRescueNegativeTestJSON-2061875223 tempest-ServerRescueNegativeTestJSON-2061875223-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:06:00.420939 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-41f08b50-061c-414b-bc2f-b3984d583c94 tempest-ServerRescueNegativeTestJSON-2061875223 tempest-ServerRescueNegativeTestJSON-2061875223-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:06:00.424130 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-41f08b50-061c-414b-bc2f-b3984d583c94 tempest-ServerRescueNegativeTestJSON-2061875223 tempest-ServerRescueNegativeTestJSON-2061875223-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:06:00.492401 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: INFO nova.api.openstack.requestlog [None req-41f08b50-061c-414b-bc2f-b3984d583c94 tempest-ServerRescueNegativeTestJSON-2061875223 tempest-ServerRescueNegativeTestJSON-2061875223-project] 10.222.0.18 "GET /compute/v2.1/servers/9bbb0abf-72a3-4fbc-8235-7a3ecfc8d006/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.104050 Dec 15 03:06:00.494204 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: [pid: 116157|app: 0|req: 220/468] 10.222.0.18 () {58 vars in 1301 bytes} [Wed Dec 15 03:06:00 2021] GET /compute/v2.1/servers/9bbb0abf-72a3-4fbc-8235-7a3ecfc8d006/os-volume_attachments => generated 25 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Dec 15 03:06:00.793365 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi [req-91ab4645-9a9c-4b76-9d7e-4ff093ca5def req-ccf639fd-0e40-489f-9e45-1bc5fcc4889d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "46fc96ad-6439-40ca-b2b9-ffe3b3e9bb17", "tag": "9010a98c-e7c8-42bc-8a01-5924495b7f7d"}]} {{(pid=116156) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 03:06:00.794943 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 15 03:06:00.794943 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: warnings.warn(msg) Dec 15 03:06:00.881588 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [req-91ab4645-9a9c-4b76-9d7e-4ff093ca5def req-ccf639fd-0e40-489f-9e45-1bc5fcc4889d service nova] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:06:00.882744 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [req-91ab4645-9a9c-4b76-9d7e-4ff093ca5def req-ccf639fd-0e40-489f-9e45-1bc5fcc4889d service nova] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:06:00.908242 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: INFO nova.api.openstack.compute.server_external_events [req-91ab4645-9a9c-4b76-9d7e-4ff093ca5def req-ccf639fd-0e40-489f-9e45-1bc5fcc4889d service nova] Creating event network-changed:9010a98c-e7c8-42bc-8a01-5924495b7f7d for instance 46fc96ad-6439-40ca-b2b9-ffe3b3e9bb17 on hv-cinder-81803 Dec 15 03:06:00.941056 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: INFO nova.api.openstack.requestlog [req-91ab4645-9a9c-4b76-9d7e-4ff093ca5def req-ccf639fd-0e40-489f-9e45-1bc5fcc4889d service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.151692 Dec 15 03:06:00.957686 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: [pid: 116156|app: 0|req: 249/469] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Dec 15 03:06:00 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 15 03:06:01.152406 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi [None req-82c36b7c-cbef-48c3-87ef-463942690fcb tempest-AttachVolumeNegativeTest-1640336653 tempest-AttachVolumeNegativeTest-1640336653-project] Calling method '>' {{(pid=116157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:06:01.153004 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.compute.api [None req-82c36b7c-cbef-48c3-87ef-463942690fcb tempest-AttachVolumeNegativeTest-1640336653 tempest-AttachVolumeNegativeTest-1640336653-project] [instance: 46fc96ad-6439-40ca-b2b9-ffe3b3e9bb17] Fetching instance by UUID {{(pid=116157) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:06:01.162667 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-82c36b7c-cbef-48c3-87ef-463942690fcb tempest-AttachVolumeNegativeTest-1640336653 tempest-AttachVolumeNegativeTest-1640336653-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:06:01.163090 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-82c36b7c-cbef-48c3-87ef-463942690fcb tempest-AttachVolumeNegativeTest-1640336653 tempest-AttachVolumeNegativeTest-1640336653-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:06:01.168751 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-82c36b7c-cbef-48c3-87ef-463942690fcb tempest-AttachVolumeNegativeTest-1640336653 tempest-AttachVolumeNegativeTest-1640336653-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:06:01.169212 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-82c36b7c-cbef-48c3-87ef-463942690fcb tempest-AttachVolumeNegativeTest-1640336653 tempest-AttachVolumeNegativeTest-1640336653-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:06:01.314371 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi [None req-6c278f06-5395-4269-9649-bebadee81ad3 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116156) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 03:06:01.317172 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.compute.api [None req-6c278f06-5395-4269-9649-bebadee81ad3 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] [instance: b89094ac-aee1-4bd6-a33d-8c4347cebfc7] Fetching instance by UUID {{(pid=116156) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:06:01.326396 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-6c278f06-5395-4269-9649-bebadee81ad3 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:06:01.327189 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-6c278f06-5395-4269-9649-bebadee81ad3 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:06:01.329445 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-6c278f06-5395-4269-9649-bebadee81ad3 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:06:01.330184 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-6c278f06-5395-4269-9649-bebadee81ad3 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:06:01.459467 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: INFO nova.api.openstack.requestlog [None req-6c278f06-5395-4269-9649-bebadee81ad3 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] 10.222.0.18 "POST /compute/v2.1/servers/b89094ac-aee1-4bd6-a33d-8c4347cebfc7/action" status: 200 len: 30617 microversion: 2.20 time: 0.154061 Dec 15 03:06:01.460233 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: [pid: 116156|app: 0|req: 250/470] 10.222.0.18 () {62 vars in 1318 bytes} [Wed Dec 15 03:06:01 2021] POST /compute/v2.1/servers/b89094ac-aee1-4bd6-a33d-8c4347cebfc7/action => generated 30617 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Dec 15 03:06:01.479798 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.policy [None req-82c36b7c-cbef-48c3-87ef-463942690fcb tempest-AttachVolumeNegativeTest-1640336653 tempest-AttachVolumeNegativeTest-1640336653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35d37a3d8e504b8186182468b77dd114', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '409b41637da94c469444954258444b4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116157) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:06:01.489392 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: INFO nova.api.openstack.requestlog [None req-82c36b7c-cbef-48c3-87ef-463942690fcb tempest-AttachVolumeNegativeTest-1640336653 tempest-AttachVolumeNegativeTest-1640336653-project] 10.222.0.18 "GET /compute/v2.1/servers/46fc96ad-6439-40ca-b2b9-ffe3b3e9bb17" status: 200 len: 1318 microversion: 2.1 time: 0.340608 Dec 15 03:06:01.489966 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: [pid: 116157|app: 0|req: 221/471] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 03:06:01 2021] GET /compute/v2.1/servers/46fc96ad-6439-40ca-b2b9-ffe3b3e9bb17 => generated 1318 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 03:06:02.473121 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi [None req-4f31682b-2549-4525-b8ef-577ca1f6bab4 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116156) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 03:06:02.475898 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.compute.api [None req-4f31682b-2549-4525-b8ef-577ca1f6bab4 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] [instance: b89094ac-aee1-4bd6-a33d-8c4347cebfc7] Fetching instance by UUID {{(pid=116156) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:06:02.482459 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-4f31682b-2549-4525-b8ef-577ca1f6bab4 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:06:02.483006 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-4f31682b-2549-4525-b8ef-577ca1f6bab4 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:06:02.484044 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-4f31682b-2549-4525-b8ef-577ca1f6bab4 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:06:02.485160 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-4f31682b-2549-4525-b8ef-577ca1f6bab4 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:06:02.506272 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi [None req-65cebd7d-985f-4d95-b500-eabf86c3b663 tempest-AttachVolumeNegativeTest-1640336653 tempest-AttachVolumeNegativeTest-1640336653-project] Calling method '>' {{(pid=116157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:06:02.508648 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.compute.api [None req-65cebd7d-985f-4d95-b500-eabf86c3b663 tempest-AttachVolumeNegativeTest-1640336653 tempest-AttachVolumeNegativeTest-1640336653-project] [instance: 46fc96ad-6439-40ca-b2b9-ffe3b3e9bb17] Fetching instance by UUID {{(pid=116157) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:06:02.521213 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-65cebd7d-985f-4d95-b500-eabf86c3b663 tempest-AttachVolumeNegativeTest-1640336653 tempest-AttachVolumeNegativeTest-1640336653-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:06:02.521848 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-65cebd7d-985f-4d95-b500-eabf86c3b663 tempest-AttachVolumeNegativeTest-1640336653 tempest-AttachVolumeNegativeTest-1640336653-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:06:02.522683 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-65cebd7d-985f-4d95-b500-eabf86c3b663 tempest-AttachVolumeNegativeTest-1640336653 tempest-AttachVolumeNegativeTest-1640336653-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:06:02.523121 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-65cebd7d-985f-4d95-b500-eabf86c3b663 tempest-AttachVolumeNegativeTest-1640336653 tempest-AttachVolumeNegativeTest-1640336653-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:06:02.617477 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: INFO nova.api.openstack.requestlog [None req-4f31682b-2549-4525-b8ef-577ca1f6bab4 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] 10.222.0.18 "POST /compute/v2.1/servers/b89094ac-aee1-4bd6-a33d-8c4347cebfc7/action" status: 200 len: 31536 microversion: 2.20 time: 0.149134 Dec 15 03:06:02.618459 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: [pid: 116156|app: 0|req: 251/472] 10.222.0.18 () {62 vars in 1318 bytes} [Wed Dec 15 03:06:02 2021] POST /compute/v2.1/servers/b89094ac-aee1-4bd6-a33d-8c4347cebfc7/action => generated 31536 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 15 03:06:02.679357 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.policy [None req-65cebd7d-985f-4d95-b500-eabf86c3b663 tempest-AttachVolumeNegativeTest-1640336653 tempest-AttachVolumeNegativeTest-1640336653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35d37a3d8e504b8186182468b77dd114', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '409b41637da94c469444954258444b4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116157) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:06:02.686494 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: INFO nova.api.openstack.requestlog [None req-65cebd7d-985f-4d95-b500-eabf86c3b663 tempest-AttachVolumeNegativeTest-1640336653 tempest-AttachVolumeNegativeTest-1640336653-project] 10.222.0.18 "GET /compute/v2.1/servers/46fc96ad-6439-40ca-b2b9-ffe3b3e9bb17" status: 200 len: 1318 microversion: 2.1 time: 0.184075 Dec 15 03:06:02.687054 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: [pid: 116157|app: 0|req: 222/473] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 03:06:02 2021] GET /compute/v2.1/servers/46fc96ad-6439-40ca-b2b9-ffe3b3e9bb17 => generated 1318 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 03:06:03.106241 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi [None req-b9c4e251-c29d-47b5-b6d7-38aa4712eccc tempest-ServerRescueNegativeTestJSON-2061875223 tempest-ServerRescueNegativeTestJSON-2061875223-project] Calling method '>' {{(pid=116156) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:06:03.106832 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.compute.api [None req-b9c4e251-c29d-47b5-b6d7-38aa4712eccc tempest-ServerRescueNegativeTestJSON-2061875223 tempest-ServerRescueNegativeTestJSON-2061875223-project] [instance: 2d20c8be-04a9-4c79-aa0a-138a79fe50cd] Fetching instance by UUID {{(pid=116156) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:06:03.114651 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-b9c4e251-c29d-47b5-b6d7-38aa4712eccc tempest-ServerRescueNegativeTestJSON-2061875223 tempest-ServerRescueNegativeTestJSON-2061875223-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:06:03.115135 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-b9c4e251-c29d-47b5-b6d7-38aa4712eccc tempest-ServerRescueNegativeTestJSON-2061875223 tempest-ServerRescueNegativeTestJSON-2061875223-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:06:03.115916 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-b9c4e251-c29d-47b5-b6d7-38aa4712eccc tempest-ServerRescueNegativeTestJSON-2061875223 tempest-ServerRescueNegativeTestJSON-2061875223-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:06:03.116380 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-b9c4e251-c29d-47b5-b6d7-38aa4712eccc tempest-ServerRescueNegativeTestJSON-2061875223 tempest-ServerRescueNegativeTestJSON-2061875223-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:06:03.141201 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.compute.api [None req-b9c4e251-c29d-47b5-b6d7-38aa4712eccc tempest-ServerRescueNegativeTestJSON-2061875223 tempest-ServerRescueNegativeTestJSON-2061875223-project] [instance: 2d20c8be-04a9-4c79-aa0a-138a79fe50cd] Going to try to terminate instance {{(pid=116156) delete /opt/stack/nova/nova/compute/api.py:2614}} Dec 15 03:06:03.229893 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: INFO nova.api.openstack.requestlog [None req-b9c4e251-c29d-47b5-b6d7-38aa4712eccc tempest-ServerRescueNegativeTestJSON-2061875223 tempest-ServerRescueNegativeTestJSON-2061875223-project] 10.222.0.18 "DELETE /compute/v2.1/servers/2d20c8be-04a9-4c79-aa0a-138a79fe50cd" status: 204 len: 0 microversion: 2.1 time: 0.127305 Dec 15 03:06:03.230664 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: [pid: 116156|app: 0|req: 252/474] 10.222.0.18 () {58 vars in 1238 bytes} [Wed Dec 15 03:06:03 2021] DELETE /compute/v2.1/servers/2d20c8be-04a9-4c79-aa0a-138a79fe50cd => generated 0 bytes in 129 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Dec 15 03:06:03.239083 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi [None req-dae13e23-5de5-4806-b979-6764bb76aea8 tempest-ServerRescueNegativeTestJSON-2061875223 tempest-ServerRescueNegativeTestJSON-2061875223-project] Calling method '>' {{(pid=116157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:06:03.239723 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.compute.api [None req-dae13e23-5de5-4806-b979-6764bb76aea8 tempest-ServerRescueNegativeTestJSON-2061875223 tempest-ServerRescueNegativeTestJSON-2061875223-project] [instance: 2d20c8be-04a9-4c79-aa0a-138a79fe50cd] Fetching instance by UUID {{(pid=116157) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:06:03.246502 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-dae13e23-5de5-4806-b979-6764bb76aea8 tempest-ServerRescueNegativeTestJSON-2061875223 tempest-ServerRescueNegativeTestJSON-2061875223-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:06:03.247252 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-dae13e23-5de5-4806-b979-6764bb76aea8 tempest-ServerRescueNegativeTestJSON-2061875223 tempest-ServerRescueNegativeTestJSON-2061875223-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:06:03.248373 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-dae13e23-5de5-4806-b979-6764bb76aea8 tempest-ServerRescueNegativeTestJSON-2061875223 tempest-ServerRescueNegativeTestJSON-2061875223-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:06:03.248980 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-dae13e23-5de5-4806-b979-6764bb76aea8 tempest-ServerRescueNegativeTestJSON-2061875223 tempest-ServerRescueNegativeTestJSON-2061875223-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:06:03.400903 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.policy [None req-dae13e23-5de5-4806-b979-6764bb76aea8 tempest-ServerRescueNegativeTestJSON-2061875223 tempest-ServerRescueNegativeTestJSON-2061875223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ea02b6e8f1548a1bd78952cb7337403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5e8a958d4bf43868502b13728b9583b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116157) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:06:03.413266 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: INFO nova.api.openstack.requestlog [None req-dae13e23-5de5-4806-b979-6764bb76aea8 tempest-ServerRescueNegativeTestJSON-2061875223 tempest-ServerRescueNegativeTestJSON-2061875223-project] 10.222.0.18 "GET /compute/v2.1/servers/2d20c8be-04a9-4c79-aa0a-138a79fe50cd" status: 200 len: 1508 microversion: 2.1 time: 0.177504 Dec 15 03:06:03.426618 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: [pid: 116157|app: 0|req: 223/475] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 03:06:03 2021] GET /compute/v2.1/servers/2d20c8be-04a9-4c79-aa0a-138a79fe50cd => generated 1508 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 03:06:03.629999 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi [None req-31c9f0ad-75a4-4f7a-9335-a1b894469232 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116156) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 03:06:03.630874 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.compute.api [None req-31c9f0ad-75a4-4f7a-9335-a1b894469232 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] [instance: b89094ac-aee1-4bd6-a33d-8c4347cebfc7] Fetching instance by UUID {{(pid=116156) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:06:03.637356 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-31c9f0ad-75a4-4f7a-9335-a1b894469232 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:06:03.637805 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-31c9f0ad-75a4-4f7a-9335-a1b894469232 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:06:03.639143 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-31c9f0ad-75a4-4f7a-9335-a1b894469232 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:06:03.639586 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-31c9f0ad-75a4-4f7a-9335-a1b894469232 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:06:03.703798 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi [None req-eb0060ec-18ef-4f80-85ab-53bb04c1ad7b tempest-AttachVolumeNegativeTest-1640336653 tempest-AttachVolumeNegativeTest-1640336653-project] Calling method '>' {{(pid=116157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:06:03.704397 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.compute.api [None req-eb0060ec-18ef-4f80-85ab-53bb04c1ad7b tempest-AttachVolumeNegativeTest-1640336653 tempest-AttachVolumeNegativeTest-1640336653-project] [instance: 46fc96ad-6439-40ca-b2b9-ffe3b3e9bb17] Fetching instance by UUID {{(pid=116157) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:06:03.710806 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-eb0060ec-18ef-4f80-85ab-53bb04c1ad7b tempest-AttachVolumeNegativeTest-1640336653 tempest-AttachVolumeNegativeTest-1640336653-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:06:03.711287 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-eb0060ec-18ef-4f80-85ab-53bb04c1ad7b tempest-AttachVolumeNegativeTest-1640336653 tempest-AttachVolumeNegativeTest-1640336653-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:06:03.712064 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-eb0060ec-18ef-4f80-85ab-53bb04c1ad7b tempest-AttachVolumeNegativeTest-1640336653 tempest-AttachVolumeNegativeTest-1640336653-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:06:03.712500 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-eb0060ec-18ef-4f80-85ab-53bb04c1ad7b tempest-AttachVolumeNegativeTest-1640336653 tempest-AttachVolumeNegativeTest-1640336653-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:06:03.764622 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: INFO nova.api.openstack.requestlog [None req-31c9f0ad-75a4-4f7a-9335-a1b894469232 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] 10.222.0.18 "POST /compute/v2.1/servers/b89094ac-aee1-4bd6-a33d-8c4347cebfc7/action" status: 200 len: 32194 microversion: 2.20 time: 0.139366 Dec 15 03:06:03.769148 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: [pid: 116156|app: 0|req: 253/476] 10.222.0.18 () {62 vars in 1318 bytes} [Wed Dec 15 03:06:03 2021] POST /compute/v2.1/servers/b89094ac-aee1-4bd6-a33d-8c4347cebfc7/action => generated 32194 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 15 03:06:03.855913 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.policy [None req-eb0060ec-18ef-4f80-85ab-53bb04c1ad7b tempest-AttachVolumeNegativeTest-1640336653 tempest-AttachVolumeNegativeTest-1640336653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35d37a3d8e504b8186182468b77dd114', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '409b41637da94c469444954258444b4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116157) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:06:03.863489 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: INFO nova.api.openstack.requestlog [None req-eb0060ec-18ef-4f80-85ab-53bb04c1ad7b tempest-AttachVolumeNegativeTest-1640336653 tempest-AttachVolumeNegativeTest-1640336653-project] 10.222.0.18 "GET /compute/v2.1/servers/46fc96ad-6439-40ca-b2b9-ffe3b3e9bb17" status: 200 len: 1318 microversion: 2.1 time: 0.163710 Dec 15 03:06:03.864054 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: [pid: 116157|app: 0|req: 224/477] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 03:06:03 2021] GET /compute/v2.1/servers/46fc96ad-6439-40ca-b2b9-ffe3b3e9bb17 => generated 1318 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 03:06:04.433090 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi [None req-bb8d6c65-0ef1-4ae0-9879-f9234bc4ad91 tempest-ServerRescueNegativeTestJSON-2061875223 tempest-ServerRescueNegativeTestJSON-2061875223-project] Calling method '>' {{(pid=116156) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:06:04.433815 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.compute.api [None req-bb8d6c65-0ef1-4ae0-9879-f9234bc4ad91 tempest-ServerRescueNegativeTestJSON-2061875223 tempest-ServerRescueNegativeTestJSON-2061875223-project] [instance: 2d20c8be-04a9-4c79-aa0a-138a79fe50cd] Fetching instance by UUID {{(pid=116156) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:06:04.441272 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-bb8d6c65-0ef1-4ae0-9879-f9234bc4ad91 tempest-ServerRescueNegativeTestJSON-2061875223 tempest-ServerRescueNegativeTestJSON-2061875223-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:06:04.441724 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-bb8d6c65-0ef1-4ae0-9879-f9234bc4ad91 tempest-ServerRescueNegativeTestJSON-2061875223 tempest-ServerRescueNegativeTestJSON-2061875223-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:06:04.442699 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-bb8d6c65-0ef1-4ae0-9879-f9234bc4ad91 tempest-ServerRescueNegativeTestJSON-2061875223 tempest-ServerRescueNegativeTestJSON-2061875223-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:06:04.443140 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-bb8d6c65-0ef1-4ae0-9879-f9234bc4ad91 tempest-ServerRescueNegativeTestJSON-2061875223 tempest-ServerRescueNegativeTestJSON-2061875223-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:06:04.678446 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.policy [None req-bb8d6c65-0ef1-4ae0-9879-f9234bc4ad91 tempest-ServerRescueNegativeTestJSON-2061875223 tempest-ServerRescueNegativeTestJSON-2061875223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ea02b6e8f1548a1bd78952cb7337403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5e8a958d4bf43868502b13728b9583b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116156) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:06:04.697640 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: INFO nova.api.openstack.requestlog [None req-bb8d6c65-0ef1-4ae0-9879-f9234bc4ad91 tempest-ServerRescueNegativeTestJSON-2061875223 tempest-ServerRescueNegativeTestJSON-2061875223-project] 10.222.0.18 "GET /compute/v2.1/servers/2d20c8be-04a9-4c79-aa0a-138a79fe50cd" status: 200 len: 1508 microversion: 2.1 time: 0.268378 Dec 15 03:06:04.714263 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: [pid: 116156|app: 0|req: 254/478] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 03:06:04 2021] GET /compute/v2.1/servers/2d20c8be-04a9-4c79-aa0a-138a79fe50cd => generated 1508 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 03:06:04.777973 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi [None req-26835636-8ecf-4c80-8f59-ea16c0398b63 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 03:06:04.780009 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.compute.api [None req-26835636-8ecf-4c80-8f59-ea16c0398b63 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] [instance: b89094ac-aee1-4bd6-a33d-8c4347cebfc7] Fetching instance by UUID {{(pid=116157) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:06:04.799298 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-26835636-8ecf-4c80-8f59-ea16c0398b63 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:06:04.800016 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-26835636-8ecf-4c80-8f59-ea16c0398b63 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:06:04.802878 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-26835636-8ecf-4c80-8f59-ea16c0398b63 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:06:04.805396 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-26835636-8ecf-4c80-8f59-ea16c0398b63 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:06:04.882529 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi [None req-99a60e50-8a2a-4861-a544-51484e9f1f76 tempest-AttachVolumeNegativeTest-1640336653 tempest-AttachVolumeNegativeTest-1640336653-project] Calling method '>' {{(pid=116156) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:06:04.883166 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.compute.api [None req-99a60e50-8a2a-4861-a544-51484e9f1f76 tempest-AttachVolumeNegativeTest-1640336653 tempest-AttachVolumeNegativeTest-1640336653-project] [instance: 46fc96ad-6439-40ca-b2b9-ffe3b3e9bb17] Fetching instance by UUID {{(pid=116156) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:06:04.904933 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-99a60e50-8a2a-4861-a544-51484e9f1f76 tempest-AttachVolumeNegativeTest-1640336653 tempest-AttachVolumeNegativeTest-1640336653-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:06:04.905954 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-99a60e50-8a2a-4861-a544-51484e9f1f76 tempest-AttachVolumeNegativeTest-1640336653 tempest-AttachVolumeNegativeTest-1640336653-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:06:04.907035 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-99a60e50-8a2a-4861-a544-51484e9f1f76 tempest-AttachVolumeNegativeTest-1640336653 tempest-AttachVolumeNegativeTest-1640336653-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:06:04.907644 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-99a60e50-8a2a-4861-a544-51484e9f1f76 tempest-AttachVolumeNegativeTest-1640336653 tempest-AttachVolumeNegativeTest-1640336653-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:06:04.940345 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: INFO nova.api.openstack.requestlog [None req-26835636-8ecf-4c80-8f59-ea16c0398b63 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] 10.222.0.18 "POST /compute/v2.1/servers/b89094ac-aee1-4bd6-a33d-8c4347cebfc7/action" status: 200 len: 32718 microversion: 2.20 time: 0.166979 Dec 15 03:06:04.941242 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: [pid: 116157|app: 0|req: 225/479] 10.222.0.18 () {62 vars in 1318 bytes} [Wed Dec 15 03:06:04 2021] POST /compute/v2.1/servers/b89094ac-aee1-4bd6-a33d-8c4347cebfc7/action => generated 32718 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 15 03:06:05.107022 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.policy [None req-99a60e50-8a2a-4861-a544-51484e9f1f76 tempest-AttachVolumeNegativeTest-1640336653 tempest-AttachVolumeNegativeTest-1640336653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35d37a3d8e504b8186182468b77dd114', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '409b41637da94c469444954258444b4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116156) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:06:05.117402 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: INFO nova.api.openstack.requestlog [None req-99a60e50-8a2a-4861-a544-51484e9f1f76 tempest-AttachVolumeNegativeTest-1640336653 tempest-AttachVolumeNegativeTest-1640336653-project] 10.222.0.18 "GET /compute/v2.1/servers/46fc96ad-6439-40ca-b2b9-ffe3b3e9bb17" status: 200 len: 1318 microversion: 2.1 time: 0.239799 Dec 15 03:06:05.119273 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: [pid: 116156|app: 0|req: 255/480] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 03:06:04 2021] GET /compute/v2.1/servers/46fc96ad-6439-40ca-b2b9-ffe3b3e9bb17 => generated 1318 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 03:06:05.716488 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi [None req-843fa9d9-c421-462c-a9e6-590847d2c131 tempest-ServerRescueNegativeTestJSON-2061875223 tempest-ServerRescueNegativeTestJSON-2061875223-project] Calling method '>' {{(pid=116157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:06:05.717189 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.compute.api [None req-843fa9d9-c421-462c-a9e6-590847d2c131 tempest-ServerRescueNegativeTestJSON-2061875223 tempest-ServerRescueNegativeTestJSON-2061875223-project] [instance: 2d20c8be-04a9-4c79-aa0a-138a79fe50cd] Fetching instance by UUID {{(pid=116157) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:06:05.724313 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-843fa9d9-c421-462c-a9e6-590847d2c131 tempest-ServerRescueNegativeTestJSON-2061875223 tempest-ServerRescueNegativeTestJSON-2061875223-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:06:05.724861 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-843fa9d9-c421-462c-a9e6-590847d2c131 tempest-ServerRescueNegativeTestJSON-2061875223 tempest-ServerRescueNegativeTestJSON-2061875223-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:06:05.725885 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-843fa9d9-c421-462c-a9e6-590847d2c131 tempest-ServerRescueNegativeTestJSON-2061875223 tempest-ServerRescueNegativeTestJSON-2061875223-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:06:05.726343 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-843fa9d9-c421-462c-a9e6-590847d2c131 tempest-ServerRescueNegativeTestJSON-2061875223 tempest-ServerRescueNegativeTestJSON-2061875223-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:06:05.880867 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.policy [None req-843fa9d9-c421-462c-a9e6-590847d2c131 tempest-ServerRescueNegativeTestJSON-2061875223 tempest-ServerRescueNegativeTestJSON-2061875223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ea02b6e8f1548a1bd78952cb7337403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5e8a958d4bf43868502b13728b9583b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116157) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:06:05.888334 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: INFO nova.api.openstack.requestlog [None req-843fa9d9-c421-462c-a9e6-590847d2c131 tempest-ServerRescueNegativeTestJSON-2061875223 tempest-ServerRescueNegativeTestJSON-2061875223-project] 10.222.0.18 "GET /compute/v2.1/servers/2d20c8be-04a9-4c79-aa0a-138a79fe50cd" status: 200 len: 1508 microversion: 2.1 time: 0.175864 Dec 15 03:06:05.888886 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: [pid: 116157|app: 0|req: 226/481] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 03:06:05 2021] GET /compute/v2.1/servers/2d20c8be-04a9-4c79-aa0a-138a79fe50cd => generated 1508 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 03:06:05.960459 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi [None req-195bed14-de6b-453b-bd51-5b7a69caa4e6 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116156) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 03:06:05.961461 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.compute.api [None req-195bed14-de6b-453b-bd51-5b7a69caa4e6 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] [instance: b89094ac-aee1-4bd6-a33d-8c4347cebfc7] Fetching instance by UUID {{(pid=116156) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:06:05.967984 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-195bed14-de6b-453b-bd51-5b7a69caa4e6 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:06:05.968515 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-195bed14-de6b-453b-bd51-5b7a69caa4e6 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:06:05.969416 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-195bed14-de6b-453b-bd51-5b7a69caa4e6 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:06:05.970126 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-195bed14-de6b-453b-bd51-5b7a69caa4e6 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:06:06.084430 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: INFO nova.api.openstack.requestlog [None req-195bed14-de6b-453b-bd51-5b7a69caa4e6 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] 10.222.0.18 "POST /compute/v2.1/servers/b89094ac-aee1-4bd6-a33d-8c4347cebfc7/action" status: 200 len: 33252 microversion: 2.20 time: 0.128252 Dec 15 03:06:06.085078 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: [pid: 116156|app: 0|req: 256/482] 10.222.0.18 () {62 vars in 1318 bytes} [Wed Dec 15 03:06:05 2021] POST /compute/v2.1/servers/b89094ac-aee1-4bd6-a33d-8c4347cebfc7/action => generated 33252 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 15 03:06:06.136388 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi [None req-52e3bd78-af12-4643-8dc2-1a70ce7210a9 tempest-AttachVolumeNegativeTest-1640336653 tempest-AttachVolumeNegativeTest-1640336653-project] Calling method '>' {{(pid=116157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:06:06.137001 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.compute.api [None req-52e3bd78-af12-4643-8dc2-1a70ce7210a9 tempest-AttachVolumeNegativeTest-1640336653 tempest-AttachVolumeNegativeTest-1640336653-project] [instance: 46fc96ad-6439-40ca-b2b9-ffe3b3e9bb17] Fetching instance by UUID {{(pid=116157) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:06:06.143818 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-52e3bd78-af12-4643-8dc2-1a70ce7210a9 tempest-AttachVolumeNegativeTest-1640336653 tempest-AttachVolumeNegativeTest-1640336653-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:06:06.144268 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-52e3bd78-af12-4643-8dc2-1a70ce7210a9 tempest-AttachVolumeNegativeTest-1640336653 tempest-AttachVolumeNegativeTest-1640336653-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:06:06.145045 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-52e3bd78-af12-4643-8dc2-1a70ce7210a9 tempest-AttachVolumeNegativeTest-1640336653 tempest-AttachVolumeNegativeTest-1640336653-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:06:06.145569 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-52e3bd78-af12-4643-8dc2-1a70ce7210a9 tempest-AttachVolumeNegativeTest-1640336653 tempest-AttachVolumeNegativeTest-1640336653-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:06:06.290295 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.policy [None req-52e3bd78-af12-4643-8dc2-1a70ce7210a9 tempest-AttachVolumeNegativeTest-1640336653 tempest-AttachVolumeNegativeTest-1640336653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35d37a3d8e504b8186182468b77dd114', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '409b41637da94c469444954258444b4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116157) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:06:06.298122 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: INFO nova.api.openstack.requestlog [None req-52e3bd78-af12-4643-8dc2-1a70ce7210a9 tempest-AttachVolumeNegativeTest-1640336653 tempest-AttachVolumeNegativeTest-1640336653-project] 10.222.0.18 "GET /compute/v2.1/servers/46fc96ad-6439-40ca-b2b9-ffe3b3e9bb17" status: 200 len: 1318 microversion: 2.1 time: 0.165399 Dec 15 03:06:06.298945 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: [pid: 116157|app: 0|req: 227/483] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 03:06:06 2021] GET /compute/v2.1/servers/46fc96ad-6439-40ca-b2b9-ffe3b3e9bb17 => generated 1318 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 03:06:06.907510 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi [None req-b7c5c8e0-25f3-4576-b8f5-a4950a1cc166 tempest-ServerRescueNegativeTestJSON-2061875223 tempest-ServerRescueNegativeTestJSON-2061875223-project] Calling method '>' {{(pid=116156) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:06:06.909278 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.compute.api [None req-b7c5c8e0-25f3-4576-b8f5-a4950a1cc166 tempest-ServerRescueNegativeTestJSON-2061875223 tempest-ServerRescueNegativeTestJSON-2061875223-project] [instance: 2d20c8be-04a9-4c79-aa0a-138a79fe50cd] Fetching instance by UUID {{(pid=116156) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:06:06.919258 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-b7c5c8e0-25f3-4576-b8f5-a4950a1cc166 tempest-ServerRescueNegativeTestJSON-2061875223 tempest-ServerRescueNegativeTestJSON-2061875223-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:06:06.920222 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-b7c5c8e0-25f3-4576-b8f5-a4950a1cc166 tempest-ServerRescueNegativeTestJSON-2061875223 tempest-ServerRescueNegativeTestJSON-2061875223-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:06:06.921370 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-b7c5c8e0-25f3-4576-b8f5-a4950a1cc166 tempest-ServerRescueNegativeTestJSON-2061875223 tempest-ServerRescueNegativeTestJSON-2061875223-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:06:06.921805 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-b7c5c8e0-25f3-4576-b8f5-a4950a1cc166 tempest-ServerRescueNegativeTestJSON-2061875223 tempest-ServerRescueNegativeTestJSON-2061875223-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:06:07.097968 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi [None req-2db13789-df11-4647-9915-a87d5341d454 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 03:06:07.099137 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.compute.api [None req-2db13789-df11-4647-9915-a87d5341d454 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] [instance: b89094ac-aee1-4bd6-a33d-8c4347cebfc7] Fetching instance by UUID {{(pid=116157) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:06:07.108351 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-2db13789-df11-4647-9915-a87d5341d454 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:06:07.114112 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-2db13789-df11-4647-9915-a87d5341d454 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:06:07.115073 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-2db13789-df11-4647-9915-a87d5341d454 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:06:07.115704 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-2db13789-df11-4647-9915-a87d5341d454 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:06:07.146778 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.policy [None req-b7c5c8e0-25f3-4576-b8f5-a4950a1cc166 tempest-ServerRescueNegativeTestJSON-2061875223 tempest-ServerRescueNegativeTestJSON-2061875223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ea02b6e8f1548a1bd78952cb7337403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5e8a958d4bf43868502b13728b9583b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116156) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:06:07.160670 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: INFO nova.api.openstack.requestlog [None req-b7c5c8e0-25f3-4576-b8f5-a4950a1cc166 tempest-ServerRescueNegativeTestJSON-2061875223 tempest-ServerRescueNegativeTestJSON-2061875223-project] 10.222.0.18 "GET /compute/v2.1/servers/2d20c8be-04a9-4c79-aa0a-138a79fe50cd" status: 200 len: 1508 microversion: 2.1 time: 0.258308 Dec 15 03:06:07.172776 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: [pid: 116156|app: 0|req: 257/484] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 03:06:06 2021] GET /compute/v2.1/servers/2d20c8be-04a9-4c79-aa0a-138a79fe50cd => generated 1508 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 03:06:07.246664 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: INFO nova.api.openstack.requestlog [None req-2db13789-df11-4647-9915-a87d5341d454 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] 10.222.0.18 "POST /compute/v2.1/servers/b89094ac-aee1-4bd6-a33d-8c4347cebfc7/action" status: 200 len: 33825 microversion: 2.20 time: 0.152972 Dec 15 03:06:07.247912 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: [pid: 116157|app: 0|req: 228/485] 10.222.0.18 () {62 vars in 1318 bytes} [Wed Dec 15 03:06:07 2021] POST /compute/v2.1/servers/b89094ac-aee1-4bd6-a33d-8c4347cebfc7/action => generated 33825 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 15 03:06:07.315503 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi [None req-f31ef61c-a110-4227-83d0-3b7063a7457d tempest-AttachVolumeNegativeTest-1640336653 tempest-AttachVolumeNegativeTest-1640336653-project] Calling method '>' {{(pid=116156) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:06:07.316179 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.compute.api [None req-f31ef61c-a110-4227-83d0-3b7063a7457d tempest-AttachVolumeNegativeTest-1640336653 tempest-AttachVolumeNegativeTest-1640336653-project] [instance: 46fc96ad-6439-40ca-b2b9-ffe3b3e9bb17] Fetching instance by UUID {{(pid=116156) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:06:07.323729 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-f31ef61c-a110-4227-83d0-3b7063a7457d tempest-AttachVolumeNegativeTest-1640336653 tempest-AttachVolumeNegativeTest-1640336653-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:06:07.330339 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-f31ef61c-a110-4227-83d0-3b7063a7457d tempest-AttachVolumeNegativeTest-1640336653 tempest-AttachVolumeNegativeTest-1640336653-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:06:07.334435 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-f31ef61c-a110-4227-83d0-3b7063a7457d tempest-AttachVolumeNegativeTest-1640336653 tempest-AttachVolumeNegativeTest-1640336653-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:06:07.336160 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-f31ef61c-a110-4227-83d0-3b7063a7457d tempest-AttachVolumeNegativeTest-1640336653 tempest-AttachVolumeNegativeTest-1640336653-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:06:07.595595 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi [req-2943850a-409e-4e47-8ab5-389c8c73287a req-626613f3-3297-4d03-b170-75874c6f7e98 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2d20c8be-04a9-4c79-aa0a-138a79fe50cd", "name": "network-vif-deleted", "tag": "6a22ab04-9553-401b-9bbb-1e4693ade51b"}]} {{(pid=116157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 03:06:07.597762 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 15 03:06:07.597762 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: warnings.warn(msg) Dec 15 03:06:07.610011 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [req-2943850a-409e-4e47-8ab5-389c8c73287a req-626613f3-3297-4d03-b170-75874c6f7e98 service nova] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:06:07.610929 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [req-2943850a-409e-4e47-8ab5-389c8c73287a req-626613f3-3297-4d03-b170-75874c6f7e98 service nova] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:06:07.638104 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.policy [None req-f31ef61c-a110-4227-83d0-3b7063a7457d tempest-AttachVolumeNegativeTest-1640336653 tempest-AttachVolumeNegativeTest-1640336653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35d37a3d8e504b8186182468b77dd114', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '409b41637da94c469444954258444b4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116156) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:06:07.649078 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: INFO nova.api.openstack.compute.server_external_events [req-2943850a-409e-4e47-8ab5-389c8c73287a req-626613f3-3297-4d03-b170-75874c6f7e98 service nova] Creating event network-vif-deleted:6a22ab04-9553-401b-9bbb-1e4693ade51b for instance 2d20c8be-04a9-4c79-aa0a-138a79fe50cd on hv-cinder-81803 Dec 15 03:06:07.649900 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: INFO nova.api.openstack.requestlog [None req-f31ef61c-a110-4227-83d0-3b7063a7457d tempest-AttachVolumeNegativeTest-1640336653 tempest-AttachVolumeNegativeTest-1640336653-project] 10.222.0.18 "GET /compute/v2.1/servers/46fc96ad-6439-40ca-b2b9-ffe3b3e9bb17" status: 200 len: 1318 microversion: 2.1 time: 0.337630 Dec 15 03:06:07.650773 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: [pid: 116156|app: 0|req: 258/486] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 03:06:07 2021] GET /compute/v2.1/servers/46fc96ad-6439-40ca-b2b9-ffe3b3e9bb17 => generated 1318 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 03:06:07.654939 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: INFO nova.api.openstack.requestlog [req-2943850a-409e-4e47-8ab5-389c8c73287a req-626613f3-3297-4d03-b170-75874c6f7e98 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.065927 Dec 15 03:06:07.655750 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: [pid: 116157|app: 0|req: 229/487] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Dec 15 03:06:07 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 15 03:06:07.667613 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi [req-44e65e95-0534-46de-8e2e-12198c156e26 req-2f96de4a-79ab-49a6-ab93-3842213674cc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "46fc96ad-6439-40ca-b2b9-ffe3b3e9bb17", "name": "network-vif-plugged", "status": "completed", "tag": "9010a98c-e7c8-42bc-8a01-5924495b7f7d"}]} {{(pid=116156) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 03:06:07.671508 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 15 03:06:07.671508 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: warnings.warn(msg) Dec 15 03:06:07.686132 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [req-44e65e95-0534-46de-8e2e-12198c156e26 req-2f96de4a-79ab-49a6-ab93-3842213674cc service nova] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:06:07.687346 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [req-44e65e95-0534-46de-8e2e-12198c156e26 req-2f96de4a-79ab-49a6-ab93-3842213674cc service nova] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:06:07.733507 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: INFO nova.api.openstack.compute.server_external_events [req-44e65e95-0534-46de-8e2e-12198c156e26 req-2f96de4a-79ab-49a6-ab93-3842213674cc service nova] Creating event network-vif-plugged:9010a98c-e7c8-42bc-8a01-5924495b7f7d for instance 46fc96ad-6439-40ca-b2b9-ffe3b3e9bb17 on hv-cinder-81803 Dec 15 03:06:07.742802 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: INFO nova.api.openstack.requestlog [req-44e65e95-0534-46de-8e2e-12198c156e26 req-2f96de4a-79ab-49a6-ab93-3842213674cc service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.083527 Dec 15 03:06:07.745223 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: [pid: 116156|app: 0|req: 259/488] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Dec 15 03:06:07 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 03:06:08.184417 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi [None req-7a329f3f-1c91-4575-a20f-1d23bcb1d8a8 tempest-ServerRescueNegativeTestJSON-2061875223 tempest-ServerRescueNegativeTestJSON-2061875223-project] Calling method '>' {{(pid=116157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:06:08.185244 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.compute.api [None req-7a329f3f-1c91-4575-a20f-1d23bcb1d8a8 tempest-ServerRescueNegativeTestJSON-2061875223 tempest-ServerRescueNegativeTestJSON-2061875223-project] [instance: 2d20c8be-04a9-4c79-aa0a-138a79fe50cd] Fetching instance by UUID {{(pid=116157) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:06:08.197590 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-7a329f3f-1c91-4575-a20f-1d23bcb1d8a8 tempest-ServerRescueNegativeTestJSON-2061875223 tempest-ServerRescueNegativeTestJSON-2061875223-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:06:08.198168 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-7a329f3f-1c91-4575-a20f-1d23bcb1d8a8 tempest-ServerRescueNegativeTestJSON-2061875223 tempest-ServerRescueNegativeTestJSON-2061875223-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:06:08.199209 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-7a329f3f-1c91-4575-a20f-1d23bcb1d8a8 tempest-ServerRescueNegativeTestJSON-2061875223 tempest-ServerRescueNegativeTestJSON-2061875223-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:06:08.199867 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-7a329f3f-1c91-4575-a20f-1d23bcb1d8a8 tempest-ServerRescueNegativeTestJSON-2061875223 tempest-ServerRescueNegativeTestJSON-2061875223-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:06:08.241004 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-7a329f3f-1c91-4575-a20f-1d23bcb1d8a8 tempest-ServerRescueNegativeTestJSON-2061875223 tempest-ServerRescueNegativeTestJSON-2061875223-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:06:08.241737 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-7a329f3f-1c91-4575-a20f-1d23bcb1d8a8 tempest-ServerRescueNegativeTestJSON-2061875223 tempest-ServerRescueNegativeTestJSON-2061875223-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:06:08.242454 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.objects.instance [None req-7a329f3f-1c91-4575-a20f-1d23bcb1d8a8 tempest-ServerRescueNegativeTestJSON-2061875223 tempest-ServerRescueNegativeTestJSON-2061875223-project] Lazy-loading 'fault' on Instance uuid 2d20c8be-04a9-4c79-aa0a-138a79fe50cd {{(pid=116157) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Dec 15 03:06:08.260941 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi [None req-008395a1-cd7a-4cd1-acda-2e543d7d8a6d tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116156) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 03:06:08.262972 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.compute.api [None req-008395a1-cd7a-4cd1-acda-2e543d7d8a6d tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] [instance: b89094ac-aee1-4bd6-a33d-8c4347cebfc7] Fetching instance by UUID {{(pid=116156) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:06:08.272939 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-008395a1-cd7a-4cd1-acda-2e543d7d8a6d tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:06:08.274066 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-008395a1-cd7a-4cd1-acda-2e543d7d8a6d tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:06:08.275612 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-008395a1-cd7a-4cd1-acda-2e543d7d8a6d tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:06:08.276361 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-008395a1-cd7a-4cd1-acda-2e543d7d8a6d tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:06:08.300259 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.policy [None req-7a329f3f-1c91-4575-a20f-1d23bcb1d8a8 tempest-ServerRescueNegativeTestJSON-2061875223 tempest-ServerRescueNegativeTestJSON-2061875223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ea02b6e8f1548a1bd78952cb7337403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5e8a958d4bf43868502b13728b9583b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116157) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:06:08.309765 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: INFO nova.api.openstack.requestlog [None req-7a329f3f-1c91-4575-a20f-1d23bcb1d8a8 tempest-ServerRescueNegativeTestJSON-2061875223 tempest-ServerRescueNegativeTestJSON-2061875223-project] 10.222.0.18 "GET /compute/v2.1/servers/2d20c8be-04a9-4c79-aa0a-138a79fe50cd" status: 200 len: 1311 microversion: 2.1 time: 0.133525 Dec 15 03:06:08.310904 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: [pid: 116157|app: 0|req: 230/489] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 03:06:08 2021] GET /compute/v2.1/servers/2d20c8be-04a9-4c79-aa0a-138a79fe50cd => generated 1311 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 03:06:08.600094 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: INFO nova.api.openstack.requestlog [None req-008395a1-cd7a-4cd1-acda-2e543d7d8a6d tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] 10.222.0.18 "POST /compute/v2.1/servers/b89094ac-aee1-4bd6-a33d-8c4347cebfc7/action" status: 200 len: 34763 microversion: 2.20 time: 0.343645 Dec 15 03:06:08.600094 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: [pid: 116156|app: 0|req: 260/490] 10.222.0.18 () {62 vars in 1318 bytes} [Wed Dec 15 03:06:08 2021] POST /compute/v2.1/servers/b89094ac-aee1-4bd6-a33d-8c4347cebfc7/action => generated 34763 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 15 03:06:08.677450 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi [None req-9b5951a5-3c5f-45b6-bb0d-223c3abb1a7c tempest-AttachVolumeNegativeTest-1640336653 tempest-AttachVolumeNegativeTest-1640336653-project] Calling method '>' {{(pid=116157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:06:08.678122 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.compute.api [None req-9b5951a5-3c5f-45b6-bb0d-223c3abb1a7c tempest-AttachVolumeNegativeTest-1640336653 tempest-AttachVolumeNegativeTest-1640336653-project] [instance: 46fc96ad-6439-40ca-b2b9-ffe3b3e9bb17] Fetching instance by UUID {{(pid=116157) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:06:08.686199 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-9b5951a5-3c5f-45b6-bb0d-223c3abb1a7c tempest-AttachVolumeNegativeTest-1640336653 tempest-AttachVolumeNegativeTest-1640336653-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:06:08.686677 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-9b5951a5-3c5f-45b6-bb0d-223c3abb1a7c tempest-AttachVolumeNegativeTest-1640336653 tempest-AttachVolumeNegativeTest-1640336653-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:06:08.687505 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-9b5951a5-3c5f-45b6-bb0d-223c3abb1a7c tempest-AttachVolumeNegativeTest-1640336653 tempest-AttachVolumeNegativeTest-1640336653-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:06:08.687939 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-9b5951a5-3c5f-45b6-bb0d-223c3abb1a7c tempest-AttachVolumeNegativeTest-1640336653 tempest-AttachVolumeNegativeTest-1640336653-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:06:08.880073 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.policy [None req-9b5951a5-3c5f-45b6-bb0d-223c3abb1a7c tempest-AttachVolumeNegativeTest-1640336653 tempest-AttachVolumeNegativeTest-1640336653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35d37a3d8e504b8186182468b77dd114', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '409b41637da94c469444954258444b4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116157) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:06:08.889932 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: INFO nova.api.openstack.requestlog [None req-9b5951a5-3c5f-45b6-bb0d-223c3abb1a7c tempest-AttachVolumeNegativeTest-1640336653 tempest-AttachVolumeNegativeTest-1640336653-project] 10.222.0.18 "GET /compute/v2.1/servers/46fc96ad-6439-40ca-b2b9-ffe3b3e9bb17" status: 200 len: 1318 microversion: 2.1 time: 0.216785 Dec 15 03:06:08.891115 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: [pid: 116157|app: 0|req: 231/491] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 03:06:08 2021] GET /compute/v2.1/servers/46fc96ad-6439-40ca-b2b9-ffe3b3e9bb17 => generated 1318 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 03:06:09.329137 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi [None req-74aa0a90-1f2f-4f70-bc06-6cf11ed032b2 tempest-ServerRescueNegativeTestJSON-2061875223 tempest-ServerRescueNegativeTestJSON-2061875223-project] Calling method '>' {{(pid=116156) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:06:09.329872 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.compute.api [None req-74aa0a90-1f2f-4f70-bc06-6cf11ed032b2 tempest-ServerRescueNegativeTestJSON-2061875223 tempest-ServerRescueNegativeTestJSON-2061875223-project] [instance: 2d20c8be-04a9-4c79-aa0a-138a79fe50cd] Fetching instance by UUID {{(pid=116156) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:06:09.340391 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-74aa0a90-1f2f-4f70-bc06-6cf11ed032b2 tempest-ServerRescueNegativeTestJSON-2061875223 tempest-ServerRescueNegativeTestJSON-2061875223-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:06:09.340846 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-74aa0a90-1f2f-4f70-bc06-6cf11ed032b2 tempest-ServerRescueNegativeTestJSON-2061875223 tempest-ServerRescueNegativeTestJSON-2061875223-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:06:09.341714 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-74aa0a90-1f2f-4f70-bc06-6cf11ed032b2 tempest-ServerRescueNegativeTestJSON-2061875223 tempest-ServerRescueNegativeTestJSON-2061875223-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:06:09.342193 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-74aa0a90-1f2f-4f70-bc06-6cf11ed032b2 tempest-ServerRescueNegativeTestJSON-2061875223 tempest-ServerRescueNegativeTestJSON-2061875223-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:06:09.357034 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: INFO nova.api.openstack.wsgi [None req-74aa0a90-1f2f-4f70-bc06-6cf11ed032b2 tempest-ServerRescueNegativeTestJSON-2061875223 tempest-ServerRescueNegativeTestJSON-2061875223-project] HTTP exception thrown: Instance 2d20c8be-04a9-4c79-aa0a-138a79fe50cd could not be found. Dec 15 03:06:09.357656 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi [None req-74aa0a90-1f2f-4f70-bc06-6cf11ed032b2 tempest-ServerRescueNegativeTestJSON-2061875223 tempest-ServerRescueNegativeTestJSON-2061875223-project] Returning 404 to user: Instance 2d20c8be-04a9-4c79-aa0a-138a79fe50cd could not be found. {{(pid=116156) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 15 03:06:09.358862 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: INFO nova.api.openstack.requestlog [None req-74aa0a90-1f2f-4f70-bc06-6cf11ed032b2 tempest-ServerRescueNegativeTestJSON-2061875223 tempest-ServerRescueNegativeTestJSON-2061875223-project] 10.222.0.18 "GET /compute/v2.1/servers/2d20c8be-04a9-4c79-aa0a-138a79fe50cd" status: 404 len: 111 microversion: 2.1 time: 0.033737 Dec 15 03:06:09.359390 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: [pid: 116156|app: 0|req: 261/492] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 03:06:09 2021] GET /compute/v2.1/servers/2d20c8be-04a9-4c79-aa0a-138a79fe50cd => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 15 03:06:09.368741 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi [None req-25c764d7-4ff5-49c6-91fa-f32587e0c438 tempest-ServerRescueNegativeTestJSON-2061875223 tempest-ServerRescueNegativeTestJSON-2061875223-project] Calling method '>' {{(pid=116157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:06:09.369317 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.compute.api [None req-25c764d7-4ff5-49c6-91fa-f32587e0c438 tempest-ServerRescueNegativeTestJSON-2061875223 tempest-ServerRescueNegativeTestJSON-2061875223-project] [instance: 9bbb0abf-72a3-4fbc-8235-7a3ecfc8d006] Fetching instance by UUID {{(pid=116157) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:06:09.377750 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-25c764d7-4ff5-49c6-91fa-f32587e0c438 tempest-ServerRescueNegativeTestJSON-2061875223 tempest-ServerRescueNegativeTestJSON-2061875223-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:06:09.378503 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-25c764d7-4ff5-49c6-91fa-f32587e0c438 tempest-ServerRescueNegativeTestJSON-2061875223 tempest-ServerRescueNegativeTestJSON-2061875223-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:06:09.379495 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-25c764d7-4ff5-49c6-91fa-f32587e0c438 tempest-ServerRescueNegativeTestJSON-2061875223 tempest-ServerRescueNegativeTestJSON-2061875223-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:06:09.379997 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-25c764d7-4ff5-49c6-91fa-f32587e0c438 tempest-ServerRescueNegativeTestJSON-2061875223 tempest-ServerRescueNegativeTestJSON-2061875223-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:06:09.411696 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.compute.api [None req-25c764d7-4ff5-49c6-91fa-f32587e0c438 tempest-ServerRescueNegativeTestJSON-2061875223 tempest-ServerRescueNegativeTestJSON-2061875223-project] [instance: 9bbb0abf-72a3-4fbc-8235-7a3ecfc8d006] Going to try to terminate instance {{(pid=116157) delete /opt/stack/nova/nova/compute/api.py:2614}} Dec 15 03:06:09.523353 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: INFO nova.api.openstack.requestlog [None req-25c764d7-4ff5-49c6-91fa-f32587e0c438 tempest-ServerRescueNegativeTestJSON-2061875223 tempest-ServerRescueNegativeTestJSON-2061875223-project] 10.222.0.18 "DELETE /compute/v2.1/servers/9bbb0abf-72a3-4fbc-8235-7a3ecfc8d006" status: 204 len: 0 microversion: 2.1 time: 0.158390 Dec 15 03:06:09.528651 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: [pid: 116157|app: 0|req: 232/493] 10.222.0.18 () {58 vars in 1238 bytes} [Wed Dec 15 03:06:09 2021] DELETE /compute/v2.1/servers/9bbb0abf-72a3-4fbc-8235-7a3ecfc8d006 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Dec 15 03:06:09.535366 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi [None req-396b08da-f864-4364-a99f-af4bf6fabcd3 tempest-ServerRescueNegativeTestJSON-2061875223 tempest-ServerRescueNegativeTestJSON-2061875223-project] Calling method '>' {{(pid=116156) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:06:09.536258 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.compute.api [None req-396b08da-f864-4364-a99f-af4bf6fabcd3 tempest-ServerRescueNegativeTestJSON-2061875223 tempest-ServerRescueNegativeTestJSON-2061875223-project] [instance: 9bbb0abf-72a3-4fbc-8235-7a3ecfc8d006] Fetching instance by UUID {{(pid=116156) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:06:09.545218 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-396b08da-f864-4364-a99f-af4bf6fabcd3 tempest-ServerRescueNegativeTestJSON-2061875223 tempest-ServerRescueNegativeTestJSON-2061875223-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:06:09.546350 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-396b08da-f864-4364-a99f-af4bf6fabcd3 tempest-ServerRescueNegativeTestJSON-2061875223 tempest-ServerRescueNegativeTestJSON-2061875223-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:06:09.547356 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-396b08da-f864-4364-a99f-af4bf6fabcd3 tempest-ServerRescueNegativeTestJSON-2061875223 tempest-ServerRescueNegativeTestJSON-2061875223-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:06:09.548096 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-396b08da-f864-4364-a99f-af4bf6fabcd3 tempest-ServerRescueNegativeTestJSON-2061875223 tempest-ServerRescueNegativeTestJSON-2061875223-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:06:09.622775 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi [None req-b4690c34-912f-4ac5-b68d-f6f56c9bfe98 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 03:06:09.623933 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.compute.api [None req-b4690c34-912f-4ac5-b68d-f6f56c9bfe98 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] [instance: b89094ac-aee1-4bd6-a33d-8c4347cebfc7] Fetching instance by UUID {{(pid=116157) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:06:09.631495 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-b4690c34-912f-4ac5-b68d-f6f56c9bfe98 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:06:09.632550 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-b4690c34-912f-4ac5-b68d-f6f56c9bfe98 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:06:09.633537 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-b4690c34-912f-4ac5-b68d-f6f56c9bfe98 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:06:09.634203 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-b4690c34-912f-4ac5-b68d-f6f56c9bfe98 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:06:09.704587 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.policy [None req-396b08da-f864-4364-a99f-af4bf6fabcd3 tempest-ServerRescueNegativeTestJSON-2061875223 tempest-ServerRescueNegativeTestJSON-2061875223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ea02b6e8f1548a1bd78952cb7337403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5e8a958d4bf43868502b13728b9583b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116156) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:06:09.713112 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: INFO nova.api.openstack.requestlog [None req-396b08da-f864-4364-a99f-af4bf6fabcd3 tempest-ServerRescueNegativeTestJSON-2061875223 tempest-ServerRescueNegativeTestJSON-2061875223-project] 10.222.0.18 "GET /compute/v2.1/servers/9bbb0abf-72a3-4fbc-8235-7a3ecfc8d006" status: 200 len: 1521 microversion: 2.1 time: 0.182674 Dec 15 03:06:09.724070 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: [pid: 116156|app: 0|req: 262/494] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 03:06:09 2021] GET /compute/v2.1/servers/9bbb0abf-72a3-4fbc-8235-7a3ecfc8d006 => generated 1521 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 03:06:09.780477 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: INFO nova.api.openstack.requestlog [None req-b4690c34-912f-4ac5-b68d-f6f56c9bfe98 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] 10.222.0.18 "POST /compute/v2.1/servers/b89094ac-aee1-4bd6-a33d-8c4347cebfc7/action" status: 200 len: 35333 microversion: 2.20 time: 0.172546 Dec 15 03:06:09.785277 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: [pid: 116157|app: 0|req: 233/495] 10.222.0.18 () {62 vars in 1318 bytes} [Wed Dec 15 03:06:09 2021] POST /compute/v2.1/servers/b89094ac-aee1-4bd6-a33d-8c4347cebfc7/action => generated 35333 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Dec 15 03:06:09.907194 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi [None req-5097b873-a629-47dc-a978-d797bb227070 tempest-AttachVolumeNegativeTest-1640336653 tempest-AttachVolumeNegativeTest-1640336653-project] Calling method '>' {{(pid=116156) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:06:09.907823 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.compute.api [None req-5097b873-a629-47dc-a978-d797bb227070 tempest-AttachVolumeNegativeTest-1640336653 tempest-AttachVolumeNegativeTest-1640336653-project] [instance: 46fc96ad-6439-40ca-b2b9-ffe3b3e9bb17] Fetching instance by UUID {{(pid=116156) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:06:09.914224 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-5097b873-a629-47dc-a978-d797bb227070 tempest-AttachVolumeNegativeTest-1640336653 tempest-AttachVolumeNegativeTest-1640336653-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:06:09.914920 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-5097b873-a629-47dc-a978-d797bb227070 tempest-AttachVolumeNegativeTest-1640336653 tempest-AttachVolumeNegativeTest-1640336653-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:06:09.915933 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-5097b873-a629-47dc-a978-d797bb227070 tempest-AttachVolumeNegativeTest-1640336653 tempest-AttachVolumeNegativeTest-1640336653-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:06:09.916364 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-5097b873-a629-47dc-a978-d797bb227070 tempest-AttachVolumeNegativeTest-1640336653 tempest-AttachVolumeNegativeTest-1640336653-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:06:10.122932 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.policy [None req-5097b873-a629-47dc-a978-d797bb227070 tempest-AttachVolumeNegativeTest-1640336653 tempest-AttachVolumeNegativeTest-1640336653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35d37a3d8e504b8186182468b77dd114', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '409b41637da94c469444954258444b4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116156) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:06:10.131195 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: INFO nova.api.openstack.requestlog [None req-5097b873-a629-47dc-a978-d797bb227070 tempest-AttachVolumeNegativeTest-1640336653 tempest-AttachVolumeNegativeTest-1640336653-project] 10.222.0.18 "GET /compute/v2.1/servers/46fc96ad-6439-40ca-b2b9-ffe3b3e9bb17" status: 200 len: 1507 microversion: 2.1 time: 0.227643 Dec 15 03:06:10.132039 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: [pid: 116156|app: 0|req: 263/496] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 03:06:09 2021] GET /compute/v2.1/servers/46fc96ad-6439-40ca-b2b9-ffe3b3e9bb17 => generated 1507 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 03:06:10.731495 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi [None req-53dacde6-1cd3-42ac-ae99-7391b746ee57 tempest-ServerRescueNegativeTestJSON-2061875223 tempest-ServerRescueNegativeTestJSON-2061875223-project] Calling method '>' {{(pid=116157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:06:10.732262 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.compute.api [None req-53dacde6-1cd3-42ac-ae99-7391b746ee57 tempest-ServerRescueNegativeTestJSON-2061875223 tempest-ServerRescueNegativeTestJSON-2061875223-project] [instance: 9bbb0abf-72a3-4fbc-8235-7a3ecfc8d006] Fetching instance by UUID {{(pid=116157) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:06:10.738913 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-53dacde6-1cd3-42ac-ae99-7391b746ee57 tempest-ServerRescueNegativeTestJSON-2061875223 tempest-ServerRescueNegativeTestJSON-2061875223-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:06:10.739356 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-53dacde6-1cd3-42ac-ae99-7391b746ee57 tempest-ServerRescueNegativeTestJSON-2061875223 tempest-ServerRescueNegativeTestJSON-2061875223-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:06:10.740247 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-53dacde6-1cd3-42ac-ae99-7391b746ee57 tempest-ServerRescueNegativeTestJSON-2061875223 tempest-ServerRescueNegativeTestJSON-2061875223-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:06:10.740563 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-53dacde6-1cd3-42ac-ae99-7391b746ee57 tempest-ServerRescueNegativeTestJSON-2061875223 tempest-ServerRescueNegativeTestJSON-2061875223-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:06:10.793223 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi [None req-41153de0-7bd7-4368-8843-b724e947fa30 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116156) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 03:06:10.795007 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.compute.api [None req-41153de0-7bd7-4368-8843-b724e947fa30 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] [instance: b89094ac-aee1-4bd6-a33d-8c4347cebfc7] Fetching instance by UUID {{(pid=116156) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:06:10.802085 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-41153de0-7bd7-4368-8843-b724e947fa30 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:06:10.802869 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-41153de0-7bd7-4368-8843-b724e947fa30 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:06:10.803877 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-41153de0-7bd7-4368-8843-b724e947fa30 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:06:10.804577 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-41153de0-7bd7-4368-8843-b724e947fa30 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:06:10.897548 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.policy [None req-53dacde6-1cd3-42ac-ae99-7391b746ee57 tempest-ServerRescueNegativeTestJSON-2061875223 tempest-ServerRescueNegativeTestJSON-2061875223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ea02b6e8f1548a1bd78952cb7337403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5e8a958d4bf43868502b13728b9583b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116157) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:06:10.905381 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: INFO nova.api.openstack.requestlog [None req-53dacde6-1cd3-42ac-ae99-7391b746ee57 tempest-ServerRescueNegativeTestJSON-2061875223 tempest-ServerRescueNegativeTestJSON-2061875223-project] 10.222.0.18 "GET /compute/v2.1/servers/9bbb0abf-72a3-4fbc-8235-7a3ecfc8d006" status: 200 len: 1521 microversion: 2.1 time: 0.177942 Dec 15 03:06:10.905938 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: [pid: 116157|app: 0|req: 234/497] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 03:06:10 2021] GET /compute/v2.1/servers/9bbb0abf-72a3-4fbc-8235-7a3ecfc8d006 => generated 1521 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 03:06:10.949233 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: INFO nova.api.openstack.requestlog [None req-41153de0-7bd7-4368-8843-b724e947fa30 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] 10.222.0.18 "POST /compute/v2.1/servers/b89094ac-aee1-4bd6-a33d-8c4347cebfc7/action" status: 200 len: 36028 microversion: 2.20 time: 0.159650 Dec 15 03:06:10.953404 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: [pid: 116156|app: 0|req: 264/498] 10.222.0.18 () {62 vars in 1318 bytes} [Wed Dec 15 03:06:10 2021] POST /compute/v2.1/servers/b89094ac-aee1-4bd6-a33d-8c4347cebfc7/action => generated 36028 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 15 03:06:11.514541 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi [None req-356cd737-bc94-4ccb-aca2-9c7d2bd4500e tempest-AttachVolumeNegativeTest-1640336653 tempest-AttachVolumeNegativeTest-1640336653-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "68f59cc5-ee11-4864-8215-4c70657ca1a5"}} {{(pid=116157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 03:06:11.515594 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.compute.api [None req-356cd737-bc94-4ccb-aca2-9c7d2bd4500e tempest-AttachVolumeNegativeTest-1640336653 tempest-AttachVolumeNegativeTest-1640336653-project] [instance: 46fc96ad-6439-40ca-b2b9-ffe3b3e9bb17] Fetching instance by UUID {{(pid=116157) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:06:11.525795 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-356cd737-bc94-4ccb-aca2-9c7d2bd4500e tempest-AttachVolumeNegativeTest-1640336653 tempest-AttachVolumeNegativeTest-1640336653-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:06:11.526268 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-356cd737-bc94-4ccb-aca2-9c7d2bd4500e tempest-AttachVolumeNegativeTest-1640336653 tempest-AttachVolumeNegativeTest-1640336653-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:06:11.527054 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-356cd737-bc94-4ccb-aca2-9c7d2bd4500e tempest-AttachVolumeNegativeTest-1640336653 tempest-AttachVolumeNegativeTest-1640336653-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:06:11.527607 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-356cd737-bc94-4ccb-aca2-9c7d2bd4500e tempest-AttachVolumeNegativeTest-1640336653 tempest-AttachVolumeNegativeTest-1640336653-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:06:11.925378 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi [None req-7954714f-3746-4a2f-8349-d108a1b9d87e tempest-ServerRescueNegativeTestJSON-2061875223 tempest-ServerRescueNegativeTestJSON-2061875223-project] Calling method '>' {{(pid=116156) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:06:11.927056 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: INFO nova.api.openstack.requestlog [None req-356cd737-bc94-4ccb-aca2-9c7d2bd4500e tempest-AttachVolumeNegativeTest-1640336653 tempest-AttachVolumeNegativeTest-1640336653-project] 10.222.0.18 "POST /compute/v2.1/servers/46fc96ad-6439-40ca-b2b9-ffe3b3e9bb17/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.416644 Dec 15 03:06:11.927976 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.compute.api [None req-7954714f-3746-4a2f-8349-d108a1b9d87e tempest-ServerRescueNegativeTestJSON-2061875223 tempest-ServerRescueNegativeTestJSON-2061875223-project] [instance: 9bbb0abf-72a3-4fbc-8235-7a3ecfc8d006] Fetching instance by UUID {{(pid=116156) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:06:11.948603 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-7954714f-3746-4a2f-8349-d108a1b9d87e tempest-ServerRescueNegativeTestJSON-2061875223 tempest-ServerRescueNegativeTestJSON-2061875223-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:06:11.948881 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: [pid: 116157|app: 0|req: 235/499] 10.222.0.18 () {60 vars in 1322 bytes} [Wed Dec 15 03:06:11 2021] POST /compute/v2.1/servers/46fc96ad-6439-40ca-b2b9-ffe3b3e9bb17/os-volume_attachments => generated 194 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 03:06:11.950667 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-7954714f-3746-4a2f-8349-d108a1b9d87e tempest-ServerRescueNegativeTestJSON-2061875223 tempest-ServerRescueNegativeTestJSON-2061875223-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:06:11.952540 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-7954714f-3746-4a2f-8349-d108a1b9d87e tempest-ServerRescueNegativeTestJSON-2061875223 tempest-ServerRescueNegativeTestJSON-2061875223-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:06:11.952979 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-7954714f-3746-4a2f-8349-d108a1b9d87e tempest-ServerRescueNegativeTestJSON-2061875223 tempest-ServerRescueNegativeTestJSON-2061875223-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:06:11.976248 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi [None req-a6c98884-b982-42e4-aefc-109e86653f4b tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 03:06:11.980902 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.compute.api [None req-a6c98884-b982-42e4-aefc-109e86653f4b tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] [instance: b89094ac-aee1-4bd6-a33d-8c4347cebfc7] Fetching instance by UUID {{(pid=116157) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:06:12.016968 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-a6c98884-b982-42e4-aefc-109e86653f4b tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:06:12.031756 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-a6c98884-b982-42e4-aefc-109e86653f4b tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:06:12.031756 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-a6c98884-b982-42e4-aefc-109e86653f4b tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:06:12.031756 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-a6c98884-b982-42e4-aefc-109e86653f4b tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:06:12.192381 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.policy [None req-7954714f-3746-4a2f-8349-d108a1b9d87e tempest-ServerRescueNegativeTestJSON-2061875223 tempest-ServerRescueNegativeTestJSON-2061875223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ea02b6e8f1548a1bd78952cb7337403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5e8a958d4bf43868502b13728b9583b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116156) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:06:12.205078 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: INFO nova.api.openstack.requestlog [None req-7954714f-3746-4a2f-8349-d108a1b9d87e tempest-ServerRescueNegativeTestJSON-2061875223 tempest-ServerRescueNegativeTestJSON-2061875223-project] 10.222.0.18 "GET /compute/v2.1/servers/9bbb0abf-72a3-4fbc-8235-7a3ecfc8d006" status: 200 len: 1521 microversion: 2.1 time: 0.285660 Dec 15 03:06:12.207949 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: [pid: 116156|app: 0|req: 265/500] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 03:06:11 2021] GET /compute/v2.1/servers/9bbb0abf-72a3-4fbc-8235-7a3ecfc8d006 => generated 1521 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 03:06:12.273630 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: INFO nova.api.openstack.requestlog [None req-a6c98884-b982-42e4-aefc-109e86653f4b tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] 10.222.0.18 "POST /compute/v2.1/servers/b89094ac-aee1-4bd6-a33d-8c4347cebfc7/action" status: 200 len: 36990 microversion: 2.20 time: 0.310955 Dec 15 03:06:12.278855 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: [pid: 116157|app: 0|req: 236/501] 10.222.0.18 () {62 vars in 1318 bytes} [Wed Dec 15 03:06:11 2021] POST /compute/v2.1/servers/b89094ac-aee1-4bd6-a33d-8c4347cebfc7/action => generated 36990 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 15 03:06:13.223177 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi [None req-7127c127-86c9-480b-b0f5-32b41cf76072 tempest-ServerRescueNegativeTestJSON-2061875223 tempest-ServerRescueNegativeTestJSON-2061875223-project] Calling method '>' {{(pid=116156) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:06:13.223918 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.compute.api [None req-7127c127-86c9-480b-b0f5-32b41cf76072 tempest-ServerRescueNegativeTestJSON-2061875223 tempest-ServerRescueNegativeTestJSON-2061875223-project] [instance: 9bbb0abf-72a3-4fbc-8235-7a3ecfc8d006] Fetching instance by UUID {{(pid=116156) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:06:13.231764 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-7127c127-86c9-480b-b0f5-32b41cf76072 tempest-ServerRescueNegativeTestJSON-2061875223 tempest-ServerRescueNegativeTestJSON-2061875223-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:06:13.232423 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-7127c127-86c9-480b-b0f5-32b41cf76072 tempest-ServerRescueNegativeTestJSON-2061875223 tempest-ServerRescueNegativeTestJSON-2061875223-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:06:13.233455 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-7127c127-86c9-480b-b0f5-32b41cf76072 tempest-ServerRescueNegativeTestJSON-2061875223 tempest-ServerRescueNegativeTestJSON-2061875223-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:06:13.234121 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-7127c127-86c9-480b-b0f5-32b41cf76072 tempest-ServerRescueNegativeTestJSON-2061875223 tempest-ServerRescueNegativeTestJSON-2061875223-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:06:13.290088 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi [None req-a08a0f40-d233-4af7-bc8d-40eff7a66c58 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 03:06:13.291290 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.compute.api [None req-a08a0f40-d233-4af7-bc8d-40eff7a66c58 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] [instance: b89094ac-aee1-4bd6-a33d-8c4347cebfc7] Fetching instance by UUID {{(pid=116157) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:06:13.306290 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-a08a0f40-d233-4af7-bc8d-40eff7a66c58 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:06:13.307095 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-a08a0f40-d233-4af7-bc8d-40eff7a66c58 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:06:13.308154 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-a08a0f40-d233-4af7-bc8d-40eff7a66c58 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:06:13.308765 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-a08a0f40-d233-4af7-bc8d-40eff7a66c58 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:06:13.429872 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: INFO nova.api.openstack.requestlog [None req-a08a0f40-d233-4af7-bc8d-40eff7a66c58 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] 10.222.0.18 "POST /compute/v2.1/servers/b89094ac-aee1-4bd6-a33d-8c4347cebfc7/action" status: 200 len: 37796 microversion: 2.20 time: 0.143805 Dec 15 03:06:13.435591 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: [pid: 116157|app: 0|req: 237/502] 10.222.0.18 () {62 vars in 1318 bytes} [Wed Dec 15 03:06:13 2021] POST /compute/v2.1/servers/b89094ac-aee1-4bd6-a33d-8c4347cebfc7/action => generated 37796 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Dec 15 03:06:13.566285 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.policy [None req-7127c127-86c9-480b-b0f5-32b41cf76072 tempest-ServerRescueNegativeTestJSON-2061875223 tempest-ServerRescueNegativeTestJSON-2061875223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ea02b6e8f1548a1bd78952cb7337403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5e8a958d4bf43868502b13728b9583b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116156) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:06:13.575480 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: INFO nova.api.openstack.requestlog [None req-7127c127-86c9-480b-b0f5-32b41cf76072 tempest-ServerRescueNegativeTestJSON-2061875223 tempest-ServerRescueNegativeTestJSON-2061875223-project] 10.222.0.18 "GET /compute/v2.1/servers/9bbb0abf-72a3-4fbc-8235-7a3ecfc8d006" status: 200 len: 1521 microversion: 2.1 time: 0.356592 Dec 15 03:06:13.587305 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: [pid: 116156|app: 0|req: 266/503] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 03:06:13 2021] GET /compute/v2.1/servers/9bbb0abf-72a3-4fbc-8235-7a3ecfc8d006 => generated 1521 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 03:06:14.443502 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi [None req-619d7bff-49ba-4217-bc1c-3ab4b304c8a4 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 03:06:14.445903 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.compute.api [None req-619d7bff-49ba-4217-bc1c-3ab4b304c8a4 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] [instance: b89094ac-aee1-4bd6-a33d-8c4347cebfc7] Fetching instance by UUID {{(pid=116157) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:06:14.457885 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-619d7bff-49ba-4217-bc1c-3ab4b304c8a4 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:06:14.458363 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-619d7bff-49ba-4217-bc1c-3ab4b304c8a4 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:06:14.464147 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-619d7bff-49ba-4217-bc1c-3ab4b304c8a4 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:06:14.465063 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-619d7bff-49ba-4217-bc1c-3ab4b304c8a4 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:06:14.594464 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi [None req-4057385e-249f-4850-ace8-76e57e34e608 tempest-ServerRescueNegativeTestJSON-2061875223 tempest-ServerRescueNegativeTestJSON-2061875223-project] Calling method '>' {{(pid=116156) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:06:14.595759 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.compute.api [None req-4057385e-249f-4850-ace8-76e57e34e608 tempest-ServerRescueNegativeTestJSON-2061875223 tempest-ServerRescueNegativeTestJSON-2061875223-project] [instance: 9bbb0abf-72a3-4fbc-8235-7a3ecfc8d006] Fetching instance by UUID {{(pid=116156) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:06:14.613548 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-4057385e-249f-4850-ace8-76e57e34e608 tempest-ServerRescueNegativeTestJSON-2061875223 tempest-ServerRescueNegativeTestJSON-2061875223-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:06:14.614402 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-4057385e-249f-4850-ace8-76e57e34e608 tempest-ServerRescueNegativeTestJSON-2061875223 tempest-ServerRescueNegativeTestJSON-2061875223-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:06:14.614745 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: INFO nova.api.openstack.requestlog [None req-619d7bff-49ba-4217-bc1c-3ab4b304c8a4 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] 10.222.0.18 "POST /compute/v2.1/servers/b89094ac-aee1-4bd6-a33d-8c4347cebfc7/action" status: 200 len: 38167 microversion: 2.20 time: 0.175656 Dec 15 03:06:14.615448 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-4057385e-249f-4850-ace8-76e57e34e608 tempest-ServerRescueNegativeTestJSON-2061875223 tempest-ServerRescueNegativeTestJSON-2061875223-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:06:14.615621 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: [pid: 116157|app: 0|req: 238/504] 10.222.0.18 () {62 vars in 1318 bytes} [Wed Dec 15 03:06:14 2021] POST /compute/v2.1/servers/b89094ac-aee1-4bd6-a33d-8c4347cebfc7/action => generated 38167 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 15 03:06:14.615897 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-4057385e-249f-4850-ace8-76e57e34e608 tempest-ServerRescueNegativeTestJSON-2061875223 tempest-ServerRescueNegativeTestJSON-2061875223-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:06:14.874952 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.policy [None req-4057385e-249f-4850-ace8-76e57e34e608 tempest-ServerRescueNegativeTestJSON-2061875223 tempest-ServerRescueNegativeTestJSON-2061875223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ea02b6e8f1548a1bd78952cb7337403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5e8a958d4bf43868502b13728b9583b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116156) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:06:14.891069 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: INFO nova.api.openstack.requestlog [None req-4057385e-249f-4850-ace8-76e57e34e608 tempest-ServerRescueNegativeTestJSON-2061875223 tempest-ServerRescueNegativeTestJSON-2061875223-project] 10.222.0.18 "GET /compute/v2.1/servers/9bbb0abf-72a3-4fbc-8235-7a3ecfc8d006" status: 200 len: 1521 microversion: 2.1 time: 0.300109 Dec 15 03:06:14.893443 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: [pid: 116156|app: 0|req: 267/505] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 03:06:14 2021] GET /compute/v2.1/servers/9bbb0abf-72a3-4fbc-8235-7a3ecfc8d006 => generated 1521 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 03:06:15.628060 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi [None req-edb248fe-8bda-4888-9caa-c9de67c48107 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 03:06:15.629081 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.compute.api [None req-edb248fe-8bda-4888-9caa-c9de67c48107 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] [instance: b89094ac-aee1-4bd6-a33d-8c4347cebfc7] Fetching instance by UUID {{(pid=116157) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:06:15.639234 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-edb248fe-8bda-4888-9caa-c9de67c48107 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:06:15.640085 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-edb248fe-8bda-4888-9caa-c9de67c48107 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:06:15.641119 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-edb248fe-8bda-4888-9caa-c9de67c48107 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:06:15.641777 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-edb248fe-8bda-4888-9caa-c9de67c48107 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:06:15.769692 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: INFO nova.api.openstack.requestlog [None req-edb248fe-8bda-4888-9caa-c9de67c48107 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] 10.222.0.18 "POST /compute/v2.1/servers/b89094ac-aee1-4bd6-a33d-8c4347cebfc7/action" status: 200 len: 38307 microversion: 2.20 time: 0.145818 Dec 15 03:06:15.771085 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: [pid: 116157|app: 0|req: 239/506] 10.222.0.18 () {62 vars in 1318 bytes} [Wed Dec 15 03:06:15 2021] POST /compute/v2.1/servers/b89094ac-aee1-4bd6-a33d-8c4347cebfc7/action => generated 38307 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 15 03:06:15.780564 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi [None req-d56d75da-0a80-4956-85c5-127525be904c tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Calling method '>' {{(pid=116156) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:06:15.781716 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.compute.api [None req-d56d75da-0a80-4956-85c5-127525be904c tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] [instance: b89094ac-aee1-4bd6-a33d-8c4347cebfc7] Fetching instance by UUID {{(pid=116156) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:06:15.792098 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-d56d75da-0a80-4956-85c5-127525be904c tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:06:15.792828 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-d56d75da-0a80-4956-85c5-127525be904c tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:06:15.793810 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-d56d75da-0a80-4956-85c5-127525be904c tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:06:15.794467 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-d56d75da-0a80-4956-85c5-127525be904c tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:06:15.821870 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: INFO nova.api.openstack.requestlog [None req-d56d75da-0a80-4956-85c5-127525be904c tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] 10.222.0.18 "GET /compute/v2.1/servers/b89094ac-aee1-4bd6-a33d-8c4347cebfc7/ips" status: 200 len: 151 microversion: 2.20 time: 0.044926 Dec 15 03:06:15.855725 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: [pid: 116156|app: 0|req: 268/507] 10.222.0.18 () {60 vars in 1288 bytes} [Wed Dec 15 03:06:15 2021] GET /compute/v2.1/servers/b89094ac-aee1-4bd6-a33d-8c4347cebfc7/ips => generated 151 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 03:06:15.911075 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi [None req-70c075c5-08c5-49e7-aa72-ac599bdbd686 tempest-ServerRescueNegativeTestJSON-2061875223 tempest-ServerRescueNegativeTestJSON-2061875223-project] Calling method '>' {{(pid=116157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:06:15.911791 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.compute.api [None req-70c075c5-08c5-49e7-aa72-ac599bdbd686 tempest-ServerRescueNegativeTestJSON-2061875223 tempest-ServerRescueNegativeTestJSON-2061875223-project] [instance: 9bbb0abf-72a3-4fbc-8235-7a3ecfc8d006] Fetching instance by UUID {{(pid=116157) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:06:15.922207 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-70c075c5-08c5-49e7-aa72-ac599bdbd686 tempest-ServerRescueNegativeTestJSON-2061875223 tempest-ServerRescueNegativeTestJSON-2061875223-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:06:15.926724 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-70c075c5-08c5-49e7-aa72-ac599bdbd686 tempest-ServerRescueNegativeTestJSON-2061875223 tempest-ServerRescueNegativeTestJSON-2061875223-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:06:15.927650 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-70c075c5-08c5-49e7-aa72-ac599bdbd686 tempest-ServerRescueNegativeTestJSON-2061875223 tempest-ServerRescueNegativeTestJSON-2061875223-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:06:15.928207 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-70c075c5-08c5-49e7-aa72-ac599bdbd686 tempest-ServerRescueNegativeTestJSON-2061875223 tempest-ServerRescueNegativeTestJSON-2061875223-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:06:16.294677 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.policy [None req-70c075c5-08c5-49e7-aa72-ac599bdbd686 tempest-ServerRescueNegativeTestJSON-2061875223 tempest-ServerRescueNegativeTestJSON-2061875223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ea02b6e8f1548a1bd78952cb7337403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5e8a958d4bf43868502b13728b9583b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116157) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:06:16.310292 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: INFO nova.api.openstack.requestlog [None req-70c075c5-08c5-49e7-aa72-ac599bdbd686 tempest-ServerRescueNegativeTestJSON-2061875223 tempest-ServerRescueNegativeTestJSON-2061875223-project] 10.222.0.18 "GET /compute/v2.1/servers/9bbb0abf-72a3-4fbc-8235-7a3ecfc8d006" status: 200 len: 1521 microversion: 2.1 time: 0.403378 Dec 15 03:06:16.311066 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: [pid: 116157|app: 0|req: 240/508] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 03:06:15 2021] GET /compute/v2.1/servers/9bbb0abf-72a3-4fbc-8235-7a3ecfc8d006 => generated 1521 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 03:06:17.328223 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi [None req-4bb98c0a-4428-45c7-bfe1-79f99c461e95 tempest-ServerRescueNegativeTestJSON-2061875223 tempest-ServerRescueNegativeTestJSON-2061875223-project] Calling method '>' {{(pid=116156) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:06:17.329875 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.compute.api [None req-4bb98c0a-4428-45c7-bfe1-79f99c461e95 tempest-ServerRescueNegativeTestJSON-2061875223 tempest-ServerRescueNegativeTestJSON-2061875223-project] [instance: 9bbb0abf-72a3-4fbc-8235-7a3ecfc8d006] Fetching instance by UUID {{(pid=116156) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:06:17.340853 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-4bb98c0a-4428-45c7-bfe1-79f99c461e95 tempest-ServerRescueNegativeTestJSON-2061875223 tempest-ServerRescueNegativeTestJSON-2061875223-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:06:17.341602 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-4bb98c0a-4428-45c7-bfe1-79f99c461e95 tempest-ServerRescueNegativeTestJSON-2061875223 tempest-ServerRescueNegativeTestJSON-2061875223-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:06:17.344264 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-4bb98c0a-4428-45c7-bfe1-79f99c461e95 tempest-ServerRescueNegativeTestJSON-2061875223 tempest-ServerRescueNegativeTestJSON-2061875223-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:06:17.345810 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-4bb98c0a-4428-45c7-bfe1-79f99c461e95 tempest-ServerRescueNegativeTestJSON-2061875223 tempest-ServerRescueNegativeTestJSON-2061875223-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:06:17.586121 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.policy [None req-4bb98c0a-4428-45c7-bfe1-79f99c461e95 tempest-ServerRescueNegativeTestJSON-2061875223 tempest-ServerRescueNegativeTestJSON-2061875223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ea02b6e8f1548a1bd78952cb7337403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5e8a958d4bf43868502b13728b9583b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116156) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:06:17.597618 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: INFO nova.api.openstack.requestlog [None req-4bb98c0a-4428-45c7-bfe1-79f99c461e95 tempest-ServerRescueNegativeTestJSON-2061875223 tempest-ServerRescueNegativeTestJSON-2061875223-project] 10.222.0.18 "GET /compute/v2.1/servers/9bbb0abf-72a3-4fbc-8235-7a3ecfc8d006" status: 200 len: 1521 microversion: 2.1 time: 0.272858 Dec 15 03:06:17.607360 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: [pid: 116156|app: 0|req: 269/509] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 03:06:17 2021] GET /compute/v2.1/servers/9bbb0abf-72a3-4fbc-8235-7a3ecfc8d006 => generated 1521 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 03:06:18.269827 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi [req-99c4d362-fe18-40c2-8ca5-5a2759d5b7b8 req-fb6b679f-e0be-4ae7-b632-9b1e8a9eb31f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9bbb0abf-72a3-4fbc-8235-7a3ecfc8d006", "name": "network-vif-deleted", "tag": "7b1a4626-5ae6-4522-8d7b-19824de5f496"}]} {{(pid=116157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 03:06:18.271724 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 15 03:06:18.271724 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: warnings.warn(msg) Dec 15 03:06:18.299875 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [req-99c4d362-fe18-40c2-8ca5-5a2759d5b7b8 req-fb6b679f-e0be-4ae7-b632-9b1e8a9eb31f service nova] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:06:18.300323 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [req-99c4d362-fe18-40c2-8ca5-5a2759d5b7b8 req-fb6b679f-e0be-4ae7-b632-9b1e8a9eb31f service nova] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:06:18.333622 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: INFO nova.api.openstack.compute.server_external_events [req-99c4d362-fe18-40c2-8ca5-5a2759d5b7b8 req-fb6b679f-e0be-4ae7-b632-9b1e8a9eb31f service nova] Creating event network-vif-deleted:7b1a4626-5ae6-4522-8d7b-19824de5f496 for instance 9bbb0abf-72a3-4fbc-8235-7a3ecfc8d006 on hv-cinder-81803 Dec 15 03:06:18.345581 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: INFO nova.api.openstack.requestlog [req-99c4d362-fe18-40c2-8ca5-5a2759d5b7b8 req-fb6b679f-e0be-4ae7-b632-9b1e8a9eb31f service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.080651 Dec 15 03:06:18.348131 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: [pid: 116157|app: 0|req: 241/510] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Dec 15 03:06:18 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 03:06:18.530925 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi [None req-19e17340-db37-42b5-a6fe-44237665c66b tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=116156) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 03:06:18.532069 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.compute.api [None req-19e17340-db37-42b5-a6fe-44237665c66b tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] [instance: b89094ac-aee1-4bd6-a33d-8c4347cebfc7] Fetching instance by UUID {{(pid=116156) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:06:18.542967 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-19e17340-db37-42b5-a6fe-44237665c66b tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:06:18.547482 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-19e17340-db37-42b5-a6fe-44237665c66b tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:06:18.549257 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-19e17340-db37-42b5-a6fe-44237665c66b tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:06:18.549863 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-19e17340-db37-42b5-a6fe-44237665c66b tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:06:18.590658 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.objects.instance [None req-19e17340-db37-42b5-a6fe-44237665c66b tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lazy-loading 'flavor' on Instance uuid b89094ac-aee1-4bd6-a33d-8c4347cebfc7 {{(pid=116156) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Dec 15 03:06:18.616182 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi [None req-52f8dfb2-704f-43ee-a836-1288bc1e519e tempest-ServerRescueNegativeTestJSON-2061875223 tempest-ServerRescueNegativeTestJSON-2061875223-project] Calling method '>' {{(pid=116157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:06:18.616872 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.compute.api [None req-52f8dfb2-704f-43ee-a836-1288bc1e519e tempest-ServerRescueNegativeTestJSON-2061875223 tempest-ServerRescueNegativeTestJSON-2061875223-project] [instance: 9bbb0abf-72a3-4fbc-8235-7a3ecfc8d006] Fetching instance by UUID {{(pid=116157) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:06:18.627043 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-52f8dfb2-704f-43ee-a836-1288bc1e519e tempest-ServerRescueNegativeTestJSON-2061875223 tempest-ServerRescueNegativeTestJSON-2061875223-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:06:18.627625 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-52f8dfb2-704f-43ee-a836-1288bc1e519e tempest-ServerRescueNegativeTestJSON-2061875223 tempest-ServerRescueNegativeTestJSON-2061875223-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:06:18.635712 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-52f8dfb2-704f-43ee-a836-1288bc1e519e tempest-ServerRescueNegativeTestJSON-2061875223 tempest-ServerRescueNegativeTestJSON-2061875223-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:06:18.638032 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-52f8dfb2-704f-43ee-a836-1288bc1e519e tempest-ServerRescueNegativeTestJSON-2061875223 tempest-ServerRescueNegativeTestJSON-2061875223-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:06:18.717446 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-52f8dfb2-704f-43ee-a836-1288bc1e519e tempest-ServerRescueNegativeTestJSON-2061875223 tempest-ServerRescueNegativeTestJSON-2061875223-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:06:18.724609 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-52f8dfb2-704f-43ee-a836-1288bc1e519e tempest-ServerRescueNegativeTestJSON-2061875223 tempest-ServerRescueNegativeTestJSON-2061875223-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:06:18.728249 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.objects.instance [None req-52f8dfb2-704f-43ee-a836-1288bc1e519e tempest-ServerRescueNegativeTestJSON-2061875223 tempest-ServerRescueNegativeTestJSON-2061875223-project] Lazy-loading 'fault' on Instance uuid 9bbb0abf-72a3-4fbc-8235-7a3ecfc8d006 {{(pid=116157) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Dec 15 03:06:18.788430 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.policy [None req-52f8dfb2-704f-43ee-a836-1288bc1e519e tempest-ServerRescueNegativeTestJSON-2061875223 tempest-ServerRescueNegativeTestJSON-2061875223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ea02b6e8f1548a1bd78952cb7337403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5e8a958d4bf43868502b13728b9583b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116157) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:06:18.825321 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: INFO nova.api.openstack.requestlog [None req-52f8dfb2-704f-43ee-a836-1288bc1e519e tempest-ServerRescueNegativeTestJSON-2061875223 tempest-ServerRescueNegativeTestJSON-2061875223-project] 10.222.0.18 "GET /compute/v2.1/servers/9bbb0abf-72a3-4fbc-8235-7a3ecfc8d006" status: 200 len: 1311 microversion: 2.1 time: 0.212930 Dec 15 03:06:18.830590 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: [pid: 116157|app: 0|req: 242/511] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 03:06:18 2021] GET /compute/v2.1/servers/9bbb0abf-72a3-4fbc-8235-7a3ecfc8d006 => generated 1311 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 03:06:19.847549 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi [None req-b0c855d5-dec2-49dd-9a5a-6ff0d011ad6b tempest-ServerRescueNegativeTestJSON-2061875223 tempest-ServerRescueNegativeTestJSON-2061875223-project] Calling method '>' {{(pid=116157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:06:19.848741 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.compute.api [None req-b0c855d5-dec2-49dd-9a5a-6ff0d011ad6b tempest-ServerRescueNegativeTestJSON-2061875223 tempest-ServerRescueNegativeTestJSON-2061875223-project] [instance: 9bbb0abf-72a3-4fbc-8235-7a3ecfc8d006] Fetching instance by UUID {{(pid=116157) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:06:19.857178 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-b0c855d5-dec2-49dd-9a5a-6ff0d011ad6b tempest-ServerRescueNegativeTestJSON-2061875223 tempest-ServerRescueNegativeTestJSON-2061875223-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:06:19.866710 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-b0c855d5-dec2-49dd-9a5a-6ff0d011ad6b tempest-ServerRescueNegativeTestJSON-2061875223 tempest-ServerRescueNegativeTestJSON-2061875223-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:06:19.867978 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-b0c855d5-dec2-49dd-9a5a-6ff0d011ad6b tempest-ServerRescueNegativeTestJSON-2061875223 tempest-ServerRescueNegativeTestJSON-2061875223-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:06:19.868579 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-b0c855d5-dec2-49dd-9a5a-6ff0d011ad6b tempest-ServerRescueNegativeTestJSON-2061875223 tempest-ServerRescueNegativeTestJSON-2061875223-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:06:19.885340 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: INFO nova.api.openstack.wsgi [None req-b0c855d5-dec2-49dd-9a5a-6ff0d011ad6b tempest-ServerRescueNegativeTestJSON-2061875223 tempest-ServerRescueNegativeTestJSON-2061875223-project] HTTP exception thrown: Instance 9bbb0abf-72a3-4fbc-8235-7a3ecfc8d006 could not be found. Dec 15 03:06:19.894812 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi [None req-b0c855d5-dec2-49dd-9a5a-6ff0d011ad6b tempest-ServerRescueNegativeTestJSON-2061875223 tempest-ServerRescueNegativeTestJSON-2061875223-project] Returning 404 to user: Instance 9bbb0abf-72a3-4fbc-8235-7a3ecfc8d006 could not be found. {{(pid=116157) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 15 03:06:19.895680 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: INFO nova.api.openstack.requestlog [None req-b0c855d5-dec2-49dd-9a5a-6ff0d011ad6b tempest-ServerRescueNegativeTestJSON-2061875223 tempest-ServerRescueNegativeTestJSON-2061875223-project] 10.222.0.18 "GET /compute/v2.1/servers/9bbb0abf-72a3-4fbc-8235-7a3ecfc8d006" status: 404 len: 111 microversion: 2.1 time: 0.052342 Dec 15 03:06:19.899904 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: [pid: 116157|app: 0|req: 243/512] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 03:06:19 2021] GET /compute/v2.1/servers/9bbb0abf-72a3-4fbc-8235-7a3ecfc8d006 => generated 111 bytes in 57 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 15 03:06:19.962267 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi [None req-1d73a20c-befd-4f56-994d-6f3aa9aead9b tempest-AttachVolumeNegativeTest-1640336653 tempest-AttachVolumeNegativeTest-1640336653-project] Calling method '>' {{(pid=116157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:06:19.962765 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.compute.api [None req-1d73a20c-befd-4f56-994d-6f3aa9aead9b tempest-AttachVolumeNegativeTest-1640336653 tempest-AttachVolumeNegativeTest-1640336653-project] [instance: 46fc96ad-6439-40ca-b2b9-ffe3b3e9bb17] Fetching instance by UUID {{(pid=116157) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:06:19.969304 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-1d73a20c-befd-4f56-994d-6f3aa9aead9b tempest-AttachVolumeNegativeTest-1640336653 tempest-AttachVolumeNegativeTest-1640336653-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:06:19.969753 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-1d73a20c-befd-4f56-994d-6f3aa9aead9b tempest-AttachVolumeNegativeTest-1640336653 tempest-AttachVolumeNegativeTest-1640336653-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:06:19.982732 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-1d73a20c-befd-4f56-994d-6f3aa9aead9b tempest-AttachVolumeNegativeTest-1640336653 tempest-AttachVolumeNegativeTest-1640336653-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:06:19.984220 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-1d73a20c-befd-4f56-994d-6f3aa9aead9b tempest-AttachVolumeNegativeTest-1640336653 tempest-AttachVolumeNegativeTest-1640336653-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:06:20.191385 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.objects.instance [None req-1d73a20c-befd-4f56-994d-6f3aa9aead9b tempest-AttachVolumeNegativeTest-1640336653 tempest-AttachVolumeNegativeTest-1640336653-project] Lazy-loading 'services' on Instance uuid 46fc96ad-6439-40ca-b2b9-ffe3b3e9bb17 {{(pid=116157) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Dec 15 03:06:20.318625 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: INFO nova.api.openstack.requestlog [None req-1d73a20c-befd-4f56-994d-6f3aa9aead9b tempest-AttachVolumeNegativeTest-1640336653 tempest-AttachVolumeNegativeTest-1640336653-project] 10.222.0.18 "DELETE /compute/v2.1/servers/46fc96ad-6439-40ca-b2b9-ffe3b3e9bb17/os-volume_attachments/68f59cc5-ee11-4864-8215-4c70657ca1a5" status: 202 len: 0 microversion: 2.1 time: 0.360333 Dec 15 03:06:20.319514 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: [pid: 116157|app: 0|req: 244/513] 10.222.0.18 () {58 vars in 1415 bytes} [Wed Dec 15 03:06:19 2021] DELETE /compute/v2.1/servers/46fc96ad-6439-40ca-b2b9-ffe3b3e9bb17/os-volume_attachments/68f59cc5-ee11-4864-8215-4c70657ca1a5 => generated 0 bytes in 362 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Dec 15 03:06:20.330986 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi [None req-1144c1b8-90cf-4686-834b-e1e7f18eb964 tempest-AttachVolumeNegativeTest-1640336653 tempest-AttachVolumeNegativeTest-1640336653-project] Calling method '>' {{(pid=116157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:06:20.332170 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.compute.api [None req-1144c1b8-90cf-4686-834b-e1e7f18eb964 tempest-AttachVolumeNegativeTest-1640336653 tempest-AttachVolumeNegativeTest-1640336653-project] [instance: 46fc96ad-6439-40ca-b2b9-ffe3b3e9bb17] Fetching instance by UUID {{(pid=116157) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:06:20.351739 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-1144c1b8-90cf-4686-834b-e1e7f18eb964 tempest-AttachVolumeNegativeTest-1640336653 tempest-AttachVolumeNegativeTest-1640336653-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:06:20.352560 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-1144c1b8-90cf-4686-834b-e1e7f18eb964 tempest-AttachVolumeNegativeTest-1640336653 tempest-AttachVolumeNegativeTest-1640336653-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:06:20.353575 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-1144c1b8-90cf-4686-834b-e1e7f18eb964 tempest-AttachVolumeNegativeTest-1640336653 tempest-AttachVolumeNegativeTest-1640336653-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:06:20.354293 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-1144c1b8-90cf-4686-834b-e1e7f18eb964 tempest-AttachVolumeNegativeTest-1640336653 tempest-AttachVolumeNegativeTest-1640336653-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:06:20.436532 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: INFO nova.api.openstack.requestlog [None req-1144c1b8-90cf-4686-834b-e1e7f18eb964 tempest-AttachVolumeNegativeTest-1640336653 tempest-AttachVolumeNegativeTest-1640336653-project] 10.222.0.18 "GET /compute/v2.1/servers/46fc96ad-6439-40ca-b2b9-ffe3b3e9bb17/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.110159 Dec 15 03:06:20.441337 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: [pid: 116157|app: 0|req: 245/514] 10.222.0.18 () {58 vars in 1301 bytes} [Wed Dec 15 03:06:20 2021] GET /compute/v2.1/servers/46fc96ad-6439-40ca-b2b9-ffe3b3e9bb17/os-volume_attachments => generated 197 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 03:06:21.456485 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi [None req-ef095a51-db02-41b4-b3a3-f08373d48448 tempest-AttachVolumeNegativeTest-1640336653 tempest-AttachVolumeNegativeTest-1640336653-project] Calling method '>' {{(pid=116157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:06:21.458129 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.compute.api [None req-ef095a51-db02-41b4-b3a3-f08373d48448 tempest-AttachVolumeNegativeTest-1640336653 tempest-AttachVolumeNegativeTest-1640336653-project] [instance: 46fc96ad-6439-40ca-b2b9-ffe3b3e9bb17] Fetching instance by UUID {{(pid=116157) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:06:21.476602 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-ef095a51-db02-41b4-b3a3-f08373d48448 tempest-AttachVolumeNegativeTest-1640336653 tempest-AttachVolumeNegativeTest-1640336653-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:06:21.477084 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-ef095a51-db02-41b4-b3a3-f08373d48448 tempest-AttachVolumeNegativeTest-1640336653 tempest-AttachVolumeNegativeTest-1640336653-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:06:21.478089 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-ef095a51-db02-41b4-b3a3-f08373d48448 tempest-AttachVolumeNegativeTest-1640336653 tempest-AttachVolumeNegativeTest-1640336653-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:06:21.478606 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-ef095a51-db02-41b4-b3a3-f08373d48448 tempest-AttachVolumeNegativeTest-1640336653 tempest-AttachVolumeNegativeTest-1640336653-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:06:21.590753 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: INFO nova.api.openstack.requestlog [None req-ef095a51-db02-41b4-b3a3-f08373d48448 tempest-AttachVolumeNegativeTest-1640336653 tempest-AttachVolumeNegativeTest-1640336653-project] 10.222.0.18 "GET /compute/v2.1/servers/46fc96ad-6439-40ca-b2b9-ffe3b3e9bb17/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.140134 Dec 15 03:06:21.596512 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: [pid: 116157|app: 0|req: 246/515] 10.222.0.18 () {58 vars in 1301 bytes} [Wed Dec 15 03:06:21 2021] GET /compute/v2.1/servers/46fc96ad-6439-40ca-b2b9-ffe3b3e9bb17/os-volume_attachments => generated 197 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 03:06:22.606380 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi [None req-6a41b2f2-fee6-48df-96ec-850fd0ce68d8 tempest-AttachVolumeNegativeTest-1640336653 tempest-AttachVolumeNegativeTest-1640336653-project] Calling method '>' {{(pid=116157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:06:22.607296 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.compute.api [None req-6a41b2f2-fee6-48df-96ec-850fd0ce68d8 tempest-AttachVolumeNegativeTest-1640336653 tempest-AttachVolumeNegativeTest-1640336653-project] [instance: 46fc96ad-6439-40ca-b2b9-ffe3b3e9bb17] Fetching instance by UUID {{(pid=116157) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:06:22.622986 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-6a41b2f2-fee6-48df-96ec-850fd0ce68d8 tempest-AttachVolumeNegativeTest-1640336653 tempest-AttachVolumeNegativeTest-1640336653-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:06:22.623442 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-6a41b2f2-fee6-48df-96ec-850fd0ce68d8 tempest-AttachVolumeNegativeTest-1640336653 tempest-AttachVolumeNegativeTest-1640336653-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:06:22.624269 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-6a41b2f2-fee6-48df-96ec-850fd0ce68d8 tempest-AttachVolumeNegativeTest-1640336653 tempest-AttachVolumeNegativeTest-1640336653-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:06:22.624789 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-6a41b2f2-fee6-48df-96ec-850fd0ce68d8 tempest-AttachVolumeNegativeTest-1640336653 tempest-AttachVolumeNegativeTest-1640336653-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:06:22.746820 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: INFO nova.api.openstack.requestlog [None req-6a41b2f2-fee6-48df-96ec-850fd0ce68d8 tempest-AttachVolumeNegativeTest-1640336653 tempest-AttachVolumeNegativeTest-1640336653-project] 10.222.0.18 "GET /compute/v2.1/servers/46fc96ad-6439-40ca-b2b9-ffe3b3e9bb17/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.144036 Dec 15 03:06:22.747377 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: [pid: 116157|app: 0|req: 247/516] 10.222.0.18 () {58 vars in 1301 bytes} [Wed Dec 15 03:06:22 2021] GET /compute/v2.1/servers/46fc96ad-6439-40ca-b2b9-ffe3b3e9bb17/os-volume_attachments => generated 25 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Dec 15 03:06:23.181783 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: INFO nova.api.openstack.requestlog [None req-19e17340-db37-42b5-a6fe-44237665c66b tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] 10.222.0.18 "POST /compute/v2.1/servers/b89094ac-aee1-4bd6-a33d-8c4347cebfc7/action" status: 202 len: 0 microversion: 2.20 time: 4.654812 Dec 15 03:06:23.185186 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: [pid: 116156|app: 0|req: 270/517] 10.222.0.18 () {62 vars in 1318 bytes} [Wed Dec 15 03:06:18 2021] POST /compute/v2.1/servers/b89094ac-aee1-4bd6-a33d-8c4347cebfc7/action => generated 0 bytes in 4659 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Dec 15 03:06:23.192828 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi [None req-518509d1-f271-4e59-b061-a28c4504a783 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Calling method '>' {{(pid=116157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:06:23.193562 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.compute.api [None req-518509d1-f271-4e59-b061-a28c4504a783 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] [instance: b89094ac-aee1-4bd6-a33d-8c4347cebfc7] Fetching instance by UUID {{(pid=116157) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:06:23.205055 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-518509d1-f271-4e59-b061-a28c4504a783 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:06:23.206452 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-518509d1-f271-4e59-b061-a28c4504a783 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:06:23.213132 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-518509d1-f271-4e59-b061-a28c4504a783 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:06:23.216602 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-518509d1-f271-4e59-b061-a28c4504a783 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:06:24.179809 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi [None req-9c7c32a7-e82e-40e5-be71-71de4da05e60 tempest-AttachVolumeNegativeTest-1640336653 tempest-AttachVolumeNegativeTest-1640336653-project] Calling method '>' {{(pid=116156) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:06:24.180397 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.compute.api [None req-9c7c32a7-e82e-40e5-be71-71de4da05e60 tempest-AttachVolumeNegativeTest-1640336653 tempest-AttachVolumeNegativeTest-1640336653-project] [instance: 46fc96ad-6439-40ca-b2b9-ffe3b3e9bb17] Fetching instance by UUID {{(pid=116156) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:06:24.191691 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-9c7c32a7-e82e-40e5-be71-71de4da05e60 tempest-AttachVolumeNegativeTest-1640336653 tempest-AttachVolumeNegativeTest-1640336653-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:06:24.213868 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-9c7c32a7-e82e-40e5-be71-71de4da05e60 tempest-AttachVolumeNegativeTest-1640336653 tempest-AttachVolumeNegativeTest-1640336653-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:06:24.219448 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-9c7c32a7-e82e-40e5-be71-71de4da05e60 tempest-AttachVolumeNegativeTest-1640336653 tempest-AttachVolumeNegativeTest-1640336653-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:06:24.221553 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-9c7c32a7-e82e-40e5-be71-71de4da05e60 tempest-AttachVolumeNegativeTest-1640336653 tempest-AttachVolumeNegativeTest-1640336653-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:06:24.289748 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.compute.api [None req-9c7c32a7-e82e-40e5-be71-71de4da05e60 tempest-AttachVolumeNegativeTest-1640336653 tempest-AttachVolumeNegativeTest-1640336653-project] [instance: 46fc96ad-6439-40ca-b2b9-ffe3b3e9bb17] Going to try to terminate instance {{(pid=116156) delete /opt/stack/nova/nova/compute/api.py:2614}} Dec 15 03:06:24.460329 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.policy [None req-518509d1-f271-4e59-b061-a28c4504a783 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fedc11e2dbd74b919982a0657222cca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f16202549724b878f908d68384ec9c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116157) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:06:24.473525 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: INFO nova.api.openstack.requestlog [None req-9c7c32a7-e82e-40e5-be71-71de4da05e60 tempest-AttachVolumeNegativeTest-1640336653 tempest-AttachVolumeNegativeTest-1640336653-project] 10.222.0.18 "DELETE /compute/v2.1/servers/46fc96ad-6439-40ca-b2b9-ffe3b3e9bb17" status: 204 len: 0 microversion: 2.1 time: 0.297580 Dec 15 03:06:24.475046 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: [pid: 116156|app: 0|req: 271/518] 10.222.0.18 () {58 vars in 1238 bytes} [Wed Dec 15 03:06:24 2021] DELETE /compute/v2.1/servers/46fc96ad-6439-40ca-b2b9-ffe3b3e9bb17 => generated 0 bytes in 300 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Dec 15 03:06:24.484606 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi [None req-61e3e7d7-6deb-45c5-bdae-321f5c705ec7 tempest-AttachVolumeNegativeTest-1640336653 tempest-AttachVolumeNegativeTest-1640336653-project] Calling method '>' {{(pid=116156) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:06:24.487305 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.compute.api [None req-61e3e7d7-6deb-45c5-bdae-321f5c705ec7 tempest-AttachVolumeNegativeTest-1640336653 tempest-AttachVolumeNegativeTest-1640336653-project] [instance: 46fc96ad-6439-40ca-b2b9-ffe3b3e9bb17] Fetching instance by UUID {{(pid=116156) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:06:24.495942 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-61e3e7d7-6deb-45c5-bdae-321f5c705ec7 tempest-AttachVolumeNegativeTest-1640336653 tempest-AttachVolumeNegativeTest-1640336653-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:06:24.496649 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-61e3e7d7-6deb-45c5-bdae-321f5c705ec7 tempest-AttachVolumeNegativeTest-1640336653 tempest-AttachVolumeNegativeTest-1640336653-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:06:24.499124 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.policy [None req-518509d1-f271-4e59-b061-a28c4504a783 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fedc11e2dbd74b919982a0657222cca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f16202549724b878f908d68384ec9c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116157) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:06:24.500209 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-61e3e7d7-6deb-45c5-bdae-321f5c705ec7 tempest-AttachVolumeNegativeTest-1640336653 tempest-AttachVolumeNegativeTest-1640336653-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:06:24.503617 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-61e3e7d7-6deb-45c5-bdae-321f5c705ec7 tempest-AttachVolumeNegativeTest-1640336653 tempest-AttachVolumeNegativeTest-1640336653-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:06:24.507330 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.policy [None req-518509d1-f271-4e59-b061-a28c4504a783 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fedc11e2dbd74b919982a0657222cca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f16202549724b878f908d68384ec9c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116157) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:06:24.512247 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: INFO nova.api.openstack.requestlog [None req-518509d1-f271-4e59-b061-a28c4504a783 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] 10.222.0.18 "GET /compute/v2.1/servers/b89094ac-aee1-4bd6-a33d-8c4347cebfc7" status: 200 len: 1722 microversion: 2.20 time: 1.323383 Dec 15 03:06:24.514361 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: [pid: 116157|app: 0|req: 248/519] 10.222.0.18 () {60 vars in 1276 bytes} [Wed Dec 15 03:06:23 2021] GET /compute/v2.1/servers/b89094ac-aee1-4bd6-a33d-8c4347cebfc7 => generated 1722 bytes in 1328 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 03:06:25.007433 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.policy [None req-61e3e7d7-6deb-45c5-bdae-321f5c705ec7 tempest-AttachVolumeNegativeTest-1640336653 tempest-AttachVolumeNegativeTest-1640336653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35d37a3d8e504b8186182468b77dd114', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '409b41637da94c469444954258444b4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116156) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:06:25.022840 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: INFO nova.api.openstack.requestlog [None req-61e3e7d7-6deb-45c5-bdae-321f5c705ec7 tempest-AttachVolumeNegativeTest-1640336653 tempest-AttachVolumeNegativeTest-1640336653-project] 10.222.0.18 "GET /compute/v2.1/servers/46fc96ad-6439-40ca-b2b9-ffe3b3e9bb17" status: 200 len: 1513 microversion: 2.1 time: 0.541956 Dec 15 03:06:25.024189 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: [pid: 116156|app: 0|req: 272/520] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 03:06:24 2021] GET /compute/v2.1/servers/46fc96ad-6439-40ca-b2b9-ffe3b3e9bb17 => generated 1513 bytes in 546 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 03:06:25.531270 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi [None req-1f1e1eaf-f73f-428d-a7ea-8312caf35e2e tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Calling method '>' {{(pid=116157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:06:25.531889 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.compute.api [None req-1f1e1eaf-f73f-428d-a7ea-8312caf35e2e tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] [instance: b89094ac-aee1-4bd6-a33d-8c4347cebfc7] Fetching instance by UUID {{(pid=116157) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:06:25.541180 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-1f1e1eaf-f73f-428d-a7ea-8312caf35e2e tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:06:25.541846 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-1f1e1eaf-f73f-428d-a7ea-8312caf35e2e tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:06:25.542839 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-1f1e1eaf-f73f-428d-a7ea-8312caf35e2e tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:06:25.543316 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-1f1e1eaf-f73f-428d-a7ea-8312caf35e2e tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:06:25.726573 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.policy [None req-1f1e1eaf-f73f-428d-a7ea-8312caf35e2e tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fedc11e2dbd74b919982a0657222cca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f16202549724b878f908d68384ec9c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116157) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:06:25.737590 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.policy [None req-1f1e1eaf-f73f-428d-a7ea-8312caf35e2e tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fedc11e2dbd74b919982a0657222cca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f16202549724b878f908d68384ec9c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116157) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:06:25.742460 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.policy [None req-1f1e1eaf-f73f-428d-a7ea-8312caf35e2e tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fedc11e2dbd74b919982a0657222cca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f16202549724b878f908d68384ec9c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116157) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:06:25.743669 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: INFO nova.api.openstack.requestlog [None req-1f1e1eaf-f73f-428d-a7ea-8312caf35e2e tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] 10.222.0.18 "GET /compute/v2.1/servers/b89094ac-aee1-4bd6-a33d-8c4347cebfc7" status: 200 len: 1722 microversion: 2.20 time: 0.216172 Dec 15 03:06:25.744222 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: [pid: 116157|app: 0|req: 249/521] 10.222.0.18 () {60 vars in 1276 bytes} [Wed Dec 15 03:06:25 2021] GET /compute/v2.1/servers/b89094ac-aee1-4bd6-a33d-8c4347cebfc7 => generated 1722 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 03:06:26.042802 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi [None req-85454708-2869-4116-875a-ff0772f4dcd5 tempest-AttachVolumeNegativeTest-1640336653 tempest-AttachVolumeNegativeTest-1640336653-project] Calling method '>' {{(pid=116156) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:06:26.044709 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.compute.api [None req-85454708-2869-4116-875a-ff0772f4dcd5 tempest-AttachVolumeNegativeTest-1640336653 tempest-AttachVolumeNegativeTest-1640336653-project] [instance: 46fc96ad-6439-40ca-b2b9-ffe3b3e9bb17] Fetching instance by UUID {{(pid=116156) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:06:26.052449 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-85454708-2869-4116-875a-ff0772f4dcd5 tempest-AttachVolumeNegativeTest-1640336653 tempest-AttachVolumeNegativeTest-1640336653-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:06:26.052904 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-85454708-2869-4116-875a-ff0772f4dcd5 tempest-AttachVolumeNegativeTest-1640336653 tempest-AttachVolumeNegativeTest-1640336653-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:06:26.055677 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-85454708-2869-4116-875a-ff0772f4dcd5 tempest-AttachVolumeNegativeTest-1640336653 tempest-AttachVolumeNegativeTest-1640336653-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:06:26.056145 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-85454708-2869-4116-875a-ff0772f4dcd5 tempest-AttachVolumeNegativeTest-1640336653 tempest-AttachVolumeNegativeTest-1640336653-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:06:26.413199 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.policy [None req-85454708-2869-4116-875a-ff0772f4dcd5 tempest-AttachVolumeNegativeTest-1640336653 tempest-AttachVolumeNegativeTest-1640336653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35d37a3d8e504b8186182468b77dd114', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '409b41637da94c469444954258444b4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116156) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:06:26.421106 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: INFO nova.api.openstack.requestlog [None req-85454708-2869-4116-875a-ff0772f4dcd5 tempest-AttachVolumeNegativeTest-1640336653 tempest-AttachVolumeNegativeTest-1640336653-project] 10.222.0.18 "GET /compute/v2.1/servers/46fc96ad-6439-40ca-b2b9-ffe3b3e9bb17" status: 200 len: 1513 microversion: 2.1 time: 0.383961 Dec 15 03:06:26.424622 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: [pid: 116156|app: 0|req: 273/522] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 03:06:26 2021] GET /compute/v2.1/servers/46fc96ad-6439-40ca-b2b9-ffe3b3e9bb17 => generated 1513 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 03:06:26.472383 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi [None req-3ddb1832-e207-4322-b40f-e5b50f327a6d tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Action: 'create', calling method: .version_select at 0x7f126b6875e0>, body: {"keypair": {"name": "tempest-TestVolumeBootPattern-2120609320"}} {{(pid=116157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 03:06:26.497319 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.quota [None req-3ddb1832-e207-4322-b40f-e5b50f327a6d tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Getting quotas for project 494b56bf5eae4d56a5591546f85bc32b. Resources: {'key_pairs'} {{(pid=116157) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 15 03:06:26.501811 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.quota [None req-3ddb1832-e207-4322-b40f-e5b50f327a6d tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Getting quotas for user 97bdf19af9e34fc3886ff451cb9d7a27 and project 494b56bf5eae4d56a5591546f85bc32b. Resources: {'key_pairs'} {{(pid=116157) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 15 03:06:26.766419 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi [None req-38b05775-0f31-499e-b8ea-e2fa2cfc190f tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Calling method '>' {{(pid=116156) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:06:26.768296 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.compute.api [None req-38b05775-0f31-499e-b8ea-e2fa2cfc190f tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] [instance: b89094ac-aee1-4bd6-a33d-8c4347cebfc7] Fetching instance by UUID {{(pid=116156) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:06:26.783546 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-38b05775-0f31-499e-b8ea-e2fa2cfc190f tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:06:26.784915 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-38b05775-0f31-499e-b8ea-e2fa2cfc190f tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:06:26.787169 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-38b05775-0f31-499e-b8ea-e2fa2cfc190f tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:06:26.788258 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-38b05775-0f31-499e-b8ea-e2fa2cfc190f tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:06:26.802538 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.quota [None req-3ddb1832-e207-4322-b40f-e5b50f327a6d tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Getting quotas for project 494b56bf5eae4d56a5591546f85bc32b. Resources: {'key_pairs'} {{(pid=116157) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 15 03:06:26.809052 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.quota [None req-3ddb1832-e207-4322-b40f-e5b50f327a6d tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Getting quotas for user 97bdf19af9e34fc3886ff451cb9d7a27 and project 494b56bf5eae4d56a5591546f85bc32b. Resources: {'key_pairs'} {{(pid=116157) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 15 03:06:26.842172 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: INFO nova.api.openstack.requestlog [None req-3ddb1832-e207-4322-b40f-e5b50f327a6d tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] 10.222.0.18 "POST /compute/v2.1/os-keypairs" status: 200 len: 2319 microversion: 2.1 time: 0.659531 Dec 15 03:06:26.842984 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: [pid: 116157|app: 0|req: 250/523] 10.222.0.18 () {60 vars in 1157 bytes} [Wed Dec 15 03:06:26 2021] POST /compute/v2.1/os-keypairs => generated 2319 bytes in 661 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 03:06:26.971835 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.policy [None req-38b05775-0f31-499e-b8ea-e2fa2cfc190f tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fedc11e2dbd74b919982a0657222cca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f16202549724b878f908d68384ec9c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116156) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:06:26.984045 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.policy [None req-38b05775-0f31-499e-b8ea-e2fa2cfc190f tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fedc11e2dbd74b919982a0657222cca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f16202549724b878f908d68384ec9c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116156) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:06:26.985949 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.policy [None req-38b05775-0f31-499e-b8ea-e2fa2cfc190f tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fedc11e2dbd74b919982a0657222cca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f16202549724b878f908d68384ec9c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116156) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:06:26.987717 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: INFO nova.api.openstack.requestlog [None req-38b05775-0f31-499e-b8ea-e2fa2cfc190f tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] 10.222.0.18 "GET /compute/v2.1/servers/b89094ac-aee1-4bd6-a33d-8c4347cebfc7" status: 200 len: 1722 microversion: 2.20 time: 0.226315 Dec 15 03:06:26.995416 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: [pid: 116156|app: 0|req: 274/524] 10.222.0.18 () {60 vars in 1276 bytes} [Wed Dec 15 03:06:26 2021] GET /compute/v2.1/servers/b89094ac-aee1-4bd6-a33d-8c4347cebfc7 => generated 1722 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 03:06:27.439119 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi [None req-ea098b9f-526c-4eaf-8826-52c5687a49cf tempest-AttachVolumeNegativeTest-1640336653 tempest-AttachVolumeNegativeTest-1640336653-project] Calling method '>' {{(pid=116157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:06:27.439741 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.compute.api [None req-ea098b9f-526c-4eaf-8826-52c5687a49cf tempest-AttachVolumeNegativeTest-1640336653 tempest-AttachVolumeNegativeTest-1640336653-project] [instance: 46fc96ad-6439-40ca-b2b9-ffe3b3e9bb17] Fetching instance by UUID {{(pid=116157) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:06:27.456591 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-ea098b9f-526c-4eaf-8826-52c5687a49cf tempest-AttachVolumeNegativeTest-1640336653 tempest-AttachVolumeNegativeTest-1640336653-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:06:27.461316 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-ea098b9f-526c-4eaf-8826-52c5687a49cf tempest-AttachVolumeNegativeTest-1640336653 tempest-AttachVolumeNegativeTest-1640336653-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:06:27.465791 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-ea098b9f-526c-4eaf-8826-52c5687a49cf tempest-AttachVolumeNegativeTest-1640336653 tempest-AttachVolumeNegativeTest-1640336653-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:06:27.466482 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-ea098b9f-526c-4eaf-8826-52c5687a49cf tempest-AttachVolumeNegativeTest-1640336653 tempest-AttachVolumeNegativeTest-1640336653-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:06:27.955589 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.policy [None req-ea098b9f-526c-4eaf-8826-52c5687a49cf tempest-AttachVolumeNegativeTest-1640336653 tempest-AttachVolumeNegativeTest-1640336653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35d37a3d8e504b8186182468b77dd114', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '409b41637da94c469444954258444b4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116157) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:06:27.966757 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: INFO nova.api.openstack.requestlog [None req-ea098b9f-526c-4eaf-8826-52c5687a49cf tempest-AttachVolumeNegativeTest-1640336653 tempest-AttachVolumeNegativeTest-1640336653-project] 10.222.0.18 "GET /compute/v2.1/servers/46fc96ad-6439-40ca-b2b9-ffe3b3e9bb17" status: 200 len: 1513 microversion: 2.1 time: 0.531719 Dec 15 03:06:27.975886 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: [pid: 116157|app: 0|req: 251/525] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 03:06:27 2021] GET /compute/v2.1/servers/46fc96ad-6439-40ca-b2b9-ffe3b3e9bb17 => generated 1513 bytes in 541 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 03:06:28.007134 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi [None req-6fa8da8d-2b79-4c01-984b-759f7ae8da2c tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Calling method '>' {{(pid=116156) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:06:28.007752 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.compute.api [None req-6fa8da8d-2b79-4c01-984b-759f7ae8da2c tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] [instance: b89094ac-aee1-4bd6-a33d-8c4347cebfc7] Fetching instance by UUID {{(pid=116156) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:06:28.019917 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-6fa8da8d-2b79-4c01-984b-759f7ae8da2c tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:06:28.022227 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-6fa8da8d-2b79-4c01-984b-759f7ae8da2c tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:06:28.023291 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-6fa8da8d-2b79-4c01-984b-759f7ae8da2c tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:06:28.025948 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-6fa8da8d-2b79-4c01-984b-759f7ae8da2c tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:06:28.072725 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi [req-387e8014-b9ee-4674-9ce0-5c6f0bcd87a1 req-4ad2fc54-336b-47e7-9b16-26a8004f4064 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "46fc96ad-6439-40ca-b2b9-ffe3b3e9bb17", "name": "network-vif-deleted", "tag": "9010a98c-e7c8-42bc-8a01-5924495b7f7d"}]} {{(pid=116157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 03:06:28.075828 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 15 03:06:28.075828 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: warnings.warn(msg) Dec 15 03:06:28.091319 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [req-387e8014-b9ee-4674-9ce0-5c6f0bcd87a1 req-4ad2fc54-336b-47e7-9b16-26a8004f4064 service nova] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:06:28.092030 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [req-387e8014-b9ee-4674-9ce0-5c6f0bcd87a1 req-4ad2fc54-336b-47e7-9b16-26a8004f4064 service nova] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:06:28.140177 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: INFO nova.api.openstack.compute.server_external_events [req-387e8014-b9ee-4674-9ce0-5c6f0bcd87a1 req-4ad2fc54-336b-47e7-9b16-26a8004f4064 service nova] Creating event network-vif-deleted:9010a98c-e7c8-42bc-8a01-5924495b7f7d for instance 46fc96ad-6439-40ca-b2b9-ffe3b3e9bb17 on hv-cinder-81803 Dec 15 03:06:28.150816 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: INFO nova.api.openstack.requestlog [req-387e8014-b9ee-4674-9ce0-5c6f0bcd87a1 req-4ad2fc54-336b-47e7-9b16-26a8004f4064 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.081632 Dec 15 03:06:28.151703 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: [pid: 116157|app: 0|req: 252/526] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Dec 15 03:06:28 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 15 03:06:28.524115 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.policy [None req-6fa8da8d-2b79-4c01-984b-759f7ae8da2c tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fedc11e2dbd74b919982a0657222cca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f16202549724b878f908d68384ec9c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116156) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:06:28.538958 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.policy [None req-6fa8da8d-2b79-4c01-984b-759f7ae8da2c tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fedc11e2dbd74b919982a0657222cca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f16202549724b878f908d68384ec9c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116156) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:06:28.540962 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.policy [None req-6fa8da8d-2b79-4c01-984b-759f7ae8da2c tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fedc11e2dbd74b919982a0657222cca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f16202549724b878f908d68384ec9c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116156) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:06:28.542447 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: INFO nova.api.openstack.requestlog [None req-6fa8da8d-2b79-4c01-984b-759f7ae8da2c tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] 10.222.0.18 "GET /compute/v2.1/servers/b89094ac-aee1-4bd6-a33d-8c4347cebfc7" status: 200 len: 1722 microversion: 2.20 time: 0.539044 Dec 15 03:06:28.559896 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: [pid: 116156|app: 0|req: 275/527] 10.222.0.18 () {60 vars in 1276 bytes} [Wed Dec 15 03:06:28 2021] GET /compute/v2.1/servers/b89094ac-aee1-4bd6-a33d-8c4347cebfc7 => generated 1722 bytes in 557 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 03:06:28.983670 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi [None req-c6f7a7de-16ac-4f2b-9d75-802c638c9be4 tempest-AttachVolumeNegativeTest-1640336653 tempest-AttachVolumeNegativeTest-1640336653-project] Calling method '>' {{(pid=116157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:06:28.984570 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.compute.api [None req-c6f7a7de-16ac-4f2b-9d75-802c638c9be4 tempest-AttachVolumeNegativeTest-1640336653 tempest-AttachVolumeNegativeTest-1640336653-project] [instance: 46fc96ad-6439-40ca-b2b9-ffe3b3e9bb17] Fetching instance by UUID {{(pid=116157) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:06:28.997219 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-c6f7a7de-16ac-4f2b-9d75-802c638c9be4 tempest-AttachVolumeNegativeTest-1640336653 tempest-AttachVolumeNegativeTest-1640336653-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:06:28.997667 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-c6f7a7de-16ac-4f2b-9d75-802c638c9be4 tempest-AttachVolumeNegativeTest-1640336653 tempest-AttachVolumeNegativeTest-1640336653-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:06:28.998480 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-c6f7a7de-16ac-4f2b-9d75-802c638c9be4 tempest-AttachVolumeNegativeTest-1640336653 tempest-AttachVolumeNegativeTest-1640336653-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:06:29.005536 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-c6f7a7de-16ac-4f2b-9d75-802c638c9be4 tempest-AttachVolumeNegativeTest-1640336653 tempest-AttachVolumeNegativeTest-1640336653-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:06:29.022026 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi [None req-9c814c70-57a3-47d6-b335-8a01185380ca tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-1804461977", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-1219174885", "security_groups": [{"name": "tempest-secgroup-smoke-794886116"}], "networks": [{"uuid": "2bb09015-52be-4120-a2d5-3dd90fad6b22"}], "block_device_mapping_v2": [{"uuid": "b2770b3f-752c-4228-9adf-e3069b63305f", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=116156) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 03:06:29.055885 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-c6f7a7de-16ac-4f2b-9d75-802c638c9be4 tempest-AttachVolumeNegativeTest-1640336653 tempest-AttachVolumeNegativeTest-1640336653-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:06:29.057176 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-c6f7a7de-16ac-4f2b-9d75-802c638c9be4 tempest-AttachVolumeNegativeTest-1640336653 tempest-AttachVolumeNegativeTest-1640336653-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:06:29.057794 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.objects.instance [None req-c6f7a7de-16ac-4f2b-9d75-802c638c9be4 tempest-AttachVolumeNegativeTest-1640336653 tempest-AttachVolumeNegativeTest-1640336653-project] Lazy-loading 'fault' on Instance uuid 46fc96ad-6439-40ca-b2b9-ffe3b3e9bb17 {{(pid=116157) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Dec 15 03:06:29.140118 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.policy [None req-c6f7a7de-16ac-4f2b-9d75-802c638c9be4 tempest-AttachVolumeNegativeTest-1640336653 tempest-AttachVolumeNegativeTest-1640336653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35d37a3d8e504b8186182468b77dd114', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '409b41637da94c469444954258444b4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116157) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:06:29.151918 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: INFO nova.api.openstack.requestlog [None req-c6f7a7de-16ac-4f2b-9d75-802c638c9be4 tempest-AttachVolumeNegativeTest-1640336653 tempest-AttachVolumeNegativeTest-1640336653-project] 10.222.0.18 "GET /compute/v2.1/servers/46fc96ad-6439-40ca-b2b9-ffe3b3e9bb17" status: 200 len: 1308 microversion: 2.1 time: 0.172333 Dec 15 03:06:29.164574 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: [pid: 116157|app: 0|req: 253/528] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 03:06:28 2021] GET /compute/v2.1/servers/46fc96ad-6439-40ca-b2b9-ffe3b3e9bb17 => generated 1308 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 03:06:29.348927 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.network.neutron [None req-9c814c70-57a3-47d6-b335-8a01185380ca tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] validate_networks() for [('2bb09015-52be-4120-a2d5-3dd90fad6b22', None, None, None, None, None)] {{(pid=116156) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Dec 15 03:06:29.569454 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi [None req-95541671-007c-403c-9770-eb46fd77bddf tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Calling method '>' {{(pid=116157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:06:29.570191 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.compute.api [None req-95541671-007c-403c-9770-eb46fd77bddf tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] [instance: b89094ac-aee1-4bd6-a33d-8c4347cebfc7] Fetching instance by UUID {{(pid=116157) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:06:29.579419 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-95541671-007c-403c-9770-eb46fd77bddf tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:06:29.581577 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-95541671-007c-403c-9770-eb46fd77bddf tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:06:29.582561 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-95541671-007c-403c-9770-eb46fd77bddf tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:06:29.585738 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-95541671-007c-403c-9770-eb46fd77bddf tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:06:29.890283 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.policy [None req-95541671-007c-403c-9770-eb46fd77bddf tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fedc11e2dbd74b919982a0657222cca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f16202549724b878f908d68384ec9c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116157) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:06:29.901288 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.policy [None req-95541671-007c-403c-9770-eb46fd77bddf tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fedc11e2dbd74b919982a0657222cca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f16202549724b878f908d68384ec9c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116157) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:06:29.906301 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.policy [None req-95541671-007c-403c-9770-eb46fd77bddf tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fedc11e2dbd74b919982a0657222cca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f16202549724b878f908d68384ec9c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116157) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:06:29.907569 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: INFO nova.api.openstack.requestlog [None req-95541671-007c-403c-9770-eb46fd77bddf tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] 10.222.0.18 "GET /compute/v2.1/servers/b89094ac-aee1-4bd6-a33d-8c4347cebfc7" status: 200 len: 1722 microversion: 2.20 time: 0.345138 Dec 15 03:06:29.910324 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: [pid: 116157|app: 0|req: 254/529] 10.222.0.18 () {60 vars in 1276 bytes} [Wed Dec 15 03:06:29 2021] GET /compute/v2.1/servers/b89094ac-aee1-4bd6-a33d-8c4347cebfc7 => generated 1722 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 03:06:29.950819 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.virt.hardware [None req-9c814c70-57a3-47d6-b335-8a01185380ca tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Flavor limits 0:0:0 {{(pid=116156) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Dec 15 03:06:29.951247 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.virt.hardware [None req-9c814c70-57a3-47d6-b335-8a01185380ca tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Image limits 0:0:0 {{(pid=116156) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Dec 15 03:06:29.951748 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.virt.hardware [None req-9c814c70-57a3-47d6-b335-8a01185380ca tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Flavor pref 0:0:0 {{(pid=116156) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Dec 15 03:06:29.952117 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.virt.hardware [None req-9c814c70-57a3-47d6-b335-8a01185380ca tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Image pref 0:0:0 {{(pid=116156) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Dec 15 03:06:29.952542 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.virt.hardware [None req-9c814c70-57a3-47d6-b335-8a01185380ca tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116156) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Dec 15 03:06:29.967290 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-9c814c70-57a3-47d6-b335-8a01185380ca tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:06:29.967752 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-9c814c70-57a3-47d6-b335-8a01185380ca tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:06:29.969619 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-9c814c70-57a3-47d6-b335-8a01185380ca tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:06:29.970148 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-9c814c70-57a3-47d6-b335-8a01185380ca tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:06:30.012295 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.quota [None req-9c814c70-57a3-47d6-b335-8a01185380ca tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Getting quotas for project 5a093d0bf43046aaa845f3cc115f3f5f. Resources: {'cores', 'instances', 'ram'} {{(pid=116156) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 15 03:06:30.017058 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.quota [None req-9c814c70-57a3-47d6-b335-8a01185380ca tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Getting quotas for user 6c4c0c82448e40ba801c0b52ec44e74a and project 5a093d0bf43046aaa845f3cc115f3f5f. Resources: {'cores', 'instances', 'ram'} {{(pid=116156) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 15 03:06:30.117454 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.compute.api [None req-9c814c70-57a3-47d6-b335-8a01185380ca tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Going to run 1 instances... {{(pid=116156) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Dec 15 03:06:30.120089 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.compute.api [None req-9c814c70-57a3-47d6-b335-8a01185380ca tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] [instance: fa7c86bc-c46f-4120-8f3d-d795f8d7c5cc] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='b2770b3f-752c-4228-9adf-e3069b63305f',volume_size=None,volume_type=None)] {{(pid=116156) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Dec 15 03:06:30.170489 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi [None req-196af2d7-aa08-4e56-9884-a75526fa4562 tempest-AttachVolumeNegativeTest-1640336653 tempest-AttachVolumeNegativeTest-1640336653-project] Calling method '>' {{(pid=116157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:06:30.172153 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.compute.api [None req-196af2d7-aa08-4e56-9884-a75526fa4562 tempest-AttachVolumeNegativeTest-1640336653 tempest-AttachVolumeNegativeTest-1640336653-project] [instance: 46fc96ad-6439-40ca-b2b9-ffe3b3e9bb17] Fetching instance by UUID {{(pid=116157) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:06:30.183844 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-196af2d7-aa08-4e56-9884-a75526fa4562 tempest-AttachVolumeNegativeTest-1640336653 tempest-AttachVolumeNegativeTest-1640336653-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:06:30.186644 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-196af2d7-aa08-4e56-9884-a75526fa4562 tempest-AttachVolumeNegativeTest-1640336653 tempest-AttachVolumeNegativeTest-1640336653-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:06:30.188272 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-196af2d7-aa08-4e56-9884-a75526fa4562 tempest-AttachVolumeNegativeTest-1640336653 tempest-AttachVolumeNegativeTest-1640336653-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:06:30.189465 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-196af2d7-aa08-4e56-9884-a75526fa4562 tempest-AttachVolumeNegativeTest-1640336653 tempest-AttachVolumeNegativeTest-1640336653-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:06:30.220661 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: INFO nova.api.openstack.wsgi [None req-196af2d7-aa08-4e56-9884-a75526fa4562 tempest-AttachVolumeNegativeTest-1640336653 tempest-AttachVolumeNegativeTest-1640336653-project] HTTP exception thrown: Instance 46fc96ad-6439-40ca-b2b9-ffe3b3e9bb17 could not be found. Dec 15 03:06:30.224065 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi [None req-196af2d7-aa08-4e56-9884-a75526fa4562 tempest-AttachVolumeNegativeTest-1640336653 tempest-AttachVolumeNegativeTest-1640336653-project] Returning 404 to user: Instance 46fc96ad-6439-40ca-b2b9-ffe3b3e9bb17 could not be found. {{(pid=116157) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 15 03:06:30.225202 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: INFO nova.api.openstack.requestlog [None req-196af2d7-aa08-4e56-9884-a75526fa4562 tempest-AttachVolumeNegativeTest-1640336653 tempest-AttachVolumeNegativeTest-1640336653-project] 10.222.0.18 "GET /compute/v2.1/servers/46fc96ad-6439-40ca-b2b9-ffe3b3e9bb17" status: 404 len: 111 microversion: 2.1 time: 0.059104 Dec 15 03:06:30.226028 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: [pid: 116157|app: 0|req: 255/530] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 03:06:30 2021] GET /compute/v2.1/servers/46fc96ad-6439-40ca-b2b9-ffe3b3e9bb17 => generated 111 bytes in 61 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 15 03:06:30.292096 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: INFO nova.api.openstack.requestlog [None req-9c814c70-57a3-47d6-b335-8a01185380ca tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 1.273581 Dec 15 03:06:30.292933 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: [pid: 116156|app: 0|req: 276/531] 10.222.0.18 () {60 vars in 1146 bytes} [Wed Dec 15 03:06:29 2021] POST /compute/v2.1/servers => generated 405 bytes in 1275 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Dec 15 03:06:30.304311 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi [None req-a91e1473-0f99-4167-ac27-3faca069cd12 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Calling method '>' {{(pid=116157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:06:30.305297 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.compute.api [None req-a91e1473-0f99-4167-ac27-3faca069cd12 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] [instance: fa7c86bc-c46f-4120-8f3d-d795f8d7c5cc] Fetching instance by UUID {{(pid=116157) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:06:30.419367 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.policy [None req-a91e1473-0f99-4167-ac27-3faca069cd12 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c4c0c82448e40ba801c0b52ec44e74a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a093d0bf43046aaa845f3cc115f3f5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116157) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:06:30.430142 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: INFO nova.api.openstack.requestlog [None req-a91e1473-0f99-4167-ac27-3faca069cd12 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] 10.222.0.18 "GET /compute/v2.1/servers/fa7c86bc-c46f-4120-8f3d-d795f8d7c5cc" status: 200 len: 1089 microversion: 2.1 time: 0.130377 Dec 15 03:06:30.431120 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: [pid: 116157|app: 0|req: 256/532] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 03:06:30 2021] GET /compute/v2.1/servers/fa7c86bc-c46f-4120-8f3d-d795f8d7c5cc => generated 1089 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 03:06:30.926986 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi [None req-0b94b270-3ec8-44d5-8141-b4d7693c5211 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Calling method '>' {{(pid=116156) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:06:30.928035 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.compute.api [None req-0b94b270-3ec8-44d5-8141-b4d7693c5211 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] [instance: b89094ac-aee1-4bd6-a33d-8c4347cebfc7] Fetching instance by UUID {{(pid=116156) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:06:30.937817 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-0b94b270-3ec8-44d5-8141-b4d7693c5211 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:06:30.939232 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-0b94b270-3ec8-44d5-8141-b4d7693c5211 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:06:30.940344 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-0b94b270-3ec8-44d5-8141-b4d7693c5211 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:06:30.941129 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-0b94b270-3ec8-44d5-8141-b4d7693c5211 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:06:31.122309 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.policy [None req-0b94b270-3ec8-44d5-8141-b4d7693c5211 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fedc11e2dbd74b919982a0657222cca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f16202549724b878f908d68384ec9c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116156) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:06:31.138292 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.policy [None req-0b94b270-3ec8-44d5-8141-b4d7693c5211 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fedc11e2dbd74b919982a0657222cca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f16202549724b878f908d68384ec9c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116156) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:06:31.139880 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.policy [None req-0b94b270-3ec8-44d5-8141-b4d7693c5211 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fedc11e2dbd74b919982a0657222cca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f16202549724b878f908d68384ec9c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116156) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:06:31.146745 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: INFO nova.api.openstack.requestlog [None req-0b94b270-3ec8-44d5-8141-b4d7693c5211 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] 10.222.0.18 "GET /compute/v2.1/servers/b89094ac-aee1-4bd6-a33d-8c4347cebfc7" status: 200 len: 1722 microversion: 2.20 time: 0.224370 Dec 15 03:06:31.147403 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: [pid: 116156|app: 0|req: 277/533] 10.222.0.18 () {60 vars in 1276 bytes} [Wed Dec 15 03:06:30 2021] GET /compute/v2.1/servers/b89094ac-aee1-4bd6-a33d-8c4347cebfc7 => generated 1722 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 03:06:31.433805 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi [None req-0a92ce5d-99be-4d1f-83b4-83cd45155a03 tempest-AttachVolumeNegativeTest-1640336653 tempest-AttachVolumeNegativeTest-1640336653-project] Calling method '>' {{(pid=116157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:06:31.434410 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.compute.api [None req-0a92ce5d-99be-4d1f-83b4-83cd45155a03 tempest-AttachVolumeNegativeTest-1640336653 tempest-AttachVolumeNegativeTest-1640336653-project] [instance: c3d5f143-e994-4098-989b-660411a8dd8f] Fetching instance by UUID {{(pid=116157) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:06:31.446056 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-0a92ce5d-99be-4d1f-83b4-83cd45155a03 tempest-AttachVolumeNegativeTest-1640336653 tempest-AttachVolumeNegativeTest-1640336653-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:06:31.448924 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi [None req-79721cb3-3ca2-41d7-8f20-9d5cae37c5d1 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Calling method '>' {{(pid=116156) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:06:31.449121 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-0a92ce5d-99be-4d1f-83b4-83cd45155a03 tempest-AttachVolumeNegativeTest-1640336653 tempest-AttachVolumeNegativeTest-1640336653-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:06:31.449752 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.compute.api [None req-79721cb3-3ca2-41d7-8f20-9d5cae37c5d1 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] [instance: fa7c86bc-c46f-4120-8f3d-d795f8d7c5cc] Fetching instance by UUID {{(pid=116156) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:06:31.450153 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-0a92ce5d-99be-4d1f-83b4-83cd45155a03 tempest-AttachVolumeNegativeTest-1640336653 tempest-AttachVolumeNegativeTest-1640336653-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:06:31.450600 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-0a92ce5d-99be-4d1f-83b4-83cd45155a03 tempest-AttachVolumeNegativeTest-1640336653 tempest-AttachVolumeNegativeTest-1640336653-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:06:31.458700 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-79721cb3-3ca2-41d7-8f20-9d5cae37c5d1 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:06:31.459206 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-79721cb3-3ca2-41d7-8f20-9d5cae37c5d1 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:06:31.465168 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-79721cb3-3ca2-41d7-8f20-9d5cae37c5d1 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:06:31.465892 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-79721cb3-3ca2-41d7-8f20-9d5cae37c5d1 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:06:31.496498 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.compute.api [None req-0a92ce5d-99be-4d1f-83b4-83cd45155a03 tempest-AttachVolumeNegativeTest-1640336653 tempest-AttachVolumeNegativeTest-1640336653-project] [instance: c3d5f143-e994-4098-989b-660411a8dd8f] Going to try to terminate instance {{(pid=116157) delete /opt/stack/nova/nova/compute/api.py:2614}} Dec 15 03:06:31.596379 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.policy [None req-79721cb3-3ca2-41d7-8f20-9d5cae37c5d1 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c4c0c82448e40ba801c0b52ec44e74a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a093d0bf43046aaa845f3cc115f3f5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116156) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:06:31.619100 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: INFO nova.api.openstack.requestlog [None req-0a92ce5d-99be-4d1f-83b4-83cd45155a03 tempest-AttachVolumeNegativeTest-1640336653 tempest-AttachVolumeNegativeTest-1640336653-project] 10.222.0.18 "DELETE /compute/v2.1/servers/c3d5f143-e994-4098-989b-660411a8dd8f" status: 204 len: 0 microversion: 2.1 time: 0.188957 Dec 15 03:06:31.619337 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: INFO nova.api.openstack.requestlog [None req-79721cb3-3ca2-41d7-8f20-9d5cae37c5d1 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] 10.222.0.18 "GET /compute/v2.1/servers/fa7c86bc-c46f-4120-8f3d-d795f8d7c5cc" status: 200 len: 1187 microversion: 2.1 time: 0.173948 Dec 15 03:06:31.622921 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: [pid: 116157|app: 0|req: 257/535] 10.222.0.18 () {58 vars in 1238 bytes} [Wed Dec 15 03:06:31 2021] DELETE /compute/v2.1/servers/c3d5f143-e994-4098-989b-660411a8dd8f => generated 0 bytes in 191 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Dec 15 03:06:31.623061 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: [pid: 116156|app: 0|req: 278/535] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 03:06:31 2021] GET /compute/v2.1/servers/fa7c86bc-c46f-4120-8f3d-d795f8d7c5cc => generated 1187 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 03:06:31.629621 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi [None req-7ef8d737-9fcc-44dc-b035-7a2cd79650e3 tempest-AttachVolumeNegativeTest-1640336653 tempest-AttachVolumeNegativeTest-1640336653-project] Calling method '>' {{(pid=116157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:06:31.630622 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.compute.api [None req-7ef8d737-9fcc-44dc-b035-7a2cd79650e3 tempest-AttachVolumeNegativeTest-1640336653 tempest-AttachVolumeNegativeTest-1640336653-project] [instance: c3d5f143-e994-4098-989b-660411a8dd8f] Fetching instance by UUID {{(pid=116157) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:06:31.639110 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-7ef8d737-9fcc-44dc-b035-7a2cd79650e3 tempest-AttachVolumeNegativeTest-1640336653 tempest-AttachVolumeNegativeTest-1640336653-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:06:31.639561 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-7ef8d737-9fcc-44dc-b035-7a2cd79650e3 tempest-AttachVolumeNegativeTest-1640336653 tempest-AttachVolumeNegativeTest-1640336653-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:06:31.640704 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-7ef8d737-9fcc-44dc-b035-7a2cd79650e3 tempest-AttachVolumeNegativeTest-1640336653 tempest-AttachVolumeNegativeTest-1640336653-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:06:31.641151 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-7ef8d737-9fcc-44dc-b035-7a2cd79650e3 tempest-AttachVolumeNegativeTest-1640336653 tempest-AttachVolumeNegativeTest-1640336653-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:06:31.899133 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.policy [None req-7ef8d737-9fcc-44dc-b035-7a2cd79650e3 tempest-AttachVolumeNegativeTest-1640336653 tempest-AttachVolumeNegativeTest-1640336653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35d37a3d8e504b8186182468b77dd114', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '409b41637da94c469444954258444b4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116157) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:06:31.906370 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: INFO nova.api.openstack.requestlog [None req-7ef8d737-9fcc-44dc-b035-7a2cd79650e3 tempest-AttachVolumeNegativeTest-1640336653 tempest-AttachVolumeNegativeTest-1640336653-project] 10.222.0.18 "GET /compute/v2.1/servers/c3d5f143-e994-4098-989b-660411a8dd8f" status: 200 len: 1513 microversion: 2.1 time: 0.281633 Dec 15 03:06:31.916822 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: [pid: 116157|app: 0|req: 258/536] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 03:06:31 2021] GET /compute/v2.1/servers/c3d5f143-e994-4098-989b-660411a8dd8f => generated 1513 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 03:06:32.174757 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi [None req-0f917925-34dd-4ac2-a026-16ebcf451eb8 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Calling method '>' {{(pid=116156) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:06:32.176346 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.compute.api [None req-0f917925-34dd-4ac2-a026-16ebcf451eb8 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] [instance: b89094ac-aee1-4bd6-a33d-8c4347cebfc7] Fetching instance by UUID {{(pid=116156) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:06:32.184784 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-0f917925-34dd-4ac2-a026-16ebcf451eb8 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:06:32.185615 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-0f917925-34dd-4ac2-a026-16ebcf451eb8 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:06:32.186756 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-0f917925-34dd-4ac2-a026-16ebcf451eb8 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:06:32.187423 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-0f917925-34dd-4ac2-a026-16ebcf451eb8 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:06:32.437553 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.policy [None req-0f917925-34dd-4ac2-a026-16ebcf451eb8 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fedc11e2dbd74b919982a0657222cca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f16202549724b878f908d68384ec9c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116156) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:06:32.447941 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.policy [None req-0f917925-34dd-4ac2-a026-16ebcf451eb8 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fedc11e2dbd74b919982a0657222cca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f16202549724b878f908d68384ec9c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116156) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:06:32.450679 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.policy [None req-0f917925-34dd-4ac2-a026-16ebcf451eb8 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fedc11e2dbd74b919982a0657222cca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f16202549724b878f908d68384ec9c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116156) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:06:32.452145 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: INFO nova.api.openstack.requestlog [None req-0f917925-34dd-4ac2-a026-16ebcf451eb8 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] 10.222.0.18 "GET /compute/v2.1/servers/b89094ac-aee1-4bd6-a33d-8c4347cebfc7" status: 200 len: 1722 microversion: 2.20 time: 0.288642 Dec 15 03:06:32.453062 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: [pid: 116156|app: 0|req: 279/537] 10.222.0.18 () {60 vars in 1276 bytes} [Wed Dec 15 03:06:32 2021] GET /compute/v2.1/servers/b89094ac-aee1-4bd6-a33d-8c4347cebfc7 => generated 1722 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 03:06:32.648193 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi [None req-951e8bec-2a63-4bb2-aa9c-00e110aed7d5 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Calling method '>' {{(pid=116157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:06:32.649346 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.compute.api [None req-951e8bec-2a63-4bb2-aa9c-00e110aed7d5 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] [instance: fa7c86bc-c46f-4120-8f3d-d795f8d7c5cc] Fetching instance by UUID {{(pid=116157) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:06:32.659884 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-951e8bec-2a63-4bb2-aa9c-00e110aed7d5 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:06:32.667955 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-951e8bec-2a63-4bb2-aa9c-00e110aed7d5 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:06:32.674627 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-951e8bec-2a63-4bb2-aa9c-00e110aed7d5 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:06:32.678153 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-951e8bec-2a63-4bb2-aa9c-00e110aed7d5 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:06:32.924608 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi [None req-599d6801-473d-4687-8133-2aa9c971c6ed tempest-AttachVolumeNegativeTest-1640336653 tempest-AttachVolumeNegativeTest-1640336653-project] Calling method '>' {{(pid=116156) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:06:32.925514 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.compute.api [None req-599d6801-473d-4687-8133-2aa9c971c6ed tempest-AttachVolumeNegativeTest-1640336653 tempest-AttachVolumeNegativeTest-1640336653-project] [instance: c3d5f143-e994-4098-989b-660411a8dd8f] Fetching instance by UUID {{(pid=116156) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:06:32.933072 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-599d6801-473d-4687-8133-2aa9c971c6ed tempest-AttachVolumeNegativeTest-1640336653 tempest-AttachVolumeNegativeTest-1640336653-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:06:32.934082 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-599d6801-473d-4687-8133-2aa9c971c6ed tempest-AttachVolumeNegativeTest-1640336653 tempest-AttachVolumeNegativeTest-1640336653-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:06:32.935032 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-599d6801-473d-4687-8133-2aa9c971c6ed tempest-AttachVolumeNegativeTest-1640336653 tempest-AttachVolumeNegativeTest-1640336653-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:06:32.935617 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-599d6801-473d-4687-8133-2aa9c971c6ed tempest-AttachVolumeNegativeTest-1640336653 tempest-AttachVolumeNegativeTest-1640336653-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:06:32.953574 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.policy [None req-951e8bec-2a63-4bb2-aa9c-00e110aed7d5 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c4c0c82448e40ba801c0b52ec44e74a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a093d0bf43046aaa845f3cc115f3f5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116157) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:06:32.964604 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: INFO nova.api.openstack.requestlog [None req-951e8bec-2a63-4bb2-aa9c-00e110aed7d5 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] 10.222.0.18 "GET /compute/v2.1/servers/fa7c86bc-c46f-4120-8f3d-d795f8d7c5cc" status: 200 len: 1272 microversion: 2.1 time: 0.331766 Dec 15 03:06:32.981956 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: [pid: 116157|app: 0|req: 259/538] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 03:06:32 2021] GET /compute/v2.1/servers/fa7c86bc-c46f-4120-8f3d-d795f8d7c5cc => generated 1272 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 03:06:33.241173 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.policy [None req-599d6801-473d-4687-8133-2aa9c971c6ed tempest-AttachVolumeNegativeTest-1640336653 tempest-AttachVolumeNegativeTest-1640336653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35d37a3d8e504b8186182468b77dd114', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '409b41637da94c469444954258444b4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116156) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:06:33.250741 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: INFO nova.api.openstack.requestlog [None req-599d6801-473d-4687-8133-2aa9c971c6ed tempest-AttachVolumeNegativeTest-1640336653 tempest-AttachVolumeNegativeTest-1640336653-project] 10.222.0.18 "GET /compute/v2.1/servers/c3d5f143-e994-4098-989b-660411a8dd8f" status: 200 len: 1513 microversion: 2.1 time: 0.330193 Dec 15 03:06:33.254307 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: [pid: 116156|app: 0|req: 280/539] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 03:06:32 2021] GET /compute/v2.1/servers/c3d5f143-e994-4098-989b-660411a8dd8f => generated 1513 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 03:06:33.471274 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi [None req-a0a7e3ef-604d-43c8-a7a5-72193309aa94 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Calling method '>' {{(pid=116157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:06:33.471994 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.compute.api [None req-a0a7e3ef-604d-43c8-a7a5-72193309aa94 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] [instance: b89094ac-aee1-4bd6-a33d-8c4347cebfc7] Fetching instance by UUID {{(pid=116157) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:06:33.481395 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-a0a7e3ef-604d-43c8-a7a5-72193309aa94 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:06:33.482003 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-a0a7e3ef-604d-43c8-a7a5-72193309aa94 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:06:33.484493 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-a0a7e3ef-604d-43c8-a7a5-72193309aa94 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:06:33.486077 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-a0a7e3ef-604d-43c8-a7a5-72193309aa94 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:06:33.951333 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.policy [None req-a0a7e3ef-604d-43c8-a7a5-72193309aa94 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fedc11e2dbd74b919982a0657222cca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f16202549724b878f908d68384ec9c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116157) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:06:33.963163 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.policy [None req-a0a7e3ef-604d-43c8-a7a5-72193309aa94 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fedc11e2dbd74b919982a0657222cca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f16202549724b878f908d68384ec9c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116157) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:06:33.964713 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.policy [None req-a0a7e3ef-604d-43c8-a7a5-72193309aa94 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fedc11e2dbd74b919982a0657222cca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f16202549724b878f908d68384ec9c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116157) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:06:33.965904 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: INFO nova.api.openstack.requestlog [None req-a0a7e3ef-604d-43c8-a7a5-72193309aa94 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] 10.222.0.18 "GET /compute/v2.1/servers/b89094ac-aee1-4bd6-a33d-8c4347cebfc7" status: 200 len: 1722 microversion: 2.20 time: 0.498808 Dec 15 03:06:33.979670 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: [pid: 116157|app: 0|req: 260/540] 10.222.0.18 () {60 vars in 1276 bytes} [Wed Dec 15 03:06:33 2021] GET /compute/v2.1/servers/b89094ac-aee1-4bd6-a33d-8c4347cebfc7 => generated 1722 bytes in 513 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 03:06:33.994094 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi [None req-a4062884-1799-4be9-b4ed-6e4c8d18ed44 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Calling method '>' {{(pid=116156) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:06:33.995138 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.compute.api [None req-a4062884-1799-4be9-b4ed-6e4c8d18ed44 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] [instance: fa7c86bc-c46f-4120-8f3d-d795f8d7c5cc] Fetching instance by UUID {{(pid=116156) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:06:34.009028 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-a4062884-1799-4be9-b4ed-6e4c8d18ed44 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:06:34.009755 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-a4062884-1799-4be9-b4ed-6e4c8d18ed44 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:06:34.011897 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-a4062884-1799-4be9-b4ed-6e4c8d18ed44 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:06:34.013623 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-a4062884-1799-4be9-b4ed-6e4c8d18ed44 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:06:34.233425 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi [req-a8664a64-793f-48b0-8ea1-d8b5cefd8024 req-a85f1037-b098-4853-b4b7-c82b7e474a59 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fa7c86bc-c46f-4120-8f3d-d795f8d7c5cc", "tag": "6bbc39c5-40bb-4350-a006-fae5a1ef78a6"}]} {{(pid=116157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 03:06:34.239807 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 15 03:06:34.239807 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: warnings.warn(msg) Dec 15 03:06:34.263655 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [req-a8664a64-793f-48b0-8ea1-d8b5cefd8024 req-a85f1037-b098-4853-b4b7-c82b7e474a59 service nova] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:06:34.265682 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [req-a8664a64-793f-48b0-8ea1-d8b5cefd8024 req-a85f1037-b098-4853-b4b7-c82b7e474a59 service nova] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:06:34.301859 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: INFO nova.api.openstack.compute.server_external_events [req-a8664a64-793f-48b0-8ea1-d8b5cefd8024 req-a85f1037-b098-4853-b4b7-c82b7e474a59 service nova] Creating event network-changed:6bbc39c5-40bb-4350-a006-fae5a1ef78a6 for instance fa7c86bc-c46f-4120-8f3d-d795f8d7c5cc on hv-cinder-81803 Dec 15 03:06:34.311705 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: INFO nova.api.openstack.requestlog [req-a8664a64-793f-48b0-8ea1-d8b5cefd8024 req-a85f1037-b098-4853-b4b7-c82b7e474a59 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.100623 Dec 15 03:06:34.315148 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: [pid: 116157|app: 0|req: 261/541] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Dec 15 03:06:34 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 03:06:34.324766 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi [None req-890fd0d1-454d-4e4c-b3e9-54d7da3d6ea3 tempest-AttachVolumeNegativeTest-1640336653 tempest-AttachVolumeNegativeTest-1640336653-project] Calling method '>' {{(pid=116157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:06:34.326962 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.compute.api [None req-890fd0d1-454d-4e4c-b3e9-54d7da3d6ea3 tempest-AttachVolumeNegativeTest-1640336653 tempest-AttachVolumeNegativeTest-1640336653-project] [instance: c3d5f143-e994-4098-989b-660411a8dd8f] Fetching instance by UUID {{(pid=116157) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:06:34.352246 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-890fd0d1-454d-4e4c-b3e9-54d7da3d6ea3 tempest-AttachVolumeNegativeTest-1640336653 tempest-AttachVolumeNegativeTest-1640336653-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:06:34.353084 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-890fd0d1-454d-4e4c-b3e9-54d7da3d6ea3 tempest-AttachVolumeNegativeTest-1640336653 tempest-AttachVolumeNegativeTest-1640336653-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:06:34.354194 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-890fd0d1-454d-4e4c-b3e9-54d7da3d6ea3 tempest-AttachVolumeNegativeTest-1640336653 tempest-AttachVolumeNegativeTest-1640336653-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:06:34.354877 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-890fd0d1-454d-4e4c-b3e9-54d7da3d6ea3 tempest-AttachVolumeNegativeTest-1640336653 tempest-AttachVolumeNegativeTest-1640336653-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:06:34.458659 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.policy [None req-a4062884-1799-4be9-b4ed-6e4c8d18ed44 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c4c0c82448e40ba801c0b52ec44e74a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a093d0bf43046aaa845f3cc115f3f5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116156) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:06:34.468644 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: INFO nova.api.openstack.requestlog [None req-a4062884-1799-4be9-b4ed-6e4c8d18ed44 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] 10.222.0.18 "GET /compute/v2.1/servers/fa7c86bc-c46f-4120-8f3d-d795f8d7c5cc" status: 200 len: 1260 microversion: 2.1 time: 0.490236 Dec 15 03:06:34.474523 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: [pid: 116156|app: 0|req: 281/542] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 03:06:33 2021] GET /compute/v2.1/servers/fa7c86bc-c46f-4120-8f3d-d795f8d7c5cc => generated 1260 bytes in 497 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 03:06:34.669674 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi [req-f86bafd8-30d5-41b9-b7ec-f7f853a1589b req-8eeb4f26-9658-4cd6-8ef4-f5e8e7591dca service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c3d5f143-e994-4098-989b-660411a8dd8f", "name": "network-vif-deleted", "tag": "aef969b5-d8c1-47b9-b0d3-730bcdaaea83"}]} {{(pid=116156) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 03:06:34.672181 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 15 03:06:34.672181 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: warnings.warn(msg) Dec 15 03:06:34.681636 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [req-f86bafd8-30d5-41b9-b7ec-f7f853a1589b req-8eeb4f26-9658-4cd6-8ef4-f5e8e7591dca service nova] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:06:34.683066 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [req-f86bafd8-30d5-41b9-b7ec-f7f853a1589b req-8eeb4f26-9658-4cd6-8ef4-f5e8e7591dca service nova] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:06:34.698559 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: INFO nova.api.openstack.compute.server_external_events [req-f86bafd8-30d5-41b9-b7ec-f7f853a1589b req-8eeb4f26-9658-4cd6-8ef4-f5e8e7591dca service nova] Creating event network-vif-deleted:aef969b5-d8c1-47b9-b0d3-730bcdaaea83 for instance c3d5f143-e994-4098-989b-660411a8dd8f on hv-cinder-81803 Dec 15 03:06:34.712411 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: INFO nova.api.openstack.requestlog [req-f86bafd8-30d5-41b9-b7ec-f7f853a1589b req-8eeb4f26-9658-4cd6-8ef4-f5e8e7591dca service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046954 Dec 15 03:06:34.713456 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: [pid: 116156|app: 0|req: 282/543] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Dec 15 03:06:34 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 03:06:34.808576 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.policy [None req-890fd0d1-454d-4e4c-b3e9-54d7da3d6ea3 tempest-AttachVolumeNegativeTest-1640336653 tempest-AttachVolumeNegativeTest-1640336653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35d37a3d8e504b8186182468b77dd114', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '409b41637da94c469444954258444b4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116157) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:06:34.818071 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: INFO nova.api.openstack.requestlog [None req-890fd0d1-454d-4e4c-b3e9-54d7da3d6ea3 tempest-AttachVolumeNegativeTest-1640336653 tempest-AttachVolumeNegativeTest-1640336653-project] 10.222.0.18 "GET /compute/v2.1/servers/c3d5f143-e994-4098-989b-660411a8dd8f" status: 200 len: 1471 microversion: 2.1 time: 0.499082 Dec 15 03:06:34.819094 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: [pid: 116157|app: 0|req: 262/544] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 03:06:34 2021] GET /compute/v2.1/servers/c3d5f143-e994-4098-989b-660411a8dd8f => generated 1471 bytes in 502 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 03:06:34.999483 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi [None req-243914f8-f1a7-461d-91a8-fbbe25a065c9 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Calling method '>' {{(pid=116156) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:06:35.000642 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.compute.api [None req-243914f8-f1a7-461d-91a8-fbbe25a065c9 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] [instance: b89094ac-aee1-4bd6-a33d-8c4347cebfc7] Fetching instance by UUID {{(pid=116156) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:06:35.006871 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-243914f8-f1a7-461d-91a8-fbbe25a065c9 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:06:35.007624 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-243914f8-f1a7-461d-91a8-fbbe25a065c9 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:06:35.008857 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-243914f8-f1a7-461d-91a8-fbbe25a065c9 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:06:35.009392 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-243914f8-f1a7-461d-91a8-fbbe25a065c9 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:06:35.188054 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.policy [None req-243914f8-f1a7-461d-91a8-fbbe25a065c9 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fedc11e2dbd74b919982a0657222cca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f16202549724b878f908d68384ec9c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116156) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:06:35.204958 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.policy [None req-243914f8-f1a7-461d-91a8-fbbe25a065c9 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fedc11e2dbd74b919982a0657222cca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f16202549724b878f908d68384ec9c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116156) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:06:35.207824 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.policy [None req-243914f8-f1a7-461d-91a8-fbbe25a065c9 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fedc11e2dbd74b919982a0657222cca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f16202549724b878f908d68384ec9c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116156) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:06:35.209630 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: INFO nova.api.openstack.requestlog [None req-243914f8-f1a7-461d-91a8-fbbe25a065c9 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] 10.222.0.18 "GET /compute/v2.1/servers/b89094ac-aee1-4bd6-a33d-8c4347cebfc7" status: 200 len: 1743 microversion: 2.20 time: 0.215183 Dec 15 03:06:35.210700 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: [pid: 116156|app: 0|req: 283/545] 10.222.0.18 () {60 vars in 1276 bytes} [Wed Dec 15 03:06:34 2021] GET /compute/v2.1/servers/b89094ac-aee1-4bd6-a33d-8c4347cebfc7 => generated 1743 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 03:06:35.500228 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi [None req-78d821cc-8694-4365-9e12-ca658e8b15ea tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Calling method '>' {{(pid=116157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:06:35.501884 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.compute.api [None req-78d821cc-8694-4365-9e12-ca658e8b15ea tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] [instance: fa7c86bc-c46f-4120-8f3d-d795f8d7c5cc] Fetching instance by UUID {{(pid=116157) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:06:35.510729 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-78d821cc-8694-4365-9e12-ca658e8b15ea tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:06:35.511486 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-78d821cc-8694-4365-9e12-ca658e8b15ea tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:06:35.512657 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-78d821cc-8694-4365-9e12-ca658e8b15ea tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:06:35.513560 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-78d821cc-8694-4365-9e12-ca658e8b15ea tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:06:35.835999 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi [None req-ed7a171b-80cf-4f1d-9e8a-fa635b5bc832 tempest-AttachVolumeNegativeTest-1640336653 tempest-AttachVolumeNegativeTest-1640336653-project] Calling method '>' {{(pid=116156) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:06:35.836788 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.compute.api [None req-ed7a171b-80cf-4f1d-9e8a-fa635b5bc832 tempest-AttachVolumeNegativeTest-1640336653 tempest-AttachVolumeNegativeTest-1640336653-project] [instance: c3d5f143-e994-4098-989b-660411a8dd8f] Fetching instance by UUID {{(pid=116156) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:06:35.843277 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-ed7a171b-80cf-4f1d-9e8a-fa635b5bc832 tempest-AttachVolumeNegativeTest-1640336653 tempest-AttachVolumeNegativeTest-1640336653-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:06:35.843830 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-ed7a171b-80cf-4f1d-9e8a-fa635b5bc832 tempest-AttachVolumeNegativeTest-1640336653 tempest-AttachVolumeNegativeTest-1640336653-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:06:35.845328 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-ed7a171b-80cf-4f1d-9e8a-fa635b5bc832 tempest-AttachVolumeNegativeTest-1640336653 tempest-AttachVolumeNegativeTest-1640336653-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:06:35.846062 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-ed7a171b-80cf-4f1d-9e8a-fa635b5bc832 tempest-AttachVolumeNegativeTest-1640336653 tempest-AttachVolumeNegativeTest-1640336653-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:06:35.854329 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.policy [None req-78d821cc-8694-4365-9e12-ca658e8b15ea tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c4c0c82448e40ba801c0b52ec44e74a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a093d0bf43046aaa845f3cc115f3f5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116157) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:06:35.862851 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: INFO nova.api.openstack.requestlog [None req-78d821cc-8694-4365-9e12-ca658e8b15ea tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] 10.222.0.18 "GET /compute/v2.1/servers/fa7c86bc-c46f-4120-8f3d-d795f8d7c5cc" status: 200 len: 1260 microversion: 2.1 time: 0.374054 Dec 15 03:06:35.864063 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: INFO nova.api.openstack.wsgi [None req-ed7a171b-80cf-4f1d-9e8a-fa635b5bc832 tempest-AttachVolumeNegativeTest-1640336653 tempest-AttachVolumeNegativeTest-1640336653-project] HTTP exception thrown: Instance c3d5f143-e994-4098-989b-660411a8dd8f could not be found. Dec 15 03:06:35.864240 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: [pid: 116157|app: 0|req: 263/546] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 03:06:35 2021] GET /compute/v2.1/servers/fa7c86bc-c46f-4120-8f3d-d795f8d7c5cc => generated 1260 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 03:06:35.865560 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi [None req-ed7a171b-80cf-4f1d-9e8a-fa635b5bc832 tempest-AttachVolumeNegativeTest-1640336653 tempest-AttachVolumeNegativeTest-1640336653-project] Returning 404 to user: Instance c3d5f143-e994-4098-989b-660411a8dd8f could not be found. {{(pid=116156) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 15 03:06:35.866420 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: INFO nova.api.openstack.requestlog [None req-ed7a171b-80cf-4f1d-9e8a-fa635b5bc832 tempest-AttachVolumeNegativeTest-1640336653 tempest-AttachVolumeNegativeTest-1640336653-project] 10.222.0.18 "GET /compute/v2.1/servers/c3d5f143-e994-4098-989b-660411a8dd8f" status: 404 len: 111 microversion: 2.1 time: 0.034113 Dec 15 03:06:35.867110 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: [pid: 116156|app: 0|req: 284/547] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 03:06:35 2021] GET /compute/v2.1/servers/c3d5f143-e994-4098-989b-660411a8dd8f => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 15 03:06:35.876574 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi [None req-f20484af-8624-40cd-a6b1-1f2d94416805 tempest-AttachVolumeNegativeTest-1640336653 tempest-AttachVolumeNegativeTest-1640336653-project] Calling method '>' {{(pid=116157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:06:35.877064 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.compute.api [None req-f20484af-8624-40cd-a6b1-1f2d94416805 tempest-AttachVolumeNegativeTest-1640336653 tempest-AttachVolumeNegativeTest-1640336653-project] [instance: b302a057-8ba0-4cec-bcb7-805bd598c638] Fetching instance by UUID {{(pid=116157) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:06:35.883052 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-f20484af-8624-40cd-a6b1-1f2d94416805 tempest-AttachVolumeNegativeTest-1640336653 tempest-AttachVolumeNegativeTest-1640336653-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:06:35.883497 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-f20484af-8624-40cd-a6b1-1f2d94416805 tempest-AttachVolumeNegativeTest-1640336653 tempest-AttachVolumeNegativeTest-1640336653-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:06:35.884274 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-f20484af-8624-40cd-a6b1-1f2d94416805 tempest-AttachVolumeNegativeTest-1640336653 tempest-AttachVolumeNegativeTest-1640336653-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:06:35.884705 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-f20484af-8624-40cd-a6b1-1f2d94416805 tempest-AttachVolumeNegativeTest-1640336653 tempest-AttachVolumeNegativeTest-1640336653-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:06:35.917729 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.compute.api [None req-f20484af-8624-40cd-a6b1-1f2d94416805 tempest-AttachVolumeNegativeTest-1640336653 tempest-AttachVolumeNegativeTest-1640336653-project] [instance: b302a057-8ba0-4cec-bcb7-805bd598c638] Going to try to terminate instance {{(pid=116157) delete /opt/stack/nova/nova/compute/api.py:2614}} Dec 15 03:06:36.033762 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: INFO nova.api.openstack.requestlog [None req-f20484af-8624-40cd-a6b1-1f2d94416805 tempest-AttachVolumeNegativeTest-1640336653 tempest-AttachVolumeNegativeTest-1640336653-project] 10.222.0.18 "DELETE /compute/v2.1/servers/b302a057-8ba0-4cec-bcb7-805bd598c638" status: 204 len: 0 microversion: 2.1 time: 0.161568 Dec 15 03:06:36.034721 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: [pid: 116157|app: 0|req: 264/548] 10.222.0.18 () {58 vars in 1238 bytes} [Wed Dec 15 03:06:35 2021] DELETE /compute/v2.1/servers/b302a057-8ba0-4cec-bcb7-805bd598c638 => generated 0 bytes in 163 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Dec 15 03:06:36.043284 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi [None req-16ac84fa-9c7c-49d9-8f47-40fbc5308f6f tempest-AttachVolumeNegativeTest-1640336653 tempest-AttachVolumeNegativeTest-1640336653-project] Calling method '>' {{(pid=116156) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:06:36.044301 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.compute.api [None req-16ac84fa-9c7c-49d9-8f47-40fbc5308f6f tempest-AttachVolumeNegativeTest-1640336653 tempest-AttachVolumeNegativeTest-1640336653-project] [instance: b302a057-8ba0-4cec-bcb7-805bd598c638] Fetching instance by UUID {{(pid=116156) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:06:36.055199 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-16ac84fa-9c7c-49d9-8f47-40fbc5308f6f tempest-AttachVolumeNegativeTest-1640336653 tempest-AttachVolumeNegativeTest-1640336653-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:06:36.061517 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-16ac84fa-9c7c-49d9-8f47-40fbc5308f6f tempest-AttachVolumeNegativeTest-1640336653 tempest-AttachVolumeNegativeTest-1640336653-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:06:36.062516 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-16ac84fa-9c7c-49d9-8f47-40fbc5308f6f tempest-AttachVolumeNegativeTest-1640336653 tempest-AttachVolumeNegativeTest-1640336653-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:06:36.063064 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-16ac84fa-9c7c-49d9-8f47-40fbc5308f6f tempest-AttachVolumeNegativeTest-1640336653 tempest-AttachVolumeNegativeTest-1640336653-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:06:36.252900 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi [None req-42c38e75-43cd-44e2-a350-b889dd7fa7a2 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Calling method '>' {{(pid=116157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:06:36.253914 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.compute.api [None req-42c38e75-43cd-44e2-a350-b889dd7fa7a2 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] [instance: b89094ac-aee1-4bd6-a33d-8c4347cebfc7] Fetching instance by UUID {{(pid=116157) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:06:36.268350 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-42c38e75-43cd-44e2-a350-b889dd7fa7a2 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:06:36.273960 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-42c38e75-43cd-44e2-a350-b889dd7fa7a2 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:06:36.275373 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-42c38e75-43cd-44e2-a350-b889dd7fa7a2 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:06:36.284625 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-42c38e75-43cd-44e2-a350-b889dd7fa7a2 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:06:36.323332 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.policy [None req-16ac84fa-9c7c-49d9-8f47-40fbc5308f6f tempest-AttachVolumeNegativeTest-1640336653 tempest-AttachVolumeNegativeTest-1640336653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35d37a3d8e504b8186182468b77dd114', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '409b41637da94c469444954258444b4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116156) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:06:36.333720 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: INFO nova.api.openstack.requestlog [None req-16ac84fa-9c7c-49d9-8f47-40fbc5308f6f tempest-AttachVolumeNegativeTest-1640336653 tempest-AttachVolumeNegativeTest-1640336653-project] 10.222.0.18 "GET /compute/v2.1/servers/b302a057-8ba0-4cec-bcb7-805bd598c638" status: 200 len: 1513 microversion: 2.1 time: 0.294716 Dec 15 03:06:36.334331 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: [pid: 116156|app: 0|req: 285/549] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 03:06:36 2021] GET /compute/v2.1/servers/b302a057-8ba0-4cec-bcb7-805bd598c638 => generated 1513 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 03:06:36.833862 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.policy [None req-42c38e75-43cd-44e2-a350-b889dd7fa7a2 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fedc11e2dbd74b919982a0657222cca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f16202549724b878f908d68384ec9c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116157) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:06:36.843008 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.policy [None req-42c38e75-43cd-44e2-a350-b889dd7fa7a2 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fedc11e2dbd74b919982a0657222cca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f16202549724b878f908d68384ec9c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116157) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:06:36.845056 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.policy [None req-42c38e75-43cd-44e2-a350-b889dd7fa7a2 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fedc11e2dbd74b919982a0657222cca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f16202549724b878f908d68384ec9c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116157) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:06:36.846309 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: INFO nova.api.openstack.requestlog [None req-42c38e75-43cd-44e2-a350-b889dd7fa7a2 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] 10.222.0.18 "GET /compute/v2.1/servers/b89094ac-aee1-4bd6-a33d-8c4347cebfc7" status: 200 len: 1738 microversion: 2.20 time: 0.621258 Dec 15 03:06:36.857989 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: [pid: 116157|app: 0|req: 265/550] 10.222.0.18 () {60 vars in 1276 bytes} [Wed Dec 15 03:06:36 2021] GET /compute/v2.1/servers/b89094ac-aee1-4bd6-a33d-8c4347cebfc7 => generated 1738 bytes in 634 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Dec 15 03:06:36.882387 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi [None req-d435c92f-b7f9-47b7-8c3c-5201463c55c5 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Calling method '>' {{(pid=116156) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:06:36.883696 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.compute.api [None req-d435c92f-b7f9-47b7-8c3c-5201463c55c5 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] [instance: fa7c86bc-c46f-4120-8f3d-d795f8d7c5cc] Fetching instance by UUID {{(pid=116156) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:06:36.891246 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-d435c92f-b7f9-47b7-8c3c-5201463c55c5 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:06:36.892042 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-d435c92f-b7f9-47b7-8c3c-5201463c55c5 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:06:36.892915 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-d435c92f-b7f9-47b7-8c3c-5201463c55c5 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:06:36.893420 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-d435c92f-b7f9-47b7-8c3c-5201463c55c5 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:06:37.092431 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.policy [None req-d435c92f-b7f9-47b7-8c3c-5201463c55c5 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c4c0c82448e40ba801c0b52ec44e74a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a093d0bf43046aaa845f3cc115f3f5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116156) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:06:37.101270 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: INFO nova.api.openstack.requestlog [None req-d435c92f-b7f9-47b7-8c3c-5201463c55c5 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] 10.222.0.18 "GET /compute/v2.1/servers/fa7c86bc-c46f-4120-8f3d-d795f8d7c5cc" status: 200 len: 1260 microversion: 2.1 time: 0.223716 Dec 15 03:06:37.111754 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: [pid: 116156|app: 0|req: 286/551] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 03:06:36 2021] GET /compute/v2.1/servers/fa7c86bc-c46f-4120-8f3d-d795f8d7c5cc => generated 1260 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 03:06:37.351963 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi [None req-5229132a-e469-4b72-9e11-511cfc0abf7e tempest-AttachVolumeNegativeTest-1640336653 tempest-AttachVolumeNegativeTest-1640336653-project] Calling method '>' {{(pid=116157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:06:37.352971 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.compute.api [None req-5229132a-e469-4b72-9e11-511cfc0abf7e tempest-AttachVolumeNegativeTest-1640336653 tempest-AttachVolumeNegativeTest-1640336653-project] [instance: b302a057-8ba0-4cec-bcb7-805bd598c638] Fetching instance by UUID {{(pid=116157) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:06:37.359611 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-5229132a-e469-4b72-9e11-511cfc0abf7e tempest-AttachVolumeNegativeTest-1640336653 tempest-AttachVolumeNegativeTest-1640336653-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:06:37.363927 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-5229132a-e469-4b72-9e11-511cfc0abf7e tempest-AttachVolumeNegativeTest-1640336653 tempest-AttachVolumeNegativeTest-1640336653-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:06:37.365368 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-5229132a-e469-4b72-9e11-511cfc0abf7e tempest-AttachVolumeNegativeTest-1640336653 tempest-AttachVolumeNegativeTest-1640336653-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:06:37.368110 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-5229132a-e469-4b72-9e11-511cfc0abf7e tempest-AttachVolumeNegativeTest-1640336653 tempest-AttachVolumeNegativeTest-1640336653-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:06:37.846962 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.policy [None req-5229132a-e469-4b72-9e11-511cfc0abf7e tempest-AttachVolumeNegativeTest-1640336653 tempest-AttachVolumeNegativeTest-1640336653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35d37a3d8e504b8186182468b77dd114', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '409b41637da94c469444954258444b4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116157) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:06:37.859014 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: INFO nova.api.openstack.requestlog [None req-5229132a-e469-4b72-9e11-511cfc0abf7e tempest-AttachVolumeNegativeTest-1640336653 tempest-AttachVolumeNegativeTest-1640336653-project] 10.222.0.18 "GET /compute/v2.1/servers/b302a057-8ba0-4cec-bcb7-805bd598c638" status: 200 len: 1513 microversion: 2.1 time: 0.508822 Dec 15 03:06:37.870106 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi [req-92d9e10a-7601-486f-befd-a63a7d8afb7f req-8ec3d22b-ef40-42fd-9336-df5d8bb703ef service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b89094ac-aee1-4bd6-a33d-8c4347cebfc7", "name": "network-vif-plugged", "status": "completed", "tag": "455e429c-96fb-4858-b8fe-cf282ae96b72"}]} {{(pid=116156) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 03:06:37.870318 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: [pid: 116157|app: 0|req: 266/552] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 03:06:37 2021] GET /compute/v2.1/servers/b302a057-8ba0-4cec-bcb7-805bd598c638 => generated 1513 bytes in 517 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 03:06:37.870406 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 15 03:06:37.870406 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: warnings.warn(msg) Dec 15 03:06:37.881209 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [req-92d9e10a-7601-486f-befd-a63a7d8afb7f req-8ec3d22b-ef40-42fd-9336-df5d8bb703ef service nova] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:06:37.882031 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [req-92d9e10a-7601-486f-befd-a63a7d8afb7f req-8ec3d22b-ef40-42fd-9336-df5d8bb703ef service nova] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:06:37.890606 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi [None req-7adb4d99-0c90-44f4-b22e-08c93eb59585 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Calling method '>' {{(pid=116157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:06:37.891264 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.compute.api [None req-7adb4d99-0c90-44f4-b22e-08c93eb59585 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] [instance: b89094ac-aee1-4bd6-a33d-8c4347cebfc7] Fetching instance by UUID {{(pid=116157) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:06:37.914542 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-7adb4d99-0c90-44f4-b22e-08c93eb59585 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:06:37.915533 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: INFO nova.api.openstack.compute.server_external_events [req-92d9e10a-7601-486f-befd-a63a7d8afb7f req-8ec3d22b-ef40-42fd-9336-df5d8bb703ef service nova] Creating event network-vif-plugged:455e429c-96fb-4858-b8fe-cf282ae96b72 for instance b89094ac-aee1-4bd6-a33d-8c4347cebfc7 on hv-cinder-81803 Dec 15 03:06:37.919109 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-7adb4d99-0c90-44f4-b22e-08c93eb59585 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:06:37.921002 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-7adb4d99-0c90-44f4-b22e-08c93eb59585 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:06:37.921447 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-7adb4d99-0c90-44f4-b22e-08c93eb59585 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:06:37.928129 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: INFO nova.api.openstack.requestlog [req-92d9e10a-7601-486f-befd-a63a7d8afb7f req-8ec3d22b-ef40-42fd-9336-df5d8bb703ef service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.070834 Dec 15 03:06:37.929472 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: [pid: 116156|app: 0|req: 287/553] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Dec 15 03:06:37 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 15 03:06:38.293437 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi [None req-fffa30ca-b200-48aa-b056-23f045280de9 tempest-AttachVolumeTestJSON-244989543 tempest-AttachVolumeTestJSON-244989543-project] Action: 'create', calling method: .version_select at 0x7f126a24fdc0>, body: {"keypair": {"name": "tempest-keypair-595314316"}} {{(pid=116156) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 03:06:38.317877 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.quota [None req-fffa30ca-b200-48aa-b056-23f045280de9 tempest-AttachVolumeTestJSON-244989543 tempest-AttachVolumeTestJSON-244989543-project] Getting quotas for project 00e76c2a092544e1a51928f1d84879b2. Resources: {'key_pairs'} {{(pid=116156) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 15 03:06:38.323118 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.quota [None req-fffa30ca-b200-48aa-b056-23f045280de9 tempest-AttachVolumeTestJSON-244989543 tempest-AttachVolumeTestJSON-244989543-project] Getting quotas for user a5fb31c3d4874e13ba22e0242d4aaa58 and project 00e76c2a092544e1a51928f1d84879b2. Resources: {'key_pairs'} {{(pid=116156) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 15 03:06:38.338232 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.policy [None req-7adb4d99-0c90-44f4-b22e-08c93eb59585 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fedc11e2dbd74b919982a0657222cca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f16202549724b878f908d68384ec9c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116157) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:06:38.347234 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.policy [None req-7adb4d99-0c90-44f4-b22e-08c93eb59585 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fedc11e2dbd74b919982a0657222cca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f16202549724b878f908d68384ec9c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116157) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:06:38.348730 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.policy [None req-7adb4d99-0c90-44f4-b22e-08c93eb59585 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fedc11e2dbd74b919982a0657222cca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f16202549724b878f908d68384ec9c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116157) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:06:38.360003 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: INFO nova.api.openstack.requestlog [None req-7adb4d99-0c90-44f4-b22e-08c93eb59585 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] 10.222.0.18 "GET /compute/v2.1/servers/b89094ac-aee1-4bd6-a33d-8c4347cebfc7" status: 200 len: 1738 microversion: 2.20 time: 0.495291 Dec 15 03:06:38.371904 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: [pid: 116157|app: 0|req: 267/554] 10.222.0.18 () {60 vars in 1276 bytes} [Wed Dec 15 03:06:37 2021] GET /compute/v2.1/servers/b89094ac-aee1-4bd6-a33d-8c4347cebfc7 => generated 1738 bytes in 508 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 03:06:38.378726 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi [None req-e37a6679-9538-45d2-b1da-93616ecc3a3b tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Calling method '>' {{(pid=116157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:06:38.379416 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.compute.api [None req-e37a6679-9538-45d2-b1da-93616ecc3a3b tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] [instance: fa7c86bc-c46f-4120-8f3d-d795f8d7c5cc] Fetching instance by UUID {{(pid=116157) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:06:38.388585 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-e37a6679-9538-45d2-b1da-93616ecc3a3b tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:06:38.390039 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-e37a6679-9538-45d2-b1da-93616ecc3a3b tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:06:38.391058 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-e37a6679-9538-45d2-b1da-93616ecc3a3b tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:06:38.392095 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-e37a6679-9538-45d2-b1da-93616ecc3a3b tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:06:38.605343 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.quota [None req-fffa30ca-b200-48aa-b056-23f045280de9 tempest-AttachVolumeTestJSON-244989543 tempest-AttachVolumeTestJSON-244989543-project] Getting quotas for project 00e76c2a092544e1a51928f1d84879b2. Resources: {'key_pairs'} {{(pid=116156) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 15 03:06:38.611932 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.quota [None req-fffa30ca-b200-48aa-b056-23f045280de9 tempest-AttachVolumeTestJSON-244989543 tempest-AttachVolumeTestJSON-244989543-project] Getting quotas for user a5fb31c3d4874e13ba22e0242d4aaa58 and project 00e76c2a092544e1a51928f1d84879b2. Resources: {'key_pairs'} {{(pid=116156) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 15 03:06:38.631167 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: INFO nova.api.openstack.requestlog [None req-fffa30ca-b200-48aa-b056-23f045280de9 tempest-AttachVolumeTestJSON-244989543 tempest-AttachVolumeTestJSON-244989543-project] 10.222.0.18 "POST /compute/v2.1/os-keypairs" status: 200 len: 2300 microversion: 2.1 time: 0.693322 Dec 15 03:06:38.632361 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: [pid: 116156|app: 0|req: 288/555] 10.222.0.18 () {60 vars in 1157 bytes} [Wed Dec 15 03:06:37 2021] POST /compute/v2.1/os-keypairs => generated 2300 bytes in 695 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 03:06:38.885210 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi [None req-139cd353-bfd0-4b66-ab82-f9c863865561 tempest-AttachVolumeNegativeTest-1640336653 tempest-AttachVolumeNegativeTest-1640336653-project] Calling method '>' {{(pid=116156) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:06:38.886899 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.compute.api [None req-139cd353-bfd0-4b66-ab82-f9c863865561 tempest-AttachVolumeNegativeTest-1640336653 tempest-AttachVolumeNegativeTest-1640336653-project] [instance: b302a057-8ba0-4cec-bcb7-805bd598c638] Fetching instance by UUID {{(pid=116156) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:06:38.904821 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-139cd353-bfd0-4b66-ab82-f9c863865561 tempest-AttachVolumeNegativeTest-1640336653 tempest-AttachVolumeNegativeTest-1640336653-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:06:38.905601 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-139cd353-bfd0-4b66-ab82-f9c863865561 tempest-AttachVolumeNegativeTest-1640336653 tempest-AttachVolumeNegativeTest-1640336653-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:06:38.907838 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-139cd353-bfd0-4b66-ab82-f9c863865561 tempest-AttachVolumeNegativeTest-1640336653 tempest-AttachVolumeNegativeTest-1640336653-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:06:38.908651 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-139cd353-bfd0-4b66-ab82-f9c863865561 tempest-AttachVolumeNegativeTest-1640336653 tempest-AttachVolumeNegativeTest-1640336653-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:06:39.015790 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.policy [None req-e37a6679-9538-45d2-b1da-93616ecc3a3b tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c4c0c82448e40ba801c0b52ec44e74a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a093d0bf43046aaa845f3cc115f3f5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116157) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:06:39.028359 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: INFO nova.api.openstack.requestlog [None req-e37a6679-9538-45d2-b1da-93616ecc3a3b tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] 10.222.0.18 "GET /compute/v2.1/servers/fa7c86bc-c46f-4120-8f3d-d795f8d7c5cc" status: 200 len: 1260 microversion: 2.1 time: 0.651421 Dec 15 03:06:39.039591 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: [pid: 116157|app: 0|req: 268/556] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 03:06:38 2021] GET /compute/v2.1/servers/fa7c86bc-c46f-4120-8f3d-d795f8d7c5cc => generated 1260 bytes in 666 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 03:06:39.045452 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi [req-890afb72-daee-4c33-a4f4-f1d50ccb93a7 req-43a4be92-e9f6-4f38-b1e7-91dbbfe3dac2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b302a057-8ba0-4cec-bcb7-805bd598c638", "name": "network-vif-deleted", "tag": "bd1e9500-c9d2-4a4b-bbc3-fc1261110821"}]} {{(pid=116157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 03:06:39.047499 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 15 03:06:39.047499 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: warnings.warn(msg) Dec 15 03:06:39.060305 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [req-890afb72-daee-4c33-a4f4-f1d50ccb93a7 req-43a4be92-e9f6-4f38-b1e7-91dbbfe3dac2 service nova] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:06:39.060763 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [req-890afb72-daee-4c33-a4f4-f1d50ccb93a7 req-43a4be92-e9f6-4f38-b1e7-91dbbfe3dac2 service nova] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:06:39.088876 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.policy [None req-139cd353-bfd0-4b66-ab82-f9c863865561 tempest-AttachVolumeNegativeTest-1640336653 tempest-AttachVolumeNegativeTest-1640336653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35d37a3d8e504b8186182468b77dd114', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '409b41637da94c469444954258444b4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116156) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:06:39.092326 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: INFO nova.api.openstack.compute.server_external_events [req-890afb72-daee-4c33-a4f4-f1d50ccb93a7 req-43a4be92-e9f6-4f38-b1e7-91dbbfe3dac2 service nova] Creating event network-vif-deleted:bd1e9500-c9d2-4a4b-bbc3-fc1261110821 for instance b302a057-8ba0-4cec-bcb7-805bd598c638 on hv-cinder-81803 Dec 15 03:06:39.098880 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: INFO nova.api.openstack.requestlog [None req-139cd353-bfd0-4b66-ab82-f9c863865561 tempest-AttachVolumeNegativeTest-1640336653 tempest-AttachVolumeNegativeTest-1640336653-project] 10.222.0.18 "GET /compute/v2.1/servers/b302a057-8ba0-4cec-bcb7-805bd598c638" status: 200 len: 1471 microversion: 2.1 time: 0.222919 Dec 15 03:06:39.106409 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: INFO nova.api.openstack.requestlog [req-890afb72-daee-4c33-a4f4-f1d50ccb93a7 req-43a4be92-e9f6-4f38-b1e7-91dbbfe3dac2 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.064837 Dec 15 03:06:39.107264 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: [pid: 116157|app: 0|req: 269/557] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Dec 15 03:06:39 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 03:06:39.116502 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: [pid: 116156|app: 0|req: 289/558] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 03:06:38 2021] GET /compute/v2.1/servers/b302a057-8ba0-4cec-bcb7-805bd598c638 => generated 1471 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 03:06:39.381248 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi [None req-ac9640a5-a6f1-4559-bfc6-517771b94a5a tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Calling method '>' {{(pid=116157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:06:39.382239 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.compute.api [None req-ac9640a5-a6f1-4559-bfc6-517771b94a5a tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] [instance: b89094ac-aee1-4bd6-a33d-8c4347cebfc7] Fetching instance by UUID {{(pid=116157) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:06:39.394903 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-ac9640a5-a6f1-4559-bfc6-517771b94a5a tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:06:39.395592 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-ac9640a5-a6f1-4559-bfc6-517771b94a5a tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:06:39.396762 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-ac9640a5-a6f1-4559-bfc6-517771b94a5a tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:06:39.401885 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-ac9640a5-a6f1-4559-bfc6-517771b94a5a tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:06:39.611675 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.policy [None req-ac9640a5-a6f1-4559-bfc6-517771b94a5a tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fedc11e2dbd74b919982a0657222cca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f16202549724b878f908d68384ec9c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116157) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:06:39.633625 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.policy [None req-ac9640a5-a6f1-4559-bfc6-517771b94a5a tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fedc11e2dbd74b919982a0657222cca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f16202549724b878f908d68384ec9c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116157) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:06:39.635516 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.policy [None req-ac9640a5-a6f1-4559-bfc6-517771b94a5a tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fedc11e2dbd74b919982a0657222cca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f16202549724b878f908d68384ec9c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116157) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:06:39.641512 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: INFO nova.api.openstack.requestlog [None req-ac9640a5-a6f1-4559-bfc6-517771b94a5a tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] 10.222.0.18 "GET /compute/v2.1/servers/b89094ac-aee1-4bd6-a33d-8c4347cebfc7" status: 200 len: 1738 microversion: 2.20 time: 0.260887 Dec 15 03:06:39.642369 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: [pid: 116157|app: 0|req: 270/559] 10.222.0.18 () {60 vars in 1276 bytes} [Wed Dec 15 03:06:39 2021] GET /compute/v2.1/servers/b89094ac-aee1-4bd6-a33d-8c4347cebfc7 => generated 1738 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 03:06:40.046275 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi [None req-36629c91-6a36-4819-a619-74a2ad5eb9e9 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Calling method '>' {{(pid=116156) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:06:40.048012 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.compute.api [None req-36629c91-6a36-4819-a619-74a2ad5eb9e9 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] [instance: fa7c86bc-c46f-4120-8f3d-d795f8d7c5cc] Fetching instance by UUID {{(pid=116156) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:06:40.064200 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-36629c91-6a36-4819-a619-74a2ad5eb9e9 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:06:40.064670 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-36629c91-6a36-4819-a619-74a2ad5eb9e9 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:06:40.069044 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-36629c91-6a36-4819-a619-74a2ad5eb9e9 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:06:40.069526 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-36629c91-6a36-4819-a619-74a2ad5eb9e9 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:06:40.120601 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi [None req-22de8b41-8296-4cad-aad0-8d0f9278fd33 tempest-AttachVolumeNegativeTest-1640336653 tempest-AttachVolumeNegativeTest-1640336653-project] Calling method '>' {{(pid=116157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:06:40.121811 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.compute.api [None req-22de8b41-8296-4cad-aad0-8d0f9278fd33 tempest-AttachVolumeNegativeTest-1640336653 tempest-AttachVolumeNegativeTest-1640336653-project] [instance: b302a057-8ba0-4cec-bcb7-805bd598c638] Fetching instance by UUID {{(pid=116157) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:06:40.133438 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-22de8b41-8296-4cad-aad0-8d0f9278fd33 tempest-AttachVolumeNegativeTest-1640336653 tempest-AttachVolumeNegativeTest-1640336653-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:06:40.133911 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-22de8b41-8296-4cad-aad0-8d0f9278fd33 tempest-AttachVolumeNegativeTest-1640336653 tempest-AttachVolumeNegativeTest-1640336653-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:06:40.138044 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-22de8b41-8296-4cad-aad0-8d0f9278fd33 tempest-AttachVolumeNegativeTest-1640336653 tempest-AttachVolumeNegativeTest-1640336653-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:06:40.138506 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-22de8b41-8296-4cad-aad0-8d0f9278fd33 tempest-AttachVolumeNegativeTest-1640336653 tempest-AttachVolumeNegativeTest-1640336653-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:06:40.177486 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: INFO nova.api.openstack.wsgi [None req-22de8b41-8296-4cad-aad0-8d0f9278fd33 tempest-AttachVolumeNegativeTest-1640336653 tempest-AttachVolumeNegativeTest-1640336653-project] HTTP exception thrown: Instance b302a057-8ba0-4cec-bcb7-805bd598c638 could not be found. Dec 15 03:06:40.178064 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi [None req-22de8b41-8296-4cad-aad0-8d0f9278fd33 tempest-AttachVolumeNegativeTest-1640336653 tempest-AttachVolumeNegativeTest-1640336653-project] Returning 404 to user: Instance b302a057-8ba0-4cec-bcb7-805bd598c638 could not be found. {{(pid=116157) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 15 03:06:40.181261 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: INFO nova.api.openstack.requestlog [None req-22de8b41-8296-4cad-aad0-8d0f9278fd33 tempest-AttachVolumeNegativeTest-1640336653 tempest-AttachVolumeNegativeTest-1640336653-project] 10.222.0.18 "GET /compute/v2.1/servers/b302a057-8ba0-4cec-bcb7-805bd598c638" status: 404 len: 111 microversion: 2.1 time: 0.062455 Dec 15 03:06:40.185305 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: [pid: 116157|app: 0|req: 271/560] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 03:06:40 2021] GET /compute/v2.1/servers/b302a057-8ba0-4cec-bcb7-805bd598c638 => generated 111 bytes in 69 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Dec 15 03:06:40.444656 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.policy [None req-36629c91-6a36-4819-a619-74a2ad5eb9e9 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c4c0c82448e40ba801c0b52ec44e74a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a093d0bf43046aaa845f3cc115f3f5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116156) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:06:40.459033 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: INFO nova.api.openstack.requestlog [None req-36629c91-6a36-4819-a619-74a2ad5eb9e9 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] 10.222.0.18 "GET /compute/v2.1/servers/fa7c86bc-c46f-4120-8f3d-d795f8d7c5cc" status: 200 len: 1260 microversion: 2.1 time: 0.416929 Dec 15 03:06:40.462414 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: [pid: 116156|app: 0|req: 290/561] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 03:06:40 2021] GET /compute/v2.1/servers/fa7c86bc-c46f-4120-8f3d-d795f8d7c5cc => generated 1260 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 03:06:40.663996 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi [None req-880076c4-15c7-4221-84e9-9fb3f9971e31 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Calling method '>' {{(pid=116157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:06:40.665008 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.compute.api [None req-880076c4-15c7-4221-84e9-9fb3f9971e31 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] [instance: b89094ac-aee1-4bd6-a33d-8c4347cebfc7] Fetching instance by UUID {{(pid=116157) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:06:40.689161 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-880076c4-15c7-4221-84e9-9fb3f9971e31 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:06:40.689939 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-880076c4-15c7-4221-84e9-9fb3f9971e31 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:06:40.694141 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-880076c4-15c7-4221-84e9-9fb3f9971e31 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:06:40.694993 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-880076c4-15c7-4221-84e9-9fb3f9971e31 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:06:41.012026 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.policy [None req-880076c4-15c7-4221-84e9-9fb3f9971e31 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fedc11e2dbd74b919982a0657222cca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f16202549724b878f908d68384ec9c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116157) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:06:41.021711 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.policy [None req-880076c4-15c7-4221-84e9-9fb3f9971e31 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fedc11e2dbd74b919982a0657222cca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f16202549724b878f908d68384ec9c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116157) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:06:41.023695 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.policy [None req-880076c4-15c7-4221-84e9-9fb3f9971e31 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fedc11e2dbd74b919982a0657222cca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f16202549724b878f908d68384ec9c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116157) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:06:41.027001 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: INFO nova.api.openstack.requestlog [None req-880076c4-15c7-4221-84e9-9fb3f9971e31 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] 10.222.0.18 "GET /compute/v2.1/servers/b89094ac-aee1-4bd6-a33d-8c4347cebfc7" status: 200 len: 1738 microversion: 2.20 time: 0.367549 Dec 15 03:06:41.032400 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: [pid: 116157|app: 0|req: 272/562] 10.222.0.18 () {60 vars in 1276 bytes} [Wed Dec 15 03:06:40 2021] GET /compute/v2.1/servers/b89094ac-aee1-4bd6-a33d-8c4347cebfc7 => generated 1738 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 03:06:41.443019 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi [None req-5972fce7-73d9-41a6-a994-dadaced1b444 tempest-AttachVolumeNegativeTest-1640336653 tempest-AttachVolumeNegativeTest-1640336653-project] Calling method '>' {{(pid=116156) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:06:41.444264 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.compute.api [None req-5972fce7-73d9-41a6-a994-dadaced1b444 tempest-AttachVolumeNegativeTest-1640336653 tempest-AttachVolumeNegativeTest-1640336653-project] [instance: 4923355f-95d6-443d-9487-574f56b87f66] Fetching instance by UUID {{(pid=116156) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:06:41.458799 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-5972fce7-73d9-41a6-a994-dadaced1b444 tempest-AttachVolumeNegativeTest-1640336653 tempest-AttachVolumeNegativeTest-1640336653-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:06:41.459381 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi [None req-6a2b9ffe-08c3-47c0-b9b1-1f4829fefb73 tempest-AttachVolumeTestJSON-244989543 tempest-AttachVolumeTestJSON-244989543-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-1594742100", "imageRef": "5195b034-9fa4-468b-a94d-ef3ee79ce449", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "aedd89e5-7e2d-4810-95c0-a87228c5c673"}], "security_groups": [{"name": "tempest-securitygroup--342501313"}], "key_name": "tempest-keypair-595314316", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=116157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 03:06:41.459766 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-5972fce7-73d9-41a6-a994-dadaced1b444 tempest-AttachVolumeNegativeTest-1640336653 tempest-AttachVolumeNegativeTest-1640336653-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:06:41.460241 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-5972fce7-73d9-41a6-a994-dadaced1b444 tempest-AttachVolumeNegativeTest-1640336653 tempest-AttachVolumeNegativeTest-1640336653-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:06:41.461257 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-5972fce7-73d9-41a6-a994-dadaced1b444 tempest-AttachVolumeNegativeTest-1640336653 tempest-AttachVolumeNegativeTest-1640336653-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:06:41.495621 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.compute.api [None req-5972fce7-73d9-41a6-a994-dadaced1b444 tempest-AttachVolumeNegativeTest-1640336653 tempest-AttachVolumeNegativeTest-1640336653-project] [instance: 4923355f-95d6-443d-9487-574f56b87f66] Going to try to terminate instance {{(pid=116156) delete /opt/stack/nova/nova/compute/api.py:2614}} Dec 15 03:06:41.605431 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: INFO nova.api.openstack.requestlog [None req-5972fce7-73d9-41a6-a994-dadaced1b444 tempest-AttachVolumeNegativeTest-1640336653 tempest-AttachVolumeNegativeTest-1640336653-project] 10.222.0.18 "DELETE /compute/v2.1/servers/4923355f-95d6-443d-9487-574f56b87f66" status: 204 len: 0 microversion: 2.1 time: 0.165715 Dec 15 03:06:41.606358 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: [pid: 116156|app: 0|req: 291/563] 10.222.0.18 () {58 vars in 1238 bytes} [Wed Dec 15 03:06:41 2021] DELETE /compute/v2.1/servers/4923355f-95d6-443d-9487-574f56b87f66 => generated 0 bytes in 168 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Dec 15 03:06:41.619644 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi [None req-1e76ba72-1992-4e5b-980e-b44ac0b164d0 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Calling method '>' {{(pid=116156) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:06:41.620945 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.compute.api [None req-1e76ba72-1992-4e5b-980e-b44ac0b164d0 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] [instance: fa7c86bc-c46f-4120-8f3d-d795f8d7c5cc] Fetching instance by UUID {{(pid=116156) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:06:41.628580 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-1e76ba72-1992-4e5b-980e-b44ac0b164d0 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:06:41.629046 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-1e76ba72-1992-4e5b-980e-b44ac0b164d0 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:06:41.629834 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-1e76ba72-1992-4e5b-980e-b44ac0b164d0 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:06:41.630478 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-1e76ba72-1992-4e5b-980e-b44ac0b164d0 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:06:41.817552 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.policy [None req-1e76ba72-1992-4e5b-980e-b44ac0b164d0 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c4c0c82448e40ba801c0b52ec44e74a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a093d0bf43046aaa845f3cc115f3f5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116156) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:06:41.826431 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: INFO nova.api.openstack.requestlog [None req-1e76ba72-1992-4e5b-980e-b44ac0b164d0 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] 10.222.0.18 "GET /compute/v2.1/servers/fa7c86bc-c46f-4120-8f3d-d795f8d7c5cc" status: 200 len: 1260 microversion: 2.1 time: 0.212075 Dec 15 03:06:41.827367 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: [pid: 116156|app: 0|req: 292/564] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 03:06:41 2021] GET /compute/v2.1/servers/fa7c86bc-c46f-4120-8f3d-d795f8d7c5cc => generated 1260 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 03:06:41.832343 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi [None req-55f9505d-dab4-48a8-aa7c-a20c423cf74e tempest-AttachVolumeNegativeTest-1640336653 tempest-AttachVolumeNegativeTest-1640336653-project] Calling method '>' {{(pid=116156) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:06:41.838266 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.compute.api [None req-55f9505d-dab4-48a8-aa7c-a20c423cf74e tempest-AttachVolumeNegativeTest-1640336653 tempest-AttachVolumeNegativeTest-1640336653-project] [instance: 4923355f-95d6-443d-9487-574f56b87f66] Fetching instance by UUID {{(pid=116156) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:06:41.846577 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-55f9505d-dab4-48a8-aa7c-a20c423cf74e tempest-AttachVolumeNegativeTest-1640336653 tempest-AttachVolumeNegativeTest-1640336653-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:06:41.847328 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-55f9505d-dab4-48a8-aa7c-a20c423cf74e tempest-AttachVolumeNegativeTest-1640336653 tempest-AttachVolumeNegativeTest-1640336653-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:06:41.848524 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-55f9505d-dab4-48a8-aa7c-a20c423cf74e tempest-AttachVolumeNegativeTest-1640336653 tempest-AttachVolumeNegativeTest-1640336653-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:06:41.849316 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-55f9505d-dab4-48a8-aa7c-a20c423cf74e tempest-AttachVolumeNegativeTest-1640336653 tempest-AttachVolumeNegativeTest-1640336653-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:06:42.011947 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.policy [None req-55f9505d-dab4-48a8-aa7c-a20c423cf74e tempest-AttachVolumeNegativeTest-1640336653 tempest-AttachVolumeNegativeTest-1640336653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35d37a3d8e504b8186182468b77dd114', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '409b41637da94c469444954258444b4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116156) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:06:42.017680 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: INFO nova.api.openstack.requestlog [None req-55f9505d-dab4-48a8-aa7c-a20c423cf74e tempest-AttachVolumeNegativeTest-1640336653 tempest-AttachVolumeNegativeTest-1640336653-project] 10.222.0.18 "GET /compute/v2.1/servers/4923355f-95d6-443d-9487-574f56b87f66" status: 200 len: 1514 microversion: 2.1 time: 0.189042 Dec 15 03:06:42.018469 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: [pid: 116156|app: 0|req: 293/565] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 03:06:41 2021] GET /compute/v2.1/servers/4923355f-95d6-443d-9487-574f56b87f66 => generated 1514 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 03:06:42.059212 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi [None req-d6ec1c3d-f5f6-4ad2-be09-eef79b3993b3 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Calling method '>' {{(pid=116156) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:06:42.060190 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.compute.api [None req-d6ec1c3d-f5f6-4ad2-be09-eef79b3993b3 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] [instance: b89094ac-aee1-4bd6-a33d-8c4347cebfc7] Fetching instance by UUID {{(pid=116156) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:06:42.067680 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-d6ec1c3d-f5f6-4ad2-be09-eef79b3993b3 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:06:42.068576 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-d6ec1c3d-f5f6-4ad2-be09-eef79b3993b3 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:06:42.069575 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-d6ec1c3d-f5f6-4ad2-be09-eef79b3993b3 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:06:42.070352 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-d6ec1c3d-f5f6-4ad2-be09-eef79b3993b3 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:06:42.257067 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.policy [None req-d6ec1c3d-f5f6-4ad2-be09-eef79b3993b3 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fedc11e2dbd74b919982a0657222cca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f16202549724b878f908d68384ec9c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116156) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:06:42.265493 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.policy [None req-d6ec1c3d-f5f6-4ad2-be09-eef79b3993b3 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fedc11e2dbd74b919982a0657222cca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f16202549724b878f908d68384ec9c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116156) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:06:42.267617 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.policy [None req-d6ec1c3d-f5f6-4ad2-be09-eef79b3993b3 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fedc11e2dbd74b919982a0657222cca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f16202549724b878f908d68384ec9c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116156) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:06:42.270330 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: INFO nova.api.openstack.requestlog [None req-d6ec1c3d-f5f6-4ad2-be09-eef79b3993b3 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] 10.222.0.18 "GET /compute/v2.1/servers/b89094ac-aee1-4bd6-a33d-8c4347cebfc7" status: 200 len: 1738 microversion: 2.20 time: 0.222750 Dec 15 03:06:42.281662 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: [pid: 116156|app: 0|req: 294/566] 10.222.0.18 () {60 vars in 1276 bytes} [Wed Dec 15 03:06:42 2021] GET /compute/v2.1/servers/b89094ac-aee1-4bd6-a33d-8c4347cebfc7 => generated 1738 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Dec 15 03:06:42.483968 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.network.neutron [None req-6a2b9ffe-08c3-47c0-b9b1-1f4829fefb73 tempest-AttachVolumeTestJSON-244989543 tempest-AttachVolumeTestJSON-244989543-project] validate_networks() for [('aedd89e5-7e2d-4810-95c0-a87228c5c673', None, None, None, None, None)] {{(pid=116157) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Dec 15 03:06:42.843583 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi [None req-40313241-e872-4f79-90b8-47c9accf881f tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Calling method '>' {{(pid=116156) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:06:42.845003 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.compute.api [None req-40313241-e872-4f79-90b8-47c9accf881f tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] [instance: fa7c86bc-c46f-4120-8f3d-d795f8d7c5cc] Fetching instance by UUID {{(pid=116156) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:06:42.853512 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-40313241-e872-4f79-90b8-47c9accf881f tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:06:42.854337 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-40313241-e872-4f79-90b8-47c9accf881f tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:06:42.855557 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-40313241-e872-4f79-90b8-47c9accf881f tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:06:42.857532 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-40313241-e872-4f79-90b8-47c9accf881f tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:06:42.920271 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.virt.hardware [None req-6a2b9ffe-08c3-47c0-b9b1-1f4829fefb73 tempest-AttachVolumeTestJSON-244989543 tempest-AttachVolumeTestJSON-244989543-project] Flavor limits 0:0:0 {{(pid=116157) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Dec 15 03:06:42.920756 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.virt.hardware [None req-6a2b9ffe-08c3-47c0-b9b1-1f4829fefb73 tempest-AttachVolumeTestJSON-244989543 tempest-AttachVolumeTestJSON-244989543-project] Image limits 0:0:0 {{(pid=116157) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Dec 15 03:06:42.921602 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.virt.hardware [None req-6a2b9ffe-08c3-47c0-b9b1-1f4829fefb73 tempest-AttachVolumeTestJSON-244989543 tempest-AttachVolumeTestJSON-244989543-project] Flavor pref 0:0:0 {{(pid=116157) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Dec 15 03:06:42.922098 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.virt.hardware [None req-6a2b9ffe-08c3-47c0-b9b1-1f4829fefb73 tempest-AttachVolumeTestJSON-244989543 tempest-AttachVolumeTestJSON-244989543-project] Image pref 0:0:0 {{(pid=116157) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Dec 15 03:06:42.922747 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.virt.hardware [None req-6a2b9ffe-08c3-47c0-b9b1-1f4829fefb73 tempest-AttachVolumeTestJSON-244989543 tempest-AttachVolumeTestJSON-244989543-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116157) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Dec 15 03:06:42.932864 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-6a2b9ffe-08c3-47c0-b9b1-1f4829fefb73 tempest-AttachVolumeTestJSON-244989543 tempest-AttachVolumeTestJSON-244989543-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:06:42.933584 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-6a2b9ffe-08c3-47c0-b9b1-1f4829fefb73 tempest-AttachVolumeTestJSON-244989543 tempest-AttachVolumeTestJSON-244989543-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:06:42.936430 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-6a2b9ffe-08c3-47c0-b9b1-1f4829fefb73 tempest-AttachVolumeTestJSON-244989543 tempest-AttachVolumeTestJSON-244989543-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:06:42.939554 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-6a2b9ffe-08c3-47c0-b9b1-1f4829fefb73 tempest-AttachVolumeTestJSON-244989543 tempest-AttachVolumeTestJSON-244989543-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:06:42.965298 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.quota [None req-6a2b9ffe-08c3-47c0-b9b1-1f4829fefb73 tempest-AttachVolumeTestJSON-244989543 tempest-AttachVolumeTestJSON-244989543-project] Getting quotas for project 00e76c2a092544e1a51928f1d84879b2. Resources: {'cores', 'instances', 'ram'} {{(pid=116157) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 15 03:06:42.973430 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.quota [None req-6a2b9ffe-08c3-47c0-b9b1-1f4829fefb73 tempest-AttachVolumeTestJSON-244989543 tempest-AttachVolumeTestJSON-244989543-project] Getting quotas for user a5fb31c3d4874e13ba22e0242d4aaa58 and project 00e76c2a092544e1a51928f1d84879b2. Resources: {'cores', 'instances', 'ram'} {{(pid=116157) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 15 03:06:42.988592 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.compute.api [None req-6a2b9ffe-08c3-47c0-b9b1-1f4829fefb73 tempest-AttachVolumeTestJSON-244989543 tempest-AttachVolumeTestJSON-244989543-project] Going to run 1 instances... {{(pid=116157) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Dec 15 03:06:42.993709 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.compute.api [None req-6a2b9ffe-08c3-47c0-b9b1-1f4829fefb73 tempest-AttachVolumeTestJSON-244989543 tempest-AttachVolumeTestJSON-244989543-project] [instance: f22dfea6-4599-43e4-93d5-d99f1db3b4fb] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='5195b034-9fa4-468b-a94d-ef3ee79ce449',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=116157) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Dec 15 03:06:43.049776 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: INFO nova.api.openstack.requestlog [None req-6a2b9ffe-08c3-47c0-b9b1-1f4829fefb73 tempest-AttachVolumeTestJSON-244989543 tempest-AttachVolumeTestJSON-244989543-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 1.595016 Dec 15 03:06:43.050446 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: [pid: 116157|app: 0|req: 273/567] 10.222.0.18 () {60 vars in 1146 bytes} [Wed Dec 15 03:06:41 2021] POST /compute/v2.1/servers => generated 401 bytes in 1596 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Dec 15 03:06:43.054868 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi [None req-632f9a78-df0c-4d48-ba07-3b077708e141 tempest-AttachVolumeNegativeTest-1640336653 tempest-AttachVolumeNegativeTest-1640336653-project] Calling method '>' {{(pid=116157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:06:43.055693 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.compute.api [None req-632f9a78-df0c-4d48-ba07-3b077708e141 tempest-AttachVolumeNegativeTest-1640336653 tempest-AttachVolumeNegativeTest-1640336653-project] [instance: 4923355f-95d6-443d-9487-574f56b87f66] Fetching instance by UUID {{(pid=116157) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:06:43.056338 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.policy [None req-40313241-e872-4f79-90b8-47c9accf881f tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c4c0c82448e40ba801c0b52ec44e74a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a093d0bf43046aaa845f3cc115f3f5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116156) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:06:43.065289 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-632f9a78-df0c-4d48-ba07-3b077708e141 tempest-AttachVolumeNegativeTest-1640336653 tempest-AttachVolumeNegativeTest-1640336653-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:06:43.066219 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-632f9a78-df0c-4d48-ba07-3b077708e141 tempest-AttachVolumeNegativeTest-1640336653 tempest-AttachVolumeNegativeTest-1640336653-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:06:43.067961 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: INFO nova.api.openstack.requestlog [None req-40313241-e872-4f79-90b8-47c9accf881f tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] 10.222.0.18 "GET /compute/v2.1/servers/fa7c86bc-c46f-4120-8f3d-d795f8d7c5cc" status: 200 len: 1260 microversion: 2.1 time: 0.227736 Dec 15 03:06:43.070036 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: [pid: 116156|app: 0|req: 295/568] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 03:06:42 2021] GET /compute/v2.1/servers/fa7c86bc-c46f-4120-8f3d-d795f8d7c5cc => generated 1260 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 03:06:43.070275 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-632f9a78-df0c-4d48-ba07-3b077708e141 tempest-AttachVolumeNegativeTest-1640336653 tempest-AttachVolumeNegativeTest-1640336653-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:06:43.070739 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-632f9a78-df0c-4d48-ba07-3b077708e141 tempest-AttachVolumeNegativeTest-1640336653 tempest-AttachVolumeNegativeTest-1640336653-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:06:43.093385 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi [None req-cff89983-8c07-4923-9438-066481725b7c tempest-AttachVolumeTestJSON-244989543 tempest-AttachVolumeTestJSON-244989543-project] Calling method '>' {{(pid=116156) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:06:43.094123 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.compute.api [None req-cff89983-8c07-4923-9438-066481725b7c tempest-AttachVolumeTestJSON-244989543 tempest-AttachVolumeTestJSON-244989543-project] [instance: f22dfea6-4599-43e4-93d5-d99f1db3b4fb] Fetching instance by UUID {{(pid=116156) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:06:43.190634 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.policy [None req-cff89983-8c07-4923-9438-066481725b7c tempest-AttachVolumeTestJSON-244989543 tempest-AttachVolumeTestJSON-244989543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5fb31c3d4874e13ba22e0242d4aaa58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00e76c2a092544e1a51928f1d84879b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116156) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:06:43.200597 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: INFO nova.api.openstack.requestlog [None req-cff89983-8c07-4923-9438-066481725b7c tempest-AttachVolumeTestJSON-244989543 tempest-AttachVolumeTestJSON-244989543-project] 10.222.0.18 "GET /compute/v2.1/servers/f22dfea6-4599-43e4-93d5-d99f1db3b4fb" status: 200 len: 1237 microversion: 2.1 time: 0.128499 Dec 15 03:06:43.201804 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: [pid: 116156|app: 0|req: 296/569] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 03:06:43 2021] GET /compute/v2.1/servers/f22dfea6-4599-43e4-93d5-d99f1db3b4fb => generated 1237 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 03:06:43.288362 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi [None req-64b8eca8-c7ce-474b-9c75-97a5e27ae749 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Calling method '>' {{(pid=116156) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:06:43.288608 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.policy [None req-632f9a78-df0c-4d48-ba07-3b077708e141 tempest-AttachVolumeNegativeTest-1640336653 tempest-AttachVolumeNegativeTest-1640336653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35d37a3d8e504b8186182468b77dd114', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '409b41637da94c469444954258444b4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116157) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:06:43.289807 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.compute.api [None req-64b8eca8-c7ce-474b-9c75-97a5e27ae749 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] [instance: b89094ac-aee1-4bd6-a33d-8c4347cebfc7] Fetching instance by UUID {{(pid=116156) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:06:43.299929 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-64b8eca8-c7ce-474b-9c75-97a5e27ae749 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:06:43.300384 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-64b8eca8-c7ce-474b-9c75-97a5e27ae749 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:06:43.301194 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-64b8eca8-c7ce-474b-9c75-97a5e27ae749 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:06:43.301630 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-64b8eca8-c7ce-474b-9c75-97a5e27ae749 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:06:43.307906 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: INFO nova.api.openstack.requestlog [None req-632f9a78-df0c-4d48-ba07-3b077708e141 tempest-AttachVolumeNegativeTest-1640336653 tempest-AttachVolumeNegativeTest-1640336653-project] 10.222.0.18 "GET /compute/v2.1/servers/4923355f-95d6-443d-9487-574f56b87f66" status: 200 len: 1514 microversion: 2.1 time: 0.254581 Dec 15 03:06:43.308935 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: [pid: 116157|app: 0|req: 274/570] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 03:06:43 2021] GET /compute/v2.1/servers/4923355f-95d6-443d-9487-574f56b87f66 => generated 1514 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 03:06:43.522086 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.policy [None req-64b8eca8-c7ce-474b-9c75-97a5e27ae749 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fedc11e2dbd74b919982a0657222cca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f16202549724b878f908d68384ec9c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116156) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:06:43.532875 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.policy [None req-64b8eca8-c7ce-474b-9c75-97a5e27ae749 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fedc11e2dbd74b919982a0657222cca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f16202549724b878f908d68384ec9c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116156) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:06:43.537204 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.policy [None req-64b8eca8-c7ce-474b-9c75-97a5e27ae749 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fedc11e2dbd74b919982a0657222cca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f16202549724b878f908d68384ec9c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116156) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:06:43.538680 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: INFO nova.api.openstack.requestlog [None req-64b8eca8-c7ce-474b-9c75-97a5e27ae749 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] 10.222.0.18 "GET /compute/v2.1/servers/b89094ac-aee1-4bd6-a33d-8c4347cebfc7" status: 200 len: 1738 microversion: 2.20 time: 0.254003 Dec 15 03:06:43.541389 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: [pid: 116156|app: 0|req: 297/571] 10.222.0.18 () {60 vars in 1276 bytes} [Wed Dec 15 03:06:43 2021] GET /compute/v2.1/servers/b89094ac-aee1-4bd6-a33d-8c4347cebfc7 => generated 1738 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Dec 15 03:06:44.084975 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi [None req-7f7a4e32-3676-4985-8e04-5bb36b2384c2 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Calling method '>' {{(pid=116157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:06:44.085600 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.compute.api [None req-7f7a4e32-3676-4985-8e04-5bb36b2384c2 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] [instance: fa7c86bc-c46f-4120-8f3d-d795f8d7c5cc] Fetching instance by UUID {{(pid=116157) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:06:44.098718 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-7f7a4e32-3676-4985-8e04-5bb36b2384c2 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:06:44.099380 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-7f7a4e32-3676-4985-8e04-5bb36b2384c2 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:06:44.100186 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-7f7a4e32-3676-4985-8e04-5bb36b2384c2 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:06:44.100631 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-7f7a4e32-3676-4985-8e04-5bb36b2384c2 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:06:44.226609 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi [None req-0c373804-10ec-40b2-835f-40e8f1b8806c tempest-AttachVolumeTestJSON-244989543 tempest-AttachVolumeTestJSON-244989543-project] Calling method '>' {{(pid=116156) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:06:44.227241 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.compute.api [None req-0c373804-10ec-40b2-835f-40e8f1b8806c tempest-AttachVolumeTestJSON-244989543 tempest-AttachVolumeTestJSON-244989543-project] [instance: f22dfea6-4599-43e4-93d5-d99f1db3b4fb] Fetching instance by UUID {{(pid=116156) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:06:44.247735 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-0c373804-10ec-40b2-835f-40e8f1b8806c tempest-AttachVolumeTestJSON-244989543 tempest-AttachVolumeTestJSON-244989543-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:06:44.248289 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-0c373804-10ec-40b2-835f-40e8f1b8806c tempest-AttachVolumeTestJSON-244989543 tempest-AttachVolumeTestJSON-244989543-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:06:44.248970 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-0c373804-10ec-40b2-835f-40e8f1b8806c tempest-AttachVolumeTestJSON-244989543 tempest-AttachVolumeTestJSON-244989543-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:06:44.249475 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-0c373804-10ec-40b2-835f-40e8f1b8806c tempest-AttachVolumeTestJSON-244989543 tempest-AttachVolumeTestJSON-244989543-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:06:44.319269 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.policy [None req-7f7a4e32-3676-4985-8e04-5bb36b2384c2 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c4c0c82448e40ba801c0b52ec44e74a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a093d0bf43046aaa845f3cc115f3f5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116157) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:06:44.340015 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: INFO nova.api.openstack.requestlog [None req-7f7a4e32-3676-4985-8e04-5bb36b2384c2 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] 10.222.0.18 "GET /compute/v2.1/servers/fa7c86bc-c46f-4120-8f3d-d795f8d7c5cc" status: 200 len: 1260 microversion: 2.1 time: 0.250296 Dec 15 03:06:44.341224 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: [pid: 116157|app: 0|req: 275/572] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 03:06:44 2021] GET /compute/v2.1/servers/fa7c86bc-c46f-4120-8f3d-d795f8d7c5cc => generated 1260 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 03:06:44.346053 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi [req-89df412b-3562-442b-8aab-726a458a7bf6 req-c7fd63dd-aa9f-405d-836c-16d52d9d6d6b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4923355f-95d6-443d-9487-574f56b87f66", "name": "network-vif-deleted", "tag": "a334403e-b33f-4832-89e4-ad890500445a"}]} {{(pid=116157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 03:06:44.347872 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 15 03:06:44.347872 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: warnings.warn(msg) Dec 15 03:06:44.367786 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [req-89df412b-3562-442b-8aab-726a458a7bf6 req-c7fd63dd-aa9f-405d-836c-16d52d9d6d6b service nova] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:06:44.370286 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [req-89df412b-3562-442b-8aab-726a458a7bf6 req-c7fd63dd-aa9f-405d-836c-16d52d9d6d6b service nova] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:06:44.394262 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: INFO nova.api.openstack.compute.server_external_events [req-89df412b-3562-442b-8aab-726a458a7bf6 req-c7fd63dd-aa9f-405d-836c-16d52d9d6d6b service nova] Creating event network-vif-deleted:a334403e-b33f-4832-89e4-ad890500445a for instance 4923355f-95d6-443d-9487-574f56b87f66 on hv-cinder-81803 Dec 15 03:06:44.400545 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: INFO nova.api.openstack.requestlog [req-89df412b-3562-442b-8aab-726a458a7bf6 req-c7fd63dd-aa9f-405d-836c-16d52d9d6d6b service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.057458 Dec 15 03:06:44.402147 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: [pid: 116157|app: 0|req: 276/573] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Dec 15 03:06:44 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 03:06:44.408463 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi [None req-fa2d86dd-0ed3-4432-9f9e-26f8bb4cc4c4 tempest-AttachVolumeNegativeTest-1640336653 tempest-AttachVolumeNegativeTest-1640336653-project] Calling method '>' {{(pid=116157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:06:44.409459 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.compute.api [None req-fa2d86dd-0ed3-4432-9f9e-26f8bb4cc4c4 tempest-AttachVolumeNegativeTest-1640336653 tempest-AttachVolumeNegativeTest-1640336653-project] [instance: 4923355f-95d6-443d-9487-574f56b87f66] Fetching instance by UUID {{(pid=116157) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:06:44.413800 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.policy [None req-0c373804-10ec-40b2-835f-40e8f1b8806c tempest-AttachVolumeTestJSON-244989543 tempest-AttachVolumeTestJSON-244989543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5fb31c3d4874e13ba22e0242d4aaa58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00e76c2a092544e1a51928f1d84879b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116156) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:06:44.426644 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: INFO nova.api.openstack.requestlog [None req-0c373804-10ec-40b2-835f-40e8f1b8806c tempest-AttachVolumeTestJSON-244989543 tempest-AttachVolumeTestJSON-244989543-project] 10.222.0.18 "GET /compute/v2.1/servers/f22dfea6-4599-43e4-93d5-d99f1db3b4fb" status: 200 len: 1289 microversion: 2.1 time: 0.211431 Dec 15 03:06:44.430502 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-fa2d86dd-0ed3-4432-9f9e-26f8bb4cc4c4 tempest-AttachVolumeNegativeTest-1640336653 tempest-AttachVolumeNegativeTest-1640336653-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:06:44.431152 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-fa2d86dd-0ed3-4432-9f9e-26f8bb4cc4c4 tempest-AttachVolumeNegativeTest-1640336653 tempest-AttachVolumeNegativeTest-1640336653-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:06:44.432493 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-fa2d86dd-0ed3-4432-9f9e-26f8bb4cc4c4 tempest-AttachVolumeNegativeTest-1640336653 tempest-AttachVolumeNegativeTest-1640336653-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:06:44.433157 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-fa2d86dd-0ed3-4432-9f9e-26f8bb4cc4c4 tempest-AttachVolumeNegativeTest-1640336653 tempest-AttachVolumeNegativeTest-1640336653-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:06:44.450090 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: [pid: 116156|app: 0|req: 298/574] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 03:06:44 2021] GET /compute/v2.1/servers/f22dfea6-4599-43e4-93d5-d99f1db3b4fb => generated 1289 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 03:06:44.476977 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-fa2d86dd-0ed3-4432-9f9e-26f8bb4cc4c4 tempest-AttachVolumeNegativeTest-1640336653 tempest-AttachVolumeNegativeTest-1640336653-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:06:44.477731 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-fa2d86dd-0ed3-4432-9f9e-26f8bb4cc4c4 tempest-AttachVolumeNegativeTest-1640336653 tempest-AttachVolumeNegativeTest-1640336653-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:06:44.478698 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.objects.instance [None req-fa2d86dd-0ed3-4432-9f9e-26f8bb4cc4c4 tempest-AttachVolumeNegativeTest-1640336653 tempest-AttachVolumeNegativeTest-1640336653-project] Lazy-loading 'fault' on Instance uuid 4923355f-95d6-443d-9487-574f56b87f66 {{(pid=116157) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Dec 15 03:06:44.534381 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.policy [None req-fa2d86dd-0ed3-4432-9f9e-26f8bb4cc4c4 tempest-AttachVolumeNegativeTest-1640336653 tempest-AttachVolumeNegativeTest-1640336653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35d37a3d8e504b8186182468b77dd114', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '409b41637da94c469444954258444b4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116157) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:06:44.541612 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: INFO nova.api.openstack.requestlog [None req-fa2d86dd-0ed3-4432-9f9e-26f8bb4cc4c4 tempest-AttachVolumeNegativeTest-1640336653 tempest-AttachVolumeNegativeTest-1640336653-project] 10.222.0.18 "GET /compute/v2.1/servers/4923355f-95d6-443d-9487-574f56b87f66" status: 200 len: 1308 microversion: 2.1 time: 0.137571 Dec 15 03:06:44.542457 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: [pid: 116157|app: 0|req: 277/575] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 03:06:44 2021] GET /compute/v2.1/servers/4923355f-95d6-443d-9487-574f56b87f66 => generated 1308 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 03:06:44.562279 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi [None req-fee3eeda-ad3c-4c2d-ba8e-21a28b0b82e4 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Calling method '>' {{(pid=116156) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:06:44.563809 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.compute.api [None req-fee3eeda-ad3c-4c2d-ba8e-21a28b0b82e4 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] [instance: b89094ac-aee1-4bd6-a33d-8c4347cebfc7] Fetching instance by UUID {{(pid=116156) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:06:44.585279 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-fee3eeda-ad3c-4c2d-ba8e-21a28b0b82e4 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:06:44.587308 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-fee3eeda-ad3c-4c2d-ba8e-21a28b0b82e4 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:06:44.588523 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-fee3eeda-ad3c-4c2d-ba8e-21a28b0b82e4 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:06:44.594783 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-fee3eeda-ad3c-4c2d-ba8e-21a28b0b82e4 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:06:44.777825 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.policy [None req-fee3eeda-ad3c-4c2d-ba8e-21a28b0b82e4 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fedc11e2dbd74b919982a0657222cca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f16202549724b878f908d68384ec9c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116156) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:06:44.789668 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.policy [None req-fee3eeda-ad3c-4c2d-ba8e-21a28b0b82e4 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fedc11e2dbd74b919982a0657222cca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f16202549724b878f908d68384ec9c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116156) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:06:44.791761 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.policy [None req-fee3eeda-ad3c-4c2d-ba8e-21a28b0b82e4 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fedc11e2dbd74b919982a0657222cca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f16202549724b878f908d68384ec9c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116156) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:06:44.793248 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: INFO nova.api.openstack.requestlog [None req-fee3eeda-ad3c-4c2d-ba8e-21a28b0b82e4 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] 10.222.0.18 "GET /compute/v2.1/servers/b89094ac-aee1-4bd6-a33d-8c4347cebfc7" status: 200 len: 1738 microversion: 2.20 time: 0.235059 Dec 15 03:06:44.806881 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: [pid: 116156|app: 0|req: 299/576] 10.222.0.18 () {60 vars in 1276 bytes} [Wed Dec 15 03:06:44 2021] GET /compute/v2.1/servers/b89094ac-aee1-4bd6-a33d-8c4347cebfc7 => generated 1738 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 03:06:45.357444 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi [None req-09035e83-ba19-418d-896a-1c9dd08b8a6a tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Calling method '>' {{(pid=116157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:06:45.358114 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.compute.api [None req-09035e83-ba19-418d-896a-1c9dd08b8a6a tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] [instance: fa7c86bc-c46f-4120-8f3d-d795f8d7c5cc] Fetching instance by UUID {{(pid=116157) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:06:45.373786 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-09035e83-ba19-418d-896a-1c9dd08b8a6a tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:06:45.374354 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-09035e83-ba19-418d-896a-1c9dd08b8a6a tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:06:45.375161 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-09035e83-ba19-418d-896a-1c9dd08b8a6a tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:06:45.375838 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-09035e83-ba19-418d-896a-1c9dd08b8a6a tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:06:45.444183 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi [None req-7edb40d4-f77b-450d-bcb9-2f85d7a5fda5 tempest-AttachVolumeTestJSON-244989543 tempest-AttachVolumeTestJSON-244989543-project] Calling method '>' {{(pid=116156) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:06:45.444754 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.compute.api [None req-7edb40d4-f77b-450d-bcb9-2f85d7a5fda5 tempest-AttachVolumeTestJSON-244989543 tempest-AttachVolumeTestJSON-244989543-project] [instance: f22dfea6-4599-43e4-93d5-d99f1db3b4fb] Fetching instance by UUID {{(pid=116156) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:06:45.455490 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-7edb40d4-f77b-450d-bcb9-2f85d7a5fda5 tempest-AttachVolumeTestJSON-244989543 tempest-AttachVolumeTestJSON-244989543-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:06:45.456340 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-7edb40d4-f77b-450d-bcb9-2f85d7a5fda5 tempest-AttachVolumeTestJSON-244989543 tempest-AttachVolumeTestJSON-244989543-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:06:45.458187 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-7edb40d4-f77b-450d-bcb9-2f85d7a5fda5 tempest-AttachVolumeTestJSON-244989543 tempest-AttachVolumeTestJSON-244989543-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:06:45.459668 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-7edb40d4-f77b-450d-bcb9-2f85d7a5fda5 tempest-AttachVolumeTestJSON-244989543 tempest-AttachVolumeTestJSON-244989543-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:06:45.652063 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.policy [None req-09035e83-ba19-418d-896a-1c9dd08b8a6a tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c4c0c82448e40ba801c0b52ec44e74a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a093d0bf43046aaa845f3cc115f3f5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116157) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:06:45.660449 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: INFO nova.api.openstack.requestlog [None req-09035e83-ba19-418d-896a-1c9dd08b8a6a tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] 10.222.0.18 "GET /compute/v2.1/servers/fa7c86bc-c46f-4120-8f3d-d795f8d7c5cc" status: 200 len: 1260 microversion: 2.1 time: 0.306816 Dec 15 03:06:45.664583 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: [pid: 116157|app: 0|req: 278/577] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 03:06:45 2021] GET /compute/v2.1/servers/fa7c86bc-c46f-4120-8f3d-d795f8d7c5cc => generated 1260 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 03:06:45.673072 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi [None req-f1cdb9a0-d7e5-4b23-9903-9a24127b32ef tempest-AttachVolumeNegativeTest-1640336653 tempest-AttachVolumeNegativeTest-1640336653-project] Calling method '>' {{(pid=116157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:06:45.686502 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.compute.api [None req-f1cdb9a0-d7e5-4b23-9903-9a24127b32ef tempest-AttachVolumeNegativeTest-1640336653 tempest-AttachVolumeNegativeTest-1640336653-project] [instance: 4923355f-95d6-443d-9487-574f56b87f66] Fetching instance by UUID {{(pid=116157) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:06:45.704893 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-f1cdb9a0-d7e5-4b23-9903-9a24127b32ef tempest-AttachVolumeNegativeTest-1640336653 tempest-AttachVolumeNegativeTest-1640336653-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:06:45.705470 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-f1cdb9a0-d7e5-4b23-9903-9a24127b32ef tempest-AttachVolumeNegativeTest-1640336653 tempest-AttachVolumeNegativeTest-1640336653-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:06:45.706722 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-f1cdb9a0-d7e5-4b23-9903-9a24127b32ef tempest-AttachVolumeNegativeTest-1640336653 tempest-AttachVolumeNegativeTest-1640336653-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:06:45.707359 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-f1cdb9a0-d7e5-4b23-9903-9a24127b32ef tempest-AttachVolumeNegativeTest-1640336653 tempest-AttachVolumeNegativeTest-1640336653-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:06:45.713266 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.policy [None req-7edb40d4-f77b-450d-bcb9-2f85d7a5fda5 tempest-AttachVolumeTestJSON-244989543 tempest-AttachVolumeTestJSON-244989543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5fb31c3d4874e13ba22e0242d4aaa58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00e76c2a092544e1a51928f1d84879b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116156) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:06:45.724239 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: INFO nova.api.openstack.requestlog [None req-7edb40d4-f77b-450d-bcb9-2f85d7a5fda5 tempest-AttachVolumeTestJSON-244989543 tempest-AttachVolumeTestJSON-244989543-project] 10.222.0.18 "GET /compute/v2.1/servers/f22dfea6-4599-43e4-93d5-d99f1db3b4fb" status: 200 len: 1362 microversion: 2.1 time: 0.281197 Dec 15 03:06:45.725555 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: [pid: 116156|app: 0|req: 300/578] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 03:06:45 2021] GET /compute/v2.1/servers/f22dfea6-4599-43e4-93d5-d99f1db3b4fb => generated 1362 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 03:06:45.726973 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: INFO nova.api.openstack.wsgi [None req-f1cdb9a0-d7e5-4b23-9903-9a24127b32ef tempest-AttachVolumeNegativeTest-1640336653 tempest-AttachVolumeNegativeTest-1640336653-project] HTTP exception thrown: Instance 4923355f-95d6-443d-9487-574f56b87f66 could not be found. Dec 15 03:06:45.727894 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi [None req-f1cdb9a0-d7e5-4b23-9903-9a24127b32ef tempest-AttachVolumeNegativeTest-1640336653 tempest-AttachVolumeNegativeTest-1640336653-project] Returning 404 to user: Instance 4923355f-95d6-443d-9487-574f56b87f66 could not be found. {{(pid=116157) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 15 03:06:45.729019 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: INFO nova.api.openstack.requestlog [None req-f1cdb9a0-d7e5-4b23-9903-9a24127b32ef tempest-AttachVolumeNegativeTest-1640336653 tempest-AttachVolumeNegativeTest-1640336653-project] 10.222.0.18 "GET /compute/v2.1/servers/4923355f-95d6-443d-9487-574f56b87f66" status: 404 len: 111 microversion: 2.1 time: 0.063219 Dec 15 03:06:45.730804 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: [pid: 116157|app: 0|req: 279/579] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 03:06:45 2021] GET /compute/v2.1/servers/4923355f-95d6-443d-9487-574f56b87f66 => generated 111 bytes in 65 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 15 03:06:45.814320 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi [None req-7fb3f377-8ea7-43d9-ae5d-67eaf29af57c tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Calling method '>' {{(pid=116156) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:06:45.814890 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.compute.api [None req-7fb3f377-8ea7-43d9-ae5d-67eaf29af57c tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] [instance: b89094ac-aee1-4bd6-a33d-8c4347cebfc7] Fetching instance by UUID {{(pid=116156) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:06:45.824075 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-7fb3f377-8ea7-43d9-ae5d-67eaf29af57c tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:06:45.825688 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-7fb3f377-8ea7-43d9-ae5d-67eaf29af57c tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:06:45.828481 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-7fb3f377-8ea7-43d9-ae5d-67eaf29af57c tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:06:45.831306 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-7fb3f377-8ea7-43d9-ae5d-67eaf29af57c tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:06:45.848989 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi [req-1ef2aa9a-9df5-4bc0-b8f4-b8a1a8e6f8a4 req-5b30726e-90bd-4a41-9028-0c9c743f699a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fa7c86bc-c46f-4120-8f3d-d795f8d7c5cc", "name": "network-vif-plugged", "status": "completed", "tag": "6bbc39c5-40bb-4350-a006-fae5a1ef78a6"}]} {{(pid=116157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 03:06:45.850620 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 15 03:06:45.850620 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: warnings.warn(msg) Dec 15 03:06:45.867836 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [req-1ef2aa9a-9df5-4bc0-b8f4-b8a1a8e6f8a4 req-5b30726e-90bd-4a41-9028-0c9c743f699a service nova] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:06:45.868468 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [req-1ef2aa9a-9df5-4bc0-b8f4-b8a1a8e6f8a4 req-5b30726e-90bd-4a41-9028-0c9c743f699a service nova] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:06:45.895268 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: INFO nova.api.openstack.compute.server_external_events [req-1ef2aa9a-9df5-4bc0-b8f4-b8a1a8e6f8a4 req-5b30726e-90bd-4a41-9028-0c9c743f699a service nova] Creating event network-vif-plugged:6bbc39c5-40bb-4350-a006-fae5a1ef78a6 for instance fa7c86bc-c46f-4120-8f3d-d795f8d7c5cc on hv-cinder-81803 Dec 15 03:06:45.903701 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: INFO nova.api.openstack.requestlog [req-1ef2aa9a-9df5-4bc0-b8f4-b8a1a8e6f8a4 req-5b30726e-90bd-4a41-9028-0c9c743f699a service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.059188 Dec 15 03:06:45.908272 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: [pid: 116157|app: 0|req: 280/580] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Dec 15 03:06:45 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 15 03:06:46.134089 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.policy [None req-7fb3f377-8ea7-43d9-ae5d-67eaf29af57c tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fedc11e2dbd74b919982a0657222cca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f16202549724b878f908d68384ec9c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116156) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:06:46.144259 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.policy [None req-7fb3f377-8ea7-43d9-ae5d-67eaf29af57c tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fedc11e2dbd74b919982a0657222cca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f16202549724b878f908d68384ec9c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116156) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:06:46.145785 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.policy [None req-7fb3f377-8ea7-43d9-ae5d-67eaf29af57c tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fedc11e2dbd74b919982a0657222cca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f16202549724b878f908d68384ec9c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116156) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:06:46.147503 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: INFO nova.api.openstack.requestlog [None req-7fb3f377-8ea7-43d9-ae5d-67eaf29af57c tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] 10.222.0.18 "GET /compute/v2.1/servers/b89094ac-aee1-4bd6-a33d-8c4347cebfc7" status: 200 len: 1738 microversion: 2.20 time: 0.337049 Dec 15 03:06:46.148286 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: [pid: 116156|app: 0|req: 301/581] 10.222.0.18 () {60 vars in 1276 bytes} [Wed Dec 15 03:06:45 2021] GET /compute/v2.1/servers/b89094ac-aee1-4bd6-a33d-8c4347cebfc7 => generated 1738 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 03:06:46.681793 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi [None req-260f1b0f-fcb7-45df-bf3d-7947f7f825a3 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Calling method '>' {{(pid=116157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:06:46.683796 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.compute.api [None req-260f1b0f-fcb7-45df-bf3d-7947f7f825a3 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] [instance: fa7c86bc-c46f-4120-8f3d-d795f8d7c5cc] Fetching instance by UUID {{(pid=116157) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:06:46.692198 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-260f1b0f-fcb7-45df-bf3d-7947f7f825a3 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:06:46.693089 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-260f1b0f-fcb7-45df-bf3d-7947f7f825a3 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:06:46.694350 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-260f1b0f-fcb7-45df-bf3d-7947f7f825a3 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:06:46.694785 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-260f1b0f-fcb7-45df-bf3d-7947f7f825a3 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:06:46.750909 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi [None req-57b6ef78-5548-444c-8380-d51b430aa8d4 tempest-AttachVolumeTestJSON-244989543 tempest-AttachVolumeTestJSON-244989543-project] Calling method '>' {{(pid=116156) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:06:46.751969 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.compute.api [None req-57b6ef78-5548-444c-8380-d51b430aa8d4 tempest-AttachVolumeTestJSON-244989543 tempest-AttachVolumeTestJSON-244989543-project] [instance: f22dfea6-4599-43e4-93d5-d99f1db3b4fb] Fetching instance by UUID {{(pid=116156) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:06:46.777716 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-57b6ef78-5548-444c-8380-d51b430aa8d4 tempest-AttachVolumeTestJSON-244989543 tempest-AttachVolumeTestJSON-244989543-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:06:46.778163 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-57b6ef78-5548-444c-8380-d51b430aa8d4 tempest-AttachVolumeTestJSON-244989543 tempest-AttachVolumeTestJSON-244989543-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:06:46.778964 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-57b6ef78-5548-444c-8380-d51b430aa8d4 tempest-AttachVolumeTestJSON-244989543 tempest-AttachVolumeTestJSON-244989543-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:06:46.779407 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-57b6ef78-5548-444c-8380-d51b430aa8d4 tempest-AttachVolumeTestJSON-244989543 tempest-AttachVolumeTestJSON-244989543-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:06:47.003404 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.policy [None req-260f1b0f-fcb7-45df-bf3d-7947f7f825a3 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c4c0c82448e40ba801c0b52ec44e74a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a093d0bf43046aaa845f3cc115f3f5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116157) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:06:47.012698 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: INFO nova.api.openstack.requestlog [None req-260f1b0f-fcb7-45df-bf3d-7947f7f825a3 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] 10.222.0.18 "GET /compute/v2.1/servers/fa7c86bc-c46f-4120-8f3d-d795f8d7c5cc" status: 200 len: 1260 microversion: 2.1 time: 0.336005 Dec 15 03:06:47.013700 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: [pid: 116157|app: 0|req: 281/582] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 03:06:46 2021] GET /compute/v2.1/servers/fa7c86bc-c46f-4120-8f3d-d795f8d7c5cc => generated 1260 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 03:06:47.019780 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi [req-55260a47-b50d-4fe8-b553-13e6cdeccb52 req-2fc765db-392e-4006-89ea-5620f455d40b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f22dfea6-4599-43e4-93d5-d99f1db3b4fb", "tag": "7cca5c1a-379b-494a-bcfb-406b62828d76"}]} {{(pid=116157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 03:06:47.021401 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 15 03:06:47.021401 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: warnings.warn(msg) Dec 15 03:06:47.044414 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [req-55260a47-b50d-4fe8-b553-13e6cdeccb52 req-2fc765db-392e-4006-89ea-5620f455d40b service nova] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:06:47.045140 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [req-55260a47-b50d-4fe8-b553-13e6cdeccb52 req-2fc765db-392e-4006-89ea-5620f455d40b service nova] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:06:47.064183 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: INFO nova.api.openstack.compute.server_external_events [req-55260a47-b50d-4fe8-b553-13e6cdeccb52 req-2fc765db-392e-4006-89ea-5620f455d40b service nova] Creating event network-changed:7cca5c1a-379b-494a-bcfb-406b62828d76 for instance f22dfea6-4599-43e4-93d5-d99f1db3b4fb on hv-cinder-81803 Dec 15 03:06:47.074091 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: INFO nova.api.openstack.requestlog [req-55260a47-b50d-4fe8-b553-13e6cdeccb52 req-2fc765db-392e-4006-89ea-5620f455d40b service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.058669 Dec 15 03:06:47.075357 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: [pid: 116157|app: 0|req: 282/583] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Dec 15 03:06:47 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 03:06:47.146404 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.policy [None req-57b6ef78-5548-444c-8380-d51b430aa8d4 tempest-AttachVolumeTestJSON-244989543 tempest-AttachVolumeTestJSON-244989543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5fb31c3d4874e13ba22e0242d4aaa58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00e76c2a092544e1a51928f1d84879b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116156) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:06:47.166728 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: INFO nova.api.openstack.requestlog [None req-57b6ef78-5548-444c-8380-d51b430aa8d4 tempest-AttachVolumeTestJSON-244989543 tempest-AttachVolumeTestJSON-244989543-project] 10.222.0.18 "GET /compute/v2.1/servers/f22dfea6-4599-43e4-93d5-d99f1db3b4fb" status: 200 len: 1362 microversion: 2.1 time: 0.424835 Dec 15 03:06:47.167869 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: [pid: 116156|app: 0|req: 302/584] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 03:06:46 2021] GET /compute/v2.1/servers/f22dfea6-4599-43e4-93d5-d99f1db3b4fb => generated 1362 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 03:06:47.169317 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi [None req-27be03d2-7e7a-415e-9de5-591fe9eb825a tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Calling method '>' {{(pid=116157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:06:47.170241 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.compute.api [None req-27be03d2-7e7a-415e-9de5-591fe9eb825a tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] [instance: b89094ac-aee1-4bd6-a33d-8c4347cebfc7] Fetching instance by UUID {{(pid=116157) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:06:47.184473 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-27be03d2-7e7a-415e-9de5-591fe9eb825a tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:06:47.184473 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-27be03d2-7e7a-415e-9de5-591fe9eb825a tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:06:47.184473 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-27be03d2-7e7a-415e-9de5-591fe9eb825a tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:06:47.187071 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-27be03d2-7e7a-415e-9de5-591fe9eb825a tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:06:47.530790 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.policy [None req-27be03d2-7e7a-415e-9de5-591fe9eb825a tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fedc11e2dbd74b919982a0657222cca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f16202549724b878f908d68384ec9c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116157) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:06:47.542207 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.policy [None req-27be03d2-7e7a-415e-9de5-591fe9eb825a tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fedc11e2dbd74b919982a0657222cca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f16202549724b878f908d68384ec9c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116157) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:06:47.543726 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.policy [None req-27be03d2-7e7a-415e-9de5-591fe9eb825a tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fedc11e2dbd74b919982a0657222cca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f16202549724b878f908d68384ec9c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116157) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:06:47.544920 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: INFO nova.api.openstack.requestlog [None req-27be03d2-7e7a-415e-9de5-591fe9eb825a tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] 10.222.0.18 "GET /compute/v2.1/servers/b89094ac-aee1-4bd6-a33d-8c4347cebfc7" status: 200 len: 1738 microversion: 2.20 time: 0.381759 Dec 15 03:06:47.559526 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: [pid: 116157|app: 0|req: 283/585] 10.222.0.18 () {60 vars in 1276 bytes} [Wed Dec 15 03:06:47 2021] GET /compute/v2.1/servers/b89094ac-aee1-4bd6-a33d-8c4347cebfc7 => generated 1738 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Dec 15 03:06:47.714674 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi [None req-2dd1cf5c-3ae2-4880-a509-92487f5f3d78 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1912518146", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-2120609320", "security_groups": [{"name": "tempest-secgroup-smoke-415417953"}], "block_device_mapping_v2": [{"uuid": "c154ab69-e2e9-4450-b74e-edd3310b0810", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "9bfb10c8-eae8-458b-b8f3-4697ea0f8034"}]}} {{(pid=116156) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 03:06:47.883507 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.network.neutron [None req-2dd1cf5c-3ae2-4880-a509-92487f5f3d78 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] validate_networks() for [('9bfb10c8-eae8-458b-b8f3-4697ea0f8034', None, None, None, None, None)] {{(pid=116156) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Dec 15 03:06:48.028883 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi [None req-3c06db37-37bd-4736-b7fc-0dae6cb399c2 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Calling method '>' {{(pid=116157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:06:48.030530 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.compute.api [None req-3c06db37-37bd-4736-b7fc-0dae6cb399c2 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] [instance: fa7c86bc-c46f-4120-8f3d-d795f8d7c5cc] Fetching instance by UUID {{(pid=116157) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:06:48.058840 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-3c06db37-37bd-4736-b7fc-0dae6cb399c2 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:06:48.059700 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-3c06db37-37bd-4736-b7fc-0dae6cb399c2 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:06:48.060803 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-3c06db37-37bd-4736-b7fc-0dae6cb399c2 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:06:48.061493 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-3c06db37-37bd-4736-b7fc-0dae6cb399c2 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:06:48.301569 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.policy [None req-3c06db37-37bd-4736-b7fc-0dae6cb399c2 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c4c0c82448e40ba801c0b52ec44e74a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a093d0bf43046aaa845f3cc115f3f5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116157) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:06:48.310787 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: INFO nova.api.openstack.requestlog [None req-3c06db37-37bd-4736-b7fc-0dae6cb399c2 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] 10.222.0.18 "GET /compute/v2.1/servers/fa7c86bc-c46f-4120-8f3d-d795f8d7c5cc" status: 200 len: 1445 microversion: 2.1 time: 0.285769 Dec 15 03:06:48.311368 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: [pid: 116157|app: 0|req: 284/586] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 03:06:48 2021] GET /compute/v2.1/servers/fa7c86bc-c46f-4120-8f3d-d795f8d7c5cc => generated 1445 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 03:06:48.335235 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi [None req-5efa36e2-a996-4cb8-aee8-3a3226f81bd5 tempest-AttachVolumeTestJSON-244989543 tempest-AttachVolumeTestJSON-244989543-project] Calling method '>' {{(pid=116157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:06:48.335848 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.compute.api [None req-5efa36e2-a996-4cb8-aee8-3a3226f81bd5 tempest-AttachVolumeTestJSON-244989543 tempest-AttachVolumeTestJSON-244989543-project] [instance: f22dfea6-4599-43e4-93d5-d99f1db3b4fb] Fetching instance by UUID {{(pid=116157) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:06:48.352058 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-5efa36e2-a996-4cb8-aee8-3a3226f81bd5 tempest-AttachVolumeTestJSON-244989543 tempest-AttachVolumeTestJSON-244989543-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:06:48.352513 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-5efa36e2-a996-4cb8-aee8-3a3226f81bd5 tempest-AttachVolumeTestJSON-244989543 tempest-AttachVolumeTestJSON-244989543-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:06:48.355421 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-5efa36e2-a996-4cb8-aee8-3a3226f81bd5 tempest-AttachVolumeTestJSON-244989543 tempest-AttachVolumeTestJSON-244989543-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:06:48.355877 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-5efa36e2-a996-4cb8-aee8-3a3226f81bd5 tempest-AttachVolumeTestJSON-244989543 tempest-AttachVolumeTestJSON-244989543-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:06:48.505189 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.virt.hardware [None req-2dd1cf5c-3ae2-4880-a509-92487f5f3d78 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Flavor limits 0:0:0 {{(pid=116156) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Dec 15 03:06:48.507570 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.virt.hardware [None req-2dd1cf5c-3ae2-4880-a509-92487f5f3d78 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Image limits 0:0:0 {{(pid=116156) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Dec 15 03:06:48.508251 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.virt.hardware [None req-2dd1cf5c-3ae2-4880-a509-92487f5f3d78 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Flavor pref 0:0:0 {{(pid=116156) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Dec 15 03:06:48.508882 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.virt.hardware [None req-2dd1cf5c-3ae2-4880-a509-92487f5f3d78 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Image pref 0:0:0 {{(pid=116156) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Dec 15 03:06:48.510009 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.virt.hardware [None req-2dd1cf5c-3ae2-4880-a509-92487f5f3d78 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116156) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Dec 15 03:06:48.532024 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-2dd1cf5c-3ae2-4880-a509-92487f5f3d78 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:06:48.532920 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-2dd1cf5c-3ae2-4880-a509-92487f5f3d78 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:06:48.534299 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-2dd1cf5c-3ae2-4880-a509-92487f5f3d78 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:06:48.534998 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-2dd1cf5c-3ae2-4880-a509-92487f5f3d78 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:06:48.562377 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.quota [None req-2dd1cf5c-3ae2-4880-a509-92487f5f3d78 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Getting quotas for project 494b56bf5eae4d56a5591546f85bc32b. Resources: {'cores', 'instances', 'ram'} {{(pid=116156) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 15 03:06:48.567825 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.quota [None req-2dd1cf5c-3ae2-4880-a509-92487f5f3d78 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Getting quotas for user 97bdf19af9e34fc3886ff451cb9d7a27 and project 494b56bf5eae4d56a5591546f85bc32b. Resources: {'cores', 'instances', 'ram'} {{(pid=116156) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 15 03:06:48.627976 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.policy [None req-5efa36e2-a996-4cb8-aee8-3a3226f81bd5 tempest-AttachVolumeTestJSON-244989543 tempest-AttachVolumeTestJSON-244989543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5fb31c3d4874e13ba22e0242d4aaa58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00e76c2a092544e1a51928f1d84879b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116157) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:06:48.636056 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: INFO nova.api.openstack.requestlog [None req-5efa36e2-a996-4cb8-aee8-3a3226f81bd5 tempest-AttachVolumeTestJSON-244989543 tempest-AttachVolumeTestJSON-244989543-project] 10.222.0.18 "GET /compute/v2.1/servers/f22dfea6-4599-43e4-93d5-d99f1db3b4fb" status: 200 len: 1362 microversion: 2.1 time: 0.323690 Dec 15 03:06:48.638848 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: [pid: 116157|app: 0|req: 285/587] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 03:06:48 2021] GET /compute/v2.1/servers/f22dfea6-4599-43e4-93d5-d99f1db3b4fb => generated 1362 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 03:06:48.656850 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi [None req-e048f00c-020e-479a-810d-602529a7a287 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Calling method '>' {{(pid=116157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:06:48.660692 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.compute.api [None req-e048f00c-020e-479a-810d-602529a7a287 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] [instance: fa7c86bc-c46f-4120-8f3d-d795f8d7c5cc] Fetching instance by UUID {{(pid=116157) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:06:48.678562 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.compute.api [None req-2dd1cf5c-3ae2-4880-a509-92487f5f3d78 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Going to run 1 instances... {{(pid=116156) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Dec 15 03:06:48.679544 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-e048f00c-020e-479a-810d-602529a7a287 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:06:48.680128 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-e048f00c-020e-479a-810d-602529a7a287 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:06:48.681058 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-e048f00c-020e-479a-810d-602529a7a287 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:06:48.681186 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.compute.api [None req-2dd1cf5c-3ae2-4880-a509-92487f5f3d78 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] [instance: bbb8462c-9501-4541-b67e-43ec5c5061a7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='c154ab69-e2e9-4450-b74e-edd3310b0810',volume_size=None,volume_type=None)] {{(pid=116156) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Dec 15 03:06:48.681822 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-e048f00c-020e-479a-810d-602529a7a287 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:06:48.853845 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.policy [None req-e048f00c-020e-479a-810d-602529a7a287 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c4c0c82448e40ba801c0b52ec44e74a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a093d0bf43046aaa845f3cc115f3f5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116157) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:06:48.869655 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: INFO nova.api.openstack.requestlog [None req-e048f00c-020e-479a-810d-602529a7a287 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] 10.222.0.18 "GET /compute/v2.1/servers/fa7c86bc-c46f-4120-8f3d-d795f8d7c5cc" status: 200 len: 1445 microversion: 2.1 time: 0.226772 Dec 15 03:06:48.870508 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: [pid: 116157|app: 0|req: 286/588] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 03:06:48 2021] GET /compute/v2.1/servers/fa7c86bc-c46f-4120-8f3d-d795f8d7c5cc => generated 1445 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 03:06:48.874906 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi [None req-89b1e42b-5d87-4454-8e3e-e280a282f6ea tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Calling method '>' {{(pid=116157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:06:48.875582 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.compute.api [None req-89b1e42b-5d87-4454-8e3e-e280a282f6ea tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] [instance: b89094ac-aee1-4bd6-a33d-8c4347cebfc7] Fetching instance by UUID {{(pid=116157) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:06:48.881326 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-89b1e42b-5d87-4454-8e3e-e280a282f6ea tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:06:48.881765 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-89b1e42b-5d87-4454-8e3e-e280a282f6ea tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:06:48.882876 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-89b1e42b-5d87-4454-8e3e-e280a282f6ea tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:06:48.883315 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-89b1e42b-5d87-4454-8e3e-e280a282f6ea tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:06:48.890682 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: INFO nova.api.openstack.requestlog [None req-2dd1cf5c-3ae2-4880-a509-92487f5f3d78 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 1.180008 Dec 15 03:06:48.896583 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: [pid: 116156|app: 0|req: 303/589] 10.222.0.18 () {60 vars in 1146 bytes} [Wed Dec 15 03:06:47 2021] POST /compute/v2.1/servers => generated 405 bytes in 1182 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Dec 15 03:06:48.908405 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi [None req-9d27e28a-c186-42ae-8b7d-84262be075aa tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Calling method '>' {{(pid=116156) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:06:48.910275 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.compute.api [None req-9d27e28a-c186-42ae-8b7d-84262be075aa tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] [instance: bbb8462c-9501-4541-b67e-43ec5c5061a7] Fetching instance by UUID {{(pid=116156) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:06:49.060404 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.policy [None req-9d27e28a-c186-42ae-8b7d-84262be075aa tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97bdf19af9e34fc3886ff451cb9d7a27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '494b56bf5eae4d56a5591546f85bc32b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116156) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:06:49.068976 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: INFO nova.api.openstack.requestlog [None req-9d27e28a-c186-42ae-8b7d-84262be075aa tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] 10.222.0.18 "GET /compute/v2.1/servers/bbb8462c-9501-4541-b67e-43ec5c5061a7" status: 200 len: 1095 microversion: 2.1 time: 0.170759 Dec 15 03:06:49.074693 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: [pid: 116156|app: 0|req: 304/590] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 03:06:48 2021] GET /compute/v2.1/servers/bbb8462c-9501-4541-b67e-43ec5c5061a7 => generated 1095 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 03:06:49.209466 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.policy [None req-89b1e42b-5d87-4454-8e3e-e280a282f6ea tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fedc11e2dbd74b919982a0657222cca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f16202549724b878f908d68384ec9c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116157) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:06:49.228743 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.policy [None req-89b1e42b-5d87-4454-8e3e-e280a282f6ea tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fedc11e2dbd74b919982a0657222cca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f16202549724b878f908d68384ec9c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116157) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:06:49.231213 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.policy [None req-89b1e42b-5d87-4454-8e3e-e280a282f6ea tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fedc11e2dbd74b919982a0657222cca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f16202549724b878f908d68384ec9c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116157) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:06:49.236163 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: INFO nova.api.openstack.requestlog [None req-89b1e42b-5d87-4454-8e3e-e280a282f6ea tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] 10.222.0.18 "GET /compute/v2.1/servers/b89094ac-aee1-4bd6-a33d-8c4347cebfc7" status: 200 len: 1738 microversion: 2.20 time: 0.364880 Dec 15 03:06:49.239349 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: [pid: 116157|app: 0|req: 287/591] 10.222.0.18 () {60 vars in 1276 bytes} [Wed Dec 15 03:06:48 2021] GET /compute/v2.1/servers/b89094ac-aee1-4bd6-a33d-8c4347cebfc7 => generated 1738 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 03:06:49.658593 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi [None req-e1ad848a-d334-43f9-aae0-9a34be03bba6 tempest-AttachVolumeTestJSON-244989543 tempest-AttachVolumeTestJSON-244989543-project] Calling method '>' {{(pid=116156) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:06:49.659288 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.compute.api [None req-e1ad848a-d334-43f9-aae0-9a34be03bba6 tempest-AttachVolumeTestJSON-244989543 tempest-AttachVolumeTestJSON-244989543-project] [instance: f22dfea6-4599-43e4-93d5-d99f1db3b4fb] Fetching instance by UUID {{(pid=116156) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:06:49.674608 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-e1ad848a-d334-43f9-aae0-9a34be03bba6 tempest-AttachVolumeTestJSON-244989543 tempest-AttachVolumeTestJSON-244989543-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:06:49.675925 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-e1ad848a-d334-43f9-aae0-9a34be03bba6 tempest-AttachVolumeTestJSON-244989543 tempest-AttachVolumeTestJSON-244989543-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:06:49.678580 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-e1ad848a-d334-43f9-aae0-9a34be03bba6 tempest-AttachVolumeTestJSON-244989543 tempest-AttachVolumeTestJSON-244989543-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:06:49.680005 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-e1ad848a-d334-43f9-aae0-9a34be03bba6 tempest-AttachVolumeTestJSON-244989543 tempest-AttachVolumeTestJSON-244989543-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:06:49.985648 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.policy [None req-e1ad848a-d334-43f9-aae0-9a34be03bba6 tempest-AttachVolumeTestJSON-244989543 tempest-AttachVolumeTestJSON-244989543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5fb31c3d4874e13ba22e0242d4aaa58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00e76c2a092544e1a51928f1d84879b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116156) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:06:49.997504 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: INFO nova.api.openstack.requestlog [None req-e1ad848a-d334-43f9-aae0-9a34be03bba6 tempest-AttachVolumeTestJSON-244989543 tempest-AttachVolumeTestJSON-244989543-project] 10.222.0.18 "GET /compute/v2.1/servers/f22dfea6-4599-43e4-93d5-d99f1db3b4fb" status: 200 len: 1362 microversion: 2.1 time: 0.345521 Dec 15 03:06:50.002028 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: [pid: 116156|app: 0|req: 305/592] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 03:06:49 2021] GET /compute/v2.1/servers/f22dfea6-4599-43e4-93d5-d99f1db3b4fb => generated 1362 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 03:06:50.093518 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi [None req-c65ead90-1466-4702-9932-e231703073c1 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Calling method '>' {{(pid=116157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:06:50.095127 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.compute.api [None req-c65ead90-1466-4702-9932-e231703073c1 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] [instance: bbb8462c-9501-4541-b67e-43ec5c5061a7] Fetching instance by UUID {{(pid=116157) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:06:50.103760 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-c65ead90-1466-4702-9932-e231703073c1 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:06:50.104475 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-c65ead90-1466-4702-9932-e231703073c1 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:06:50.106164 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-c65ead90-1466-4702-9932-e231703073c1 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:06:50.106961 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-c65ead90-1466-4702-9932-e231703073c1 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:06:50.208684 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.policy [None req-c65ead90-1466-4702-9932-e231703073c1 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97bdf19af9e34fc3886ff451cb9d7a27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '494b56bf5eae4d56a5591546f85bc32b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116157) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:06:50.222639 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: INFO nova.api.openstack.requestlog [None req-c65ead90-1466-4702-9932-e231703073c1 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] 10.222.0.18 "GET /compute/v2.1/servers/bbb8462c-9501-4541-b67e-43ec5c5061a7" status: 200 len: 1193 microversion: 2.1 time: 0.134020 Dec 15 03:06:50.232770 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: [pid: 116157|app: 0|req: 288/593] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 03:06:50 2021] GET /compute/v2.1/servers/bbb8462c-9501-4541-b67e-43ec5c5061a7 => generated 1193 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 03:06:50.256485 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi [None req-bcde6e6a-0a5f-431b-bfaf-d8cb2a89fb79 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Calling method '>' {{(pid=116156) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:06:50.257412 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.compute.api [None req-bcde6e6a-0a5f-431b-bfaf-d8cb2a89fb79 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] [instance: b89094ac-aee1-4bd6-a33d-8c4347cebfc7] Fetching instance by UUID {{(pid=116156) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:06:50.266898 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-bcde6e6a-0a5f-431b-bfaf-d8cb2a89fb79 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:06:50.273782 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-bcde6e6a-0a5f-431b-bfaf-d8cb2a89fb79 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:06:50.277772 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-bcde6e6a-0a5f-431b-bfaf-d8cb2a89fb79 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:06:50.278895 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-bcde6e6a-0a5f-431b-bfaf-d8cb2a89fb79 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:06:50.567101 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.policy [None req-bcde6e6a-0a5f-431b-bfaf-d8cb2a89fb79 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fedc11e2dbd74b919982a0657222cca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f16202549724b878f908d68384ec9c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116156) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:06:50.577015 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.policy [None req-bcde6e6a-0a5f-431b-bfaf-d8cb2a89fb79 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fedc11e2dbd74b919982a0657222cca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f16202549724b878f908d68384ec9c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116156) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:06:50.578783 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.policy [None req-bcde6e6a-0a5f-431b-bfaf-d8cb2a89fb79 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fedc11e2dbd74b919982a0657222cca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f16202549724b878f908d68384ec9c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116156) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:06:50.580133 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: INFO nova.api.openstack.requestlog [None req-bcde6e6a-0a5f-431b-bfaf-d8cb2a89fb79 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] 10.222.0.18 "GET /compute/v2.1/servers/b89094ac-aee1-4bd6-a33d-8c4347cebfc7" status: 200 len: 1738 microversion: 2.20 time: 0.327309 Dec 15 03:06:50.580888 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: [pid: 116156|app: 0|req: 306/594] 10.222.0.18 () {60 vars in 1276 bytes} [Wed Dec 15 03:06:50 2021] GET /compute/v2.1/servers/b89094ac-aee1-4bd6-a33d-8c4347cebfc7 => generated 1738 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 03:06:51.017597 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi [None req-3250fb95-8522-49d5-8649-bd569e3fb06b tempest-AttachVolumeTestJSON-244989543 tempest-AttachVolumeTestJSON-244989543-project] Calling method '>' {{(pid=116157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:06:51.018667 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.compute.api [None req-3250fb95-8522-49d5-8649-bd569e3fb06b tempest-AttachVolumeTestJSON-244989543 tempest-AttachVolumeTestJSON-244989543-project] [instance: f22dfea6-4599-43e4-93d5-d99f1db3b4fb] Fetching instance by UUID {{(pid=116157) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:06:51.025352 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-3250fb95-8522-49d5-8649-bd569e3fb06b tempest-AttachVolumeTestJSON-244989543 tempest-AttachVolumeTestJSON-244989543-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:06:51.026203 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-3250fb95-8522-49d5-8649-bd569e3fb06b tempest-AttachVolumeTestJSON-244989543 tempest-AttachVolumeTestJSON-244989543-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:06:51.027329 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-3250fb95-8522-49d5-8649-bd569e3fb06b tempest-AttachVolumeTestJSON-244989543 tempest-AttachVolumeTestJSON-244989543-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:06:51.027847 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-3250fb95-8522-49d5-8649-bd569e3fb06b tempest-AttachVolumeTestJSON-244989543 tempest-AttachVolumeTestJSON-244989543-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:06:51.242619 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi [None req-e7692c8e-9809-4dd1-87cc-3597faa799f4 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Calling method '>' {{(pid=116156) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:06:51.243948 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.compute.api [None req-e7692c8e-9809-4dd1-87cc-3597faa799f4 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] [instance: bbb8462c-9501-4541-b67e-43ec5c5061a7] Fetching instance by UUID {{(pid=116156) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:06:51.251541 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-e7692c8e-9809-4dd1-87cc-3597faa799f4 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:06:51.251992 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-e7692c8e-9809-4dd1-87cc-3597faa799f4 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:06:51.252804 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-e7692c8e-9809-4dd1-87cc-3597faa799f4 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:06:51.253237 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-e7692c8e-9809-4dd1-87cc-3597faa799f4 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:06:51.363489 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.policy [None req-3250fb95-8522-49d5-8649-bd569e3fb06b tempest-AttachVolumeTestJSON-244989543 tempest-AttachVolumeTestJSON-244989543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5fb31c3d4874e13ba22e0242d4aaa58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00e76c2a092544e1a51928f1d84879b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116157) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:06:51.368089 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.policy [None req-e7692c8e-9809-4dd1-87cc-3597faa799f4 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97bdf19af9e34fc3886ff451cb9d7a27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '494b56bf5eae4d56a5591546f85bc32b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116156) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:06:51.400504 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: INFO nova.api.openstack.requestlog [None req-e7692c8e-9809-4dd1-87cc-3597faa799f4 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] 10.222.0.18 "GET /compute/v2.1/servers/bbb8462c-9501-4541-b67e-43ec5c5061a7" status: 200 len: 1211 microversion: 2.1 time: 0.162893 Dec 15 03:06:51.406585 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: [pid: 116156|app: 0|req: 307/595] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 03:06:51 2021] GET /compute/v2.1/servers/bbb8462c-9501-4541-b67e-43ec5c5061a7 => generated 1211 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 03:06:51.406831 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: INFO nova.api.openstack.requestlog [None req-3250fb95-8522-49d5-8649-bd569e3fb06b tempest-AttachVolumeTestJSON-244989543 tempest-AttachVolumeTestJSON-244989543-project] 10.222.0.18 "GET /compute/v2.1/servers/f22dfea6-4599-43e4-93d5-d99f1db3b4fb" status: 200 len: 1362 microversion: 2.1 time: 0.389586 Dec 15 03:06:51.407672 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: [pid: 116157|app: 0|req: 289/596] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 03:06:51 2021] GET /compute/v2.1/servers/f22dfea6-4599-43e4-93d5-d99f1db3b4fb => generated 1362 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 03:06:51.600302 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi [None req-9788821b-893a-4b94-ab63-68de01712c30 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Calling method '>' {{(pid=116156) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:06:51.601120 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.compute.api [None req-9788821b-893a-4b94-ab63-68de01712c30 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] [instance: b89094ac-aee1-4bd6-a33d-8c4347cebfc7] Fetching instance by UUID {{(pid=116156) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:06:51.612614 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-9788821b-893a-4b94-ab63-68de01712c30 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:06:51.613456 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-9788821b-893a-4b94-ab63-68de01712c30 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:06:51.614648 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-9788821b-893a-4b94-ab63-68de01712c30 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:06:51.616084 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-9788821b-893a-4b94-ab63-68de01712c30 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:06:51.874321 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.policy [None req-9788821b-893a-4b94-ab63-68de01712c30 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fedc11e2dbd74b919982a0657222cca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f16202549724b878f908d68384ec9c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116156) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:06:51.887335 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi [req-7091bd1f-468d-400e-9e63-7dbfd2bd25f4 req-c8eb7ecd-a556-4a5a-8217-fd068502c5c1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f22dfea6-4599-43e4-93d5-d99f1db3b4fb", "name": "network-vif-plugged", "status": "completed", "tag": "7cca5c1a-379b-494a-bcfb-406b62828d76"}]} {{(pid=116157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 03:06:51.889246 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 15 03:06:51.889246 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: warnings.warn(msg) Dec 15 03:06:51.897202 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.policy [None req-9788821b-893a-4b94-ab63-68de01712c30 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fedc11e2dbd74b919982a0657222cca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f16202549724b878f908d68384ec9c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116156) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:06:51.897368 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [req-7091bd1f-468d-400e-9e63-7dbfd2bd25f4 req-c8eb7ecd-a556-4a5a-8217-fd068502c5c1 service nova] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:06:51.897902 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [req-7091bd1f-468d-400e-9e63-7dbfd2bd25f4 req-c8eb7ecd-a556-4a5a-8217-fd068502c5c1 service nova] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:06:51.898740 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.policy [None req-9788821b-893a-4b94-ab63-68de01712c30 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fedc11e2dbd74b919982a0657222cca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f16202549724b878f908d68384ec9c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116156) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:06:51.910461 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: INFO nova.api.openstack.requestlog [None req-9788821b-893a-4b94-ab63-68de01712c30 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] 10.222.0.18 "GET /compute/v2.1/servers/b89094ac-aee1-4bd6-a33d-8c4347cebfc7" status: 200 len: 1738 microversion: 2.20 time: 0.314560 Dec 15 03:06:51.912427 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: [pid: 116156|app: 0|req: 308/597] 10.222.0.18 () {60 vars in 1276 bytes} [Wed Dec 15 03:06:51 2021] GET /compute/v2.1/servers/b89094ac-aee1-4bd6-a33d-8c4347cebfc7 => generated 1738 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 03:06:51.927145 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: INFO nova.api.openstack.compute.server_external_events [req-7091bd1f-468d-400e-9e63-7dbfd2bd25f4 req-c8eb7ecd-a556-4a5a-8217-fd068502c5c1 service nova] Creating event network-vif-plugged:7cca5c1a-379b-494a-bcfb-406b62828d76 for instance f22dfea6-4599-43e4-93d5-d99f1db3b4fb on hv-cinder-81803 Dec 15 03:06:51.941194 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: INFO nova.api.openstack.requestlog [req-7091bd1f-468d-400e-9e63-7dbfd2bd25f4 req-c8eb7ecd-a556-4a5a-8217-fd068502c5c1 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.057822 Dec 15 03:06:51.944084 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: [pid: 116157|app: 0|req: 290/598] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Dec 15 03:06:51 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 15 03:06:52.429719 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi [None req-c8e5adde-af3a-414f-9073-286818268abe tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Calling method '>' {{(pid=116156) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:06:52.430398 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.compute.api [None req-c8e5adde-af3a-414f-9073-286818268abe tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] [instance: bbb8462c-9501-4541-b67e-43ec5c5061a7] Fetching instance by UUID {{(pid=116156) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:06:52.438516 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi [None req-cca9d776-d6da-4a42-bac7-8c51dd350a9d tempest-AttachVolumeTestJSON-244989543 tempest-AttachVolumeTestJSON-244989543-project] Calling method '>' {{(pid=116157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:06:52.439221 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.compute.api [None req-cca9d776-d6da-4a42-bac7-8c51dd350a9d tempest-AttachVolumeTestJSON-244989543 tempest-AttachVolumeTestJSON-244989543-project] [instance: f22dfea6-4599-43e4-93d5-d99f1db3b4fb] Fetching instance by UUID {{(pid=116157) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:06:52.446451 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-c8e5adde-af3a-414f-9073-286818268abe tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:06:52.446922 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-c8e5adde-af3a-414f-9073-286818268abe tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:06:52.447936 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-c8e5adde-af3a-414f-9073-286818268abe tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:06:52.448373 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-c8e5adde-af3a-414f-9073-286818268abe tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:06:52.449063 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-cca9d776-d6da-4a42-bac7-8c51dd350a9d tempest-AttachVolumeTestJSON-244989543 tempest-AttachVolumeTestJSON-244989543-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:06:52.449518 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-cca9d776-d6da-4a42-bac7-8c51dd350a9d tempest-AttachVolumeTestJSON-244989543 tempest-AttachVolumeTestJSON-244989543-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:06:52.450356 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-cca9d776-d6da-4a42-bac7-8c51dd350a9d tempest-AttachVolumeTestJSON-244989543 tempest-AttachVolumeTestJSON-244989543-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:06:52.450779 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-cca9d776-d6da-4a42-bac7-8c51dd350a9d tempest-AttachVolumeTestJSON-244989543 tempest-AttachVolumeTestJSON-244989543-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:06:52.597547 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.policy [None req-c8e5adde-af3a-414f-9073-286818268abe tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97bdf19af9e34fc3886ff451cb9d7a27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '494b56bf5eae4d56a5591546f85bc32b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116156) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:06:52.604859 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: INFO nova.api.openstack.requestlog [None req-c8e5adde-af3a-414f-9073-286818268abe tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] 10.222.0.18 "GET /compute/v2.1/servers/bbb8462c-9501-4541-b67e-43ec5c5061a7" status: 200 len: 1266 microversion: 2.1 time: 0.179157 Dec 15 03:06:52.614996 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: [pid: 116156|app: 0|req: 309/599] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 03:06:52 2021] GET /compute/v2.1/servers/bbb8462c-9501-4541-b67e-43ec5c5061a7 => generated 1266 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 03:06:52.725263 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi [req-9fb94696-52d2-4dce-aceb-75953312b0d3 req-7e6ab2da-6988-49b0-bb37-9f43a644da30 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fa7c86bc-c46f-4120-8f3d-d795f8d7c5cc", "tag": "6bbc39c5-40bb-4350-a006-fae5a1ef78a6"}]} {{(pid=116156) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 03:06:52.727381 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 15 03:06:52.727381 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: warnings.warn(msg) Dec 15 03:06:52.733672 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.policy [None req-cca9d776-d6da-4a42-bac7-8c51dd350a9d tempest-AttachVolumeTestJSON-244989543 tempest-AttachVolumeTestJSON-244989543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5fb31c3d4874e13ba22e0242d4aaa58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00e76c2a092544e1a51928f1d84879b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116157) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:06:52.736845 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [req-9fb94696-52d2-4dce-aceb-75953312b0d3 req-7e6ab2da-6988-49b0-bb37-9f43a644da30 service nova] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:06:52.737490 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [req-9fb94696-52d2-4dce-aceb-75953312b0d3 req-7e6ab2da-6988-49b0-bb37-9f43a644da30 service nova] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:06:52.744833 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: INFO nova.api.openstack.requestlog [None req-cca9d776-d6da-4a42-bac7-8c51dd350a9d tempest-AttachVolumeTestJSON-244989543 tempest-AttachVolumeTestJSON-244989543-project] 10.222.0.18 "GET /compute/v2.1/servers/f22dfea6-4599-43e4-93d5-d99f1db3b4fb" status: 200 len: 1362 microversion: 2.1 time: 0.311184 Dec 15 03:06:52.745724 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: [pid: 116157|app: 0|req: 291/600] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 03:06:52 2021] GET /compute/v2.1/servers/f22dfea6-4599-43e4-93d5-d99f1db3b4fb => generated 1362 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 03:06:52.755109 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: INFO nova.api.openstack.compute.server_external_events [req-9fb94696-52d2-4dce-aceb-75953312b0d3 req-7e6ab2da-6988-49b0-bb37-9f43a644da30 service nova] Creating event network-changed:6bbc39c5-40bb-4350-a006-fae5a1ef78a6 for instance fa7c86bc-c46f-4120-8f3d-d795f8d7c5cc on hv-cinder-81803 Dec 15 03:06:52.760142 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: INFO nova.api.openstack.requestlog [req-9fb94696-52d2-4dce-aceb-75953312b0d3 req-7e6ab2da-6988-49b0-bb37-9f43a644da30 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038414 Dec 15 03:06:52.761041 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: [pid: 116156|app: 0|req: 310/601] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Dec 15 03:06:52 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 15 03:06:52.931593 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi [None req-821a242c-9cb6-4f2d-b344-bea75ca37ebb tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Calling method '>' {{(pid=116157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:06:52.932632 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.compute.api [None req-821a242c-9cb6-4f2d-b344-bea75ca37ebb tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] [instance: b89094ac-aee1-4bd6-a33d-8c4347cebfc7] Fetching instance by UUID {{(pid=116157) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:06:52.939238 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-821a242c-9cb6-4f2d-b344-bea75ca37ebb tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:06:52.939966 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-821a242c-9cb6-4f2d-b344-bea75ca37ebb tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:06:52.940980 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-821a242c-9cb6-4f2d-b344-bea75ca37ebb tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:06:52.941418 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-821a242c-9cb6-4f2d-b344-bea75ca37ebb tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:06:53.221174 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.policy [None req-821a242c-9cb6-4f2d-b344-bea75ca37ebb tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fedc11e2dbd74b919982a0657222cca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f16202549724b878f908d68384ec9c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116157) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:06:53.231289 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.policy [None req-821a242c-9cb6-4f2d-b344-bea75ca37ebb tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fedc11e2dbd74b919982a0657222cca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f16202549724b878f908d68384ec9c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116157) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:06:53.236658 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.policy [None req-821a242c-9cb6-4f2d-b344-bea75ca37ebb tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fedc11e2dbd74b919982a0657222cca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f16202549724b878f908d68384ec9c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116157) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:06:53.238271 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: INFO nova.api.openstack.requestlog [None req-821a242c-9cb6-4f2d-b344-bea75ca37ebb tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] 10.222.0.18 "GET /compute/v2.1/servers/b89094ac-aee1-4bd6-a33d-8c4347cebfc7" status: 200 len: 1738 microversion: 2.20 time: 0.310473 Dec 15 03:06:53.243439 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: [pid: 116157|app: 0|req: 292/602] 10.222.0.18 () {60 vars in 1276 bytes} [Wed Dec 15 03:06:52 2021] GET /compute/v2.1/servers/b89094ac-aee1-4bd6-a33d-8c4347cebfc7 => generated 1738 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 03:06:53.623675 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi [None req-4c346c75-dbf2-4343-abfb-c60856de9dd5 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Calling method '>' {{(pid=116156) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:06:53.626400 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.compute.api [None req-4c346c75-dbf2-4343-abfb-c60856de9dd5 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] [instance: bbb8462c-9501-4541-b67e-43ec5c5061a7] Fetching instance by UUID {{(pid=116156) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:06:53.637776 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-4c346c75-dbf2-4343-abfb-c60856de9dd5 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:06:53.640055 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-4c346c75-dbf2-4343-abfb-c60856de9dd5 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:06:53.642224 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-4c346c75-dbf2-4343-abfb-c60856de9dd5 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:06:53.644107 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-4c346c75-dbf2-4343-abfb-c60856de9dd5 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:06:53.764031 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi [None req-a5f20d1d-f2f0-4524-88f3-5eaed583ef16 tempest-AttachVolumeTestJSON-244989543 tempest-AttachVolumeTestJSON-244989543-project] Calling method '>' {{(pid=116157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:06:53.765390 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.compute.api [None req-a5f20d1d-f2f0-4524-88f3-5eaed583ef16 tempest-AttachVolumeTestJSON-244989543 tempest-AttachVolumeTestJSON-244989543-project] [instance: f22dfea6-4599-43e4-93d5-d99f1db3b4fb] Fetching instance by UUID {{(pid=116157) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:06:53.779345 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-a5f20d1d-f2f0-4524-88f3-5eaed583ef16 tempest-AttachVolumeTestJSON-244989543 tempest-AttachVolumeTestJSON-244989543-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:06:53.779982 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-a5f20d1d-f2f0-4524-88f3-5eaed583ef16 tempest-AttachVolumeTestJSON-244989543 tempest-AttachVolumeTestJSON-244989543-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:06:53.781129 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-a5f20d1d-f2f0-4524-88f3-5eaed583ef16 tempest-AttachVolumeTestJSON-244989543 tempest-AttachVolumeTestJSON-244989543-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:06:53.782807 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-a5f20d1d-f2f0-4524-88f3-5eaed583ef16 tempest-AttachVolumeTestJSON-244989543 tempest-AttachVolumeTestJSON-244989543-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:06:54.033393 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.policy [None req-a5f20d1d-f2f0-4524-88f3-5eaed583ef16 tempest-AttachVolumeTestJSON-244989543 tempest-AttachVolumeTestJSON-244989543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5fb31c3d4874e13ba22e0242d4aaa58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00e76c2a092544e1a51928f1d84879b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116157) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:06:54.042400 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: INFO nova.api.openstack.requestlog [None req-a5f20d1d-f2f0-4524-88f3-5eaed583ef16 tempest-AttachVolumeTestJSON-244989543 tempest-AttachVolumeTestJSON-244989543-project] 10.222.0.18 "GET /compute/v2.1/servers/f22dfea6-4599-43e4-93d5-d99f1db3b4fb" status: 200 len: 1549 microversion: 2.1 time: 0.282464 Dec 15 03:06:54.042975 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: [pid: 116157|app: 0|req: 293/603] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 03:06:53 2021] GET /compute/v2.1/servers/f22dfea6-4599-43e4-93d5-d99f1db3b4fb => generated 1549 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 03:06:54.059592 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi [None req-df0a1130-e45b-4fab-a31f-3b1bd6f9070a tempest-AttachVolumeTestJSON-244989543 tempest-AttachVolumeTestJSON-244989543-project] Calling method '>' {{(pid=116157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:06:54.060090 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.compute.api [None req-df0a1130-e45b-4fab-a31f-3b1bd6f9070a tempest-AttachVolumeTestJSON-244989543 tempest-AttachVolumeTestJSON-244989543-project] [instance: f22dfea6-4599-43e4-93d5-d99f1db3b4fb] Fetching instance by UUID {{(pid=116157) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:06:54.066906 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-df0a1130-e45b-4fab-a31f-3b1bd6f9070a tempest-AttachVolumeTestJSON-244989543 tempest-AttachVolumeTestJSON-244989543-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:06:54.067986 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-df0a1130-e45b-4fab-a31f-3b1bd6f9070a tempest-AttachVolumeTestJSON-244989543 tempest-AttachVolumeTestJSON-244989543-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:06:54.068813 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-df0a1130-e45b-4fab-a31f-3b1bd6f9070a tempest-AttachVolumeTestJSON-244989543 tempest-AttachVolumeTestJSON-244989543-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:06:54.069579 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-df0a1130-e45b-4fab-a31f-3b1bd6f9070a tempest-AttachVolumeTestJSON-244989543 tempest-AttachVolumeTestJSON-244989543-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:06:54.128392 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.policy [None req-4c346c75-dbf2-4343-abfb-c60856de9dd5 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97bdf19af9e34fc3886ff451cb9d7a27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '494b56bf5eae4d56a5591546f85bc32b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116156) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:06:54.136096 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: INFO nova.api.openstack.requestlog [None req-4c346c75-dbf2-4343-abfb-c60856de9dd5 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] 10.222.0.18 "GET /compute/v2.1/servers/bbb8462c-9501-4541-b67e-43ec5c5061a7" status: 200 len: 1266 microversion: 2.1 time: 0.517723 Dec 15 03:06:54.137303 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: [pid: 116156|app: 0|req: 311/604] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 03:06:53 2021] GET /compute/v2.1/servers/bbb8462c-9501-4541-b67e-43ec5c5061a7 => generated 1266 bytes in 520 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 03:06:54.158617 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: INFO nova.api.openstack.requestlog [None req-df0a1130-e45b-4fab-a31f-3b1bd6f9070a tempest-AttachVolumeTestJSON-244989543 tempest-AttachVolumeTestJSON-244989543-project] 10.222.0.18 "GET /compute/v2.1/servers/f22dfea6-4599-43e4-93d5-d99f1db3b4fb/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.102978 Dec 15 03:06:54.159209 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: [pid: 116157|app: 0|req: 294/605] 10.222.0.18 () {58 vars in 1274 bytes} [Wed Dec 15 03:06:54 2021] GET /compute/v2.1/servers/f22dfea6-4599-43e4-93d5-d99f1db3b4fb/os-interface => generated 285 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 15 03:06:54.260913 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi [None req-aa43f4fb-4e19-4db2-8aff-42db279e831d tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Calling method '>' {{(pid=116156) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:06:54.262271 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.compute.api [None req-aa43f4fb-4e19-4db2-8aff-42db279e831d tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] [instance: b89094ac-aee1-4bd6-a33d-8c4347cebfc7] Fetching instance by UUID {{(pid=116156) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:06:54.269430 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-aa43f4fb-4e19-4db2-8aff-42db279e831d tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:06:54.269880 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-aa43f4fb-4e19-4db2-8aff-42db279e831d tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:06:54.270694 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-aa43f4fb-4e19-4db2-8aff-42db279e831d tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:06:54.271128 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-aa43f4fb-4e19-4db2-8aff-42db279e831d tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:06:54.416187 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.policy [None req-aa43f4fb-4e19-4db2-8aff-42db279e831d tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fedc11e2dbd74b919982a0657222cca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f16202549724b878f908d68384ec9c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116156) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:06:54.425184 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.policy [None req-aa43f4fb-4e19-4db2-8aff-42db279e831d tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fedc11e2dbd74b919982a0657222cca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f16202549724b878f908d68384ec9c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116156) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:06:54.426868 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.policy [None req-aa43f4fb-4e19-4db2-8aff-42db279e831d tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fedc11e2dbd74b919982a0657222cca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f16202549724b878f908d68384ec9c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116156) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:06:54.428159 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: INFO nova.api.openstack.requestlog [None req-aa43f4fb-4e19-4db2-8aff-42db279e831d tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] 10.222.0.18 "GET /compute/v2.1/servers/b89094ac-aee1-4bd6-a33d-8c4347cebfc7" status: 200 len: 1720 microversion: 2.20 time: 0.171338 Dec 15 03:06:54.428961 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: [pid: 116156|app: 0|req: 312/606] 10.222.0.18 () {60 vars in 1276 bytes} [Wed Dec 15 03:06:54 2021] GET /compute/v2.1/servers/b89094ac-aee1-4bd6-a33d-8c4347cebfc7 => generated 1720 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 03:06:54.776545 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi [req-66a4c888-ae99-43b3-9e13-bc1be0b201c6 req-e98cab02-8bda-4c3a-b52a-80c06b876a92 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bbb8462c-9501-4541-b67e-43ec5c5061a7", "tag": "e917aa72-0647-445c-a93a-04c2f02ade06"}]} {{(pid=116157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 03:06:54.778122 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 15 03:06:54.778122 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: warnings.warn(msg) Dec 15 03:06:54.786118 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [req-66a4c888-ae99-43b3-9e13-bc1be0b201c6 req-e98cab02-8bda-4c3a-b52a-80c06b876a92 service nova] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:06:54.786570 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [req-66a4c888-ae99-43b3-9e13-bc1be0b201c6 req-e98cab02-8bda-4c3a-b52a-80c06b876a92 service nova] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:06:54.797613 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: INFO nova.api.openstack.compute.server_external_events [req-66a4c888-ae99-43b3-9e13-bc1be0b201c6 req-e98cab02-8bda-4c3a-b52a-80c06b876a92 service nova] Creating event network-changed:e917aa72-0647-445c-a93a-04c2f02ade06 for instance bbb8462c-9501-4541-b67e-43ec5c5061a7 on hv-cinder-81803 Dec 15 03:06:54.802384 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: INFO nova.api.openstack.requestlog [req-66a4c888-ae99-43b3-9e13-bc1be0b201c6 req-e98cab02-8bda-4c3a-b52a-80c06b876a92 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029335 Dec 15 03:06:54.802998 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: [pid: 116157|app: 0|req: 295/607] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Dec 15 03:06:54 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 03:06:55.153684 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi [None req-0e569f75-27c0-432b-a2ac-6be10335cd4a tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Calling method '>' {{(pid=116156) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:06:55.154330 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.compute.api [None req-0e569f75-27c0-432b-a2ac-6be10335cd4a tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] [instance: bbb8462c-9501-4541-b67e-43ec5c5061a7] Fetching instance by UUID {{(pid=116156) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:06:55.160938 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-0e569f75-27c0-432b-a2ac-6be10335cd4a tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:06:55.161389 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-0e569f75-27c0-432b-a2ac-6be10335cd4a tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:06:55.162199 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-0e569f75-27c0-432b-a2ac-6be10335cd4a tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:06:55.162637 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-0e569f75-27c0-432b-a2ac-6be10335cd4a tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:06:55.296645 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.policy [None req-0e569f75-27c0-432b-a2ac-6be10335cd4a tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97bdf19af9e34fc3886ff451cb9d7a27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '494b56bf5eae4d56a5591546f85bc32b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116156) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:06:55.305317 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: INFO nova.api.openstack.requestlog [None req-0e569f75-27c0-432b-a2ac-6be10335cd4a tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] 10.222.0.18 "GET /compute/v2.1/servers/bbb8462c-9501-4541-b67e-43ec5c5061a7" status: 200 len: 1266 microversion: 2.1 time: 0.154651 Dec 15 03:06:55.306015 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: [pid: 116156|app: 0|req: 313/608] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 03:06:55 2021] GET /compute/v2.1/servers/bbb8462c-9501-4541-b67e-43ec5c5061a7 => generated 1266 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 03:06:55.324575 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi [None req-bad076a9-80ed-489e-b51f-3ff3e0f03d7f tempest-AttachVolumeTestJSON-244989543 tempest-AttachVolumeTestJSON-244989543-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 03:06:55.325575 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.compute.api [None req-bad076a9-80ed-489e-b51f-3ff3e0f03d7f tempest-AttachVolumeTestJSON-244989543 tempest-AttachVolumeTestJSON-244989543-project] [instance: f22dfea6-4599-43e4-93d5-d99f1db3b4fb] Fetching instance by UUID {{(pid=116157) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:06:55.332273 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-bad076a9-80ed-489e-b51f-3ff3e0f03d7f tempest-AttachVolumeTestJSON-244989543 tempest-AttachVolumeTestJSON-244989543-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:06:55.332728 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-bad076a9-80ed-489e-b51f-3ff3e0f03d7f tempest-AttachVolumeTestJSON-244989543 tempest-AttachVolumeTestJSON-244989543-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:06:55.333545 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-bad076a9-80ed-489e-b51f-3ff3e0f03d7f tempest-AttachVolumeTestJSON-244989543 tempest-AttachVolumeTestJSON-244989543-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:06:55.334008 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-bad076a9-80ed-489e-b51f-3ff3e0f03d7f tempest-AttachVolumeTestJSON-244989543 tempest-AttachVolumeTestJSON-244989543-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:06:55.447114 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi [None req-c4aa035d-d196-4923-9a4d-0f351f6d9f36 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Calling method '>' {{(pid=116156) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:06:55.447713 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.compute.api [None req-c4aa035d-d196-4923-9a4d-0f351f6d9f36 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] [instance: b89094ac-aee1-4bd6-a33d-8c4347cebfc7] Fetching instance by UUID {{(pid=116156) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:06:55.453972 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-c4aa035d-d196-4923-9a4d-0f351f6d9f36 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:06:55.454520 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-c4aa035d-d196-4923-9a4d-0f351f6d9f36 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:06:55.455388 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-c4aa035d-d196-4923-9a4d-0f351f6d9f36 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:06:55.455827 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-c4aa035d-d196-4923-9a4d-0f351f6d9f36 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:06:55.583901 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.policy [None req-c4aa035d-d196-4923-9a4d-0f351f6d9f36 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fedc11e2dbd74b919982a0657222cca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f16202549724b878f908d68384ec9c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116156) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:06:55.591564 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.policy [None req-c4aa035d-d196-4923-9a4d-0f351f6d9f36 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fedc11e2dbd74b919982a0657222cca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f16202549724b878f908d68384ec9c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116156) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:06:55.593052 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.policy [None req-c4aa035d-d196-4923-9a4d-0f351f6d9f36 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fedc11e2dbd74b919982a0657222cca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f16202549724b878f908d68384ec9c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116156) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:06:55.594275 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: INFO nova.api.openstack.requestlog [None req-c4aa035d-d196-4923-9a4d-0f351f6d9f36 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] 10.222.0.18 "GET /compute/v2.1/servers/b89094ac-aee1-4bd6-a33d-8c4347cebfc7" status: 200 len: 1720 microversion: 2.20 time: 0.150858 Dec 15 03:06:55.594831 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: [pid: 116156|app: 0|req: 314/609] 10.222.0.18 () {60 vars in 1276 bytes} [Wed Dec 15 03:06:55 2021] GET /compute/v2.1/servers/b89094ac-aee1-4bd6-a33d-8c4347cebfc7 => generated 1720 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Dec 15 03:06:56.322353 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi [None req-dd7acbfa-d314-4a14-afbd-c8869e80a125 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Calling method '>' {{(pid=116156) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:06:56.322999 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.compute.api [None req-dd7acbfa-d314-4a14-afbd-c8869e80a125 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] [instance: bbb8462c-9501-4541-b67e-43ec5c5061a7] Fetching instance by UUID {{(pid=116156) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:06:56.329415 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-dd7acbfa-d314-4a14-afbd-c8869e80a125 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:06:56.329945 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-dd7acbfa-d314-4a14-afbd-c8869e80a125 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:06:56.330894 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-dd7acbfa-d314-4a14-afbd-c8869e80a125 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:06:56.331401 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-dd7acbfa-d314-4a14-afbd-c8869e80a125 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:06:56.463028 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.policy [None req-dd7acbfa-d314-4a14-afbd-c8869e80a125 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97bdf19af9e34fc3886ff451cb9d7a27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '494b56bf5eae4d56a5591546f85bc32b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116156) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:06:56.470573 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: INFO nova.api.openstack.requestlog [None req-dd7acbfa-d314-4a14-afbd-c8869e80a125 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] 10.222.0.18 "GET /compute/v2.1/servers/bbb8462c-9501-4541-b67e-43ec5c5061a7" status: 200 len: 1266 microversion: 2.1 time: 0.151933 Dec 15 03:06:56.471130 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: [pid: 116156|app: 0|req: 315/610] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 03:06:56 2021] GET /compute/v2.1/servers/bbb8462c-9501-4541-b67e-43ec5c5061a7 => generated 1266 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 03:06:56.613138 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi [None req-202287c0-0ebb-4eff-9094-cb94b7de012b tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Calling method '>' {{(pid=116156) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:06:56.613662 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.compute.api [None req-202287c0-0ebb-4eff-9094-cb94b7de012b tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] [instance: b89094ac-aee1-4bd6-a33d-8c4347cebfc7] Fetching instance by UUID {{(pid=116156) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:06:56.619537 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-202287c0-0ebb-4eff-9094-cb94b7de012b tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:06:56.619983 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-202287c0-0ebb-4eff-9094-cb94b7de012b tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:06:56.620749 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-202287c0-0ebb-4eff-9094-cb94b7de012b tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:06:56.621180 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-202287c0-0ebb-4eff-9094-cb94b7de012b tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:06:56.776234 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: INFO nova.api.openstack.requestlog [None req-bad076a9-80ed-489e-b51f-3ff3e0f03d7f tempest-AttachVolumeTestJSON-244989543 tempest-AttachVolumeTestJSON-244989543-project] 10.222.0.18 "POST /compute/v2.1/servers/f22dfea6-4599-43e4-93d5-d99f1db3b4fb/action" status: 200 len: 14 microversion: 2.1 time: 1.454894 Dec 15 03:06:56.780581 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: [pid: 116157|app: 0|req: 296/611] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Dec 15 03:06:55 2021] POST /compute/v2.1/servers/f22dfea6-4599-43e4-93d5-d99f1db3b4fb/action => generated 14 bytes in 1457 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Dec 15 03:06:56.797765 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.policy [None req-202287c0-0ebb-4eff-9094-cb94b7de012b tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fedc11e2dbd74b919982a0657222cca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f16202549724b878f908d68384ec9c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116156) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:06:56.807050 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.policy [None req-202287c0-0ebb-4eff-9094-cb94b7de012b tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fedc11e2dbd74b919982a0657222cca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f16202549724b878f908d68384ec9c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116156) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:06:56.808632 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.policy [None req-202287c0-0ebb-4eff-9094-cb94b7de012b tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fedc11e2dbd74b919982a0657222cca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f16202549724b878f908d68384ec9c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116156) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:06:56.809715 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: INFO nova.api.openstack.requestlog [None req-202287c0-0ebb-4eff-9094-cb94b7de012b tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] 10.222.0.18 "GET /compute/v2.1/servers/b89094ac-aee1-4bd6-a33d-8c4347cebfc7" status: 200 len: 1720 microversion: 2.20 time: 0.200735 Dec 15 03:06:56.810662 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: [pid: 116156|app: 0|req: 316/612] 10.222.0.18 () {60 vars in 1276 bytes} [Wed Dec 15 03:06:56 2021] GET /compute/v2.1/servers/b89094ac-aee1-4bd6-a33d-8c4347cebfc7 => generated 1720 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Dec 15 03:06:56.829261 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi [req-92b5e6b0-5087-4409-89ac-c8036d0c32e2 req-2f634c7e-0e6a-44d1-a1b7-236f599ae8d8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b89094ac-aee1-4bd6-a33d-8c4347cebfc7", "name": "network-vif-unplugged", "status": "completed", "tag": "455e429c-96fb-4858-b8fe-cf282ae96b72"}]} {{(pid=116157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 03:06:56.831537 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 15 03:06:56.831537 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: warnings.warn(msg) Dec 15 03:06:56.843005 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi [req-09634a4f-e0eb-4bc9-87f2-9c7717fcf9ee req-d51af85b-66df-4edb-8f38-868a13f81576 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f22dfea6-4599-43e4-93d5-d99f1db3b4fb", "tag": "7cca5c1a-379b-494a-bcfb-406b62828d76"}]} {{(pid=116156) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 03:06:56.845593 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 15 03:06:56.845593 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: warnings.warn(msg) Dec 15 03:06:56.846022 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [req-92b5e6b0-5087-4409-89ac-c8036d0c32e2 req-2f634c7e-0e6a-44d1-a1b7-236f599ae8d8 service nova] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:06:56.846648 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [req-92b5e6b0-5087-4409-89ac-c8036d0c32e2 req-2f634c7e-0e6a-44d1-a1b7-236f599ae8d8 service nova] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:06:56.854007 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [req-09634a4f-e0eb-4bc9-87f2-9c7717fcf9ee req-d51af85b-66df-4edb-8f38-868a13f81576 service nova] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:06:56.854965 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [req-09634a4f-e0eb-4bc9-87f2-9c7717fcf9ee req-d51af85b-66df-4edb-8f38-868a13f81576 service nova] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:06:56.858723 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: INFO nova.api.openstack.compute.server_external_events [req-92b5e6b0-5087-4409-89ac-c8036d0c32e2 req-2f634c7e-0e6a-44d1-a1b7-236f599ae8d8 service nova] Creating event network-vif-unplugged:455e429c-96fb-4858-b8fe-cf282ae96b72 for instance b89094ac-aee1-4bd6-a33d-8c4347cebfc7 on hv-cinder-81803 Dec 15 03:06:56.864513 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: INFO nova.api.openstack.requestlog [req-92b5e6b0-5087-4409-89ac-c8036d0c32e2 req-2f634c7e-0e6a-44d1-a1b7-236f599ae8d8 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.041879 Dec 15 03:06:56.866302 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: [pid: 116157|app: 0|req: 297/613] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Dec 15 03:06:56 2021] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 03:06:56.869332 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: INFO nova.api.openstack.compute.server_external_events [req-09634a4f-e0eb-4bc9-87f2-9c7717fcf9ee req-d51af85b-66df-4edb-8f38-868a13f81576 service nova] Creating event network-changed:7cca5c1a-379b-494a-bcfb-406b62828d76 for instance f22dfea6-4599-43e4-93d5-d99f1db3b4fb on hv-cinder-81803 Dec 15 03:06:56.874529 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: INFO nova.api.openstack.requestlog [req-09634a4f-e0eb-4bc9-87f2-9c7717fcf9ee req-d51af85b-66df-4edb-8f38-868a13f81576 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037294 Dec 15 03:06:56.875412 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: [pid: 116156|app: 0|req: 317/614] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Dec 15 03:06:56 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 03:06:57.488298 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi [None req-5bae6c55-1ec2-4173-b14c-952596fcfaf4 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Calling method '>' {{(pid=116157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:06:57.489085 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.compute.api [None req-5bae6c55-1ec2-4173-b14c-952596fcfaf4 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] [instance: bbb8462c-9501-4541-b67e-43ec5c5061a7] Fetching instance by UUID {{(pid=116157) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:06:57.495740 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-5bae6c55-1ec2-4173-b14c-952596fcfaf4 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:06:57.496305 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-5bae6c55-1ec2-4173-b14c-952596fcfaf4 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:06:57.497175 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-5bae6c55-1ec2-4173-b14c-952596fcfaf4 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:06:57.497689 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-5bae6c55-1ec2-4173-b14c-952596fcfaf4 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:06:57.663963 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.policy [None req-5bae6c55-1ec2-4173-b14c-952596fcfaf4 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97bdf19af9e34fc3886ff451cb9d7a27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '494b56bf5eae4d56a5591546f85bc32b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116157) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:06:57.671253 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: INFO nova.api.openstack.requestlog [None req-5bae6c55-1ec2-4173-b14c-952596fcfaf4 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] 10.222.0.18 "GET /compute/v2.1/servers/bbb8462c-9501-4541-b67e-43ec5c5061a7" status: 200 len: 1266 microversion: 2.1 time: 0.187495 Dec 15 03:06:57.671815 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: [pid: 116157|app: 0|req: 298/615] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 03:06:57 2021] GET /compute/v2.1/servers/bbb8462c-9501-4541-b67e-43ec5c5061a7 => generated 1266 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 03:06:57.789443 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi [None req-76cc1390-f56e-4749-b48b-ebf92c88c566 tempest-AttachVolumeTestJSON-244989543 tempest-AttachVolumeTestJSON-244989543-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116156) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 03:06:57.790473 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.compute.api [None req-76cc1390-f56e-4749-b48b-ebf92c88c566 tempest-AttachVolumeTestJSON-244989543 tempest-AttachVolumeTestJSON-244989543-project] [instance: f22dfea6-4599-43e4-93d5-d99f1db3b4fb] Fetching instance by UUID {{(pid=116156) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:06:57.796831 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-76cc1390-f56e-4749-b48b-ebf92c88c566 tempest-AttachVolumeTestJSON-244989543 tempest-AttachVolumeTestJSON-244989543-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:06:57.797747 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-76cc1390-f56e-4749-b48b-ebf92c88c566 tempest-AttachVolumeTestJSON-244989543 tempest-AttachVolumeTestJSON-244989543-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:06:57.798727 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-76cc1390-f56e-4749-b48b-ebf92c88c566 tempest-AttachVolumeTestJSON-244989543 tempest-AttachVolumeTestJSON-244989543-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:06:57.799163 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-76cc1390-f56e-4749-b48b-ebf92c88c566 tempest-AttachVolumeTestJSON-244989543 tempest-AttachVolumeTestJSON-244989543-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:06:57.828928 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi [None req-6b6154de-e777-4dd5-830c-21483682b01d tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Calling method '>' {{(pid=116157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:06:57.829533 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.compute.api [None req-6b6154de-e777-4dd5-830c-21483682b01d tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] [instance: b89094ac-aee1-4bd6-a33d-8c4347cebfc7] Fetching instance by UUID {{(pid=116157) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:06:57.835754 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-6b6154de-e777-4dd5-830c-21483682b01d tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:06:57.836202 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-6b6154de-e777-4dd5-830c-21483682b01d tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:06:57.836973 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-6b6154de-e777-4dd5-830c-21483682b01d tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:06:57.837438 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-6b6154de-e777-4dd5-830c-21483682b01d tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:06:57.880487 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: INFO nova.api.openstack.requestlog [None req-76cc1390-f56e-4749-b48b-ebf92c88c566 tempest-AttachVolumeTestJSON-244989543 tempest-AttachVolumeTestJSON-244989543-project] 10.222.0.18 "POST /compute/v2.1/servers/f22dfea6-4599-43e4-93d5-d99f1db3b4fb/action" status: 200 len: 14 microversion: 2.1 time: 0.095648 Dec 15 03:06:57.883788 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: [pid: 116156|app: 0|req: 318/616] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Dec 15 03:06:57 2021] POST /compute/v2.1/servers/f22dfea6-4599-43e4-93d5-d99f1db3b4fb/action => generated 14 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Dec 15 03:06:57.966606 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.policy [None req-6b6154de-e777-4dd5-830c-21483682b01d tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fedc11e2dbd74b919982a0657222cca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f16202549724b878f908d68384ec9c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116157) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:06:57.974203 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.policy [None req-6b6154de-e777-4dd5-830c-21483682b01d tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fedc11e2dbd74b919982a0657222cca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f16202549724b878f908d68384ec9c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116157) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:06:57.975697 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.policy [None req-6b6154de-e777-4dd5-830c-21483682b01d tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fedc11e2dbd74b919982a0657222cca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f16202549724b878f908d68384ec9c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116157) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:06:57.976846 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: INFO nova.api.openstack.requestlog [None req-6b6154de-e777-4dd5-830c-21483682b01d tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] 10.222.0.18 "GET /compute/v2.1/servers/b89094ac-aee1-4bd6-a33d-8c4347cebfc7" status: 200 len: 1720 microversion: 2.20 time: 0.152334 Dec 15 03:06:57.977400 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: [pid: 116157|app: 0|req: 299/617] 10.222.0.18 () {60 vars in 1276 bytes} [Wed Dec 15 03:06:57 2021] GET /compute/v2.1/servers/b89094ac-aee1-4bd6-a33d-8c4347cebfc7 => generated 1720 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Dec 15 03:06:58.688422 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi [None req-8fa46278-af92-49a4-89bf-a54d5fc3c569 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Calling method '>' {{(pid=116156) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:06:58.689043 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.compute.api [None req-8fa46278-af92-49a4-89bf-a54d5fc3c569 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] [instance: bbb8462c-9501-4541-b67e-43ec5c5061a7] Fetching instance by UUID {{(pid=116156) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:06:58.695794 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-8fa46278-af92-49a4-89bf-a54d5fc3c569 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:06:58.696284 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-8fa46278-af92-49a4-89bf-a54d5fc3c569 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:06:58.697234 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-8fa46278-af92-49a4-89bf-a54d5fc3c569 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:06:58.697770 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-8fa46278-af92-49a4-89bf-a54d5fc3c569 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:06:58.833195 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.policy [None req-8fa46278-af92-49a4-89bf-a54d5fc3c569 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97bdf19af9e34fc3886ff451cb9d7a27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '494b56bf5eae4d56a5591546f85bc32b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116156) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:06:58.840843 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: INFO nova.api.openstack.requestlog [None req-8fa46278-af92-49a4-89bf-a54d5fc3c569 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] 10.222.0.18 "GET /compute/v2.1/servers/bbb8462c-9501-4541-b67e-43ec5c5061a7" status: 200 len: 1266 microversion: 2.1 time: 0.156525 Dec 15 03:06:58.841425 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: [pid: 116156|app: 0|req: 319/618] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 03:06:58 2021] GET /compute/v2.1/servers/bbb8462c-9501-4541-b67e-43ec5c5061a7 => generated 1266 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 03:06:58.891271 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi [None req-51136306-df02-4683-a834-d44b50af1f26 tempest-AttachVolumeTestJSON-244989543 tempest-AttachVolumeTestJSON-244989543-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 03:06:58.892235 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.compute.api [None req-51136306-df02-4683-a834-d44b50af1f26 tempest-AttachVolumeTestJSON-244989543 tempest-AttachVolumeTestJSON-244989543-project] [instance: f22dfea6-4599-43e4-93d5-d99f1db3b4fb] Fetching instance by UUID {{(pid=116157) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:06:58.899968 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-51136306-df02-4683-a834-d44b50af1f26 tempest-AttachVolumeTestJSON-244989543 tempest-AttachVolumeTestJSON-244989543-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:06:58.900415 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-51136306-df02-4683-a834-d44b50af1f26 tempest-AttachVolumeTestJSON-244989543 tempest-AttachVolumeTestJSON-244989543-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:06:58.901193 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-51136306-df02-4683-a834-d44b50af1f26 tempest-AttachVolumeTestJSON-244989543 tempest-AttachVolumeTestJSON-244989543-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:06:58.901624 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-51136306-df02-4683-a834-d44b50af1f26 tempest-AttachVolumeTestJSON-244989543 tempest-AttachVolumeTestJSON-244989543-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:06:58.989878 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: INFO nova.api.openstack.requestlog [None req-51136306-df02-4683-a834-d44b50af1f26 tempest-AttachVolumeTestJSON-244989543 tempest-AttachVolumeTestJSON-244989543-project] 10.222.0.18 "POST /compute/v2.1/servers/f22dfea6-4599-43e4-93d5-d99f1db3b4fb/action" status: 200 len: 14 microversion: 2.1 time: 0.101956 Dec 15 03:06:58.991351 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: [pid: 116157|app: 0|req: 300/619] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Dec 15 03:06:58 2021] POST /compute/v2.1/servers/f22dfea6-4599-43e4-93d5-d99f1db3b4fb/action => generated 14 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Dec 15 03:06:58.995859 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi [None req-676f7717-6c8c-4270-a744-3b0bdc514d9a tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Calling method '>' {{(pid=116156) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:06:58.996531 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.compute.api [None req-676f7717-6c8c-4270-a744-3b0bdc514d9a tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] [instance: b89094ac-aee1-4bd6-a33d-8c4347cebfc7] Fetching instance by UUID {{(pid=116156) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:06:59.002936 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-676f7717-6c8c-4270-a744-3b0bdc514d9a tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:06:59.003395 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-676f7717-6c8c-4270-a744-3b0bdc514d9a tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:06:59.004172 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-676f7717-6c8c-4270-a744-3b0bdc514d9a tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:06:59.004611 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-676f7717-6c8c-4270-a744-3b0bdc514d9a tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:06:59.135917 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.policy [None req-676f7717-6c8c-4270-a744-3b0bdc514d9a tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fedc11e2dbd74b919982a0657222cca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f16202549724b878f908d68384ec9c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116156) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:06:59.144067 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.policy [None req-676f7717-6c8c-4270-a744-3b0bdc514d9a tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fedc11e2dbd74b919982a0657222cca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f16202549724b878f908d68384ec9c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116156) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:06:59.145568 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.policy [None req-676f7717-6c8c-4270-a744-3b0bdc514d9a tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fedc11e2dbd74b919982a0657222cca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f16202549724b878f908d68384ec9c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116156) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:06:59.146753 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: INFO nova.api.openstack.requestlog [None req-676f7717-6c8c-4270-a744-3b0bdc514d9a tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] 10.222.0.18 "GET /compute/v2.1/servers/b89094ac-aee1-4bd6-a33d-8c4347cebfc7" status: 200 len: 1723 microversion: 2.20 time: 0.155528 Dec 15 03:06:59.147343 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: [pid: 116156|app: 0|req: 320/620] 10.222.0.18 () {60 vars in 1276 bytes} [Wed Dec 15 03:06:58 2021] GET /compute/v2.1/servers/b89094ac-aee1-4bd6-a33d-8c4347cebfc7 => generated 1723 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Dec 15 03:06:59.165587 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi [None req-3f6c1356-94d7-468f-a5fd-48853c53112d tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "093991ee-d5d3-4c1d-a555-3556e887a00f"}} {{(pid=116157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 03:06:59.166752 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.compute.api [None req-3f6c1356-94d7-468f-a5fd-48853c53112d tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] [instance: b89094ac-aee1-4bd6-a33d-8c4347cebfc7] Fetching instance by UUID {{(pid=116157) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:06:59.173561 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-3f6c1356-94d7-468f-a5fd-48853c53112d tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:06:59.174054 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-3f6c1356-94d7-468f-a5fd-48853c53112d tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:06:59.174848 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-3f6c1356-94d7-468f-a5fd-48853c53112d tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:06:59.175329 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-3f6c1356-94d7-468f-a5fd-48853c53112d tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:06:59.441686 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: INFO nova.api.openstack.requestlog [None req-3f6c1356-94d7-468f-a5fd-48853c53112d tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] 10.222.0.18 "POST /compute/v2.1/servers/b89094ac-aee1-4bd6-a33d-8c4347cebfc7/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.280255 Dec 15 03:06:59.442351 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: [pid: 116157|app: 0|req: 301/621] 10.222.0.18 () {62 vars in 1363 bytes} [Wed Dec 15 03:06:59 2021] POST /compute/v2.1/servers/b89094ac-aee1-4bd6-a33d-8c4347cebfc7/os-volume_attachments => generated 188 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 03:06:59.549476 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi [None req-fda6aae9-91cd-4d63-a6a9-d1ab49577257 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=116156) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 03:06:59.550069 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.compute.api [None req-fda6aae9-91cd-4d63-a6a9-d1ab49577257 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] [instance: b89094ac-aee1-4bd6-a33d-8c4347cebfc7] Fetching instance by UUID {{(pid=116156) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:06:59.556224 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-fda6aae9-91cd-4d63-a6a9-d1ab49577257 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:06:59.556682 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-fda6aae9-91cd-4d63-a6a9-d1ab49577257 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:06:59.557480 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-fda6aae9-91cd-4d63-a6a9-d1ab49577257 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:06:59.557903 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-fda6aae9-91cd-4d63-a6a9-d1ab49577257 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:06:59.651322 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: INFO nova.api.openstack.requestlog [None req-fda6aae9-91cd-4d63-a6a9-d1ab49577257 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] 10.222.0.18 "POST /compute/v2.1/servers/b89094ac-aee1-4bd6-a33d-8c4347cebfc7/action" status: 202 len: 0 microversion: 2.20 time: 0.105409 Dec 15 03:06:59.652125 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: [pid: 116156|app: 0|req: 321/622] 10.222.0.18 () {62 vars in 1318 bytes} [Wed Dec 15 03:06:59 2021] POST /compute/v2.1/servers/b89094ac-aee1-4bd6-a33d-8c4347cebfc7/action => generated 0 bytes in 107 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Dec 15 03:06:59.659945 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi [None req-1ac659cf-5d0e-4f40-8eff-61398fddeee6 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Calling method '>' {{(pid=116157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:06:59.660814 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.compute.api [None req-1ac659cf-5d0e-4f40-8eff-61398fddeee6 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] [instance: b89094ac-aee1-4bd6-a33d-8c4347cebfc7] Fetching instance by UUID {{(pid=116157) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:06:59.667699 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-1ac659cf-5d0e-4f40-8eff-61398fddeee6 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:06:59.668222 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-1ac659cf-5d0e-4f40-8eff-61398fddeee6 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:06:59.669115 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-1ac659cf-5d0e-4f40-8eff-61398fddeee6 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:06:59.669620 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-1ac659cf-5d0e-4f40-8eff-61398fddeee6 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:06:59.820874 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.policy [None req-1ac659cf-5d0e-4f40-8eff-61398fddeee6 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fedc11e2dbd74b919982a0657222cca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f16202549724b878f908d68384ec9c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116157) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:06:59.832293 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.policy [None req-1ac659cf-5d0e-4f40-8eff-61398fddeee6 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fedc11e2dbd74b919982a0657222cca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f16202549724b878f908d68384ec9c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116157) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:06:59.834097 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.policy [None req-1ac659cf-5d0e-4f40-8eff-61398fddeee6 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fedc11e2dbd74b919982a0657222cca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f16202549724b878f908d68384ec9c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116157) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:06:59.835438 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: INFO nova.api.openstack.requestlog [None req-1ac659cf-5d0e-4f40-8eff-61398fddeee6 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] 10.222.0.18 "GET /compute/v2.1/servers/b89094ac-aee1-4bd6-a33d-8c4347cebfc7" status: 200 len: 1749 microversion: 2.20 time: 0.179332 Dec 15 03:06:59.847905 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: [pid: 116157|app: 0|req: 302/623] 10.222.0.18 () {60 vars in 1276 bytes} [Wed Dec 15 03:06:59 2021] GET /compute/v2.1/servers/b89094ac-aee1-4bd6-a33d-8c4347cebfc7 => generated 1749 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 03:06:59.858616 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi [None req-9eacfa86-7377-4755-8c4e-fe1c6dc3dbe5 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Calling method '>' {{(pid=116156) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:06:59.859232 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.compute.api [None req-9eacfa86-7377-4755-8c4e-fe1c6dc3dbe5 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] [instance: bbb8462c-9501-4541-b67e-43ec5c5061a7] Fetching instance by UUID {{(pid=116156) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:06:59.865908 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-9eacfa86-7377-4755-8c4e-fe1c6dc3dbe5 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:06:59.866487 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-9eacfa86-7377-4755-8c4e-fe1c6dc3dbe5 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:06:59.867367 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-9eacfa86-7377-4755-8c4e-fe1c6dc3dbe5 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:06:59.867879 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-9eacfa86-7377-4755-8c4e-fe1c6dc3dbe5 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:07:00.002002 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi [None req-3412d1b4-17b6-4ca2-9c84-3974a42c69f5 tempest-AttachVolumeTestJSON-244989543 tempest-AttachVolumeTestJSON-244989543-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 03:07:00.003214 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.compute.api [None req-3412d1b4-17b6-4ca2-9c84-3974a42c69f5 tempest-AttachVolumeTestJSON-244989543 tempest-AttachVolumeTestJSON-244989543-project] [instance: f22dfea6-4599-43e4-93d5-d99f1db3b4fb] Fetching instance by UUID {{(pid=116157) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:07:00.005306 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.policy [None req-9eacfa86-7377-4755-8c4e-fe1c6dc3dbe5 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97bdf19af9e34fc3886ff451cb9d7a27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '494b56bf5eae4d56a5591546f85bc32b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116156) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:07:00.012560 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: INFO nova.api.openstack.requestlog [None req-9eacfa86-7377-4755-8c4e-fe1c6dc3dbe5 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] 10.222.0.18 "GET /compute/v2.1/servers/bbb8462c-9501-4541-b67e-43ec5c5061a7" status: 200 len: 1266 microversion: 2.1 time: 0.157658 Dec 15 03:07:00.013349 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: [pid: 116156|app: 0|req: 322/624] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 03:06:59 2021] GET /compute/v2.1/servers/bbb8462c-9501-4541-b67e-43ec5c5061a7 => generated 1266 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 03:07:00.016051 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-3412d1b4-17b6-4ca2-9c84-3974a42c69f5 tempest-AttachVolumeTestJSON-244989543 tempest-AttachVolumeTestJSON-244989543-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:07:00.016580 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-3412d1b4-17b6-4ca2-9c84-3974a42c69f5 tempest-AttachVolumeTestJSON-244989543 tempest-AttachVolumeTestJSON-244989543-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:07:00.017447 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-3412d1b4-17b6-4ca2-9c84-3974a42c69f5 tempest-AttachVolumeTestJSON-244989543 tempest-AttachVolumeTestJSON-244989543-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:07:00.017962 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-3412d1b4-17b6-4ca2-9c84-3974a42c69f5 tempest-AttachVolumeTestJSON-244989543 tempest-AttachVolumeTestJSON-244989543-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:07:00.099603 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: INFO nova.api.openstack.requestlog [None req-3412d1b4-17b6-4ca2-9c84-3974a42c69f5 tempest-AttachVolumeTestJSON-244989543 tempest-AttachVolumeTestJSON-244989543-project] 10.222.0.18 "POST /compute/v2.1/servers/f22dfea6-4599-43e4-93d5-d99f1db3b4fb/action" status: 200 len: 14 microversion: 2.1 time: 0.102309 Dec 15 03:07:00.109478 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: [pid: 116157|app: 0|req: 303/625] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Dec 15 03:06:59 2021] POST /compute/v2.1/servers/f22dfea6-4599-43e4-93d5-d99f1db3b4fb/action => generated 14 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Dec 15 03:07:00.854467 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi [None req-eb4f3a12-5565-4c54-9ab8-544fb4e76534 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Calling method '>' {{(pid=116156) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:07:00.855003 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.compute.api [None req-eb4f3a12-5565-4c54-9ab8-544fb4e76534 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] [instance: b89094ac-aee1-4bd6-a33d-8c4347cebfc7] Fetching instance by UUID {{(pid=116156) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:07:00.861207 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-eb4f3a12-5565-4c54-9ab8-544fb4e76534 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:07:00.861803 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-eb4f3a12-5565-4c54-9ab8-544fb4e76534 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:07:00.862631 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-eb4f3a12-5565-4c54-9ab8-544fb4e76534 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:07:00.863064 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-eb4f3a12-5565-4c54-9ab8-544fb4e76534 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:07:00.997970 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.policy [None req-eb4f3a12-5565-4c54-9ab8-544fb4e76534 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fedc11e2dbd74b919982a0657222cca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f16202549724b878f908d68384ec9c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116156) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:07:01.006791 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.policy [None req-eb4f3a12-5565-4c54-9ab8-544fb4e76534 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fedc11e2dbd74b919982a0657222cca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f16202549724b878f908d68384ec9c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116156) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:07:01.008611 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.policy [None req-eb4f3a12-5565-4c54-9ab8-544fb4e76534 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fedc11e2dbd74b919982a0657222cca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f16202549724b878f908d68384ec9c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116156) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:07:01.009925 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: INFO nova.api.openstack.requestlog [None req-eb4f3a12-5565-4c54-9ab8-544fb4e76534 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] 10.222.0.18 "GET /compute/v2.1/servers/b89094ac-aee1-4bd6-a33d-8c4347cebfc7" status: 200 len: 1751 microversion: 2.20 time: 0.159274 Dec 15 03:07:01.010687 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: [pid: 116156|app: 0|req: 323/626] 10.222.0.18 () {60 vars in 1276 bytes} [Wed Dec 15 03:07:00 2021] GET /compute/v2.1/servers/b89094ac-aee1-4bd6-a33d-8c4347cebfc7 => generated 1751 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 03:07:01.029299 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi [None req-5d173674-7b37-40ce-9712-c226515e31b9 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Calling method '>' {{(pid=116157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:07:01.030023 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.compute.api [None req-5d173674-7b37-40ce-9712-c226515e31b9 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] [instance: bbb8462c-9501-4541-b67e-43ec5c5061a7] Fetching instance by UUID {{(pid=116157) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:07:01.036819 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-5d173674-7b37-40ce-9712-c226515e31b9 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:07:01.037278 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-5d173674-7b37-40ce-9712-c226515e31b9 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:07:01.038101 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-5d173674-7b37-40ce-9712-c226515e31b9 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:07:01.038546 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-5d173674-7b37-40ce-9712-c226515e31b9 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:07:01.117077 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi [None req-5effe250-77dc-4d58-936c-2585b85d7ec1 tempest-AttachVolumeTestJSON-244989543 tempest-AttachVolumeTestJSON-244989543-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116156) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 03:07:01.117990 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.compute.api [None req-5effe250-77dc-4d58-936c-2585b85d7ec1 tempest-AttachVolumeTestJSON-244989543 tempest-AttachVolumeTestJSON-244989543-project] [instance: f22dfea6-4599-43e4-93d5-d99f1db3b4fb] Fetching instance by UUID {{(pid=116156) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:07:01.124383 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-5effe250-77dc-4d58-936c-2585b85d7ec1 tempest-AttachVolumeTestJSON-244989543 tempest-AttachVolumeTestJSON-244989543-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:07:01.124841 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-5effe250-77dc-4d58-936c-2585b85d7ec1 tempest-AttachVolumeTestJSON-244989543 tempest-AttachVolumeTestJSON-244989543-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:07:01.126242 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-5effe250-77dc-4d58-936c-2585b85d7ec1 tempest-AttachVolumeTestJSON-244989543 tempest-AttachVolumeTestJSON-244989543-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:07:01.126681 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-5effe250-77dc-4d58-936c-2585b85d7ec1 tempest-AttachVolumeTestJSON-244989543 tempest-AttachVolumeTestJSON-244989543-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:07:01.178721 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.policy [None req-5d173674-7b37-40ce-9712-c226515e31b9 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97bdf19af9e34fc3886ff451cb9d7a27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '494b56bf5eae4d56a5591546f85bc32b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116157) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:07:01.186762 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: INFO nova.api.openstack.requestlog [None req-5d173674-7b37-40ce-9712-c226515e31b9 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] 10.222.0.18 "GET /compute/v2.1/servers/bbb8462c-9501-4541-b67e-43ec5c5061a7" status: 200 len: 1266 microversion: 2.1 time: 0.161402 Dec 15 03:07:01.194061 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: [pid: 116157|app: 0|req: 304/627] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 03:07:01 2021] GET /compute/v2.1/servers/bbb8462c-9501-4541-b67e-43ec5c5061a7 => generated 1266 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 03:07:01.213159 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: INFO nova.api.openstack.requestlog [None req-5effe250-77dc-4d58-936c-2585b85d7ec1 tempest-AttachVolumeTestJSON-244989543 tempest-AttachVolumeTestJSON-244989543-project] 10.222.0.18 "POST /compute/v2.1/servers/f22dfea6-4599-43e4-93d5-d99f1db3b4fb/action" status: 200 len: 14 microversion: 2.1 time: 0.099479 Dec 15 03:07:01.217852 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: [pid: 116156|app: 0|req: 324/628] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Dec 15 03:07:01 2021] POST /compute/v2.1/servers/f22dfea6-4599-43e4-93d5-d99f1db3b4fb/action => generated 14 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Dec 15 03:07:02.030672 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi [None req-ae494528-92e3-4b89-b1b7-22e8a71c6a84 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Calling method '>' {{(pid=116157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:07:02.031443 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.compute.api [None req-ae494528-92e3-4b89-b1b7-22e8a71c6a84 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] [instance: b89094ac-aee1-4bd6-a33d-8c4347cebfc7] Fetching instance by UUID {{(pid=116157) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:07:02.041325 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-ae494528-92e3-4b89-b1b7-22e8a71c6a84 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:07:02.041883 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-ae494528-92e3-4b89-b1b7-22e8a71c6a84 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:07:02.042792 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-ae494528-92e3-4b89-b1b7-22e8a71c6a84 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:07:02.043337 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-ae494528-92e3-4b89-b1b7-22e8a71c6a84 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:07:02.209050 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.policy [None req-ae494528-92e3-4b89-b1b7-22e8a71c6a84 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fedc11e2dbd74b919982a0657222cca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f16202549724b878f908d68384ec9c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116157) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:07:02.212967 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi [None req-6bd69b60-40ea-4dd1-94a2-1ede65895d0b tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Calling method '>' {{(pid=116156) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:07:02.213663 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.compute.api [None req-6bd69b60-40ea-4dd1-94a2-1ede65895d0b tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] [instance: bbb8462c-9501-4541-b67e-43ec5c5061a7] Fetching instance by UUID {{(pid=116156) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:07:02.223322 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-6bd69b60-40ea-4dd1-94a2-1ede65895d0b tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:07:02.223947 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-6bd69b60-40ea-4dd1-94a2-1ede65895d0b tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:07:02.225121 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-6bd69b60-40ea-4dd1-94a2-1ede65895d0b tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:07:02.225848 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.policy [None req-ae494528-92e3-4b89-b1b7-22e8a71c6a84 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fedc11e2dbd74b919982a0657222cca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f16202549724b878f908d68384ec9c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116157) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:07:02.226050 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-6bd69b60-40ea-4dd1-94a2-1ede65895d0b tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:07:02.227835 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.policy [None req-ae494528-92e3-4b89-b1b7-22e8a71c6a84 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fedc11e2dbd74b919982a0657222cca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f16202549724b878f908d68384ec9c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116157) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:07:02.229184 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: INFO nova.api.openstack.requestlog [None req-ae494528-92e3-4b89-b1b7-22e8a71c6a84 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] 10.222.0.18 "GET /compute/v2.1/servers/b89094ac-aee1-4bd6-a33d-8c4347cebfc7" status: 200 len: 1807 microversion: 2.20 time: 0.202460 Dec 15 03:07:02.229889 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: [pid: 116157|app: 0|req: 305/629] 10.222.0.18 () {60 vars in 1276 bytes} [Wed Dec 15 03:07:02 2021] GET /compute/v2.1/servers/b89094ac-aee1-4bd6-a33d-8c4347cebfc7 => generated 1807 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 03:07:02.245742 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi [None req-80847803-d96b-4702-81ca-46b7b14af380 tempest-AttachVolumeTestJSON-244989543 tempest-AttachVolumeTestJSON-244989543-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 03:07:02.246772 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.compute.api [None req-80847803-d96b-4702-81ca-46b7b14af380 tempest-AttachVolumeTestJSON-244989543 tempest-AttachVolumeTestJSON-244989543-project] [instance: f22dfea6-4599-43e4-93d5-d99f1db3b4fb] Fetching instance by UUID {{(pid=116157) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:07:02.253031 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-80847803-d96b-4702-81ca-46b7b14af380 tempest-AttachVolumeTestJSON-244989543 tempest-AttachVolumeTestJSON-244989543-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:07:02.253484 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-80847803-d96b-4702-81ca-46b7b14af380 tempest-AttachVolumeTestJSON-244989543 tempest-AttachVolumeTestJSON-244989543-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:07:02.254296 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-80847803-d96b-4702-81ca-46b7b14af380 tempest-AttachVolumeTestJSON-244989543 tempest-AttachVolumeTestJSON-244989543-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:07:02.254731 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-80847803-d96b-4702-81ca-46b7b14af380 tempest-AttachVolumeTestJSON-244989543 tempest-AttachVolumeTestJSON-244989543-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:07:02.355563 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: INFO nova.api.openstack.requestlog [None req-80847803-d96b-4702-81ca-46b7b14af380 tempest-AttachVolumeTestJSON-244989543 tempest-AttachVolumeTestJSON-244989543-project] 10.222.0.18 "POST /compute/v2.1/servers/f22dfea6-4599-43e4-93d5-d99f1db3b4fb/action" status: 200 len: 14 microversion: 2.1 time: 0.113513 Dec 15 03:07:02.356770 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: [pid: 116157|app: 0|req: 306/630] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Dec 15 03:07:02 2021] POST /compute/v2.1/servers/f22dfea6-4599-43e4-93d5-d99f1db3b4fb/action => generated 14 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Dec 15 03:07:02.437108 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.policy [None req-6bd69b60-40ea-4dd1-94a2-1ede65895d0b tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97bdf19af9e34fc3886ff451cb9d7a27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '494b56bf5eae4d56a5591546f85bc32b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116156) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:07:02.445773 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: INFO nova.api.openstack.requestlog [None req-6bd69b60-40ea-4dd1-94a2-1ede65895d0b tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] 10.222.0.18 "GET /compute/v2.1/servers/bbb8462c-9501-4541-b67e-43ec5c5061a7" status: 200 len: 1266 microversion: 2.1 time: 0.240306 Dec 15 03:07:02.446370 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: [pid: 116156|app: 0|req: 325/631] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 03:07:02 2021] GET /compute/v2.1/servers/bbb8462c-9501-4541-b67e-43ec5c5061a7 => generated 1266 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 03:07:03.248743 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi [None req-8422315b-0d70-4f67-b866-75e27e96c699 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Calling method '>' {{(pid=116157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:07:03.249423 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.compute.api [None req-8422315b-0d70-4f67-b866-75e27e96c699 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] [instance: b89094ac-aee1-4bd6-a33d-8c4347cebfc7] Fetching instance by UUID {{(pid=116157) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:07:03.256554 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-8422315b-0d70-4f67-b866-75e27e96c699 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:07:03.257239 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-8422315b-0d70-4f67-b866-75e27e96c699 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:07:03.258587 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-8422315b-0d70-4f67-b866-75e27e96c699 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:07:03.259179 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-8422315b-0d70-4f67-b866-75e27e96c699 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:07:03.368772 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi [None req-e93155bd-5cc6-4702-b1f2-1177031cacef tempest-AttachVolumeTestJSON-244989543 tempest-AttachVolumeTestJSON-244989543-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116156) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 03:07:03.370866 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.compute.api [None req-e93155bd-5cc6-4702-b1f2-1177031cacef tempest-AttachVolumeTestJSON-244989543 tempest-AttachVolumeTestJSON-244989543-project] [instance: f22dfea6-4599-43e4-93d5-d99f1db3b4fb] Fetching instance by UUID {{(pid=116156) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:07:03.383444 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-e93155bd-5cc6-4702-b1f2-1177031cacef tempest-AttachVolumeTestJSON-244989543 tempest-AttachVolumeTestJSON-244989543-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:07:03.384723 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-e93155bd-5cc6-4702-b1f2-1177031cacef tempest-AttachVolumeTestJSON-244989543 tempest-AttachVolumeTestJSON-244989543-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:07:03.386989 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-e93155bd-5cc6-4702-b1f2-1177031cacef tempest-AttachVolumeTestJSON-244989543 tempest-AttachVolumeTestJSON-244989543-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:07:03.387662 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-e93155bd-5cc6-4702-b1f2-1177031cacef tempest-AttachVolumeTestJSON-244989543 tempest-AttachVolumeTestJSON-244989543-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:07:03.460657 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.policy [None req-8422315b-0d70-4f67-b866-75e27e96c699 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fedc11e2dbd74b919982a0657222cca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f16202549724b878f908d68384ec9c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116157) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:07:03.472269 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.policy [None req-8422315b-0d70-4f67-b866-75e27e96c699 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fedc11e2dbd74b919982a0657222cca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f16202549724b878f908d68384ec9c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116157) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:07:03.474462 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.policy [None req-8422315b-0d70-4f67-b866-75e27e96c699 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fedc11e2dbd74b919982a0657222cca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f16202549724b878f908d68384ec9c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116157) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:07:03.476051 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: INFO nova.api.openstack.requestlog [None req-8422315b-0d70-4f67-b866-75e27e96c699 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] 10.222.0.18 "GET /compute/v2.1/servers/b89094ac-aee1-4bd6-a33d-8c4347cebfc7" status: 200 len: 1807 microversion: 2.20 time: 0.231174 Dec 15 03:07:03.476820 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: [pid: 116157|app: 0|req: 307/632] 10.222.0.18 () {60 vars in 1276 bytes} [Wed Dec 15 03:07:03 2021] GET /compute/v2.1/servers/b89094ac-aee1-4bd6-a33d-8c4347cebfc7 => generated 1807 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 03:07:03.484113 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi [None req-3cdd1807-14ce-4a05-b37e-c7eab4b0be2d tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Calling method '>' {{(pid=116157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:07:03.485061 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.compute.api [None req-3cdd1807-14ce-4a05-b37e-c7eab4b0be2d tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] [instance: bbb8462c-9501-4541-b67e-43ec5c5061a7] Fetching instance by UUID {{(pid=116157) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:07:03.491949 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-3cdd1807-14ce-4a05-b37e-c7eab4b0be2d tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:07:03.492694 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-3cdd1807-14ce-4a05-b37e-c7eab4b0be2d tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:07:03.494246 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-3cdd1807-14ce-4a05-b37e-c7eab4b0be2d tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:07:03.494943 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-3cdd1807-14ce-4a05-b37e-c7eab4b0be2d tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:07:03.717106 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.policy [None req-3cdd1807-14ce-4a05-b37e-c7eab4b0be2d tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97bdf19af9e34fc3886ff451cb9d7a27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '494b56bf5eae4d56a5591546f85bc32b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116157) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:07:03.727992 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: INFO nova.api.openstack.requestlog [None req-3cdd1807-14ce-4a05-b37e-c7eab4b0be2d tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] 10.222.0.18 "GET /compute/v2.1/servers/bbb8462c-9501-4541-b67e-43ec5c5061a7" status: 200 len: 1266 microversion: 2.1 time: 0.249383 Dec 15 03:07:03.728561 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: [pid: 116157|app: 0|req: 308/633] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 03:07:03 2021] GET /compute/v2.1/servers/bbb8462c-9501-4541-b67e-43ec5c5061a7 => generated 1266 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 03:07:04.496723 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi [None req-f46388d9-5f00-4fe7-b029-d8b95ebf2454 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Calling method '>' {{(pid=116157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:07:04.498089 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.compute.api [None req-f46388d9-5f00-4fe7-b029-d8b95ebf2454 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] [instance: b89094ac-aee1-4bd6-a33d-8c4347cebfc7] Fetching instance by UUID {{(pid=116157) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:07:04.505007 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-f46388d9-5f00-4fe7-b029-d8b95ebf2454 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:07:04.506053 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-f46388d9-5f00-4fe7-b029-d8b95ebf2454 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:07:04.506852 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-f46388d9-5f00-4fe7-b029-d8b95ebf2454 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:07:04.507485 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-f46388d9-5f00-4fe7-b029-d8b95ebf2454 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:07:04.678492 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.policy [None req-f46388d9-5f00-4fe7-b029-d8b95ebf2454 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fedc11e2dbd74b919982a0657222cca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f16202549724b878f908d68384ec9c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116157) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:07:04.689620 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.policy [None req-f46388d9-5f00-4fe7-b029-d8b95ebf2454 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fedc11e2dbd74b919982a0657222cca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f16202549724b878f908d68384ec9c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116157) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:07:04.691136 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.policy [None req-f46388d9-5f00-4fe7-b029-d8b95ebf2454 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fedc11e2dbd74b919982a0657222cca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f16202549724b878f908d68384ec9c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116157) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:07:04.692295 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: INFO nova.api.openstack.requestlog [None req-f46388d9-5f00-4fe7-b029-d8b95ebf2454 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] 10.222.0.18 "GET /compute/v2.1/servers/b89094ac-aee1-4bd6-a33d-8c4347cebfc7" status: 200 len: 1807 microversion: 2.20 time: 0.199604 Dec 15 03:07:04.693417 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: [pid: 116157|app: 0|req: 309/634] 10.222.0.18 () {60 vars in 1276 bytes} [Wed Dec 15 03:07:04 2021] GET /compute/v2.1/servers/b89094ac-aee1-4bd6-a33d-8c4347cebfc7 => generated 1807 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Dec 15 03:07:04.770081 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi [None req-0daa3d04-cd11-4aef-8d51-92d6db01772c tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Calling method '>' {{(pid=116157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:07:04.770893 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.compute.api [None req-0daa3d04-cd11-4aef-8d51-92d6db01772c tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] [instance: bbb8462c-9501-4541-b67e-43ec5c5061a7] Fetching instance by UUID {{(pid=116157) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:07:04.778169 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-0daa3d04-cd11-4aef-8d51-92d6db01772c tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:07:04.778871 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-0daa3d04-cd11-4aef-8d51-92d6db01772c tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:07:04.779874 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-0daa3d04-cd11-4aef-8d51-92d6db01772c tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:07:04.780315 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-0daa3d04-cd11-4aef-8d51-92d6db01772c tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:07:04.925973 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.policy [None req-0daa3d04-cd11-4aef-8d51-92d6db01772c tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97bdf19af9e34fc3886ff451cb9d7a27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '494b56bf5eae4d56a5591546f85bc32b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116157) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:07:04.938550 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: INFO nova.api.openstack.requestlog [None req-0daa3d04-cd11-4aef-8d51-92d6db01772c tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] 10.222.0.18 "GET /compute/v2.1/servers/bbb8462c-9501-4541-b67e-43ec5c5061a7" status: 200 len: 1266 microversion: 2.1 time: 0.172655 Dec 15 03:07:04.939239 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: [pid: 116157|app: 0|req: 310/635] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 03:07:04 2021] GET /compute/v2.1/servers/bbb8462c-9501-4541-b67e-43ec5c5061a7 => generated 1266 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 03:07:05.710319 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi [None req-c068f186-d436-4e49-84f0-e567b28eb1f8 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Calling method '>' {{(pid=116157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:07:05.711189 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.compute.api [None req-c068f186-d436-4e49-84f0-e567b28eb1f8 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] [instance: b89094ac-aee1-4bd6-a33d-8c4347cebfc7] Fetching instance by UUID {{(pid=116157) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:07:05.724122 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-c068f186-d436-4e49-84f0-e567b28eb1f8 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:07:05.725455 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-c068f186-d436-4e49-84f0-e567b28eb1f8 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:07:05.726531 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-c068f186-d436-4e49-84f0-e567b28eb1f8 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:07:05.727163 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-c068f186-d436-4e49-84f0-e567b28eb1f8 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:07:05.903025 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.policy [None req-c068f186-d436-4e49-84f0-e567b28eb1f8 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fedc11e2dbd74b919982a0657222cca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f16202549724b878f908d68384ec9c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116157) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:07:05.915115 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.policy [None req-c068f186-d436-4e49-84f0-e567b28eb1f8 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fedc11e2dbd74b919982a0657222cca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f16202549724b878f908d68384ec9c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116157) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:07:05.917473 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.policy [None req-c068f186-d436-4e49-84f0-e567b28eb1f8 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fedc11e2dbd74b919982a0657222cca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f16202549724b878f908d68384ec9c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116157) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:07:05.918705 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: INFO nova.api.openstack.requestlog [None req-c068f186-d436-4e49-84f0-e567b28eb1f8 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] 10.222.0.18 "GET /compute/v2.1/servers/b89094ac-aee1-4bd6-a33d-8c4347cebfc7" status: 200 len: 1807 microversion: 2.20 time: 0.211970 Dec 15 03:07:05.930270 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: [pid: 116157|app: 0|req: 311/636] 10.222.0.18 () {60 vars in 1276 bytes} [Wed Dec 15 03:07:05 2021] GET /compute/v2.1/servers/b89094ac-aee1-4bd6-a33d-8c4347cebfc7 => generated 1807 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Dec 15 03:07:05.930270 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi [req-054107a9-92b9-4cea-9481-17629c96e102 req-50f8aa2b-cf89-46e6-9333-d4e29a10022a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bbb8462c-9501-4541-b67e-43ec5c5061a7", "name": "network-vif-plugged", "status": "completed", "tag": "e917aa72-0647-445c-a93a-04c2f02ade06"}]} {{(pid=116157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 03:07:05.930270 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 15 03:07:05.930270 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: warnings.warn(msg) Dec 15 03:07:05.932965 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [req-054107a9-92b9-4cea-9481-17629c96e102 req-50f8aa2b-cf89-46e6-9333-d4e29a10022a service nova] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:07:05.933426 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [req-054107a9-92b9-4cea-9481-17629c96e102 req-50f8aa2b-cf89-46e6-9333-d4e29a10022a service nova] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:07:05.947658 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: INFO nova.api.openstack.compute.server_external_events [req-054107a9-92b9-4cea-9481-17629c96e102 req-50f8aa2b-cf89-46e6-9333-d4e29a10022a service nova] Creating event network-vif-plugged:e917aa72-0647-445c-a93a-04c2f02ade06 for instance bbb8462c-9501-4541-b67e-43ec5c5061a7 on hv-cinder-81803 Dec 15 03:07:05.955589 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: INFO nova.api.openstack.requestlog [req-054107a9-92b9-4cea-9481-17629c96e102 req-50f8aa2b-cf89-46e6-9333-d4e29a10022a service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034570 Dec 15 03:07:05.956192 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: [pid: 116157|app: 0|req: 312/637] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Dec 15 03:07:05 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 03:07:05.961422 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi [None req-ee1b1d5b-8c59-402f-8601-736746544ef8 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Calling method '>' {{(pid=116157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:07:05.962156 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.compute.api [None req-ee1b1d5b-8c59-402f-8601-736746544ef8 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] [instance: bbb8462c-9501-4541-b67e-43ec5c5061a7] Fetching instance by UUID {{(pid=116157) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:07:05.968519 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-ee1b1d5b-8c59-402f-8601-736746544ef8 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:07:05.969015 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-ee1b1d5b-8c59-402f-8601-736746544ef8 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:07:05.969814 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-ee1b1d5b-8c59-402f-8601-736746544ef8 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:07:05.970277 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-ee1b1d5b-8c59-402f-8601-736746544ef8 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:07:06.126036 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.policy [None req-ee1b1d5b-8c59-402f-8601-736746544ef8 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97bdf19af9e34fc3886ff451cb9d7a27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '494b56bf5eae4d56a5591546f85bc32b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116157) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:07:06.133268 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: INFO nova.api.openstack.requestlog [None req-ee1b1d5b-8c59-402f-8601-736746544ef8 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] 10.222.0.18 "GET /compute/v2.1/servers/bbb8462c-9501-4541-b67e-43ec5c5061a7" status: 200 len: 1266 microversion: 2.1 time: 0.175904 Dec 15 03:07:06.133828 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: [pid: 116157|app: 0|req: 313/638] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 03:07:05 2021] GET /compute/v2.1/servers/bbb8462c-9501-4541-b67e-43ec5c5061a7 => generated 1266 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 03:07:06.938755 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi [None req-12002947-5156-4a7a-84dc-8570632f6e49 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Calling method '>' {{(pid=116157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:07:06.939497 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.compute.api [None req-12002947-5156-4a7a-84dc-8570632f6e49 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] [instance: b89094ac-aee1-4bd6-a33d-8c4347cebfc7] Fetching instance by UUID {{(pid=116157) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:07:06.945763 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-12002947-5156-4a7a-84dc-8570632f6e49 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:07:06.946457 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-12002947-5156-4a7a-84dc-8570632f6e49 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:07:06.947414 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-12002947-5156-4a7a-84dc-8570632f6e49 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:07:06.948210 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-12002947-5156-4a7a-84dc-8570632f6e49 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:07:07.093030 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.policy [None req-12002947-5156-4a7a-84dc-8570632f6e49 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fedc11e2dbd74b919982a0657222cca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f16202549724b878f908d68384ec9c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116157) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:07:07.101852 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.policy [None req-12002947-5156-4a7a-84dc-8570632f6e49 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fedc11e2dbd74b919982a0657222cca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f16202549724b878f908d68384ec9c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116157) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:07:07.103406 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.policy [None req-12002947-5156-4a7a-84dc-8570632f6e49 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fedc11e2dbd74b919982a0657222cca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f16202549724b878f908d68384ec9c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116157) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:07:07.104571 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: INFO nova.api.openstack.requestlog [None req-12002947-5156-4a7a-84dc-8570632f6e49 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] 10.222.0.18 "GET /compute/v2.1/servers/b89094ac-aee1-4bd6-a33d-8c4347cebfc7" status: 200 len: 1807 microversion: 2.20 time: 0.170082 Dec 15 03:07:07.105163 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: [pid: 116157|app: 0|req: 314/639] 10.222.0.18 () {60 vars in 1276 bytes} [Wed Dec 15 03:07:06 2021] GET /compute/v2.1/servers/b89094ac-aee1-4bd6-a33d-8c4347cebfc7 => generated 1807 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 03:07:07.159931 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi [None req-a9d8e815-080e-440d-9f9c-3230d53d58b8 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Calling method '>' {{(pid=116157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:07:07.160475 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.compute.api [None req-a9d8e815-080e-440d-9f9c-3230d53d58b8 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] [instance: bbb8462c-9501-4541-b67e-43ec5c5061a7] Fetching instance by UUID {{(pid=116157) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:07:07.170627 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-a9d8e815-080e-440d-9f9c-3230d53d58b8 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:07:07.171152 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-a9d8e815-080e-440d-9f9c-3230d53d58b8 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:07:07.172523 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-a9d8e815-080e-440d-9f9c-3230d53d58b8 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:07:07.172909 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-a9d8e815-080e-440d-9f9c-3230d53d58b8 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:07:07.337134 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.policy [None req-a9d8e815-080e-440d-9f9c-3230d53d58b8 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97bdf19af9e34fc3886ff451cb9d7a27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '494b56bf5eae4d56a5591546f85bc32b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116157) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:07:07.345502 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: INFO nova.api.openstack.requestlog [None req-a9d8e815-080e-440d-9f9c-3230d53d58b8 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] 10.222.0.18 "GET /compute/v2.1/servers/bbb8462c-9501-4541-b67e-43ec5c5061a7" status: 200 len: 1266 microversion: 2.1 time: 0.194831 Dec 15 03:07:07.346114 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: [pid: 116157|app: 0|req: 315/640] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 03:07:07 2021] GET /compute/v2.1/servers/bbb8462c-9501-4541-b67e-43ec5c5061a7 => generated 1266 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 03:07:08.123181 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi [None req-e0846a37-666a-4fd6-8213-2bba85002550 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Calling method '>' {{(pid=116157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:07:08.123924 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.compute.api [None req-e0846a37-666a-4fd6-8213-2bba85002550 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] [instance: b89094ac-aee1-4bd6-a33d-8c4347cebfc7] Fetching instance by UUID {{(pid=116157) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:07:08.131064 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-e0846a37-666a-4fd6-8213-2bba85002550 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:07:08.131514 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-e0846a37-666a-4fd6-8213-2bba85002550 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:07:08.132314 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-e0846a37-666a-4fd6-8213-2bba85002550 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:07:08.132752 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-e0846a37-666a-4fd6-8213-2bba85002550 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:07:08.266267 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.policy [None req-e0846a37-666a-4fd6-8213-2bba85002550 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fedc11e2dbd74b919982a0657222cca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f16202549724b878f908d68384ec9c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116157) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:07:08.274737 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.policy [None req-e0846a37-666a-4fd6-8213-2bba85002550 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fedc11e2dbd74b919982a0657222cca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f16202549724b878f908d68384ec9c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116157) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:07:08.276237 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.policy [None req-e0846a37-666a-4fd6-8213-2bba85002550 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fedc11e2dbd74b919982a0657222cca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f16202549724b878f908d68384ec9c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116157) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:07:08.277400 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: INFO nova.api.openstack.requestlog [None req-e0846a37-666a-4fd6-8213-2bba85002550 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] 10.222.0.18 "GET /compute/v2.1/servers/b89094ac-aee1-4bd6-a33d-8c4347cebfc7" status: 200 len: 1807 microversion: 2.20 time: 0.158444 Dec 15 03:07:08.277972 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: [pid: 116157|app: 0|req: 316/641] 10.222.0.18 () {60 vars in 1276 bytes} [Wed Dec 15 03:07:08 2021] GET /compute/v2.1/servers/b89094ac-aee1-4bd6-a33d-8c4347cebfc7 => generated 1807 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Dec 15 03:07:08.362355 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi [None req-0bdb1d59-4528-46ca-b944-d8f4729b6f90 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Calling method '>' {{(pid=116157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:07:08.362965 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.compute.api [None req-0bdb1d59-4528-46ca-b944-d8f4729b6f90 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] [instance: bbb8462c-9501-4541-b67e-43ec5c5061a7] Fetching instance by UUID {{(pid=116157) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:07:08.368777 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-0bdb1d59-4528-46ca-b944-d8f4729b6f90 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:07:08.369479 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-0bdb1d59-4528-46ca-b944-d8f4729b6f90 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:07:08.370294 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-0bdb1d59-4528-46ca-b944-d8f4729b6f90 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:07:08.370731 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-0bdb1d59-4528-46ca-b944-d8f4729b6f90 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:07:08.514536 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.policy [None req-0bdb1d59-4528-46ca-b944-d8f4729b6f90 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97bdf19af9e34fc3886ff451cb9d7a27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '494b56bf5eae4d56a5591546f85bc32b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116157) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:07:08.522228 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: INFO nova.api.openstack.requestlog [None req-0bdb1d59-4528-46ca-b944-d8f4729b6f90 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] 10.222.0.18 "GET /compute/v2.1/servers/bbb8462c-9501-4541-b67e-43ec5c5061a7" status: 200 len: 1266 microversion: 2.1 time: 0.163484 Dec 15 03:07:08.522802 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: [pid: 116157|app: 0|req: 317/642] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 03:07:08 2021] GET /compute/v2.1/servers/bbb8462c-9501-4541-b67e-43ec5c5061a7 => generated 1266 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 03:07:09.296616 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi [None req-7b913e0e-1d63-4406-803e-c408a10fd67d tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Calling method '>' {{(pid=116157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:07:09.297865 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.compute.api [None req-7b913e0e-1d63-4406-803e-c408a10fd67d tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] [instance: b89094ac-aee1-4bd6-a33d-8c4347cebfc7] Fetching instance by UUID {{(pid=116157) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:07:09.304518 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-7b913e0e-1d63-4406-803e-c408a10fd67d tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:07:09.304897 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-7b913e0e-1d63-4406-803e-c408a10fd67d tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:07:09.305682 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-7b913e0e-1d63-4406-803e-c408a10fd67d tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:07:09.306138 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-7b913e0e-1d63-4406-803e-c408a10fd67d tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:07:09.445950 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.policy [None req-7b913e0e-1d63-4406-803e-c408a10fd67d tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fedc11e2dbd74b919982a0657222cca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f16202549724b878f908d68384ec9c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116157) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:07:09.455095 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.policy [None req-7b913e0e-1d63-4406-803e-c408a10fd67d tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fedc11e2dbd74b919982a0657222cca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f16202549724b878f908d68384ec9c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116157) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:07:09.456679 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.policy [None req-7b913e0e-1d63-4406-803e-c408a10fd67d tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fedc11e2dbd74b919982a0657222cca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f16202549724b878f908d68384ec9c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116157) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:07:09.457849 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: INFO nova.api.openstack.requestlog [None req-7b913e0e-1d63-4406-803e-c408a10fd67d tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] 10.222.0.18 "GET /compute/v2.1/servers/b89094ac-aee1-4bd6-a33d-8c4347cebfc7" status: 200 len: 1807 microversion: 2.20 time: 0.164948 Dec 15 03:07:09.458638 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: [pid: 116157|app: 0|req: 318/643] 10.222.0.18 () {60 vars in 1276 bytes} [Wed Dec 15 03:07:09 2021] GET /compute/v2.1/servers/b89094ac-aee1-4bd6-a33d-8c4347cebfc7 => generated 1807 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Dec 15 03:07:09.539550 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi [None req-b7933785-195f-4042-a660-bf56ffd8b4ac tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Calling method '>' {{(pid=116157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:07:09.540153 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.compute.api [None req-b7933785-195f-4042-a660-bf56ffd8b4ac tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] [instance: bbb8462c-9501-4541-b67e-43ec5c5061a7] Fetching instance by UUID {{(pid=116157) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:07:09.546136 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-b7933785-195f-4042-a660-bf56ffd8b4ac tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:07:09.546632 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-b7933785-195f-4042-a660-bf56ffd8b4ac tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:07:09.547447 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-b7933785-195f-4042-a660-bf56ffd8b4ac tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:07:09.547876 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-b7933785-195f-4042-a660-bf56ffd8b4ac tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:07:09.678471 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.policy [None req-b7933785-195f-4042-a660-bf56ffd8b4ac tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97bdf19af9e34fc3886ff451cb9d7a27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '494b56bf5eae4d56a5591546f85bc32b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116157) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:07:09.685759 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: INFO nova.api.openstack.requestlog [None req-b7933785-195f-4042-a660-bf56ffd8b4ac tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] 10.222.0.18 "GET /compute/v2.1/servers/bbb8462c-9501-4541-b67e-43ec5c5061a7" status: 200 len: 1266 microversion: 2.1 time: 0.149971 Dec 15 03:07:09.686359 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: [pid: 116157|app: 0|req: 319/644] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 03:07:09 2021] GET /compute/v2.1/servers/bbb8462c-9501-4541-b67e-43ec5c5061a7 => generated 1266 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 03:07:10.478039 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi [None req-36fd131b-86f2-4ca5-a996-f07156d596b5 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Calling method '>' {{(pid=116157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:07:10.479676 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.compute.api [None req-36fd131b-86f2-4ca5-a996-f07156d596b5 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] [instance: b89094ac-aee1-4bd6-a33d-8c4347cebfc7] Fetching instance by UUID {{(pid=116157) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:07:10.487569 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-36fd131b-86f2-4ca5-a996-f07156d596b5 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:07:10.488026 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-36fd131b-86f2-4ca5-a996-f07156d596b5 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:07:10.488818 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-36fd131b-86f2-4ca5-a996-f07156d596b5 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:07:10.489250 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-36fd131b-86f2-4ca5-a996-f07156d596b5 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:07:10.629809 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.policy [None req-36fd131b-86f2-4ca5-a996-f07156d596b5 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fedc11e2dbd74b919982a0657222cca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f16202549724b878f908d68384ec9c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116157) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:07:10.636978 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.policy [None req-36fd131b-86f2-4ca5-a996-f07156d596b5 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fedc11e2dbd74b919982a0657222cca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f16202549724b878f908d68384ec9c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116157) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:07:10.638538 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.policy [None req-36fd131b-86f2-4ca5-a996-f07156d596b5 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fedc11e2dbd74b919982a0657222cca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f16202549724b878f908d68384ec9c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116157) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:07:10.639697 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: INFO nova.api.openstack.requestlog [None req-36fd131b-86f2-4ca5-a996-f07156d596b5 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] 10.222.0.18 "GET /compute/v2.1/servers/b89094ac-aee1-4bd6-a33d-8c4347cebfc7" status: 200 len: 1807 microversion: 2.20 time: 0.165936 Dec 15 03:07:10.640443 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: [pid: 116157|app: 0|req: 320/645] 10.222.0.18 () {60 vars in 1276 bytes} [Wed Dec 15 03:07:10 2021] GET /compute/v2.1/servers/b89094ac-aee1-4bd6-a33d-8c4347cebfc7 => generated 1807 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Dec 15 03:07:10.702338 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi [None req-1d7de580-f37c-4ea7-86e1-2c9e0788d7f4 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Calling method '>' {{(pid=116157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:07:10.702947 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.compute.api [None req-1d7de580-f37c-4ea7-86e1-2c9e0788d7f4 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] [instance: bbb8462c-9501-4541-b67e-43ec5c5061a7] Fetching instance by UUID {{(pid=116157) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:07:10.708999 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-1d7de580-f37c-4ea7-86e1-2c9e0788d7f4 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:07:10.709455 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-1d7de580-f37c-4ea7-86e1-2c9e0788d7f4 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:07:10.710283 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-1d7de580-f37c-4ea7-86e1-2c9e0788d7f4 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:07:10.710722 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-1d7de580-f37c-4ea7-86e1-2c9e0788d7f4 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:07:10.847479 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.policy [None req-1d7de580-f37c-4ea7-86e1-2c9e0788d7f4 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97bdf19af9e34fc3886ff451cb9d7a27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '494b56bf5eae4d56a5591546f85bc32b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116157) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:07:10.854600 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: INFO nova.api.openstack.requestlog [None req-1d7de580-f37c-4ea7-86e1-2c9e0788d7f4 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] 10.222.0.18 "GET /compute/v2.1/servers/bbb8462c-9501-4541-b67e-43ec5c5061a7" status: 200 len: 1266 microversion: 2.1 time: 0.155945 Dec 15 03:07:10.855158 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: [pid: 116157|app: 0|req: 321/646] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 03:07:10 2021] GET /compute/v2.1/servers/bbb8462c-9501-4541-b67e-43ec5c5061a7 => generated 1266 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 03:07:11.658747 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi [None req-20befb5c-528e-4128-9fa9-749d0185de96 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Calling method '>' {{(pid=116157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:07:11.659549 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.compute.api [None req-20befb5c-528e-4128-9fa9-749d0185de96 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] [instance: b89094ac-aee1-4bd6-a33d-8c4347cebfc7] Fetching instance by UUID {{(pid=116157) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:07:11.666817 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-20befb5c-528e-4128-9fa9-749d0185de96 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:07:11.667451 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-20befb5c-528e-4128-9fa9-749d0185de96 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:07:11.668419 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-20befb5c-528e-4128-9fa9-749d0185de96 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:07:11.668863 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-20befb5c-528e-4128-9fa9-749d0185de96 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:07:11.802541 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.policy [None req-20befb5c-528e-4128-9fa9-749d0185de96 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fedc11e2dbd74b919982a0657222cca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f16202549724b878f908d68384ec9c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116157) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:07:11.811314 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.policy [None req-20befb5c-528e-4128-9fa9-749d0185de96 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fedc11e2dbd74b919982a0657222cca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f16202549724b878f908d68384ec9c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116157) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:07:11.813501 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.policy [None req-20befb5c-528e-4128-9fa9-749d0185de96 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fedc11e2dbd74b919982a0657222cca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f16202549724b878f908d68384ec9c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116157) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:07:11.814839 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: INFO nova.api.openstack.requestlog [None req-20befb5c-528e-4128-9fa9-749d0185de96 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] 10.222.0.18 "GET /compute/v2.1/servers/b89094ac-aee1-4bd6-a33d-8c4347cebfc7" status: 200 len: 1807 microversion: 2.20 time: 0.160109 Dec 15 03:07:11.815779 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: [pid: 116157|app: 0|req: 322/647] 10.222.0.18 () {60 vars in 1276 bytes} [Wed Dec 15 03:07:11 2021] GET /compute/v2.1/servers/b89094ac-aee1-4bd6-a33d-8c4347cebfc7 => generated 1807 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Dec 15 03:07:11.873515 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi [None req-0c65a87c-31dc-4a92-b223-7cbcaf088223 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Calling method '>' {{(pid=116157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:07:11.874159 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.compute.api [None req-0c65a87c-31dc-4a92-b223-7cbcaf088223 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] [instance: bbb8462c-9501-4541-b67e-43ec5c5061a7] Fetching instance by UUID {{(pid=116157) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:07:11.880644 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-0c65a87c-31dc-4a92-b223-7cbcaf088223 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:07:11.881089 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-0c65a87c-31dc-4a92-b223-7cbcaf088223 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:07:11.881859 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-0c65a87c-31dc-4a92-b223-7cbcaf088223 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:07:11.882314 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-0c65a87c-31dc-4a92-b223-7cbcaf088223 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:07:12.016484 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.policy [None req-0c65a87c-31dc-4a92-b223-7cbcaf088223 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97bdf19af9e34fc3886ff451cb9d7a27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '494b56bf5eae4d56a5591546f85bc32b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116157) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:07:12.024008 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: INFO nova.api.openstack.requestlog [None req-0c65a87c-31dc-4a92-b223-7cbcaf088223 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] 10.222.0.18 "GET /compute/v2.1/servers/bbb8462c-9501-4541-b67e-43ec5c5061a7" status: 200 len: 1266 microversion: 2.1 time: 0.154069 Dec 15 03:07:12.024594 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: [pid: 116157|app: 0|req: 323/648] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 03:07:11 2021] GET /compute/v2.1/servers/bbb8462c-9501-4541-b67e-43ec5c5061a7 => generated 1266 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 03:07:12.833862 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi [None req-01a67b4e-a8b6-4bde-bdbc-8848ac31bd6a tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Calling method '>' {{(pid=116157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:07:12.834716 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.compute.api [None req-01a67b4e-a8b6-4bde-bdbc-8848ac31bd6a tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] [instance: b89094ac-aee1-4bd6-a33d-8c4347cebfc7] Fetching instance by UUID {{(pid=116157) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:07:12.841878 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-01a67b4e-a8b6-4bde-bdbc-8848ac31bd6a tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:07:12.841878 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-01a67b4e-a8b6-4bde-bdbc-8848ac31bd6a tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:07:12.842072 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-01a67b4e-a8b6-4bde-bdbc-8848ac31bd6a tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:07:12.842464 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-01a67b4e-a8b6-4bde-bdbc-8848ac31bd6a tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:07:13.017491 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.policy [None req-01a67b4e-a8b6-4bde-bdbc-8848ac31bd6a tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fedc11e2dbd74b919982a0657222cca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f16202549724b878f908d68384ec9c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116157) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:07:13.025691 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.policy [None req-01a67b4e-a8b6-4bde-bdbc-8848ac31bd6a tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fedc11e2dbd74b919982a0657222cca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f16202549724b878f908d68384ec9c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116157) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:07:13.027169 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.policy [None req-01a67b4e-a8b6-4bde-bdbc-8848ac31bd6a tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fedc11e2dbd74b919982a0657222cca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f16202549724b878f908d68384ec9c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116157) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:07:13.028314 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: INFO nova.api.openstack.requestlog [None req-01a67b4e-a8b6-4bde-bdbc-8848ac31bd6a tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] 10.222.0.18 "GET /compute/v2.1/servers/b89094ac-aee1-4bd6-a33d-8c4347cebfc7" status: 200 len: 1807 microversion: 2.20 time: 0.198082 Dec 15 03:07:13.028872 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: [pid: 116157|app: 0|req: 324/649] 10.222.0.18 () {60 vars in 1276 bytes} [Wed Dec 15 03:07:12 2021] GET /compute/v2.1/servers/b89094ac-aee1-4bd6-a33d-8c4347cebfc7 => generated 1807 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Dec 15 03:07:13.040443 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi [None req-453b2f0b-be40-4bbe-bb05-1004d7247ddb tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Calling method '>' {{(pid=116157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:07:13.041052 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.compute.api [None req-453b2f0b-be40-4bbe-bb05-1004d7247ddb tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] [instance: bbb8462c-9501-4541-b67e-43ec5c5061a7] Fetching instance by UUID {{(pid=116157) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:07:13.047231 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-453b2f0b-be40-4bbe-bb05-1004d7247ddb tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:07:13.047691 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-453b2f0b-be40-4bbe-bb05-1004d7247ddb tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:07:13.048569 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-453b2f0b-be40-4bbe-bb05-1004d7247ddb tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:07:13.048997 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-453b2f0b-be40-4bbe-bb05-1004d7247ddb tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:07:13.197162 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.policy [None req-453b2f0b-be40-4bbe-bb05-1004d7247ddb tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97bdf19af9e34fc3886ff451cb9d7a27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '494b56bf5eae4d56a5591546f85bc32b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116157) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:07:13.210781 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: INFO nova.api.openstack.requestlog [None req-453b2f0b-be40-4bbe-bb05-1004d7247ddb tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] 10.222.0.18 "GET /compute/v2.1/servers/bbb8462c-9501-4541-b67e-43ec5c5061a7" status: 200 len: 1266 microversion: 2.1 time: 0.168321 Dec 15 03:07:13.214542 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: [pid: 116157|app: 0|req: 325/650] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 03:07:13 2021] GET /compute/v2.1/servers/bbb8462c-9501-4541-b67e-43ec5c5061a7 => generated 1266 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 03:07:14.047063 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi [None req-33932a25-ff8e-43d2-801b-d98159c2aaa3 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Calling method '>' {{(pid=116157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:07:14.047730 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.compute.api [None req-33932a25-ff8e-43d2-801b-d98159c2aaa3 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] [instance: b89094ac-aee1-4bd6-a33d-8c4347cebfc7] Fetching instance by UUID {{(pid=116157) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:07:14.053863 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-33932a25-ff8e-43d2-801b-d98159c2aaa3 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:07:14.054343 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-33932a25-ff8e-43d2-801b-d98159c2aaa3 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:07:14.055124 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-33932a25-ff8e-43d2-801b-d98159c2aaa3 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:07:14.055566 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-33932a25-ff8e-43d2-801b-d98159c2aaa3 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:07:14.196338 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.policy [None req-33932a25-ff8e-43d2-801b-d98159c2aaa3 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fedc11e2dbd74b919982a0657222cca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f16202549724b878f908d68384ec9c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116157) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:07:14.216444 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.policy [None req-33932a25-ff8e-43d2-801b-d98159c2aaa3 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fedc11e2dbd74b919982a0657222cca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f16202549724b878f908d68384ec9c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116157) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:07:14.218362 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.policy [None req-33932a25-ff8e-43d2-801b-d98159c2aaa3 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fedc11e2dbd74b919982a0657222cca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f16202549724b878f908d68384ec9c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116157) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:07:14.220209 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: INFO nova.api.openstack.requestlog [None req-33932a25-ff8e-43d2-801b-d98159c2aaa3 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] 10.222.0.18 "GET /compute/v2.1/servers/b89094ac-aee1-4bd6-a33d-8c4347cebfc7" status: 200 len: 1807 microversion: 2.20 time: 0.176955 Dec 15 03:07:14.221173 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: [pid: 116157|app: 0|req: 326/651] 10.222.0.18 () {60 vars in 1276 bytes} [Wed Dec 15 03:07:14 2021] GET /compute/v2.1/servers/b89094ac-aee1-4bd6-a33d-8c4347cebfc7 => generated 1807 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Dec 15 03:07:14.229696 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi [None req-ead987f7-e31e-4525-bd02-abe48c97f308 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Calling method '>' {{(pid=116157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:07:14.230510 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.compute.api [None req-ead987f7-e31e-4525-bd02-abe48c97f308 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] [instance: bbb8462c-9501-4541-b67e-43ec5c5061a7] Fetching instance by UUID {{(pid=116157) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:07:14.237103 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-ead987f7-e31e-4525-bd02-abe48c97f308 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:07:14.237557 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-ead987f7-e31e-4525-bd02-abe48c97f308 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:07:14.238483 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-ead987f7-e31e-4525-bd02-abe48c97f308 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:07:14.238924 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-ead987f7-e31e-4525-bd02-abe48c97f308 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:07:14.383650 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.policy [None req-ead987f7-e31e-4525-bd02-abe48c97f308 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97bdf19af9e34fc3886ff451cb9d7a27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '494b56bf5eae4d56a5591546f85bc32b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116157) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:07:14.391902 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: INFO nova.api.openstack.requestlog [None req-ead987f7-e31e-4525-bd02-abe48c97f308 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] 10.222.0.18 "GET /compute/v2.1/servers/bbb8462c-9501-4541-b67e-43ec5c5061a7" status: 200 len: 1266 microversion: 2.1 time: 0.167608 Dec 15 03:07:14.392477 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: [pid: 116157|app: 0|req: 327/652] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 03:07:14 2021] GET /compute/v2.1/servers/bbb8462c-9501-4541-b67e-43ec5c5061a7 => generated 1266 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 03:07:15.192262 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: INFO nova.api.openstack.requestlog [None req-e93155bd-5cc6-4702-b1f2-1177031cacef tempest-AttachVolumeTestJSON-244989543 tempest-AttachVolumeTestJSON-244989543-project] 10.222.0.18 "POST /compute/v2.1/servers/f22dfea6-4599-43e4-93d5-d99f1db3b4fb/action" status: 200 len: 24775 microversion: 2.1 time: 11.828838 Dec 15 03:07:15.192926 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: [pid: 116156|app: 0|req: 326/653] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Dec 15 03:07:03 2021] POST /compute/v2.1/servers/f22dfea6-4599-43e4-93d5-d99f1db3b4fb/action => generated 24775 bytes in 11831 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Dec 15 03:07:15.238925 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi [None req-e27488a3-cec5-4844-ba4a-c93bde62c4a5 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Calling method '>' {{(pid=116157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:07:15.239533 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.compute.api [None req-e27488a3-cec5-4844-ba4a-c93bde62c4a5 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] [instance: b89094ac-aee1-4bd6-a33d-8c4347cebfc7] Fetching instance by UUID {{(pid=116157) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:07:15.246079 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-e27488a3-cec5-4844-ba4a-c93bde62c4a5 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:07:15.246534 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-e27488a3-cec5-4844-ba4a-c93bde62c4a5 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:07:15.247312 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-e27488a3-cec5-4844-ba4a-c93bde62c4a5 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:07:15.247746 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-e27488a3-cec5-4844-ba4a-c93bde62c4a5 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:07:15.392475 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.policy [None req-e27488a3-cec5-4844-ba4a-c93bde62c4a5 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fedc11e2dbd74b919982a0657222cca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f16202549724b878f908d68384ec9c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116157) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:07:15.401291 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.policy [None req-e27488a3-cec5-4844-ba4a-c93bde62c4a5 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fedc11e2dbd74b919982a0657222cca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f16202549724b878f908d68384ec9c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116157) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:07:15.402984 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.policy [None req-e27488a3-cec5-4844-ba4a-c93bde62c4a5 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fedc11e2dbd74b919982a0657222cca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f16202549724b878f908d68384ec9c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116157) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:07:15.409865 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi [None req-0679037a-c7ee-4095-83f6-fbaf93152432 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Calling method '>' {{(pid=116156) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:07:15.410675 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.compute.api [None req-0679037a-c7ee-4095-83f6-fbaf93152432 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] [instance: bbb8462c-9501-4541-b67e-43ec5c5061a7] Fetching instance by UUID {{(pid=116156) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:07:15.414919 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: INFO nova.api.openstack.requestlog [None req-e27488a3-cec5-4844-ba4a-c93bde62c4a5 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] 10.222.0.18 "GET /compute/v2.1/servers/b89094ac-aee1-4bd6-a33d-8c4347cebfc7" status: 200 len: 1807 microversion: 2.20 time: 0.179277 Dec 15 03:07:15.415502 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: [pid: 116157|app: 0|req: 328/654] 10.222.0.18 () {60 vars in 1276 bytes} [Wed Dec 15 03:07:15 2021] GET /compute/v2.1/servers/b89094ac-aee1-4bd6-a33d-8c4347cebfc7 => generated 1807 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 03:07:15.431305 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-0679037a-c7ee-4095-83f6-fbaf93152432 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:07:15.431755 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-0679037a-c7ee-4095-83f6-fbaf93152432 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:07:15.432588 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-0679037a-c7ee-4095-83f6-fbaf93152432 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:07:15.433025 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-0679037a-c7ee-4095-83f6-fbaf93152432 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:07:15.573075 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.policy [None req-0679037a-c7ee-4095-83f6-fbaf93152432 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97bdf19af9e34fc3886ff451cb9d7a27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '494b56bf5eae4d56a5591546f85bc32b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116156) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:07:15.581165 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: INFO nova.api.openstack.requestlog [None req-0679037a-c7ee-4095-83f6-fbaf93152432 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] 10.222.0.18 "GET /compute/v2.1/servers/bbb8462c-9501-4541-b67e-43ec5c5061a7" status: 200 len: 1266 microversion: 2.1 time: 0.176271 Dec 15 03:07:15.581735 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: [pid: 116156|app: 0|req: 327/655] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 03:07:15 2021] GET /compute/v2.1/servers/bbb8462c-9501-4541-b67e-43ec5c5061a7 => generated 1266 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 03:07:16.203690 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi [None req-4fd0f296-7312-4835-ba64-740d576765d1 tempest-AttachVolumeTestJSON-244989543 tempest-AttachVolumeTestJSON-244989543-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 03:07:16.204602 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.compute.api [None req-4fd0f296-7312-4835-ba64-740d576765d1 tempest-AttachVolumeTestJSON-244989543 tempest-AttachVolumeTestJSON-244989543-project] [instance: f22dfea6-4599-43e4-93d5-d99f1db3b4fb] Fetching instance by UUID {{(pid=116157) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:07:16.211000 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-4fd0f296-7312-4835-ba64-740d576765d1 tempest-AttachVolumeTestJSON-244989543 tempest-AttachVolumeTestJSON-244989543-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:07:16.211000 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-4fd0f296-7312-4835-ba64-740d576765d1 tempest-AttachVolumeTestJSON-244989543 tempest-AttachVolumeTestJSON-244989543-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:07:16.211698 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-4fd0f296-7312-4835-ba64-740d576765d1 tempest-AttachVolumeTestJSON-244989543 tempest-AttachVolumeTestJSON-244989543-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:07:16.212131 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-4fd0f296-7312-4835-ba64-740d576765d1 tempest-AttachVolumeTestJSON-244989543 tempest-AttachVolumeTestJSON-244989543-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:07:16.341428 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: INFO nova.api.openstack.requestlog [None req-4fd0f296-7312-4835-ba64-740d576765d1 tempest-AttachVolumeTestJSON-244989543 tempest-AttachVolumeTestJSON-244989543-project] 10.222.0.18 "POST /compute/v2.1/servers/f22dfea6-4599-43e4-93d5-d99f1db3b4fb/action" status: 200 len: 25977 microversion: 2.1 time: 0.141138 Dec 15 03:07:16.343211 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: [pid: 116157|app: 0|req: 329/656] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Dec 15 03:07:16 2021] POST /compute/v2.1/servers/f22dfea6-4599-43e4-93d5-d99f1db3b4fb/action => generated 25977 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 03:07:16.434125 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi [None req-6f8d6901-0a37-428d-ac54-c62f29fed03c tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Calling method '>' {{(pid=116156) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:07:16.434748 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.compute.api [None req-6f8d6901-0a37-428d-ac54-c62f29fed03c tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] [instance: b89094ac-aee1-4bd6-a33d-8c4347cebfc7] Fetching instance by UUID {{(pid=116156) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:07:16.441710 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-6f8d6901-0a37-428d-ac54-c62f29fed03c tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:07:16.442193 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-6f8d6901-0a37-428d-ac54-c62f29fed03c tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:07:16.442985 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-6f8d6901-0a37-428d-ac54-c62f29fed03c tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:07:16.443424 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-6f8d6901-0a37-428d-ac54-c62f29fed03c tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:07:16.584867 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.policy [None req-6f8d6901-0a37-428d-ac54-c62f29fed03c tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fedc11e2dbd74b919982a0657222cca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f16202549724b878f908d68384ec9c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116156) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:07:16.597724 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi [None req-aa2860e2-eda3-4c49-9ad5-a4aeed60a0a9 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Calling method '>' {{(pid=116157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:07:16.598479 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.compute.api [None req-aa2860e2-eda3-4c49-9ad5-a4aeed60a0a9 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] [instance: bbb8462c-9501-4541-b67e-43ec5c5061a7] Fetching instance by UUID {{(pid=116157) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:07:16.606466 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-aa2860e2-eda3-4c49-9ad5-a4aeed60a0a9 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:07:16.606926 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-aa2860e2-eda3-4c49-9ad5-a4aeed60a0a9 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:07:16.607734 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-aa2860e2-eda3-4c49-9ad5-a4aeed60a0a9 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:07:16.608110 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.policy [None req-6f8d6901-0a37-428d-ac54-c62f29fed03c tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fedc11e2dbd74b919982a0657222cca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f16202549724b878f908d68384ec9c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116156) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:07:16.610169 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.policy [None req-6f8d6901-0a37-428d-ac54-c62f29fed03c tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fedc11e2dbd74b919982a0657222cca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f16202549724b878f908d68384ec9c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116156) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:07:16.611336 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: INFO nova.api.openstack.requestlog [None req-6f8d6901-0a37-428d-ac54-c62f29fed03c tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] 10.222.0.18 "GET /compute/v2.1/servers/b89094ac-aee1-4bd6-a33d-8c4347cebfc7" status: 200 len: 1807 microversion: 2.20 time: 0.180969 Dec 15 03:07:16.611887 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: [pid: 116156|app: 0|req: 328/657] 10.222.0.18 () {60 vars in 1276 bytes} [Wed Dec 15 03:07:16 2021] GET /compute/v2.1/servers/b89094ac-aee1-4bd6-a33d-8c4347cebfc7 => generated 1807 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 03:07:16.615012 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-aa2860e2-eda3-4c49-9ad5-a4aeed60a0a9 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:07:16.758436 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.policy [None req-aa2860e2-eda3-4c49-9ad5-a4aeed60a0a9 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97bdf19af9e34fc3886ff451cb9d7a27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '494b56bf5eae4d56a5591546f85bc32b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116157) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:07:16.765840 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: INFO nova.api.openstack.requestlog [None req-aa2860e2-eda3-4c49-9ad5-a4aeed60a0a9 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] 10.222.0.18 "GET /compute/v2.1/servers/bbb8462c-9501-4541-b67e-43ec5c5061a7" status: 200 len: 1266 microversion: 2.1 time: 0.172603 Dec 15 03:07:16.766434 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: [pid: 116157|app: 0|req: 330/658] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 03:07:16 2021] GET /compute/v2.1/servers/bbb8462c-9501-4541-b67e-43ec5c5061a7 => generated 1266 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 03:07:17.352336 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi [None req-c58af38d-f1c8-4054-baa1-d3eb7c740c53 tempest-AttachVolumeTestJSON-244989543 tempest-AttachVolumeTestJSON-244989543-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116156) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 03:07:17.353327 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.compute.api [None req-c58af38d-f1c8-4054-baa1-d3eb7c740c53 tempest-AttachVolumeTestJSON-244989543 tempest-AttachVolumeTestJSON-244989543-project] [instance: f22dfea6-4599-43e4-93d5-d99f1db3b4fb] Fetching instance by UUID {{(pid=116156) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:07:17.360465 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-c58af38d-f1c8-4054-baa1-d3eb7c740c53 tempest-AttachVolumeTestJSON-244989543 tempest-AttachVolumeTestJSON-244989543-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:07:17.361032 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-c58af38d-f1c8-4054-baa1-d3eb7c740c53 tempest-AttachVolumeTestJSON-244989543 tempest-AttachVolumeTestJSON-244989543-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:07:17.361931 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-c58af38d-f1c8-4054-baa1-d3eb7c740c53 tempest-AttachVolumeTestJSON-244989543 tempest-AttachVolumeTestJSON-244989543-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:07:17.362548 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-c58af38d-f1c8-4054-baa1-d3eb7c740c53 tempest-AttachVolumeTestJSON-244989543 tempest-AttachVolumeTestJSON-244989543-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:07:17.458870 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: INFO nova.api.openstack.requestlog [None req-c58af38d-f1c8-4054-baa1-d3eb7c740c53 tempest-AttachVolumeTestJSON-244989543 tempest-AttachVolumeTestJSON-244989543-project] 10.222.0.18 "POST /compute/v2.1/servers/f22dfea6-4599-43e4-93d5-d99f1db3b4fb/action" status: 200 len: 27011 microversion: 2.1 time: 0.109907 Dec 15 03:07:17.459798 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: [pid: 116156|app: 0|req: 329/659] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Dec 15 03:07:17 2021] POST /compute/v2.1/servers/f22dfea6-4599-43e4-93d5-d99f1db3b4fb/action => generated 27011 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 03:07:17.629620 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi [None req-c2879984-6793-4e49-bd28-d4cb092b7a36 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Calling method '>' {{(pid=116157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:07:17.630263 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.compute.api [None req-c2879984-6793-4e49-bd28-d4cb092b7a36 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] [instance: b89094ac-aee1-4bd6-a33d-8c4347cebfc7] Fetching instance by UUID {{(pid=116157) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:07:17.636396 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-c2879984-6793-4e49-bd28-d4cb092b7a36 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:07:17.636848 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-c2879984-6793-4e49-bd28-d4cb092b7a36 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:07:17.637618 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-c2879984-6793-4e49-bd28-d4cb092b7a36 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:07:17.638071 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-c2879984-6793-4e49-bd28-d4cb092b7a36 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:07:17.770260 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.policy [None req-c2879984-6793-4e49-bd28-d4cb092b7a36 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fedc11e2dbd74b919982a0657222cca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f16202549724b878f908d68384ec9c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116157) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:07:17.780694 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.policy [None req-c2879984-6793-4e49-bd28-d4cb092b7a36 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fedc11e2dbd74b919982a0657222cca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f16202549724b878f908d68384ec9c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116157) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:07:17.783012 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.policy [None req-c2879984-6793-4e49-bd28-d4cb092b7a36 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fedc11e2dbd74b919982a0657222cca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f16202549724b878f908d68384ec9c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116157) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:07:17.784179 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: INFO nova.api.openstack.requestlog [None req-c2879984-6793-4e49-bd28-d4cb092b7a36 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] 10.222.0.18 "GET /compute/v2.1/servers/b89094ac-aee1-4bd6-a33d-8c4347cebfc7" status: 200 len: 1807 microversion: 2.20 time: 0.158197 Dec 15 03:07:17.784987 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: [pid: 116157|app: 0|req: 331/660] 10.222.0.18 () {60 vars in 1276 bytes} [Wed Dec 15 03:07:17 2021] GET /compute/v2.1/servers/b89094ac-aee1-4bd6-a33d-8c4347cebfc7 => generated 1807 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 03:07:17.786774 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi [None req-736c80dd-7869-4f9f-81f7-ad0cf89b54d5 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Calling method '>' {{(pid=116156) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:07:17.787542 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.compute.api [None req-736c80dd-7869-4f9f-81f7-ad0cf89b54d5 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] [instance: bbb8462c-9501-4541-b67e-43ec5c5061a7] Fetching instance by UUID {{(pid=116156) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:07:17.794382 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-736c80dd-7869-4f9f-81f7-ad0cf89b54d5 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:07:17.795084 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-736c80dd-7869-4f9f-81f7-ad0cf89b54d5 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:07:17.796101 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-736c80dd-7869-4f9f-81f7-ad0cf89b54d5 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:07:17.796641 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-736c80dd-7869-4f9f-81f7-ad0cf89b54d5 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:07:17.934651 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.policy [None req-736c80dd-7869-4f9f-81f7-ad0cf89b54d5 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97bdf19af9e34fc3886ff451cb9d7a27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '494b56bf5eae4d56a5591546f85bc32b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116156) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:07:17.943585 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: INFO nova.api.openstack.requestlog [None req-736c80dd-7869-4f9f-81f7-ad0cf89b54d5 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] 10.222.0.18 "GET /compute/v2.1/servers/bbb8462c-9501-4541-b67e-43ec5c5061a7" status: 200 len: 1452 microversion: 2.1 time: 0.164635 Dec 15 03:07:17.951796 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: [pid: 116156|app: 0|req: 330/661] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 03:07:17 2021] GET /compute/v2.1/servers/bbb8462c-9501-4541-b67e-43ec5c5061a7 => generated 1452 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 03:07:17.960786 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi [None req-0b8e1f75-01dd-4869-bc38-e5b75df9e6c4 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Calling method '>' {{(pid=116157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:07:17.961407 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.compute.api [None req-0b8e1f75-01dd-4869-bc38-e5b75df9e6c4 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] [instance: bbb8462c-9501-4541-b67e-43ec5c5061a7] Fetching instance by UUID {{(pid=116157) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:07:17.967790 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-0b8e1f75-01dd-4869-bc38-e5b75df9e6c4 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:07:17.968248 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-0b8e1f75-01dd-4869-bc38-e5b75df9e6c4 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:07:17.969644 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-0b8e1f75-01dd-4869-bc38-e5b75df9e6c4 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:07:17.970114 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-0b8e1f75-01dd-4869-bc38-e5b75df9e6c4 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:07:18.115518 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.policy [None req-0b8e1f75-01dd-4869-bc38-e5b75df9e6c4 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97bdf19af9e34fc3886ff451cb9d7a27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '494b56bf5eae4d56a5591546f85bc32b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116157) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:07:18.123544 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: INFO nova.api.openstack.requestlog [None req-0b8e1f75-01dd-4869-bc38-e5b75df9e6c4 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] 10.222.0.18 "GET /compute/v2.1/servers/bbb8462c-9501-4541-b67e-43ec5c5061a7" status: 200 len: 1452 microversion: 2.1 time: 0.166621 Dec 15 03:07:18.124619 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: [pid: 116157|app: 0|req: 332/662] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 03:07:17 2021] GET /compute/v2.1/servers/bbb8462c-9501-4541-b67e-43ec5c5061a7 => generated 1452 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 03:07:18.470349 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi [None req-54d43177-e38c-4fad-92f6-96df78028d51 tempest-AttachVolumeTestJSON-244989543 tempest-AttachVolumeTestJSON-244989543-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116156) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 03:07:18.471439 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.compute.api [None req-54d43177-e38c-4fad-92f6-96df78028d51 tempest-AttachVolumeTestJSON-244989543 tempest-AttachVolumeTestJSON-244989543-project] [instance: f22dfea6-4599-43e4-93d5-d99f1db3b4fb] Fetching instance by UUID {{(pid=116156) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:07:18.480650 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-54d43177-e38c-4fad-92f6-96df78028d51 tempest-AttachVolumeTestJSON-244989543 tempest-AttachVolumeTestJSON-244989543-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:07:18.481106 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-54d43177-e38c-4fad-92f6-96df78028d51 tempest-AttachVolumeTestJSON-244989543 tempest-AttachVolumeTestJSON-244989543-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:07:18.481894 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-54d43177-e38c-4fad-92f6-96df78028d51 tempest-AttachVolumeTestJSON-244989543 tempest-AttachVolumeTestJSON-244989543-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:07:18.486497 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-54d43177-e38c-4fad-92f6-96df78028d51 tempest-AttachVolumeTestJSON-244989543 tempest-AttachVolumeTestJSON-244989543-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:07:18.631795 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: INFO nova.api.openstack.requestlog [None req-54d43177-e38c-4fad-92f6-96df78028d51 tempest-AttachVolumeTestJSON-244989543 tempest-AttachVolumeTestJSON-244989543-project] 10.222.0.18 "POST /compute/v2.1/servers/f22dfea6-4599-43e4-93d5-d99f1db3b4fb/action" status: 200 len: 27556 microversion: 2.1 time: 0.164886 Dec 15 03:07:18.633147 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: [pid: 116156|app: 0|req: 331/663] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Dec 15 03:07:18 2021] POST /compute/v2.1/servers/f22dfea6-4599-43e4-93d5-d99f1db3b4fb/action => generated 27556 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 03:07:18.803670 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi [None req-dcb2f5a3-d67a-4141-bcf0-000efe9a92b4 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Calling method '>' {{(pid=116157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:07:18.804280 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.compute.api [None req-dcb2f5a3-d67a-4141-bcf0-000efe9a92b4 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] [instance: b89094ac-aee1-4bd6-a33d-8c4347cebfc7] Fetching instance by UUID {{(pid=116157) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:07:18.810698 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-dcb2f5a3-d67a-4141-bcf0-000efe9a92b4 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:07:18.811173 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-dcb2f5a3-d67a-4141-bcf0-000efe9a92b4 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:07:18.811947 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-dcb2f5a3-d67a-4141-bcf0-000efe9a92b4 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:07:18.812387 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-dcb2f5a3-d67a-4141-bcf0-000efe9a92b4 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:07:19.063695 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.policy [None req-dcb2f5a3-d67a-4141-bcf0-000efe9a92b4 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fedc11e2dbd74b919982a0657222cca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f16202549724b878f908d68384ec9c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116157) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:07:19.072067 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.policy [None req-dcb2f5a3-d67a-4141-bcf0-000efe9a92b4 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fedc11e2dbd74b919982a0657222cca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f16202549724b878f908d68384ec9c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116157) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:07:19.073605 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.policy [None req-dcb2f5a3-d67a-4141-bcf0-000efe9a92b4 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fedc11e2dbd74b919982a0657222cca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f16202549724b878f908d68384ec9c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116157) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:07:19.075004 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: INFO nova.api.openstack.requestlog [None req-dcb2f5a3-d67a-4141-bcf0-000efe9a92b4 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] 10.222.0.18 "GET /compute/v2.1/servers/b89094ac-aee1-4bd6-a33d-8c4347cebfc7" status: 200 len: 1807 microversion: 2.20 time: 0.275192 Dec 15 03:07:19.075607 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: [pid: 116157|app: 0|req: 333/664] 10.222.0.18 () {60 vars in 1276 bytes} [Wed Dec 15 03:07:18 2021] GET /compute/v2.1/servers/b89094ac-aee1-4bd6-a33d-8c4347cebfc7 => generated 1807 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 03:07:19.644764 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi [None req-30a427ef-4712-49c4-b643-93b1bc94b1d4 tempest-AttachVolumeTestJSON-244989543 tempest-AttachVolumeTestJSON-244989543-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116156) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 03:07:19.645763 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.compute.api [None req-30a427ef-4712-49c4-b643-93b1bc94b1d4 tempest-AttachVolumeTestJSON-244989543 tempest-AttachVolumeTestJSON-244989543-project] [instance: f22dfea6-4599-43e4-93d5-d99f1db3b4fb] Fetching instance by UUID {{(pid=116156) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:07:19.652691 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-30a427ef-4712-49c4-b643-93b1bc94b1d4 tempest-AttachVolumeTestJSON-244989543 tempest-AttachVolumeTestJSON-244989543-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:07:19.653256 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-30a427ef-4712-49c4-b643-93b1bc94b1d4 tempest-AttachVolumeTestJSON-244989543 tempest-AttachVolumeTestJSON-244989543-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:07:19.654085 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-30a427ef-4712-49c4-b643-93b1bc94b1d4 tempest-AttachVolumeTestJSON-244989543 tempest-AttachVolumeTestJSON-244989543-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:07:19.654526 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-30a427ef-4712-49c4-b643-93b1bc94b1d4 tempest-AttachVolumeTestJSON-244989543 tempest-AttachVolumeTestJSON-244989543-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:07:19.778342 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: INFO nova.api.openstack.requestlog [None req-30a427ef-4712-49c4-b643-93b1bc94b1d4 tempest-AttachVolumeTestJSON-244989543 tempest-AttachVolumeTestJSON-244989543-project] 10.222.0.18 "POST /compute/v2.1/servers/f22dfea6-4599-43e4-93d5-d99f1db3b4fb/action" status: 200 len: 27979 microversion: 2.1 time: 0.137573 Dec 15 03:07:19.779495 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: [pid: 116156|app: 0|req: 332/665] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Dec 15 03:07:19 2021] POST /compute/v2.1/servers/f22dfea6-4599-43e4-93d5-d99f1db3b4fb/action => generated 27979 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 03:07:20.093414 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi [None req-4e13677d-d3c2-4497-8a96-9b8c4633b072 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Calling method '>' {{(pid=116157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:07:20.094052 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.compute.api [None req-4e13677d-d3c2-4497-8a96-9b8c4633b072 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] [instance: b89094ac-aee1-4bd6-a33d-8c4347cebfc7] Fetching instance by UUID {{(pid=116157) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:07:20.100205 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-4e13677d-d3c2-4497-8a96-9b8c4633b072 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:07:20.100658 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-4e13677d-d3c2-4497-8a96-9b8c4633b072 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:07:20.101467 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-4e13677d-d3c2-4497-8a96-9b8c4633b072 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:07:20.102116 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-4e13677d-d3c2-4497-8a96-9b8c4633b072 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:07:20.329659 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.policy [None req-4e13677d-d3c2-4497-8a96-9b8c4633b072 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fedc11e2dbd74b919982a0657222cca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f16202549724b878f908d68384ec9c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116157) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:07:20.335011 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.policy [None req-4e13677d-d3c2-4497-8a96-9b8c4633b072 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fedc11e2dbd74b919982a0657222cca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f16202549724b878f908d68384ec9c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116157) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:07:20.336573 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.policy [None req-4e13677d-d3c2-4497-8a96-9b8c4633b072 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fedc11e2dbd74b919982a0657222cca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f16202549724b878f908d68384ec9c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116157) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:07:20.336781 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi [req-b741ffcb-4424-4341-acb8-a2b84c518d80 req-232df5a6-e687-4d82-b1df-0d2aadf4eff3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bbb8462c-9501-4541-b67e-43ec5c5061a7", "tag": "e917aa72-0647-445c-a93a-04c2f02ade06"}]} {{(pid=116156) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 03:07:20.337942 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: INFO nova.api.openstack.requestlog [None req-4e13677d-d3c2-4497-8a96-9b8c4633b072 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] 10.222.0.18 "GET /compute/v2.1/servers/b89094ac-aee1-4bd6-a33d-8c4347cebfc7" status: 200 len: 1807 microversion: 2.20 time: 0.248158 Dec 15 03:07:20.338723 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: [pid: 116157|app: 0|req: 334/666] 10.222.0.18 () {60 vars in 1276 bytes} [Wed Dec 15 03:07:20 2021] GET /compute/v2.1/servers/b89094ac-aee1-4bd6-a33d-8c4347cebfc7 => generated 1807 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 03:07:20.338908 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 15 03:07:20.338908 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: warnings.warn(msg) Dec 15 03:07:20.349232 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [req-b741ffcb-4424-4341-acb8-a2b84c518d80 req-232df5a6-e687-4d82-b1df-0d2aadf4eff3 service nova] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:07:20.349921 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [req-b741ffcb-4424-4341-acb8-a2b84c518d80 req-232df5a6-e687-4d82-b1df-0d2aadf4eff3 service nova] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:07:20.361968 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: INFO nova.api.openstack.compute.server_external_events [req-b741ffcb-4424-4341-acb8-a2b84c518d80 req-232df5a6-e687-4d82-b1df-0d2aadf4eff3 service nova] Creating event network-changed:e917aa72-0647-445c-a93a-04c2f02ade06 for instance bbb8462c-9501-4541-b67e-43ec5c5061a7 on hv-cinder-81803 Dec 15 03:07:20.367391 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: INFO nova.api.openstack.requestlog [req-b741ffcb-4424-4341-acb8-a2b84c518d80 req-232df5a6-e687-4d82-b1df-0d2aadf4eff3 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035495 Dec 15 03:07:20.368074 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: [pid: 116156|app: 0|req: 333/667] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Dec 15 03:07:20 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 03:07:20.791792 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi [None req-9b45df48-37bf-4f97-9b9a-acaaac14326c tempest-AttachVolumeTestJSON-244989543 tempest-AttachVolumeTestJSON-244989543-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 03:07:20.793532 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.compute.api [None req-9b45df48-37bf-4f97-9b9a-acaaac14326c tempest-AttachVolumeTestJSON-244989543 tempest-AttachVolumeTestJSON-244989543-project] [instance: f22dfea6-4599-43e4-93d5-d99f1db3b4fb] Fetching instance by UUID {{(pid=116157) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:07:20.799481 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-9b45df48-37bf-4f97-9b9a-acaaac14326c tempest-AttachVolumeTestJSON-244989543 tempest-AttachVolumeTestJSON-244989543-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:07:20.800185 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-9b45df48-37bf-4f97-9b9a-acaaac14326c tempest-AttachVolumeTestJSON-244989543 tempest-AttachVolumeTestJSON-244989543-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:07:20.801218 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-9b45df48-37bf-4f97-9b9a-acaaac14326c tempest-AttachVolumeTestJSON-244989543 tempest-AttachVolumeTestJSON-244989543-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:07:20.801752 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-9b45df48-37bf-4f97-9b9a-acaaac14326c tempest-AttachVolumeTestJSON-244989543 tempest-AttachVolumeTestJSON-244989543-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:07:20.951811 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: INFO nova.api.openstack.requestlog [None req-9b45df48-37bf-4f97-9b9a-acaaac14326c tempest-AttachVolumeTestJSON-244989543 tempest-AttachVolumeTestJSON-244989543-project] 10.222.0.18 "POST /compute/v2.1/servers/f22dfea6-4599-43e4-93d5-d99f1db3b4fb/action" status: 200 len: 28162 microversion: 2.1 time: 0.163555 Dec 15 03:07:20.953247 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: [pid: 116157|app: 0|req: 335/668] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Dec 15 03:07:20 2021] POST /compute/v2.1/servers/f22dfea6-4599-43e4-93d5-d99f1db3b4fb/action => generated 28162 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 03:07:21.358057 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi [None req-d604434a-5ab5-4aa4-9d07-e77b4648152a tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Calling method '>' {{(pid=116156) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:07:21.358775 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.compute.api [None req-d604434a-5ab5-4aa4-9d07-e77b4648152a tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] [instance: b89094ac-aee1-4bd6-a33d-8c4347cebfc7] Fetching instance by UUID {{(pid=116156) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:07:21.365142 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-d604434a-5ab5-4aa4-9d07-e77b4648152a tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:07:21.365479 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-d604434a-5ab5-4aa4-9d07-e77b4648152a tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:07:21.366303 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-d604434a-5ab5-4aa4-9d07-e77b4648152a tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:07:21.366870 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-d604434a-5ab5-4aa4-9d07-e77b4648152a tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:07:21.508454 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.policy [None req-d604434a-5ab5-4aa4-9d07-e77b4648152a tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fedc11e2dbd74b919982a0657222cca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f16202549724b878f908d68384ec9c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116156) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:07:21.517501 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.policy [None req-d604434a-5ab5-4aa4-9d07-e77b4648152a tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fedc11e2dbd74b919982a0657222cca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f16202549724b878f908d68384ec9c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116156) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:07:21.519109 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.policy [None req-d604434a-5ab5-4aa4-9d07-e77b4648152a tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fedc11e2dbd74b919982a0657222cca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f16202549724b878f908d68384ec9c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116156) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:07:21.520362 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: INFO nova.api.openstack.requestlog [None req-d604434a-5ab5-4aa4-9d07-e77b4648152a tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] 10.222.0.18 "GET /compute/v2.1/servers/b89094ac-aee1-4bd6-a33d-8c4347cebfc7" status: 200 len: 1807 microversion: 2.20 time: 0.167148 Dec 15 03:07:21.520922 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: [pid: 116156|app: 0|req: 334/669] 10.222.0.18 () {60 vars in 1276 bytes} [Wed Dec 15 03:07:21 2021] GET /compute/v2.1/servers/b89094ac-aee1-4bd6-a33d-8c4347cebfc7 => generated 1807 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 03:07:21.963827 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi [None req-c207cbd6-b1ed-4012-bc44-99918a1ad53f tempest-AttachVolumeTestJSON-244989543 tempest-AttachVolumeTestJSON-244989543-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 03:07:21.964822 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.compute.api [None req-c207cbd6-b1ed-4012-bc44-99918a1ad53f tempest-AttachVolumeTestJSON-244989543 tempest-AttachVolumeTestJSON-244989543-project] [instance: f22dfea6-4599-43e4-93d5-d99f1db3b4fb] Fetching instance by UUID {{(pid=116157) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:07:21.972110 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-c207cbd6-b1ed-4012-bc44-99918a1ad53f tempest-AttachVolumeTestJSON-244989543 tempest-AttachVolumeTestJSON-244989543-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:07:21.972566 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-c207cbd6-b1ed-4012-bc44-99918a1ad53f tempest-AttachVolumeTestJSON-244989543 tempest-AttachVolumeTestJSON-244989543-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:07:21.973349 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-c207cbd6-b1ed-4012-bc44-99918a1ad53f tempest-AttachVolumeTestJSON-244989543 tempest-AttachVolumeTestJSON-244989543-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:07:21.973793 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-c207cbd6-b1ed-4012-bc44-99918a1ad53f tempest-AttachVolumeTestJSON-244989543 tempest-AttachVolumeTestJSON-244989543-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:07:22.058941 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: INFO nova.api.openstack.requestlog [None req-c207cbd6-b1ed-4012-bc44-99918a1ad53f tempest-AttachVolumeTestJSON-244989543 tempest-AttachVolumeTestJSON-244989543-project] 10.222.0.18 "POST /compute/v2.1/servers/f22dfea6-4599-43e4-93d5-d99f1db3b4fb/action" status: 200 len: 28162 microversion: 2.1 time: 0.098809 Dec 15 03:07:22.059580 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: [pid: 116157|app: 0|req: 336/670] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Dec 15 03:07:21 2021] POST /compute/v2.1/servers/f22dfea6-4599-43e4-93d5-d99f1db3b4fb/action => generated 28162 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 03:07:22.538372 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi [None req-53553718-dba5-460c-aef4-6cc6e9848d5b tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Calling method '>' {{(pid=116156) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:07:22.539066 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.compute.api [None req-53553718-dba5-460c-aef4-6cc6e9848d5b tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] [instance: b89094ac-aee1-4bd6-a33d-8c4347cebfc7] Fetching instance by UUID {{(pid=116156) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:07:22.545283 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-53553718-dba5-460c-aef4-6cc6e9848d5b tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:07:22.545736 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-53553718-dba5-460c-aef4-6cc6e9848d5b tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:07:22.547175 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-53553718-dba5-460c-aef4-6cc6e9848d5b tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:07:22.547617 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-53553718-dba5-460c-aef4-6cc6e9848d5b tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:07:22.680033 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.policy [None req-53553718-dba5-460c-aef4-6cc6e9848d5b tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fedc11e2dbd74b919982a0657222cca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f16202549724b878f908d68384ec9c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116156) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:07:22.688587 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.policy [None req-53553718-dba5-460c-aef4-6cc6e9848d5b tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fedc11e2dbd74b919982a0657222cca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f16202549724b878f908d68384ec9c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116156) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:07:22.690358 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.policy [None req-53553718-dba5-460c-aef4-6cc6e9848d5b tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fedc11e2dbd74b919982a0657222cca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f16202549724b878f908d68384ec9c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116156) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:07:22.691523 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: INFO nova.api.openstack.requestlog [None req-53553718-dba5-460c-aef4-6cc6e9848d5b tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] 10.222.0.18 "GET /compute/v2.1/servers/b89094ac-aee1-4bd6-a33d-8c4347cebfc7" status: 200 len: 1807 microversion: 2.20 time: 0.156788 Dec 15 03:07:22.692084 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: [pid: 116156|app: 0|req: 335/671] 10.222.0.18 () {60 vars in 1276 bytes} [Wed Dec 15 03:07:22 2021] GET /compute/v2.1/servers/b89094ac-aee1-4bd6-a33d-8c4347cebfc7 => generated 1807 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 03:07:23.070639 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi [None req-3442ccc0-20eb-47c7-822b-3a1357b2cffc tempest-AttachVolumeTestJSON-244989543 tempest-AttachVolumeTestJSON-244989543-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 03:07:23.071637 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.compute.api [None req-3442ccc0-20eb-47c7-822b-3a1357b2cffc tempest-AttachVolumeTestJSON-244989543 tempest-AttachVolumeTestJSON-244989543-project] [instance: f22dfea6-4599-43e4-93d5-d99f1db3b4fb] Fetching instance by UUID {{(pid=116157) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:07:23.078855 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-3442ccc0-20eb-47c7-822b-3a1357b2cffc tempest-AttachVolumeTestJSON-244989543 tempest-AttachVolumeTestJSON-244989543-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:07:23.079284 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-3442ccc0-20eb-47c7-822b-3a1357b2cffc tempest-AttachVolumeTestJSON-244989543 tempest-AttachVolumeTestJSON-244989543-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:07:23.080064 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-3442ccc0-20eb-47c7-822b-3a1357b2cffc tempest-AttachVolumeTestJSON-244989543 tempest-AttachVolumeTestJSON-244989543-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:07:23.080499 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-3442ccc0-20eb-47c7-822b-3a1357b2cffc tempest-AttachVolumeTestJSON-244989543 tempest-AttachVolumeTestJSON-244989543-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:07:23.184271 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: INFO nova.api.openstack.requestlog [None req-3442ccc0-20eb-47c7-822b-3a1357b2cffc tempest-AttachVolumeTestJSON-244989543 tempest-AttachVolumeTestJSON-244989543-project] 10.222.0.18 "POST /compute/v2.1/servers/f22dfea6-4599-43e4-93d5-d99f1db3b4fb/action" status: 200 len: 28287 microversion: 2.1 time: 0.117382 Dec 15 03:07:23.185119 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: [pid: 116157|app: 0|req: 337/672] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Dec 15 03:07:23 2021] POST /compute/v2.1/servers/f22dfea6-4599-43e4-93d5-d99f1db3b4fb/action => generated 28287 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 03:07:23.710033 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi [None req-80f45511-4855-405d-adaf-6076211d8123 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Calling method '>' {{(pid=116156) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:07:23.710722 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.compute.api [None req-80f45511-4855-405d-adaf-6076211d8123 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] [instance: b89094ac-aee1-4bd6-a33d-8c4347cebfc7] Fetching instance by UUID {{(pid=116156) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:07:23.716756 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-80f45511-4855-405d-adaf-6076211d8123 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:07:23.717198 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-80f45511-4855-405d-adaf-6076211d8123 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:07:23.717970 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-80f45511-4855-405d-adaf-6076211d8123 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:07:23.718420 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-80f45511-4855-405d-adaf-6076211d8123 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:07:23.861918 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.policy [None req-80f45511-4855-405d-adaf-6076211d8123 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fedc11e2dbd74b919982a0657222cca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f16202549724b878f908d68384ec9c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116156) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:07:23.876968 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.policy [None req-80f45511-4855-405d-adaf-6076211d8123 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fedc11e2dbd74b919982a0657222cca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f16202549724b878f908d68384ec9c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116156) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:07:23.878609 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.policy [None req-80f45511-4855-405d-adaf-6076211d8123 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fedc11e2dbd74b919982a0657222cca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f16202549724b878f908d68384ec9c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116156) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:07:23.880103 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: INFO nova.api.openstack.requestlog [None req-80f45511-4855-405d-adaf-6076211d8123 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] 10.222.0.18 "GET /compute/v2.1/servers/b89094ac-aee1-4bd6-a33d-8c4347cebfc7" status: 200 len: 1807 microversion: 2.20 time: 0.173810 Dec 15 03:07:23.892102 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: [pid: 116156|app: 0|req: 336/673] 10.222.0.18 () {60 vars in 1276 bytes} [Wed Dec 15 03:07:23 2021] GET /compute/v2.1/servers/b89094ac-aee1-4bd6-a33d-8c4347cebfc7 => generated 1807 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 03:07:24.195613 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi [None req-18e5982c-a31c-4f9c-9c95-67b38b426572 tempest-AttachVolumeTestJSON-244989543 tempest-AttachVolumeTestJSON-244989543-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 03:07:24.196596 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.compute.api [None req-18e5982c-a31c-4f9c-9c95-67b38b426572 tempest-AttachVolumeTestJSON-244989543 tempest-AttachVolumeTestJSON-244989543-project] [instance: f22dfea6-4599-43e4-93d5-d99f1db3b4fb] Fetching instance by UUID {{(pid=116157) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:07:24.203692 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-18e5982c-a31c-4f9c-9c95-67b38b426572 tempest-AttachVolumeTestJSON-244989543 tempest-AttachVolumeTestJSON-244989543-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:07:24.204140 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-18e5982c-a31c-4f9c-9c95-67b38b426572 tempest-AttachVolumeTestJSON-244989543 tempest-AttachVolumeTestJSON-244989543-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:07:24.204935 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-18e5982c-a31c-4f9c-9c95-67b38b426572 tempest-AttachVolumeTestJSON-244989543 tempest-AttachVolumeTestJSON-244989543-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:07:24.205373 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-18e5982c-a31c-4f9c-9c95-67b38b426572 tempest-AttachVolumeTestJSON-244989543 tempest-AttachVolumeTestJSON-244989543-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:07:24.305837 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: INFO nova.api.openstack.requestlog [None req-18e5982c-a31c-4f9c-9c95-67b38b426572 tempest-AttachVolumeTestJSON-244989543 tempest-AttachVolumeTestJSON-244989543-project] 10.222.0.18 "POST /compute/v2.1/servers/f22dfea6-4599-43e4-93d5-d99f1db3b4fb/action" status: 200 len: 28453 microversion: 2.1 time: 0.113966 Dec 15 03:07:24.306756 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: [pid: 116157|app: 0|req: 338/674] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Dec 15 03:07:24 2021] POST /compute/v2.1/servers/f22dfea6-4599-43e4-93d5-d99f1db3b4fb/action => generated 28453 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 03:07:24.898615 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi [None req-ce21750c-8809-4af4-8ad6-5f2718dd760d tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Calling method '>' {{(pid=116156) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:07:24.899222 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.compute.api [None req-ce21750c-8809-4af4-8ad6-5f2718dd760d tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] [instance: b89094ac-aee1-4bd6-a33d-8c4347cebfc7] Fetching instance by UUID {{(pid=116156) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:07:24.905276 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-ce21750c-8809-4af4-8ad6-5f2718dd760d tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:07:24.905761 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-ce21750c-8809-4af4-8ad6-5f2718dd760d tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:07:24.906580 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-ce21750c-8809-4af4-8ad6-5f2718dd760d tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:07:24.907016 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-ce21750c-8809-4af4-8ad6-5f2718dd760d tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:07:25.100470 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.policy [None req-ce21750c-8809-4af4-8ad6-5f2718dd760d tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fedc11e2dbd74b919982a0657222cca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f16202549724b878f908d68384ec9c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116156) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:07:25.108725 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.policy [None req-ce21750c-8809-4af4-8ad6-5f2718dd760d tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fedc11e2dbd74b919982a0657222cca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f16202549724b878f908d68384ec9c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116156) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:07:25.110360 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.policy [None req-ce21750c-8809-4af4-8ad6-5f2718dd760d tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fedc11e2dbd74b919982a0657222cca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f16202549724b878f908d68384ec9c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116156) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:07:25.111515 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: INFO nova.api.openstack.requestlog [None req-ce21750c-8809-4af4-8ad6-5f2718dd760d tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] 10.222.0.18 "GET /compute/v2.1/servers/b89094ac-aee1-4bd6-a33d-8c4347cebfc7" status: 200 len: 1807 microversion: 2.20 time: 0.216499 Dec 15 03:07:25.112066 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: [pid: 116156|app: 0|req: 337/675] 10.222.0.18 () {60 vars in 1276 bytes} [Wed Dec 15 03:07:24 2021] GET /compute/v2.1/servers/b89094ac-aee1-4bd6-a33d-8c4347cebfc7 => generated 1807 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 03:07:25.318902 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi [None req-88cf5053-f383-4bc1-84d0-805834356a36 tempest-AttachVolumeTestJSON-244989543 tempest-AttachVolumeTestJSON-244989543-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 03:07:25.319886 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.compute.api [None req-88cf5053-f383-4bc1-84d0-805834356a36 tempest-AttachVolumeTestJSON-244989543 tempest-AttachVolumeTestJSON-244989543-project] [instance: f22dfea6-4599-43e4-93d5-d99f1db3b4fb] Fetching instance by UUID {{(pid=116157) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:07:25.326955 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-88cf5053-f383-4bc1-84d0-805834356a36 tempest-AttachVolumeTestJSON-244989543 tempest-AttachVolumeTestJSON-244989543-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:07:25.327626 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-88cf5053-f383-4bc1-84d0-805834356a36 tempest-AttachVolumeTestJSON-244989543 tempest-AttachVolumeTestJSON-244989543-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:07:25.328578 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-88cf5053-f383-4bc1-84d0-805834356a36 tempest-AttachVolumeTestJSON-244989543 tempest-AttachVolumeTestJSON-244989543-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:07:25.329006 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-88cf5053-f383-4bc1-84d0-805834356a36 tempest-AttachVolumeTestJSON-244989543 tempest-AttachVolumeTestJSON-244989543-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:07:25.421965 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: INFO nova.api.openstack.requestlog [None req-88cf5053-f383-4bc1-84d0-805834356a36 tempest-AttachVolumeTestJSON-244989543 tempest-AttachVolumeTestJSON-244989543-project] 10.222.0.18 "POST /compute/v2.1/servers/f22dfea6-4599-43e4-93d5-d99f1db3b4fb/action" status: 200 len: 28621 microversion: 2.1 time: 0.106223 Dec 15 03:07:25.422965 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: [pid: 116157|app: 0|req: 339/676] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Dec 15 03:07:25 2021] POST /compute/v2.1/servers/f22dfea6-4599-43e4-93d5-d99f1db3b4fb/action => generated 28621 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 03:07:25.912274 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi [req-a769051f-859c-4406-8911-b98ae417f1c0 req-b612a6fc-5cb3-447b-b255-41914eb06dd5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b89094ac-aee1-4bd6-a33d-8c4347cebfc7", "name": "network-vif-plugged", "status": "completed", "tag": "455e429c-96fb-4858-b8fe-cf282ae96b72"}]} {{(pid=116156) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 03:07:25.913917 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 15 03:07:25.913917 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: warnings.warn(msg) Dec 15 03:07:25.923387 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [req-a769051f-859c-4406-8911-b98ae417f1c0 req-b612a6fc-5cb3-447b-b255-41914eb06dd5 service nova] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:07:25.924075 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [req-a769051f-859c-4406-8911-b98ae417f1c0 req-b612a6fc-5cb3-447b-b255-41914eb06dd5 service nova] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:07:25.936329 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: INFO nova.api.openstack.compute.server_external_events [req-a769051f-859c-4406-8911-b98ae417f1c0 req-b612a6fc-5cb3-447b-b255-41914eb06dd5 service nova] Creating event network-vif-plugged:455e429c-96fb-4858-b8fe-cf282ae96b72 for instance b89094ac-aee1-4bd6-a33d-8c4347cebfc7 on hv-cinder-81803 Dec 15 03:07:25.941327 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: INFO nova.api.openstack.requestlog [req-a769051f-859c-4406-8911-b98ae417f1c0 req-b612a6fc-5cb3-447b-b255-41914eb06dd5 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032596 Dec 15 03:07:25.942224 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: [pid: 116156|app: 0|req: 338/677] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Dec 15 03:07:25 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 15 03:07:26.130599 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi [None req-60551a4d-a073-43cf-80c6-c68be0a9e1e0 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Calling method '>' {{(pid=116157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:07:26.131306 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.compute.api [None req-60551a4d-a073-43cf-80c6-c68be0a9e1e0 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] [instance: b89094ac-aee1-4bd6-a33d-8c4347cebfc7] Fetching instance by UUID {{(pid=116157) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:07:26.137419 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-60551a4d-a073-43cf-80c6-c68be0a9e1e0 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:07:26.137871 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-60551a4d-a073-43cf-80c6-c68be0a9e1e0 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:07:26.138682 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-60551a4d-a073-43cf-80c6-c68be0a9e1e0 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:07:26.139121 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-60551a4d-a073-43cf-80c6-c68be0a9e1e0 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:07:26.276523 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.policy [None req-60551a4d-a073-43cf-80c6-c68be0a9e1e0 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fedc11e2dbd74b919982a0657222cca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f16202549724b878f908d68384ec9c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116157) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:07:26.287314 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.policy [None req-60551a4d-a073-43cf-80c6-c68be0a9e1e0 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fedc11e2dbd74b919982a0657222cca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f16202549724b878f908d68384ec9c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116157) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:07:26.288922 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.policy [None req-60551a4d-a073-43cf-80c6-c68be0a9e1e0 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fedc11e2dbd74b919982a0657222cca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f16202549724b878f908d68384ec9c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116157) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:07:26.293414 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: INFO nova.api.openstack.requestlog [None req-60551a4d-a073-43cf-80c6-c68be0a9e1e0 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] 10.222.0.18 "GET /compute/v2.1/servers/b89094ac-aee1-4bd6-a33d-8c4347cebfc7" status: 200 len: 1807 microversion: 2.20 time: 0.163427 Dec 15 03:07:26.293414 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: [pid: 116157|app: 0|req: 340/678] 10.222.0.18 () {60 vars in 1276 bytes} [Wed Dec 15 03:07:26 2021] GET /compute/v2.1/servers/b89094ac-aee1-4bd6-a33d-8c4347cebfc7 => generated 1807 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 03:07:26.434966 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi [None req-314c9a69-182e-43e8-a8d3-1eabadbe1037 tempest-AttachVolumeTestJSON-244989543 tempest-AttachVolumeTestJSON-244989543-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116156) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 03:07:26.435960 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.compute.api [None req-314c9a69-182e-43e8-a8d3-1eabadbe1037 tempest-AttachVolumeTestJSON-244989543 tempest-AttachVolumeTestJSON-244989543-project] [instance: f22dfea6-4599-43e4-93d5-d99f1db3b4fb] Fetching instance by UUID {{(pid=116156) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:07:26.442747 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-314c9a69-182e-43e8-a8d3-1eabadbe1037 tempest-AttachVolumeTestJSON-244989543 tempest-AttachVolumeTestJSON-244989543-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:07:26.443249 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-314c9a69-182e-43e8-a8d3-1eabadbe1037 tempest-AttachVolumeTestJSON-244989543 tempest-AttachVolumeTestJSON-244989543-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:07:26.444083 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-314c9a69-182e-43e8-a8d3-1eabadbe1037 tempest-AttachVolumeTestJSON-244989543 tempest-AttachVolumeTestJSON-244989543-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:07:26.444657 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-314c9a69-182e-43e8-a8d3-1eabadbe1037 tempest-AttachVolumeTestJSON-244989543 tempest-AttachVolumeTestJSON-244989543-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:07:26.546857 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: INFO nova.api.openstack.requestlog [None req-314c9a69-182e-43e8-a8d3-1eabadbe1037 tempest-AttachVolumeTestJSON-244989543 tempest-AttachVolumeTestJSON-244989543-project] 10.222.0.18 "POST /compute/v2.1/servers/f22dfea6-4599-43e4-93d5-d99f1db3b4fb/action" status: 200 len: 28621 microversion: 2.1 time: 0.115394 Dec 15 03:07:26.547647 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: [pid: 116156|app: 0|req: 339/679] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Dec 15 03:07:26 2021] POST /compute/v2.1/servers/f22dfea6-4599-43e4-93d5-d99f1db3b4fb/action => generated 28621 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 03:07:27.308964 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi [None req-393a48b6-d7dc-45c3-85b4-9c268722e399 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Calling method '>' {{(pid=116157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:07:27.309611 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.compute.api [None req-393a48b6-d7dc-45c3-85b4-9c268722e399 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] [instance: b89094ac-aee1-4bd6-a33d-8c4347cebfc7] Fetching instance by UUID {{(pid=116157) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:07:27.316350 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-393a48b6-d7dc-45c3-85b4-9c268722e399 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:07:27.316805 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-393a48b6-d7dc-45c3-85b4-9c268722e399 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:07:27.317616 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-393a48b6-d7dc-45c3-85b4-9c268722e399 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:07:27.318034 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-393a48b6-d7dc-45c3-85b4-9c268722e399 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:07:27.482891 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.policy [None req-393a48b6-d7dc-45c3-85b4-9c268722e399 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fedc11e2dbd74b919982a0657222cca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f16202549724b878f908d68384ec9c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116157) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:07:27.491230 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.policy [None req-393a48b6-d7dc-45c3-85b4-9c268722e399 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fedc11e2dbd74b919982a0657222cca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f16202549724b878f908d68384ec9c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116157) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:07:27.492735 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.policy [None req-393a48b6-d7dc-45c3-85b4-9c268722e399 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fedc11e2dbd74b919982a0657222cca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f16202549724b878f908d68384ec9c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116157) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:07:27.494213 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: INFO nova.api.openstack.requestlog [None req-393a48b6-d7dc-45c3-85b4-9c268722e399 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] 10.222.0.18 "GET /compute/v2.1/servers/b89094ac-aee1-4bd6-a33d-8c4347cebfc7" status: 200 len: 1807 microversion: 2.20 time: 0.189220 Dec 15 03:07:27.494784 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: [pid: 116157|app: 0|req: 341/680] 10.222.0.18 () {60 vars in 1276 bytes} [Wed Dec 15 03:07:27 2021] GET /compute/v2.1/servers/b89094ac-aee1-4bd6-a33d-8c4347cebfc7 => generated 1807 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 03:07:27.559352 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi [None req-a81b01a3-af65-4410-98aa-ba50b5ad433d tempest-AttachVolumeTestJSON-244989543 tempest-AttachVolumeTestJSON-244989543-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116156) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 03:07:27.560351 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.compute.api [None req-a81b01a3-af65-4410-98aa-ba50b5ad433d tempest-AttachVolumeTestJSON-244989543 tempest-AttachVolumeTestJSON-244989543-project] [instance: f22dfea6-4599-43e4-93d5-d99f1db3b4fb] Fetching instance by UUID {{(pid=116156) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:07:27.567194 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-a81b01a3-af65-4410-98aa-ba50b5ad433d tempest-AttachVolumeTestJSON-244989543 tempest-AttachVolumeTestJSON-244989543-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:07:27.567652 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-a81b01a3-af65-4410-98aa-ba50b5ad433d tempest-AttachVolumeTestJSON-244989543 tempest-AttachVolumeTestJSON-244989543-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:07:27.568439 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-a81b01a3-af65-4410-98aa-ba50b5ad433d tempest-AttachVolumeTestJSON-244989543 tempest-AttachVolumeTestJSON-244989543-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:07:27.568885 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-a81b01a3-af65-4410-98aa-ba50b5ad433d tempest-AttachVolumeTestJSON-244989543 tempest-AttachVolumeTestJSON-244989543-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:07:27.750473 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: INFO nova.api.openstack.requestlog [None req-a81b01a3-af65-4410-98aa-ba50b5ad433d tempest-AttachVolumeTestJSON-244989543 tempest-AttachVolumeTestJSON-244989543-project] 10.222.0.18 "POST /compute/v2.1/servers/f22dfea6-4599-43e4-93d5-d99f1db3b4fb/action" status: 200 len: 28621 microversion: 2.1 time: 0.194853 Dec 15 03:07:27.751149 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: [pid: 116156|app: 0|req: 340/681] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Dec 15 03:07:27 2021] POST /compute/v2.1/servers/f22dfea6-4599-43e4-93d5-d99f1db3b4fb/action => generated 28621 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Dec 15 03:07:28.512784 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi [None req-ca620dc7-a961-4084-b651-43486cde3ccc tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Calling method '>' {{(pid=116157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:07:28.513398 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.compute.api [None req-ca620dc7-a961-4084-b651-43486cde3ccc tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] [instance: b89094ac-aee1-4bd6-a33d-8c4347cebfc7] Fetching instance by UUID {{(pid=116157) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:07:28.520134 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-ca620dc7-a961-4084-b651-43486cde3ccc tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:07:28.520641 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-ca620dc7-a961-4084-b651-43486cde3ccc tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:07:28.521769 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-ca620dc7-a961-4084-b651-43486cde3ccc tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:07:28.522266 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-ca620dc7-a961-4084-b651-43486cde3ccc tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:07:28.657705 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.policy [None req-ca620dc7-a961-4084-b651-43486cde3ccc tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fedc11e2dbd74b919982a0657222cca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f16202549724b878f908d68384ec9c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116157) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:07:28.665872 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.policy [None req-ca620dc7-a961-4084-b651-43486cde3ccc tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fedc11e2dbd74b919982a0657222cca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f16202549724b878f908d68384ec9c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116157) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:07:28.667420 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.policy [None req-ca620dc7-a961-4084-b651-43486cde3ccc tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fedc11e2dbd74b919982a0657222cca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f16202549724b878f908d68384ec9c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116157) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:07:28.668592 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: INFO nova.api.openstack.requestlog [None req-ca620dc7-a961-4084-b651-43486cde3ccc tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] 10.222.0.18 "GET /compute/v2.1/servers/b89094ac-aee1-4bd6-a33d-8c4347cebfc7" status: 200 len: 1807 microversion: 2.20 time: 0.159570 Dec 15 03:07:28.669151 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: [pid: 116157|app: 0|req: 342/682] 10.222.0.18 () {60 vars in 1276 bytes} [Wed Dec 15 03:07:28 2021] GET /compute/v2.1/servers/b89094ac-aee1-4bd6-a33d-8c4347cebfc7 => generated 1807 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 03:07:28.761686 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi [None req-3b0039c5-d17f-4aa4-8446-c7ec93f7934a tempest-AttachVolumeTestJSON-244989543 tempest-AttachVolumeTestJSON-244989543-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116156) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 03:07:28.762729 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.compute.api [None req-3b0039c5-d17f-4aa4-8446-c7ec93f7934a tempest-AttachVolumeTestJSON-244989543 tempest-AttachVolumeTestJSON-244989543-project] [instance: f22dfea6-4599-43e4-93d5-d99f1db3b4fb] Fetching instance by UUID {{(pid=116156) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:07:28.770149 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-3b0039c5-d17f-4aa4-8446-c7ec93f7934a tempest-AttachVolumeTestJSON-244989543 tempest-AttachVolumeTestJSON-244989543-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:07:28.770601 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-3b0039c5-d17f-4aa4-8446-c7ec93f7934a tempest-AttachVolumeTestJSON-244989543 tempest-AttachVolumeTestJSON-244989543-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:07:28.771374 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-3b0039c5-d17f-4aa4-8446-c7ec93f7934a tempest-AttachVolumeTestJSON-244989543 tempest-AttachVolumeTestJSON-244989543-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:07:28.771802 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-3b0039c5-d17f-4aa4-8446-c7ec93f7934a tempest-AttachVolumeTestJSON-244989543 tempest-AttachVolumeTestJSON-244989543-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:07:28.860960 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: INFO nova.api.openstack.requestlog [None req-3b0039c5-d17f-4aa4-8446-c7ec93f7934a tempest-AttachVolumeTestJSON-244989543 tempest-AttachVolumeTestJSON-244989543-project] 10.222.0.18 "POST /compute/v2.1/servers/f22dfea6-4599-43e4-93d5-d99f1db3b4fb/action" status: 200 len: 28621 microversion: 2.1 time: 0.103084 Dec 15 03:07:28.861594 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: [pid: 116156|app: 0|req: 341/683] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Dec 15 03:07:28 2021] POST /compute/v2.1/servers/f22dfea6-4599-43e4-93d5-d99f1db3b4fb/action => generated 28621 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 03:07:29.686774 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi [None req-28a1e79f-95f2-4481-8bad-15a534c1a791 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Calling method '>' {{(pid=116157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:07:29.687388 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.compute.api [None req-28a1e79f-95f2-4481-8bad-15a534c1a791 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] [instance: b89094ac-aee1-4bd6-a33d-8c4347cebfc7] Fetching instance by UUID {{(pid=116157) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:07:29.693697 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-28a1e79f-95f2-4481-8bad-15a534c1a791 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:07:29.694186 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-28a1e79f-95f2-4481-8bad-15a534c1a791 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:07:29.696271 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-28a1e79f-95f2-4481-8bad-15a534c1a791 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:07:29.696738 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-28a1e79f-95f2-4481-8bad-15a534c1a791 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:07:29.831893 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.policy [None req-28a1e79f-95f2-4481-8bad-15a534c1a791 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fedc11e2dbd74b919982a0657222cca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f16202549724b878f908d68384ec9c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116157) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:07:29.840252 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.policy [None req-28a1e79f-95f2-4481-8bad-15a534c1a791 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fedc11e2dbd74b919982a0657222cca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f16202549724b878f908d68384ec9c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116157) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:07:29.842431 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.policy [None req-28a1e79f-95f2-4481-8bad-15a534c1a791 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fedc11e2dbd74b919982a0657222cca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f16202549724b878f908d68384ec9c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116157) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:07:29.844288 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: INFO nova.api.openstack.requestlog [None req-28a1e79f-95f2-4481-8bad-15a534c1a791 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] 10.222.0.18 "GET /compute/v2.1/servers/b89094ac-aee1-4bd6-a33d-8c4347cebfc7" status: 200 len: 1794 microversion: 2.20 time: 0.161185 Dec 15 03:07:29.845021 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: [pid: 116157|app: 0|req: 343/684] 10.222.0.18 () {60 vars in 1276 bytes} [Wed Dec 15 03:07:29 2021] GET /compute/v2.1/servers/b89094ac-aee1-4bd6-a33d-8c4347cebfc7 => generated 1794 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 03:07:29.873198 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi [None req-a80df44c-e5bd-4bf5-aab8-56bd17a2e170 tempest-AttachVolumeTestJSON-244989543 tempest-AttachVolumeTestJSON-244989543-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116156) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 03:07:29.874216 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.compute.api [None req-a80df44c-e5bd-4bf5-aab8-56bd17a2e170 tempest-AttachVolumeTestJSON-244989543 tempest-AttachVolumeTestJSON-244989543-project] [instance: f22dfea6-4599-43e4-93d5-d99f1db3b4fb] Fetching instance by UUID {{(pid=116156) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:07:29.880986 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-a80df44c-e5bd-4bf5-aab8-56bd17a2e170 tempest-AttachVolumeTestJSON-244989543 tempest-AttachVolumeTestJSON-244989543-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:07:29.881436 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-a80df44c-e5bd-4bf5-aab8-56bd17a2e170 tempest-AttachVolumeTestJSON-244989543 tempest-AttachVolumeTestJSON-244989543-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:07:29.882236 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-a80df44c-e5bd-4bf5-aab8-56bd17a2e170 tempest-AttachVolumeTestJSON-244989543 tempest-AttachVolumeTestJSON-244989543-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:07:29.882666 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-a80df44c-e5bd-4bf5-aab8-56bd17a2e170 tempest-AttachVolumeTestJSON-244989543 tempest-AttachVolumeTestJSON-244989543-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:07:29.980937 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: INFO nova.api.openstack.requestlog [None req-a80df44c-e5bd-4bf5-aab8-56bd17a2e170 tempest-AttachVolumeTestJSON-244989543 tempest-AttachVolumeTestJSON-244989543-project] 10.222.0.18 "POST /compute/v2.1/servers/f22dfea6-4599-43e4-93d5-d99f1db3b4fb/action" status: 200 len: 29864 microversion: 2.1 time: 0.111841 Dec 15 03:07:29.982550 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: [pid: 116156|app: 0|req: 342/685] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Dec 15 03:07:29 2021] POST /compute/v2.1/servers/f22dfea6-4599-43e4-93d5-d99f1db3b4fb/action => generated 29864 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 03:07:30.992327 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi [None req-844cc119-21c6-4d63-8d9e-bd2437882b14 tempest-AttachVolumeTestJSON-244989543 tempest-AttachVolumeTestJSON-244989543-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 03:07:30.993264 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.compute.api [None req-844cc119-21c6-4d63-8d9e-bd2437882b14 tempest-AttachVolumeTestJSON-244989543 tempest-AttachVolumeTestJSON-244989543-project] [instance: f22dfea6-4599-43e4-93d5-d99f1db3b4fb] Fetching instance by UUID {{(pid=116157) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:07:30.999919 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-844cc119-21c6-4d63-8d9e-bd2437882b14 tempest-AttachVolumeTestJSON-244989543 tempest-AttachVolumeTestJSON-244989543-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:07:31.000374 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-844cc119-21c6-4d63-8d9e-bd2437882b14 tempest-AttachVolumeTestJSON-244989543 tempest-AttachVolumeTestJSON-244989543-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:07:31.001188 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-844cc119-21c6-4d63-8d9e-bd2437882b14 tempest-AttachVolumeTestJSON-244989543 tempest-AttachVolumeTestJSON-244989543-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:07:31.001627 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-844cc119-21c6-4d63-8d9e-bd2437882b14 tempest-AttachVolumeTestJSON-244989543 tempest-AttachVolumeTestJSON-244989543-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:07:31.106930 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: INFO nova.api.openstack.requestlog [None req-844cc119-21c6-4d63-8d9e-bd2437882b14 tempest-AttachVolumeTestJSON-244989543 tempest-AttachVolumeTestJSON-244989543-project] 10.222.0.18 "POST /compute/v2.1/servers/f22dfea6-4599-43e4-93d5-d99f1db3b4fb/action" status: 200 len: 31723 microversion: 2.1 time: 0.118011 Dec 15 03:07:31.111569 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: [pid: 116157|app: 0|req: 344/686] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Dec 15 03:07:30 2021] POST /compute/v2.1/servers/f22dfea6-4599-43e4-93d5-d99f1db3b4fb/action => generated 31723 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 03:07:32.120250 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi [None req-23d7da26-2d38-4801-b1ed-2376ab42ce41 tempest-AttachVolumeTestJSON-244989543 tempest-AttachVolumeTestJSON-244989543-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116156) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 03:07:32.121366 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.compute.api [None req-23d7da26-2d38-4801-b1ed-2376ab42ce41 tempest-AttachVolumeTestJSON-244989543 tempest-AttachVolumeTestJSON-244989543-project] [instance: f22dfea6-4599-43e4-93d5-d99f1db3b4fb] Fetching instance by UUID {{(pid=116156) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:07:32.129219 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-23d7da26-2d38-4801-b1ed-2376ab42ce41 tempest-AttachVolumeTestJSON-244989543 tempest-AttachVolumeTestJSON-244989543-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:07:32.129778 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-23d7da26-2d38-4801-b1ed-2376ab42ce41 tempest-AttachVolumeTestJSON-244989543 tempest-AttachVolumeTestJSON-244989543-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:07:32.130675 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-23d7da26-2d38-4801-b1ed-2376ab42ce41 tempest-AttachVolumeTestJSON-244989543 tempest-AttachVolumeTestJSON-244989543-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:07:32.131200 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-23d7da26-2d38-4801-b1ed-2376ab42ce41 tempest-AttachVolumeTestJSON-244989543 tempest-AttachVolumeTestJSON-244989543-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:07:32.237104 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: INFO nova.api.openstack.requestlog [None req-23d7da26-2d38-4801-b1ed-2376ab42ce41 tempest-AttachVolumeTestJSON-244989543 tempest-AttachVolumeTestJSON-244989543-project] 10.222.0.18 "POST /compute/v2.1/servers/f22dfea6-4599-43e4-93d5-d99f1db3b4fb/action" status: 200 len: 33043 microversion: 2.1 time: 0.121165 Dec 15 03:07:32.238569 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: [pid: 116156|app: 0|req: 343/687] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Dec 15 03:07:32 2021] POST /compute/v2.1/servers/f22dfea6-4599-43e4-93d5-d99f1db3b4fb/action => generated 33043 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 03:07:33.250117 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi [None req-f6ecb936-42b5-409a-9418-55cd798d9a39 tempest-AttachVolumeTestJSON-244989543 tempest-AttachVolumeTestJSON-244989543-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 03:07:33.251101 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.compute.api [None req-f6ecb936-42b5-409a-9418-55cd798d9a39 tempest-AttachVolumeTestJSON-244989543 tempest-AttachVolumeTestJSON-244989543-project] [instance: f22dfea6-4599-43e4-93d5-d99f1db3b4fb] Fetching instance by UUID {{(pid=116157) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:07:33.257848 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-f6ecb936-42b5-409a-9418-55cd798d9a39 tempest-AttachVolumeTestJSON-244989543 tempest-AttachVolumeTestJSON-244989543-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:07:33.258323 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-f6ecb936-42b5-409a-9418-55cd798d9a39 tempest-AttachVolumeTestJSON-244989543 tempest-AttachVolumeTestJSON-244989543-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:07:33.259095 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-f6ecb936-42b5-409a-9418-55cd798d9a39 tempest-AttachVolumeTestJSON-244989543 tempest-AttachVolumeTestJSON-244989543-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:07:33.259524 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-f6ecb936-42b5-409a-9418-55cd798d9a39 tempest-AttachVolumeTestJSON-244989543 tempest-AttachVolumeTestJSON-244989543-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:07:33.375853 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: INFO nova.api.openstack.requestlog [None req-f6ecb936-42b5-409a-9418-55cd798d9a39 tempest-AttachVolumeTestJSON-244989543 tempest-AttachVolumeTestJSON-244989543-project] 10.222.0.18 "POST /compute/v2.1/servers/f22dfea6-4599-43e4-93d5-d99f1db3b4fb/action" status: 200 len: 33766 microversion: 2.1 time: 0.130115 Dec 15 03:07:33.376432 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: [pid: 116157|app: 0|req: 345/688] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Dec 15 03:07:33 2021] POST /compute/v2.1/servers/f22dfea6-4599-43e4-93d5-d99f1db3b4fb/action => generated 33766 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 03:07:33.569897 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi [None req-0c8d1737-cf2b-47e5-b404-107f36a1e973 tempest-VolumesSnapshotTestJSON-925980516 tempest-VolumesSnapshotTestJSON-925980516-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-2112661915", "imageRef": "5195b034-9fa4-468b-a94d-ef3ee79ce449", "flavorRef": "452", "networks": [{"uuid": "66454919-290c-416c-960a-e924b340094c"}]}} {{(pid=116156) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 03:07:33.620093 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.network.neutron [None req-0c8d1737-cf2b-47e5-b404-107f36a1e973 tempest-VolumesSnapshotTestJSON-925980516 tempest-VolumesSnapshotTestJSON-925980516-project] validate_networks() for [('66454919-290c-416c-960a-e924b340094c', None, None, None, None, None)] {{(pid=116156) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Dec 15 03:07:33.948270 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.virt.hardware [None req-0c8d1737-cf2b-47e5-b404-107f36a1e973 tempest-VolumesSnapshotTestJSON-925980516 tempest-VolumesSnapshotTestJSON-925980516-project] Flavor limits 0:0:0 {{(pid=116156) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Dec 15 03:07:33.948686 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.virt.hardware [None req-0c8d1737-cf2b-47e5-b404-107f36a1e973 tempest-VolumesSnapshotTestJSON-925980516 tempest-VolumesSnapshotTestJSON-925980516-project] Image limits 0:0:0 {{(pid=116156) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Dec 15 03:07:33.949153 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.virt.hardware [None req-0c8d1737-cf2b-47e5-b404-107f36a1e973 tempest-VolumesSnapshotTestJSON-925980516 tempest-VolumesSnapshotTestJSON-925980516-project] Flavor pref 0:0:0 {{(pid=116156) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Dec 15 03:07:33.949556 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.virt.hardware [None req-0c8d1737-cf2b-47e5-b404-107f36a1e973 tempest-VolumesSnapshotTestJSON-925980516 tempest-VolumesSnapshotTestJSON-925980516-project] Image pref 0:0:0 {{(pid=116156) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Dec 15 03:07:33.949959 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.virt.hardware [None req-0c8d1737-cf2b-47e5-b404-107f36a1e973 tempest-VolumesSnapshotTestJSON-925980516 tempest-VolumesSnapshotTestJSON-925980516-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116156) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Dec 15 03:07:33.958367 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-0c8d1737-cf2b-47e5-b404-107f36a1e973 tempest-VolumesSnapshotTestJSON-925980516 tempest-VolumesSnapshotTestJSON-925980516-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:07:33.958811 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-0c8d1737-cf2b-47e5-b404-107f36a1e973 tempest-VolumesSnapshotTestJSON-925980516 tempest-VolumesSnapshotTestJSON-925980516-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:07:33.959616 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-0c8d1737-cf2b-47e5-b404-107f36a1e973 tempest-VolumesSnapshotTestJSON-925980516 tempest-VolumesSnapshotTestJSON-925980516-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:07:33.960049 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-0c8d1737-cf2b-47e5-b404-107f36a1e973 tempest-VolumesSnapshotTestJSON-925980516 tempest-VolumesSnapshotTestJSON-925980516-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:07:33.976546 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.quota [None req-0c8d1737-cf2b-47e5-b404-107f36a1e973 tempest-VolumesSnapshotTestJSON-925980516 tempest-VolumesSnapshotTestJSON-925980516-project] Getting quotas for project 9ca6934bc24846ad82474c4ef7ba6323. Resources: {'cores', 'instances', 'ram'} {{(pid=116156) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 15 03:07:33.980293 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.quota [None req-0c8d1737-cf2b-47e5-b404-107f36a1e973 tempest-VolumesSnapshotTestJSON-925980516 tempest-VolumesSnapshotTestJSON-925980516-project] Getting quotas for user e4ffcca165af40abbd93569e7f01acbe and project 9ca6934bc24846ad82474c4ef7ba6323. Resources: {'cores', 'instances', 'ram'} {{(pid=116156) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 15 03:07:33.991237 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.compute.api [None req-0c8d1737-cf2b-47e5-b404-107f36a1e973 tempest-VolumesSnapshotTestJSON-925980516 tempest-VolumesSnapshotTestJSON-925980516-project] Going to run 1 instances... {{(pid=116156) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Dec 15 03:07:33.993806 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.compute.api [None req-0c8d1737-cf2b-47e5-b404-107f36a1e973 tempest-VolumesSnapshotTestJSON-925980516 tempest-VolumesSnapshotTestJSON-925980516-project] [instance: a0097d88-6613-416a-9f4d-1bb285e53291] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='5195b034-9fa4-468b-a94d-ef3ee79ce449',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=116156) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Dec 15 03:07:34.038905 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: INFO nova.api.openstack.requestlog [None req-0c8d1737-cf2b-47e5-b404-107f36a1e973 tempest-VolumesSnapshotTestJSON-925980516 tempest-VolumesSnapshotTestJSON-925980516-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.472951 Dec 15 03:07:34.039545 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: [pid: 116156|app: 0|req: 344/689] 10.222.0.18 () {60 vars in 1146 bytes} [Wed Dec 15 03:07:33 2021] POST /compute/v2.1/servers => generated 380 bytes in 474 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Dec 15 03:07:34.050288 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi [None req-f5cb1762-3243-492e-8748-c1719a38fbd1 tempest-VolumesSnapshotTestJSON-925980516 tempest-VolumesSnapshotTestJSON-925980516-project] Calling method '>' {{(pid=116157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:07:34.051110 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.compute.api [None req-f5cb1762-3243-492e-8748-c1719a38fbd1 tempest-VolumesSnapshotTestJSON-925980516 tempest-VolumesSnapshotTestJSON-925980516-project] [instance: a0097d88-6613-416a-9f4d-1bb285e53291] Fetching instance by UUID {{(pid=116157) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:07:34.104058 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.policy [None req-f5cb1762-3243-492e-8748-c1719a38fbd1 tempest-VolumesSnapshotTestJSON-925980516 tempest-VolumesSnapshotTestJSON-925980516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4ffcca165af40abbd93569e7f01acbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ca6934bc24846ad82474c4ef7ba6323', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116157) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:07:34.111175 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: INFO nova.api.openstack.requestlog [None req-f5cb1762-3243-492e-8748-c1719a38fbd1 tempest-VolumesSnapshotTestJSON-925980516 tempest-VolumesSnapshotTestJSON-925980516-project] 10.222.0.18 "GET /compute/v2.1/servers/a0097d88-6613-416a-9f4d-1bb285e53291" status: 200 len: 1219 microversion: 2.1 time: 0.065397 Dec 15 03:07:34.112272 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: [pid: 116157|app: 0|req: 346/690] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 03:07:34 2021] GET /compute/v2.1/servers/a0097d88-6613-416a-9f4d-1bb285e53291 => generated 1219 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 03:07:34.388242 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi [None req-b2ae5314-8550-4724-88bd-40174adfa637 tempest-AttachVolumeTestJSON-244989543 tempest-AttachVolumeTestJSON-244989543-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116156) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 03:07:34.389257 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.compute.api [None req-b2ae5314-8550-4724-88bd-40174adfa637 tempest-AttachVolumeTestJSON-244989543 tempest-AttachVolumeTestJSON-244989543-project] [instance: f22dfea6-4599-43e4-93d5-d99f1db3b4fb] Fetching instance by UUID {{(pid=116156) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:07:34.396009 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-b2ae5314-8550-4724-88bd-40174adfa637 tempest-AttachVolumeTestJSON-244989543 tempest-AttachVolumeTestJSON-244989543-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:07:34.396463 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-b2ae5314-8550-4724-88bd-40174adfa637 tempest-AttachVolumeTestJSON-244989543 tempest-AttachVolumeTestJSON-244989543-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:07:34.397240 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-b2ae5314-8550-4724-88bd-40174adfa637 tempest-AttachVolumeTestJSON-244989543 tempest-AttachVolumeTestJSON-244989543-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:07:34.397680 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-b2ae5314-8550-4724-88bd-40174adfa637 tempest-AttachVolumeTestJSON-244989543 tempest-AttachVolumeTestJSON-244989543-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:07:34.529402 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: INFO nova.api.openstack.requestlog [None req-b2ae5314-8550-4724-88bd-40174adfa637 tempest-AttachVolumeTestJSON-244989543 tempest-AttachVolumeTestJSON-244989543-project] 10.222.0.18 "POST /compute/v2.1/servers/f22dfea6-4599-43e4-93d5-d99f1db3b4fb/action" status: 200 len: 34816 microversion: 2.1 time: 0.145791 Dec 15 03:07:34.529971 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: [pid: 116156|app: 0|req: 345/691] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Dec 15 03:07:34 2021] POST /compute/v2.1/servers/f22dfea6-4599-43e4-93d5-d99f1db3b4fb/action => generated 34816 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 03:07:35.129184 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi [None req-b193d707-4825-450e-b806-f6d2337c7b91 tempest-VolumesSnapshotTestJSON-925980516 tempest-VolumesSnapshotTestJSON-925980516-project] Calling method '>' {{(pid=116157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:07:35.130029 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.compute.api [None req-b193d707-4825-450e-b806-f6d2337c7b91 tempest-VolumesSnapshotTestJSON-925980516 tempest-VolumesSnapshotTestJSON-925980516-project] [instance: a0097d88-6613-416a-9f4d-1bb285e53291] Fetching instance by UUID {{(pid=116157) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:07:35.136698 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-b193d707-4825-450e-b806-f6d2337c7b91 tempest-VolumesSnapshotTestJSON-925980516 tempest-VolumesSnapshotTestJSON-925980516-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:07:35.137147 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-b193d707-4825-450e-b806-f6d2337c7b91 tempest-VolumesSnapshotTestJSON-925980516 tempest-VolumesSnapshotTestJSON-925980516-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:07:35.137923 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-b193d707-4825-450e-b806-f6d2337c7b91 tempest-VolumesSnapshotTestJSON-925980516 tempest-VolumesSnapshotTestJSON-925980516-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:07:35.138385 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-b193d707-4825-450e-b806-f6d2337c7b91 tempest-VolumesSnapshotTestJSON-925980516 tempest-VolumesSnapshotTestJSON-925980516-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:07:35.209524 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.policy [None req-b193d707-4825-450e-b806-f6d2337c7b91 tempest-VolumesSnapshotTestJSON-925980516 tempest-VolumesSnapshotTestJSON-925980516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4ffcca165af40abbd93569e7f01acbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ca6934bc24846ad82474c4ef7ba6323', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116157) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:07:35.217191 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: INFO nova.api.openstack.requestlog [None req-b193d707-4825-450e-b806-f6d2337c7b91 tempest-VolumesSnapshotTestJSON-925980516 tempest-VolumesSnapshotTestJSON-925980516-project] 10.222.0.18 "GET /compute/v2.1/servers/a0097d88-6613-416a-9f4d-1bb285e53291" status: 200 len: 1279 microversion: 2.1 time: 0.091604 Dec 15 03:07:35.217854 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: [pid: 116157|app: 0|req: 347/692] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 03:07:35 2021] GET /compute/v2.1/servers/a0097d88-6613-416a-9f4d-1bb285e53291 => generated 1279 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 03:07:35.541939 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi [None req-add641f6-2ee1-4887-97e1-e654e6389791 tempest-AttachVolumeTestJSON-244989543 tempest-AttachVolumeTestJSON-244989543-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116156) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 03:07:35.542973 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.compute.api [None req-add641f6-2ee1-4887-97e1-e654e6389791 tempest-AttachVolumeTestJSON-244989543 tempest-AttachVolumeTestJSON-244989543-project] [instance: f22dfea6-4599-43e4-93d5-d99f1db3b4fb] Fetching instance by UUID {{(pid=116156) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:07:35.550451 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-add641f6-2ee1-4887-97e1-e654e6389791 tempest-AttachVolumeTestJSON-244989543 tempest-AttachVolumeTestJSON-244989543-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:07:35.550896 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-add641f6-2ee1-4887-97e1-e654e6389791 tempest-AttachVolumeTestJSON-244989543 tempest-AttachVolumeTestJSON-244989543-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:07:35.551678 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-add641f6-2ee1-4887-97e1-e654e6389791 tempest-AttachVolumeTestJSON-244989543 tempest-AttachVolumeTestJSON-244989543-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:07:35.552107 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-add641f6-2ee1-4887-97e1-e654e6389791 tempest-AttachVolumeTestJSON-244989543 tempest-AttachVolumeTestJSON-244989543-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:07:35.662652 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: INFO nova.api.openstack.requestlog [None req-add641f6-2ee1-4887-97e1-e654e6389791 tempest-AttachVolumeTestJSON-244989543 tempest-AttachVolumeTestJSON-244989543-project] 10.222.0.18 "POST /compute/v2.1/servers/f22dfea6-4599-43e4-93d5-d99f1db3b4fb/action" status: 200 len: 35674 microversion: 2.1 time: 0.124354 Dec 15 03:07:35.666722 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: [pid: 116156|app: 0|req: 346/693] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Dec 15 03:07:35 2021] POST /compute/v2.1/servers/f22dfea6-4599-43e4-93d5-d99f1db3b4fb/action => generated 35674 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 03:07:36.233292 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi [None req-b0f1173c-6cfb-4ecc-ad0e-6168ecdc0db4 tempest-VolumesSnapshotTestJSON-925980516 tempest-VolumesSnapshotTestJSON-925980516-project] Calling method '>' {{(pid=116157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:07:36.233905 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.compute.api [None req-b0f1173c-6cfb-4ecc-ad0e-6168ecdc0db4 tempest-VolumesSnapshotTestJSON-925980516 tempest-VolumesSnapshotTestJSON-925980516-project] [instance: a0097d88-6613-416a-9f4d-1bb285e53291] Fetching instance by UUID {{(pid=116157) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:07:36.240226 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-b0f1173c-6cfb-4ecc-ad0e-6168ecdc0db4 tempest-VolumesSnapshotTestJSON-925980516 tempest-VolumesSnapshotTestJSON-925980516-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:07:36.240679 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-b0f1173c-6cfb-4ecc-ad0e-6168ecdc0db4 tempest-VolumesSnapshotTestJSON-925980516 tempest-VolumesSnapshotTestJSON-925980516-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:07:36.241461 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-b0f1173c-6cfb-4ecc-ad0e-6168ecdc0db4 tempest-VolumesSnapshotTestJSON-925980516 tempest-VolumesSnapshotTestJSON-925980516-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:07:36.241901 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-b0f1173c-6cfb-4ecc-ad0e-6168ecdc0db4 tempest-VolumesSnapshotTestJSON-925980516 tempest-VolumesSnapshotTestJSON-925980516-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:07:36.373874 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.policy [None req-b0f1173c-6cfb-4ecc-ad0e-6168ecdc0db4 tempest-VolumesSnapshotTestJSON-925980516 tempest-VolumesSnapshotTestJSON-925980516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4ffcca165af40abbd93569e7f01acbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ca6934bc24846ad82474c4ef7ba6323', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116157) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:07:36.381554 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: INFO nova.api.openstack.requestlog [None req-b0f1173c-6cfb-4ecc-ad0e-6168ecdc0db4 tempest-VolumesSnapshotTestJSON-925980516 tempest-VolumesSnapshotTestJSON-925980516-project] 10.222.0.18 "GET /compute/v2.1/servers/a0097d88-6613-416a-9f4d-1bb285e53291" status: 200 len: 1319 microversion: 2.1 time: 0.151994 Dec 15 03:07:36.382213 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: [pid: 116157|app: 0|req: 348/694] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 03:07:36 2021] GET /compute/v2.1/servers/a0097d88-6613-416a-9f4d-1bb285e53291 => generated 1319 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 03:07:36.405945 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi [req-70e9dc90-522c-4df9-ae3d-da988c7ecc1e req-fa15fd5f-f4c9-4736-95b1-5173343febd3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a0097d88-6613-416a-9f4d-1bb285e53291", "tag": "69742a90-77de-4208-bba3-942fff47bc87"}]} {{(pid=116156) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 03:07:36.407792 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 15 03:07:36.407792 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: warnings.warn(msg) Dec 15 03:07:36.416793 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [req-70e9dc90-522c-4df9-ae3d-da988c7ecc1e req-fa15fd5f-f4c9-4736-95b1-5173343febd3 service nova] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:07:36.417236 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [req-70e9dc90-522c-4df9-ae3d-da988c7ecc1e req-fa15fd5f-f4c9-4736-95b1-5173343febd3 service nova] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:07:36.432520 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: INFO nova.api.openstack.compute.server_external_events [req-70e9dc90-522c-4df9-ae3d-da988c7ecc1e req-fa15fd5f-f4c9-4736-95b1-5173343febd3 service nova] Creating event network-changed:69742a90-77de-4208-bba3-942fff47bc87 for instance a0097d88-6613-416a-9f4d-1bb285e53291 on hv-cinder-81803 Dec 15 03:07:36.437590 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: INFO nova.api.openstack.requestlog [req-70e9dc90-522c-4df9-ae3d-da988c7ecc1e req-fa15fd5f-f4c9-4736-95b1-5173343febd3 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035393 Dec 15 03:07:36.438258 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: [pid: 116156|app: 0|req: 347/695] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Dec 15 03:07:36 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 03:07:36.674937 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi [None req-0160b73e-8e3e-49e0-bca4-a6f8952b39ec tempest-AttachVolumeTestJSON-244989543 tempest-AttachVolumeTestJSON-244989543-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 03:07:36.675938 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.compute.api [None req-0160b73e-8e3e-49e0-bca4-a6f8952b39ec tempest-AttachVolumeTestJSON-244989543 tempest-AttachVolumeTestJSON-244989543-project] [instance: f22dfea6-4599-43e4-93d5-d99f1db3b4fb] Fetching instance by UUID {{(pid=116157) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:07:36.682158 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-0160b73e-8e3e-49e0-bca4-a6f8952b39ec tempest-AttachVolumeTestJSON-244989543 tempest-AttachVolumeTestJSON-244989543-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:07:36.682617 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-0160b73e-8e3e-49e0-bca4-a6f8952b39ec tempest-AttachVolumeTestJSON-244989543 tempest-AttachVolumeTestJSON-244989543-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:07:36.683416 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-0160b73e-8e3e-49e0-bca4-a6f8952b39ec tempest-AttachVolumeTestJSON-244989543 tempest-AttachVolumeTestJSON-244989543-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:07:36.683838 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-0160b73e-8e3e-49e0-bca4-a6f8952b39ec tempest-AttachVolumeTestJSON-244989543 tempest-AttachVolumeTestJSON-244989543-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:07:36.795007 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: INFO nova.api.openstack.requestlog [None req-0160b73e-8e3e-49e0-bca4-a6f8952b39ec tempest-AttachVolumeTestJSON-244989543 tempest-AttachVolumeTestJSON-244989543-project] 10.222.0.18 "POST /compute/v2.1/servers/f22dfea6-4599-43e4-93d5-d99f1db3b4fb/action" status: 200 len: 37132 microversion: 2.1 time: 0.124109 Dec 15 03:07:36.799837 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: [pid: 116157|app: 0|req: 349/696] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Dec 15 03:07:36 2021] POST /compute/v2.1/servers/f22dfea6-4599-43e4-93d5-d99f1db3b4fb/action => generated 37132 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 03:07:37.399832 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi [None req-11313e3f-6825-4762-8cb6-07e027b902d5 tempest-VolumesSnapshotTestJSON-925980516 tempest-VolumesSnapshotTestJSON-925980516-project] Calling method '>' {{(pid=116156) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:07:37.400569 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.compute.api [None req-11313e3f-6825-4762-8cb6-07e027b902d5 tempest-VolumesSnapshotTestJSON-925980516 tempest-VolumesSnapshotTestJSON-925980516-project] [instance: a0097d88-6613-416a-9f4d-1bb285e53291] Fetching instance by UUID {{(pid=116156) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:07:37.407059 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-11313e3f-6825-4762-8cb6-07e027b902d5 tempest-VolumesSnapshotTestJSON-925980516 tempest-VolumesSnapshotTestJSON-925980516-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:07:37.407517 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-11313e3f-6825-4762-8cb6-07e027b902d5 tempest-VolumesSnapshotTestJSON-925980516 tempest-VolumesSnapshotTestJSON-925980516-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:07:37.408298 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-11313e3f-6825-4762-8cb6-07e027b902d5 tempest-VolumesSnapshotTestJSON-925980516 tempest-VolumesSnapshotTestJSON-925980516-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:07:37.408741 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-11313e3f-6825-4762-8cb6-07e027b902d5 tempest-VolumesSnapshotTestJSON-925980516 tempest-VolumesSnapshotTestJSON-925980516-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:07:37.605497 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.policy [None req-11313e3f-6825-4762-8cb6-07e027b902d5 tempest-VolumesSnapshotTestJSON-925980516 tempest-VolumesSnapshotTestJSON-925980516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4ffcca165af40abbd93569e7f01acbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ca6934bc24846ad82474c4ef7ba6323', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116156) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:07:37.612729 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: INFO nova.api.openstack.requestlog [None req-11313e3f-6825-4762-8cb6-07e027b902d5 tempest-VolumesSnapshotTestJSON-925980516 tempest-VolumesSnapshotTestJSON-925980516-project] 10.222.0.18 "GET /compute/v2.1/servers/a0097d88-6613-416a-9f4d-1bb285e53291" status: 200 len: 1319 microversion: 2.1 time: 0.217307 Dec 15 03:07:37.613294 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: [pid: 116156|app: 0|req: 348/697] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 03:07:37 2021] GET /compute/v2.1/servers/a0097d88-6613-416a-9f4d-1bb285e53291 => generated 1319 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 03:07:37.807903 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi [None req-eda22574-eb93-48c3-b3d6-0f0a705bd199 tempest-AttachVolumeTestJSON-244989543 tempest-AttachVolumeTestJSON-244989543-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 03:07:37.808929 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.compute.api [None req-eda22574-eb93-48c3-b3d6-0f0a705bd199 tempest-AttachVolumeTestJSON-244989543 tempest-AttachVolumeTestJSON-244989543-project] [instance: f22dfea6-4599-43e4-93d5-d99f1db3b4fb] Fetching instance by UUID {{(pid=116157) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:07:37.816216 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-eda22574-eb93-48c3-b3d6-0f0a705bd199 tempest-AttachVolumeTestJSON-244989543 tempest-AttachVolumeTestJSON-244989543-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:07:37.816667 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-eda22574-eb93-48c3-b3d6-0f0a705bd199 tempest-AttachVolumeTestJSON-244989543 tempest-AttachVolumeTestJSON-244989543-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:07:37.817483 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-eda22574-eb93-48c3-b3d6-0f0a705bd199 tempest-AttachVolumeTestJSON-244989543 tempest-AttachVolumeTestJSON-244989543-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:07:37.817917 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-eda22574-eb93-48c3-b3d6-0f0a705bd199 tempest-AttachVolumeTestJSON-244989543 tempest-AttachVolumeTestJSON-244989543-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:07:37.908645 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: INFO nova.api.openstack.requestlog [None req-eda22574-eb93-48c3-b3d6-0f0a705bd199 tempest-AttachVolumeTestJSON-244989543 tempest-AttachVolumeTestJSON-244989543-project] 10.222.0.18 "POST /compute/v2.1/servers/f22dfea6-4599-43e4-93d5-d99f1db3b4fb/action" status: 200 len: 38148 microversion: 2.1 time: 0.104575 Dec 15 03:07:37.911708 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: [pid: 116157|app: 0|req: 350/698] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Dec 15 03:07:37 2021] POST /compute/v2.1/servers/f22dfea6-4599-43e4-93d5-d99f1db3b4fb/action => generated 38148 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 03:07:38.629573 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi [None req-75af952e-7c7c-4bdb-a2e3-ba959108769b tempest-VolumesSnapshotTestJSON-925980516 tempest-VolumesSnapshotTestJSON-925980516-project] Calling method '>' {{(pid=116156) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:07:38.630225 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.compute.api [None req-75af952e-7c7c-4bdb-a2e3-ba959108769b tempest-VolumesSnapshotTestJSON-925980516 tempest-VolumesSnapshotTestJSON-925980516-project] [instance: a0097d88-6613-416a-9f4d-1bb285e53291] Fetching instance by UUID {{(pid=116156) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:07:38.636403 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-75af952e-7c7c-4bdb-a2e3-ba959108769b tempest-VolumesSnapshotTestJSON-925980516 tempest-VolumesSnapshotTestJSON-925980516-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:07:38.636853 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-75af952e-7c7c-4bdb-a2e3-ba959108769b tempest-VolumesSnapshotTestJSON-925980516 tempest-VolumesSnapshotTestJSON-925980516-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:07:38.637630 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-75af952e-7c7c-4bdb-a2e3-ba959108769b tempest-VolumesSnapshotTestJSON-925980516 tempest-VolumesSnapshotTestJSON-925980516-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:07:38.638099 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-75af952e-7c7c-4bdb-a2e3-ba959108769b tempest-VolumesSnapshotTestJSON-925980516 tempest-VolumesSnapshotTestJSON-925980516-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:07:38.763792 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.policy [None req-75af952e-7c7c-4bdb-a2e3-ba959108769b tempest-VolumesSnapshotTestJSON-925980516 tempest-VolumesSnapshotTestJSON-925980516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4ffcca165af40abbd93569e7f01acbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ca6934bc24846ad82474c4ef7ba6323', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116156) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:07:38.771454 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: INFO nova.api.openstack.requestlog [None req-75af952e-7c7c-4bdb-a2e3-ba959108769b tempest-VolumesSnapshotTestJSON-925980516 tempest-VolumesSnapshotTestJSON-925980516-project] 10.222.0.18 "GET /compute/v2.1/servers/a0097d88-6613-416a-9f4d-1bb285e53291" status: 200 len: 1319 microversion: 2.1 time: 0.145537 Dec 15 03:07:38.772015 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: [pid: 116156|app: 0|req: 349/699] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 03:07:38 2021] GET /compute/v2.1/servers/a0097d88-6613-416a-9f4d-1bb285e53291 => generated 1319 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 03:07:38.921136 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi [None req-3a4387fa-c95b-4388-ac4a-8393ce6d3478 tempest-AttachVolumeTestJSON-244989543 tempest-AttachVolumeTestJSON-244989543-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 03:07:38.922096 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.compute.api [None req-3a4387fa-c95b-4388-ac4a-8393ce6d3478 tempest-AttachVolumeTestJSON-244989543 tempest-AttachVolumeTestJSON-244989543-project] [instance: f22dfea6-4599-43e4-93d5-d99f1db3b4fb] Fetching instance by UUID {{(pid=116157) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:07:38.928905 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-3a4387fa-c95b-4388-ac4a-8393ce6d3478 tempest-AttachVolumeTestJSON-244989543 tempest-AttachVolumeTestJSON-244989543-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:07:38.929360 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-3a4387fa-c95b-4388-ac4a-8393ce6d3478 tempest-AttachVolumeTestJSON-244989543 tempest-AttachVolumeTestJSON-244989543-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:07:38.930186 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-3a4387fa-c95b-4388-ac4a-8393ce6d3478 tempest-AttachVolumeTestJSON-244989543 tempest-AttachVolumeTestJSON-244989543-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:07:38.930627 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-3a4387fa-c95b-4388-ac4a-8393ce6d3478 tempest-AttachVolumeTestJSON-244989543 tempest-AttachVolumeTestJSON-244989543-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:07:39.023560 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: INFO nova.api.openstack.requestlog [None req-3a4387fa-c95b-4388-ac4a-8393ce6d3478 tempest-AttachVolumeTestJSON-244989543 tempest-AttachVolumeTestJSON-244989543-project] 10.222.0.18 "POST /compute/v2.1/servers/f22dfea6-4599-43e4-93d5-d99f1db3b4fb/action" status: 200 len: 38148 microversion: 2.1 time: 0.106301 Dec 15 03:07:39.024188 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: [pid: 116157|app: 0|req: 351/700] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Dec 15 03:07:38 2021] POST /compute/v2.1/servers/f22dfea6-4599-43e4-93d5-d99f1db3b4fb/action => generated 38148 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 03:07:39.788583 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi [None req-bbc10b5c-4419-4f9a-9f74-5554096ab790 tempest-VolumesSnapshotTestJSON-925980516 tempest-VolumesSnapshotTestJSON-925980516-project] Calling method '>' {{(pid=116156) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:07:39.789192 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.compute.api [None req-bbc10b5c-4419-4f9a-9f74-5554096ab790 tempest-VolumesSnapshotTestJSON-925980516 tempest-VolumesSnapshotTestJSON-925980516-project] [instance: a0097d88-6613-416a-9f4d-1bb285e53291] Fetching instance by UUID {{(pid=116156) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:07:39.795465 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-bbc10b5c-4419-4f9a-9f74-5554096ab790 tempest-VolumesSnapshotTestJSON-925980516 tempest-VolumesSnapshotTestJSON-925980516-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:07:39.796549 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-bbc10b5c-4419-4f9a-9f74-5554096ab790 tempest-VolumesSnapshotTestJSON-925980516 tempest-VolumesSnapshotTestJSON-925980516-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:07:39.797332 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-bbc10b5c-4419-4f9a-9f74-5554096ab790 tempest-VolumesSnapshotTestJSON-925980516 tempest-VolumesSnapshotTestJSON-925980516-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:07:39.798610 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-bbc10b5c-4419-4f9a-9f74-5554096ab790 tempest-VolumesSnapshotTestJSON-925980516 tempest-VolumesSnapshotTestJSON-925980516-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:07:39.926644 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.policy [None req-bbc10b5c-4419-4f9a-9f74-5554096ab790 tempest-VolumesSnapshotTestJSON-925980516 tempest-VolumesSnapshotTestJSON-925980516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4ffcca165af40abbd93569e7f01acbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ca6934bc24846ad82474c4ef7ba6323', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116156) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:07:39.933878 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: INFO nova.api.openstack.requestlog [None req-bbc10b5c-4419-4f9a-9f74-5554096ab790 tempest-VolumesSnapshotTestJSON-925980516 tempest-VolumesSnapshotTestJSON-925980516-project] 10.222.0.18 "GET /compute/v2.1/servers/a0097d88-6613-416a-9f4d-1bb285e53291" status: 200 len: 1319 microversion: 2.1 time: 0.148929 Dec 15 03:07:39.934468 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: [pid: 116156|app: 0|req: 350/701] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 03:07:39 2021] GET /compute/v2.1/servers/a0097d88-6613-416a-9f4d-1bb285e53291 => generated 1319 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 03:07:39.970229 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi [req-78874e7e-f0f2-447a-9334-9f82edce51e0 req-31c9000c-4d8c-4323-b5bc-d452b67efb65 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a0097d88-6613-416a-9f4d-1bb285e53291", "name": "network-vif-plugged", "status": "completed", "tag": "69742a90-77de-4208-bba3-942fff47bc87"}]} {{(pid=116157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 03:07:39.971791 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 15 03:07:39.971791 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: warnings.warn(msg) Dec 15 03:07:39.979667 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [req-78874e7e-f0f2-447a-9334-9f82edce51e0 req-31c9000c-4d8c-4323-b5bc-d452b67efb65 service nova] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:07:39.980106 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [req-78874e7e-f0f2-447a-9334-9f82edce51e0 req-31c9000c-4d8c-4323-b5bc-d452b67efb65 service nova] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:07:39.991423 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: INFO nova.api.openstack.compute.server_external_events [req-78874e7e-f0f2-447a-9334-9f82edce51e0 req-31c9000c-4d8c-4323-b5bc-d452b67efb65 service nova] Creating event network-vif-plugged:69742a90-77de-4208-bba3-942fff47bc87 for instance a0097d88-6613-416a-9f4d-1bb285e53291 on hv-cinder-81803 Dec 15 03:07:39.996354 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: INFO nova.api.openstack.requestlog [req-78874e7e-f0f2-447a-9334-9f82edce51e0 req-31c9000c-4d8c-4323-b5bc-d452b67efb65 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030653 Dec 15 03:07:39.996983 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: [pid: 116157|app: 0|req: 352/702] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Dec 15 03:07:39 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 03:07:40.035702 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi [None req-a817565b-2d8f-45e9-932f-4a7bba72f05f tempest-AttachVolumeTestJSON-244989543 tempest-AttachVolumeTestJSON-244989543-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116156) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 03:07:40.036855 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.compute.api [None req-a817565b-2d8f-45e9-932f-4a7bba72f05f tempest-AttachVolumeTestJSON-244989543 tempest-AttachVolumeTestJSON-244989543-project] [instance: f22dfea6-4599-43e4-93d5-d99f1db3b4fb] Fetching instance by UUID {{(pid=116156) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:07:40.042922 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-a817565b-2d8f-45e9-932f-4a7bba72f05f tempest-AttachVolumeTestJSON-244989543 tempest-AttachVolumeTestJSON-244989543-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:07:40.043305 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-a817565b-2d8f-45e9-932f-4a7bba72f05f tempest-AttachVolumeTestJSON-244989543 tempest-AttachVolumeTestJSON-244989543-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:07:40.044087 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-a817565b-2d8f-45e9-932f-4a7bba72f05f tempest-AttachVolumeTestJSON-244989543 tempest-AttachVolumeTestJSON-244989543-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:07:40.044517 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-a817565b-2d8f-45e9-932f-4a7bba72f05f tempest-AttachVolumeTestJSON-244989543 tempest-AttachVolumeTestJSON-244989543-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:07:40.138917 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: INFO nova.api.openstack.requestlog [None req-a817565b-2d8f-45e9-932f-4a7bba72f05f tempest-AttachVolumeTestJSON-244989543 tempest-AttachVolumeTestJSON-244989543-project] 10.222.0.18 "POST /compute/v2.1/servers/f22dfea6-4599-43e4-93d5-d99f1db3b4fb/action" status: 200 len: 38148 microversion: 2.1 time: 0.106727 Dec 15 03:07:40.139622 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: [pid: 116156|app: 0|req: 351/703] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Dec 15 03:07:40 2021] POST /compute/v2.1/servers/f22dfea6-4599-43e4-93d5-d99f1db3b4fb/action => generated 38148 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 03:07:40.951444 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi [None req-78e8e2ef-feff-4e8a-9e5a-52514e3a4685 tempest-VolumesSnapshotTestJSON-925980516 tempest-VolumesSnapshotTestJSON-925980516-project] Calling method '>' {{(pid=116157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:07:40.952136 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.compute.api [None req-78e8e2ef-feff-4e8a-9e5a-52514e3a4685 tempest-VolumesSnapshotTestJSON-925980516 tempest-VolumesSnapshotTestJSON-925980516-project] [instance: a0097d88-6613-416a-9f4d-1bb285e53291] Fetching instance by UUID {{(pid=116157) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:07:40.958295 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-78e8e2ef-feff-4e8a-9e5a-52514e3a4685 tempest-VolumesSnapshotTestJSON-925980516 tempest-VolumesSnapshotTestJSON-925980516-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:07:40.958740 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-78e8e2ef-feff-4e8a-9e5a-52514e3a4685 tempest-VolumesSnapshotTestJSON-925980516 tempest-VolumesSnapshotTestJSON-925980516-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:07:40.959509 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-78e8e2ef-feff-4e8a-9e5a-52514e3a4685 tempest-VolumesSnapshotTestJSON-925980516 tempest-VolumesSnapshotTestJSON-925980516-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:07:40.959940 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-78e8e2ef-feff-4e8a-9e5a-52514e3a4685 tempest-VolumesSnapshotTestJSON-925980516 tempest-VolumesSnapshotTestJSON-925980516-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:07:41.095570 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.policy [None req-78e8e2ef-feff-4e8a-9e5a-52514e3a4685 tempest-VolumesSnapshotTestJSON-925980516 tempest-VolumesSnapshotTestJSON-925980516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4ffcca165af40abbd93569e7f01acbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ca6934bc24846ad82474c4ef7ba6323', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116157) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:07:41.102718 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: INFO nova.api.openstack.requestlog [None req-78e8e2ef-feff-4e8a-9e5a-52514e3a4685 tempest-VolumesSnapshotTestJSON-925980516 tempest-VolumesSnapshotTestJSON-925980516-project] 10.222.0.18 "GET /compute/v2.1/servers/a0097d88-6613-416a-9f4d-1bb285e53291" status: 200 len: 1319 microversion: 2.1 time: 0.155673 Dec 15 03:07:41.103283 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: [pid: 116157|app: 0|req: 353/704] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 03:07:40 2021] GET /compute/v2.1/servers/a0097d88-6613-416a-9f4d-1bb285e53291 => generated 1319 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 03:07:41.151139 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi [None req-fa094815-77ee-4f8e-bd91-7e74c2cbcff2 tempest-AttachVolumeTestJSON-244989543 tempest-AttachVolumeTestJSON-244989543-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116156) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 03:07:41.152161 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.compute.api [None req-fa094815-77ee-4f8e-bd91-7e74c2cbcff2 tempest-AttachVolumeTestJSON-244989543 tempest-AttachVolumeTestJSON-244989543-project] [instance: f22dfea6-4599-43e4-93d5-d99f1db3b4fb] Fetching instance by UUID {{(pid=116156) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:07:41.158916 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-fa094815-77ee-4f8e-bd91-7e74c2cbcff2 tempest-AttachVolumeTestJSON-244989543 tempest-AttachVolumeTestJSON-244989543-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:07:41.159364 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-fa094815-77ee-4f8e-bd91-7e74c2cbcff2 tempest-AttachVolumeTestJSON-244989543 tempest-AttachVolumeTestJSON-244989543-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:07:41.160136 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-fa094815-77ee-4f8e-bd91-7e74c2cbcff2 tempest-AttachVolumeTestJSON-244989543 tempest-AttachVolumeTestJSON-244989543-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:07:41.160567 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-fa094815-77ee-4f8e-bd91-7e74c2cbcff2 tempest-AttachVolumeTestJSON-244989543 tempest-AttachVolumeTestJSON-244989543-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:07:41.262818 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: INFO nova.api.openstack.requestlog [None req-fa094815-77ee-4f8e-bd91-7e74c2cbcff2 tempest-AttachVolumeTestJSON-244989543 tempest-AttachVolumeTestJSON-244989543-project] 10.222.0.18 "POST /compute/v2.1/servers/f22dfea6-4599-43e4-93d5-d99f1db3b4fb/action" status: 200 len: 38148 microversion: 2.1 time: 0.115555 Dec 15 03:07:41.263483 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: [pid: 116156|app: 0|req: 352/705] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Dec 15 03:07:41 2021] POST /compute/v2.1/servers/f22dfea6-4599-43e4-93d5-d99f1db3b4fb/action => generated 38148 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 03:07:42.119864 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi [None req-5c0d3623-3781-446a-b3fb-b56b86fb73d2 tempest-VolumesSnapshotTestJSON-925980516 tempest-VolumesSnapshotTestJSON-925980516-project] Calling method '>' {{(pid=116157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:07:42.120478 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.compute.api [None req-5c0d3623-3781-446a-b3fb-b56b86fb73d2 tempest-VolumesSnapshotTestJSON-925980516 tempest-VolumesSnapshotTestJSON-925980516-project] [instance: a0097d88-6613-416a-9f4d-1bb285e53291] Fetching instance by UUID {{(pid=116157) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:07:42.127220 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-5c0d3623-3781-446a-b3fb-b56b86fb73d2 tempest-VolumesSnapshotTestJSON-925980516 tempest-VolumesSnapshotTestJSON-925980516-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:07:42.127673 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-5c0d3623-3781-446a-b3fb-b56b86fb73d2 tempest-VolumesSnapshotTestJSON-925980516 tempest-VolumesSnapshotTestJSON-925980516-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:07:42.128453 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-5c0d3623-3781-446a-b3fb-b56b86fb73d2 tempest-VolumesSnapshotTestJSON-925980516 tempest-VolumesSnapshotTestJSON-925980516-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:07:42.128890 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-5c0d3623-3781-446a-b3fb-b56b86fb73d2 tempest-VolumesSnapshotTestJSON-925980516 tempest-VolumesSnapshotTestJSON-925980516-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:07:42.256969 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.policy [None req-5c0d3623-3781-446a-b3fb-b56b86fb73d2 tempest-VolumesSnapshotTestJSON-925980516 tempest-VolumesSnapshotTestJSON-925980516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4ffcca165af40abbd93569e7f01acbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ca6934bc24846ad82474c4ef7ba6323', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116157) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:07:42.264161 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: INFO nova.api.openstack.requestlog [None req-5c0d3623-3781-446a-b3fb-b56b86fb73d2 tempest-VolumesSnapshotTestJSON-925980516 tempest-VolumesSnapshotTestJSON-925980516-project] 10.222.0.18 "GET /compute/v2.1/servers/a0097d88-6613-416a-9f4d-1bb285e53291" status: 200 len: 1508 microversion: 2.1 time: 0.148249 Dec 15 03:07:42.265343 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: [pid: 116157|app: 0|req: 354/706] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 03:07:42 2021] GET /compute/v2.1/servers/a0097d88-6613-416a-9f4d-1bb285e53291 => generated 1508 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 03:07:42.274972 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi [None req-0e314cab-2753-4b43-b554-b4d866d0db61 tempest-AttachVolumeTestJSON-244989543 tempest-AttachVolumeTestJSON-244989543-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116156) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 03:07:42.275980 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.compute.api [None req-0e314cab-2753-4b43-b554-b4d866d0db61 tempest-AttachVolumeTestJSON-244989543 tempest-AttachVolumeTestJSON-244989543-project] [instance: f22dfea6-4599-43e4-93d5-d99f1db3b4fb] Fetching instance by UUID {{(pid=116156) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:07:42.282804 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-0e314cab-2753-4b43-b554-b4d866d0db61 tempest-AttachVolumeTestJSON-244989543 tempest-AttachVolumeTestJSON-244989543-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:07:42.283261 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-0e314cab-2753-4b43-b554-b4d866d0db61 tempest-AttachVolumeTestJSON-244989543 tempest-AttachVolumeTestJSON-244989543-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:07:42.284051 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-0e314cab-2753-4b43-b554-b4d866d0db61 tempest-AttachVolumeTestJSON-244989543 tempest-AttachVolumeTestJSON-244989543-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:07:42.284494 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-0e314cab-2753-4b43-b554-b4d866d0db61 tempest-AttachVolumeTestJSON-244989543 tempest-AttachVolumeTestJSON-244989543-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:07:42.395622 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: INFO nova.api.openstack.requestlog [None req-0e314cab-2753-4b43-b554-b4d866d0db61 tempest-AttachVolumeTestJSON-244989543 tempest-AttachVolumeTestJSON-244989543-project] 10.222.0.18 "POST /compute/v2.1/servers/f22dfea6-4599-43e4-93d5-d99f1db3b4fb/action" status: 200 len: 38279 microversion: 2.1 time: 0.124631 Dec 15 03:07:42.396453 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: [pid: 116156|app: 0|req: 353/707] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Dec 15 03:07:42 2021] POST /compute/v2.1/servers/f22dfea6-4599-43e4-93d5-d99f1db3b4fb/action => generated 38279 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 03:07:42.405834 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi [None req-4f434708-bb68-4c1c-be30-7f3570e29d04 tempest-AttachVolumeTestJSON-244989543 tempest-AttachVolumeTestJSON-244989543-project] Calling method '>' {{(pid=116157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:07:42.406346 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.compute.api [None req-4f434708-bb68-4c1c-be30-7f3570e29d04 tempest-AttachVolumeTestJSON-244989543 tempest-AttachVolumeTestJSON-244989543-project] [instance: f22dfea6-4599-43e4-93d5-d99f1db3b4fb] Fetching instance by UUID {{(pid=116157) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:07:42.412469 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-4f434708-bb68-4c1c-be30-7f3570e29d04 tempest-AttachVolumeTestJSON-244989543 tempest-AttachVolumeTestJSON-244989543-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:07:42.412918 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-4f434708-bb68-4c1c-be30-7f3570e29d04 tempest-AttachVolumeTestJSON-244989543 tempest-AttachVolumeTestJSON-244989543-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:07:42.413685 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-4f434708-bb68-4c1c-be30-7f3570e29d04 tempest-AttachVolumeTestJSON-244989543 tempest-AttachVolumeTestJSON-244989543-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:07:42.414274 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-4f434708-bb68-4c1c-be30-7f3570e29d04 tempest-AttachVolumeTestJSON-244989543 tempest-AttachVolumeTestJSON-244989543-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:07:42.438384 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: INFO nova.api.openstack.requestlog [None req-4f434708-bb68-4c1c-be30-7f3570e29d04 tempest-AttachVolumeTestJSON-244989543 tempest-AttachVolumeTestJSON-244989543-project] 10.222.0.18 "GET /compute/v2.1/servers/f22dfea6-4599-43e4-93d5-d99f1db3b4fb/ips" status: 200 len: 146 microversion: 2.1 time: 0.036053 Dec 15 03:07:42.439440 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: [pid: 116157|app: 0|req: 355/708] 10.222.0.18 () {58 vars in 1247 bytes} [Wed Dec 15 03:07:42 2021] GET /compute/v2.1/servers/f22dfea6-4599-43e4-93d5-d99f1db3b4fb/ips => generated 146 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 03:07:44.662181 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi [None req-8a062c10-03c7-41be-b0f8-576e2f052528 tempest-AttachVolumeTestJSON-244989543 tempest-AttachVolumeTestJSON-244989543-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "4ee178c0-86f3-44b2-8895-149b7c7cd260"}} {{(pid=116156) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 03:07:44.663321 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.compute.api [None req-8a062c10-03c7-41be-b0f8-576e2f052528 tempest-AttachVolumeTestJSON-244989543 tempest-AttachVolumeTestJSON-244989543-project] [instance: f22dfea6-4599-43e4-93d5-d99f1db3b4fb] Fetching instance by UUID {{(pid=116156) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:07:44.670120 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-8a062c10-03c7-41be-b0f8-576e2f052528 tempest-AttachVolumeTestJSON-244989543 tempest-AttachVolumeTestJSON-244989543-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:07:44.670574 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-8a062c10-03c7-41be-b0f8-576e2f052528 tempest-AttachVolumeTestJSON-244989543 tempest-AttachVolumeTestJSON-244989543-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:07:44.671350 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-8a062c10-03c7-41be-b0f8-576e2f052528 tempest-AttachVolumeTestJSON-244989543 tempest-AttachVolumeTestJSON-244989543-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:07:44.671794 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-8a062c10-03c7-41be-b0f8-576e2f052528 tempest-AttachVolumeTestJSON-244989543 tempest-AttachVolumeTestJSON-244989543-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:07:44.925360 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: INFO nova.api.openstack.requestlog [None req-8a062c10-03c7-41be-b0f8-576e2f052528 tempest-AttachVolumeTestJSON-244989543 tempest-AttachVolumeTestJSON-244989543-project] 10.222.0.18 "POST /compute/v2.1/servers/f22dfea6-4599-43e4-93d5-d99f1db3b4fb/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.266997 Dec 15 03:07:44.925965 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: [pid: 116156|app: 0|req: 354/709] 10.222.0.18 () {60 vars in 1322 bytes} [Wed Dec 15 03:07:44 2021] POST /compute/v2.1/servers/f22dfea6-4599-43e4-93d5-d99f1db3b4fb/os-volume_attachments => generated 194 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 03:07:52.383942 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi [None req-e7c22f7e-de53-4f48-a887-3fe56f4a3f8f tempest-AttachVolumeTestJSON-244989543 tempest-AttachVolumeTestJSON-244989543-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=116157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 03:07:52.390334 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-e7c22f7e-de53-4f48-a887-3fe56f4a3f8f tempest-AttachVolumeTestJSON-244989543 tempest-AttachVolumeTestJSON-244989543-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:07:52.390791 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-e7c22f7e-de53-4f48-a887-3fe56f4a3f8f tempest-AttachVolumeTestJSON-244989543 tempest-AttachVolumeTestJSON-244989543-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:07:52.452491 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.compute.api [None req-e7c22f7e-de53-4f48-a887-3fe56f4a3f8f tempest-AttachVolumeTestJSON-244989543 tempest-AttachVolumeTestJSON-244989543-project] [instance: f22dfea6-4599-43e4-93d5-d99f1db3b4fb] Going to try to stop instance {{(pid=116157) force_stop /opt/stack/nova/nova/compute/api.py:2654}} Dec 15 03:07:52.493294 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: INFO nova.api.openstack.requestlog [None req-e7c22f7e-de53-4f48-a887-3fe56f4a3f8f tempest-AttachVolumeTestJSON-244989543 tempest-AttachVolumeTestJSON-244989543-project] 10.222.0.18 "POST /compute/v2.1/servers/f22dfea6-4599-43e4-93d5-d99f1db3b4fb/action" status: 202 len: 0 microversion: 2.1 time: 0.112701 Dec 15 03:07:52.494342 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: [pid: 116157|app: 0|req: 356/710] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Dec 15 03:07:52 2021] POST /compute/v2.1/servers/f22dfea6-4599-43e4-93d5-d99f1db3b4fb/action => generated 0 bytes in 115 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Dec 15 03:07:52.503071 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi [None req-20f30416-f297-453b-a56e-8286ecb529c7 tempest-AttachVolumeTestJSON-244989543 tempest-AttachVolumeTestJSON-244989543-project] Calling method '>' {{(pid=116156) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:07:52.503768 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.compute.api [None req-20f30416-f297-453b-a56e-8286ecb529c7 tempest-AttachVolumeTestJSON-244989543 tempest-AttachVolumeTestJSON-244989543-project] [instance: f22dfea6-4599-43e4-93d5-d99f1db3b4fb] Fetching instance by UUID {{(pid=116156) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:07:52.511140 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-20f30416-f297-453b-a56e-8286ecb529c7 tempest-AttachVolumeTestJSON-244989543 tempest-AttachVolumeTestJSON-244989543-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:07:52.511608 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-20f30416-f297-453b-a56e-8286ecb529c7 tempest-AttachVolumeTestJSON-244989543 tempest-AttachVolumeTestJSON-244989543-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:07:52.512566 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-20f30416-f297-453b-a56e-8286ecb529c7 tempest-AttachVolumeTestJSON-244989543 tempest-AttachVolumeTestJSON-244989543-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:07:52.513100 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-20f30416-f297-453b-a56e-8286ecb529c7 tempest-AttachVolumeTestJSON-244989543 tempest-AttachVolumeTestJSON-244989543-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:07:52.650016 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.policy [None req-20f30416-f297-453b-a56e-8286ecb529c7 tempest-AttachVolumeTestJSON-244989543 tempest-AttachVolumeTestJSON-244989543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5fb31c3d4874e13ba22e0242d4aaa58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00e76c2a092544e1a51928f1d84879b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116156) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:07:52.657885 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: INFO nova.api.openstack.requestlog [None req-20f30416-f297-453b-a56e-8286ecb529c7 tempest-AttachVolumeTestJSON-244989543 tempest-AttachVolumeTestJSON-244989543-project] 10.222.0.18 "GET /compute/v2.1/servers/f22dfea6-4599-43e4-93d5-d99f1db3b4fb" status: 200 len: 1723 microversion: 2.1 time: 0.159196 Dec 15 03:07:52.658467 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: [pid: 116156|app: 0|req: 355/711] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 03:07:52 2021] GET /compute/v2.1/servers/f22dfea6-4599-43e4-93d5-d99f1db3b4fb => generated 1723 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 03:07:53.675987 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi [None req-866cd3c2-2db5-4026-bcc0-e319db6fa35c tempest-AttachVolumeTestJSON-244989543 tempest-AttachVolumeTestJSON-244989543-project] Calling method '>' {{(pid=116157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:07:53.676675 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.compute.api [None req-866cd3c2-2db5-4026-bcc0-e319db6fa35c tempest-AttachVolumeTestJSON-244989543 tempest-AttachVolumeTestJSON-244989543-project] [instance: f22dfea6-4599-43e4-93d5-d99f1db3b4fb] Fetching instance by UUID {{(pid=116157) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:07:53.683101 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-866cd3c2-2db5-4026-bcc0-e319db6fa35c tempest-AttachVolumeTestJSON-244989543 tempest-AttachVolumeTestJSON-244989543-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:07:53.683546 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-866cd3c2-2db5-4026-bcc0-e319db6fa35c tempest-AttachVolumeTestJSON-244989543 tempest-AttachVolumeTestJSON-244989543-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:07:53.684316 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-866cd3c2-2db5-4026-bcc0-e319db6fa35c tempest-AttachVolumeTestJSON-244989543 tempest-AttachVolumeTestJSON-244989543-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:07:53.684744 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-866cd3c2-2db5-4026-bcc0-e319db6fa35c tempest-AttachVolumeTestJSON-244989543 tempest-AttachVolumeTestJSON-244989543-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:07:53.817056 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.policy [None req-866cd3c2-2db5-4026-bcc0-e319db6fa35c tempest-AttachVolumeTestJSON-244989543 tempest-AttachVolumeTestJSON-244989543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5fb31c3d4874e13ba22e0242d4aaa58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00e76c2a092544e1a51928f1d84879b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116157) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:07:53.824873 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: INFO nova.api.openstack.requestlog [None req-866cd3c2-2db5-4026-bcc0-e319db6fa35c tempest-AttachVolumeTestJSON-244989543 tempest-AttachVolumeTestJSON-244989543-project] 10.222.0.18 "GET /compute/v2.1/servers/f22dfea6-4599-43e4-93d5-d99f1db3b4fb" status: 200 len: 1723 microversion: 2.1 time: 0.152938 Dec 15 03:07:53.825443 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: [pid: 116157|app: 0|req: 357/712] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 03:07:53 2021] GET /compute/v2.1/servers/f22dfea6-4599-43e4-93d5-d99f1db3b4fb => generated 1723 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 03:07:54.842023 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi [None req-dc1dde19-5a53-4df9-b46f-562c0082a5b2 tempest-AttachVolumeTestJSON-244989543 tempest-AttachVolumeTestJSON-244989543-project] Calling method '>' {{(pid=116156) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:07:54.842654 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.compute.api [None req-dc1dde19-5a53-4df9-b46f-562c0082a5b2 tempest-AttachVolumeTestJSON-244989543 tempest-AttachVolumeTestJSON-244989543-project] [instance: f22dfea6-4599-43e4-93d5-d99f1db3b4fb] Fetching instance by UUID {{(pid=116156) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:07:54.849546 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-dc1dde19-5a53-4df9-b46f-562c0082a5b2 tempest-AttachVolumeTestJSON-244989543 tempest-AttachVolumeTestJSON-244989543-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:07:54.850048 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-dc1dde19-5a53-4df9-b46f-562c0082a5b2 tempest-AttachVolumeTestJSON-244989543 tempest-AttachVolumeTestJSON-244989543-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:07:54.850890 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-dc1dde19-5a53-4df9-b46f-562c0082a5b2 tempest-AttachVolumeTestJSON-244989543 tempest-AttachVolumeTestJSON-244989543-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:07:54.851361 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-dc1dde19-5a53-4df9-b46f-562c0082a5b2 tempest-AttachVolumeTestJSON-244989543 tempest-AttachVolumeTestJSON-244989543-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:07:54.984459 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.policy [None req-dc1dde19-5a53-4df9-b46f-562c0082a5b2 tempest-AttachVolumeTestJSON-244989543 tempest-AttachVolumeTestJSON-244989543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5fb31c3d4874e13ba22e0242d4aaa58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00e76c2a092544e1a51928f1d84879b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116156) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:07:54.992374 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: INFO nova.api.openstack.requestlog [None req-dc1dde19-5a53-4df9-b46f-562c0082a5b2 tempest-AttachVolumeTestJSON-244989543 tempest-AttachVolumeTestJSON-244989543-project] 10.222.0.18 "GET /compute/v2.1/servers/f22dfea6-4599-43e4-93d5-d99f1db3b4fb" status: 200 len: 1723 microversion: 2.1 time: 0.154116 Dec 15 03:07:54.993185 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: [pid: 116156|app: 0|req: 356/713] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 03:07:54 2021] GET /compute/v2.1/servers/f22dfea6-4599-43e4-93d5-d99f1db3b4fb => generated 1723 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 03:07:56.009417 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi [None req-d9e66e01-c96d-4d6e-8dc2-d72ee9fe4e46 tempest-AttachVolumeTestJSON-244989543 tempest-AttachVolumeTestJSON-244989543-project] Calling method '>' {{(pid=116157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:07:56.010035 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.compute.api [None req-d9e66e01-c96d-4d6e-8dc2-d72ee9fe4e46 tempest-AttachVolumeTestJSON-244989543 tempest-AttachVolumeTestJSON-244989543-project] [instance: f22dfea6-4599-43e4-93d5-d99f1db3b4fb] Fetching instance by UUID {{(pid=116157) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:07:56.016250 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-d9e66e01-c96d-4d6e-8dc2-d72ee9fe4e46 tempest-AttachVolumeTestJSON-244989543 tempest-AttachVolumeTestJSON-244989543-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:07:56.016697 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-d9e66e01-c96d-4d6e-8dc2-d72ee9fe4e46 tempest-AttachVolumeTestJSON-244989543 tempest-AttachVolumeTestJSON-244989543-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:07:56.017467 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-d9e66e01-c96d-4d6e-8dc2-d72ee9fe4e46 tempest-AttachVolumeTestJSON-244989543 tempest-AttachVolumeTestJSON-244989543-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:07:56.017900 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-d9e66e01-c96d-4d6e-8dc2-d72ee9fe4e46 tempest-AttachVolumeTestJSON-244989543 tempest-AttachVolumeTestJSON-244989543-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:07:56.144573 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.policy [None req-d9e66e01-c96d-4d6e-8dc2-d72ee9fe4e46 tempest-AttachVolumeTestJSON-244989543 tempest-AttachVolumeTestJSON-244989543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5fb31c3d4874e13ba22e0242d4aaa58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00e76c2a092544e1a51928f1d84879b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116157) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:07:56.152205 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: INFO nova.api.openstack.requestlog [None req-d9e66e01-c96d-4d6e-8dc2-d72ee9fe4e46 tempest-AttachVolumeTestJSON-244989543 tempest-AttachVolumeTestJSON-244989543-project] 10.222.0.18 "GET /compute/v2.1/servers/f22dfea6-4599-43e4-93d5-d99f1db3b4fb" status: 200 len: 1723 microversion: 2.1 time: 0.146458 Dec 15 03:07:56.152762 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: [pid: 116157|app: 0|req: 358/714] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 03:07:56 2021] GET /compute/v2.1/servers/f22dfea6-4599-43e4-93d5-d99f1db3b4fb => generated 1723 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 03:07:57.169491 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi [None req-4922aca3-c0d5-4cdf-b3dc-d18e262544da tempest-AttachVolumeTestJSON-244989543 tempest-AttachVolumeTestJSON-244989543-project] Calling method '>' {{(pid=116156) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:07:57.170126 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.compute.api [None req-4922aca3-c0d5-4cdf-b3dc-d18e262544da tempest-AttachVolumeTestJSON-244989543 tempest-AttachVolumeTestJSON-244989543-project] [instance: f22dfea6-4599-43e4-93d5-d99f1db3b4fb] Fetching instance by UUID {{(pid=116156) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:07:57.176289 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-4922aca3-c0d5-4cdf-b3dc-d18e262544da tempest-AttachVolumeTestJSON-244989543 tempest-AttachVolumeTestJSON-244989543-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:07:57.176743 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-4922aca3-c0d5-4cdf-b3dc-d18e262544da tempest-AttachVolumeTestJSON-244989543 tempest-AttachVolumeTestJSON-244989543-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:07:57.177523 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-4922aca3-c0d5-4cdf-b3dc-d18e262544da tempest-AttachVolumeTestJSON-244989543 tempest-AttachVolumeTestJSON-244989543-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:07:57.177957 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-4922aca3-c0d5-4cdf-b3dc-d18e262544da tempest-AttachVolumeTestJSON-244989543 tempest-AttachVolumeTestJSON-244989543-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:07:57.305327 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.policy [None req-4922aca3-c0d5-4cdf-b3dc-d18e262544da tempest-AttachVolumeTestJSON-244989543 tempest-AttachVolumeTestJSON-244989543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5fb31c3d4874e13ba22e0242d4aaa58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00e76c2a092544e1a51928f1d84879b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116156) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:07:57.313021 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: INFO nova.api.openstack.requestlog [None req-4922aca3-c0d5-4cdf-b3dc-d18e262544da tempest-AttachVolumeTestJSON-244989543 tempest-AttachVolumeTestJSON-244989543-project] 10.222.0.18 "GET /compute/v2.1/servers/f22dfea6-4599-43e4-93d5-d99f1db3b4fb" status: 200 len: 1723 microversion: 2.1 time: 0.147113 Dec 15 03:07:57.313578 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: [pid: 116156|app: 0|req: 357/715] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 03:07:57 2021] GET /compute/v2.1/servers/f22dfea6-4599-43e4-93d5-d99f1db3b4fb => generated 1723 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 03:07:58.330715 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi [None req-3968def2-7885-4ccc-8019-c644d7f9d25e tempest-AttachVolumeTestJSON-244989543 tempest-AttachVolumeTestJSON-244989543-project] Calling method '>' {{(pid=116157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:07:58.331323 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.compute.api [None req-3968def2-7885-4ccc-8019-c644d7f9d25e tempest-AttachVolumeTestJSON-244989543 tempest-AttachVolumeTestJSON-244989543-project] [instance: f22dfea6-4599-43e4-93d5-d99f1db3b4fb] Fetching instance by UUID {{(pid=116157) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:07:58.337499 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-3968def2-7885-4ccc-8019-c644d7f9d25e tempest-AttachVolumeTestJSON-244989543 tempest-AttachVolumeTestJSON-244989543-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:07:58.337957 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-3968def2-7885-4ccc-8019-c644d7f9d25e tempest-AttachVolumeTestJSON-244989543 tempest-AttachVolumeTestJSON-244989543-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:07:58.338777 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-3968def2-7885-4ccc-8019-c644d7f9d25e tempest-AttachVolumeTestJSON-244989543 tempest-AttachVolumeTestJSON-244989543-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:07:58.339213 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-3968def2-7885-4ccc-8019-c644d7f9d25e tempest-AttachVolumeTestJSON-244989543 tempest-AttachVolumeTestJSON-244989543-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:07:58.466981 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.policy [None req-3968def2-7885-4ccc-8019-c644d7f9d25e tempest-AttachVolumeTestJSON-244989543 tempest-AttachVolumeTestJSON-244989543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5fb31c3d4874e13ba22e0242d4aaa58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00e76c2a092544e1a51928f1d84879b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116157) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:07:58.475160 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: INFO nova.api.openstack.requestlog [None req-3968def2-7885-4ccc-8019-c644d7f9d25e tempest-AttachVolumeTestJSON-244989543 tempest-AttachVolumeTestJSON-244989543-project] 10.222.0.18 "GET /compute/v2.1/servers/f22dfea6-4599-43e4-93d5-d99f1db3b4fb" status: 200 len: 1723 microversion: 2.1 time: 0.148062 Dec 15 03:07:58.475875 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: [pid: 116157|app: 0|req: 359/716] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 03:07:58 2021] GET /compute/v2.1/servers/f22dfea6-4599-43e4-93d5-d99f1db3b4fb => generated 1723 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 03:07:59.492086 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi [None req-1aa5fd0b-3155-423e-ba3b-4e5460e220e8 tempest-AttachVolumeTestJSON-244989543 tempest-AttachVolumeTestJSON-244989543-project] Calling method '>' {{(pid=116156) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:07:59.492623 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.compute.api [None req-1aa5fd0b-3155-423e-ba3b-4e5460e220e8 tempest-AttachVolumeTestJSON-244989543 tempest-AttachVolumeTestJSON-244989543-project] [instance: f22dfea6-4599-43e4-93d5-d99f1db3b4fb] Fetching instance by UUID {{(pid=116156) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:07:59.499386 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-1aa5fd0b-3155-423e-ba3b-4e5460e220e8 tempest-AttachVolumeTestJSON-244989543 tempest-AttachVolumeTestJSON-244989543-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:07:59.499829 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-1aa5fd0b-3155-423e-ba3b-4e5460e220e8 tempest-AttachVolumeTestJSON-244989543 tempest-AttachVolumeTestJSON-244989543-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:07:59.500616 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-1aa5fd0b-3155-423e-ba3b-4e5460e220e8 tempest-AttachVolumeTestJSON-244989543 tempest-AttachVolumeTestJSON-244989543-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:07:59.501054 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-1aa5fd0b-3155-423e-ba3b-4e5460e220e8 tempest-AttachVolumeTestJSON-244989543 tempest-AttachVolumeTestJSON-244989543-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:07:59.631756 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.policy [None req-1aa5fd0b-3155-423e-ba3b-4e5460e220e8 tempest-AttachVolumeTestJSON-244989543 tempest-AttachVolumeTestJSON-244989543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5fb31c3d4874e13ba22e0242d4aaa58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00e76c2a092544e1a51928f1d84879b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116156) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:07:59.639442 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: INFO nova.api.openstack.requestlog [None req-1aa5fd0b-3155-423e-ba3b-4e5460e220e8 tempest-AttachVolumeTestJSON-244989543 tempest-AttachVolumeTestJSON-244989543-project] 10.222.0.18 "GET /compute/v2.1/servers/f22dfea6-4599-43e4-93d5-d99f1db3b4fb" status: 200 len: 1723 microversion: 2.1 time: 0.151102 Dec 15 03:07:59.640007 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: [pid: 116156|app: 0|req: 358/717] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 03:07:59 2021] GET /compute/v2.1/servers/f22dfea6-4599-43e4-93d5-d99f1db3b4fb => generated 1723 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 03:08:00.656451 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi [None req-ccee863d-eb89-424c-af6c-a467a5eb8bad tempest-AttachVolumeTestJSON-244989543 tempest-AttachVolumeTestJSON-244989543-project] Calling method '>' {{(pid=116157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:08:00.657056 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.compute.api [None req-ccee863d-eb89-424c-af6c-a467a5eb8bad tempest-AttachVolumeTestJSON-244989543 tempest-AttachVolumeTestJSON-244989543-project] [instance: f22dfea6-4599-43e4-93d5-d99f1db3b4fb] Fetching instance by UUID {{(pid=116157) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:08:00.663908 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-ccee863d-eb89-424c-af6c-a467a5eb8bad tempest-AttachVolumeTestJSON-244989543 tempest-AttachVolumeTestJSON-244989543-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:08:00.664352 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-ccee863d-eb89-424c-af6c-a467a5eb8bad tempest-AttachVolumeTestJSON-244989543 tempest-AttachVolumeTestJSON-244989543-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:08:00.665121 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-ccee863d-eb89-424c-af6c-a467a5eb8bad tempest-AttachVolumeTestJSON-244989543 tempest-AttachVolumeTestJSON-244989543-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:08:00.665549 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-ccee863d-eb89-424c-af6c-a467a5eb8bad tempest-AttachVolumeTestJSON-244989543 tempest-AttachVolumeTestJSON-244989543-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:08:00.794697 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.policy [None req-ccee863d-eb89-424c-af6c-a467a5eb8bad tempest-AttachVolumeTestJSON-244989543 tempest-AttachVolumeTestJSON-244989543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5fb31c3d4874e13ba22e0242d4aaa58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00e76c2a092544e1a51928f1d84879b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116157) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:08:00.802231 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: INFO nova.api.openstack.requestlog [None req-ccee863d-eb89-424c-af6c-a467a5eb8bad tempest-AttachVolumeTestJSON-244989543 tempest-AttachVolumeTestJSON-244989543-project] 10.222.0.18 "GET /compute/v2.1/servers/f22dfea6-4599-43e4-93d5-d99f1db3b4fb" status: 200 len: 1723 microversion: 2.1 time: 0.149589 Dec 15 03:08:00.802791 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: [pid: 116157|app: 0|req: 360/718] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 03:08:00 2021] GET /compute/v2.1/servers/f22dfea6-4599-43e4-93d5-d99f1db3b4fb => generated 1723 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 03:08:01.633428 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi [None req-5348f5f7-1c33-4b53-935c-5e03aaf7fe48 tempest-VolumesSnapshotTestJSON-925980516 tempest-VolumesSnapshotTestJSON-925980516-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "d681224a-3344-47c8-8df0-0379a5a8f296", "device": "/dev/sdb"}} {{(pid=116156) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 03:08:01.635060 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.compute.api [None req-5348f5f7-1c33-4b53-935c-5e03aaf7fe48 tempest-VolumesSnapshotTestJSON-925980516 tempest-VolumesSnapshotTestJSON-925980516-project] [instance: a0097d88-6613-416a-9f4d-1bb285e53291] Fetching instance by UUID {{(pid=116156) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:08:01.641236 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-5348f5f7-1c33-4b53-935c-5e03aaf7fe48 tempest-VolumesSnapshotTestJSON-925980516 tempest-VolumesSnapshotTestJSON-925980516-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:08:01.641689 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-5348f5f7-1c33-4b53-935c-5e03aaf7fe48 tempest-VolumesSnapshotTestJSON-925980516 tempest-VolumesSnapshotTestJSON-925980516-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:08:01.642527 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-5348f5f7-1c33-4b53-935c-5e03aaf7fe48 tempest-VolumesSnapshotTestJSON-925980516 tempest-VolumesSnapshotTestJSON-925980516-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:08:01.642955 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-5348f5f7-1c33-4b53-935c-5e03aaf7fe48 tempest-VolumesSnapshotTestJSON-925980516 tempest-VolumesSnapshotTestJSON-925980516-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:08:01.820467 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi [None req-2d77f352-2bf8-4e1f-9ac5-947ee2e8ff3e tempest-AttachVolumeTestJSON-244989543 tempest-AttachVolumeTestJSON-244989543-project] Calling method '>' {{(pid=116157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:08:01.821188 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.compute.api [None req-2d77f352-2bf8-4e1f-9ac5-947ee2e8ff3e tempest-AttachVolumeTestJSON-244989543 tempest-AttachVolumeTestJSON-244989543-project] [instance: f22dfea6-4599-43e4-93d5-d99f1db3b4fb] Fetching instance by UUID {{(pid=116157) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:08:01.827671 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-2d77f352-2bf8-4e1f-9ac5-947ee2e8ff3e tempest-AttachVolumeTestJSON-244989543 tempest-AttachVolumeTestJSON-244989543-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:08:01.828125 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-2d77f352-2bf8-4e1f-9ac5-947ee2e8ff3e tempest-AttachVolumeTestJSON-244989543 tempest-AttachVolumeTestJSON-244989543-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:08:01.829161 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-2d77f352-2bf8-4e1f-9ac5-947ee2e8ff3e tempest-AttachVolumeTestJSON-244989543 tempest-AttachVolumeTestJSON-244989543-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:08:01.829732 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-2d77f352-2bf8-4e1f-9ac5-947ee2e8ff3e tempest-AttachVolumeTestJSON-244989543 tempest-AttachVolumeTestJSON-244989543-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:08:01.877238 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: INFO nova.api.openstack.requestlog [None req-5348f5f7-1c33-4b53-935c-5e03aaf7fe48 tempest-VolumesSnapshotTestJSON-925980516 tempest-VolumesSnapshotTestJSON-925980516-project] 10.222.0.18 "POST /compute/v2.1/servers/a0097d88-6613-416a-9f4d-1bb285e53291/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.247136 Dec 15 03:08:01.877844 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: [pid: 116156|app: 0|req: 359/719] 10.222.0.18 () {60 vars in 1322 bytes} [Wed Dec 15 03:08:01 2021] POST /compute/v2.1/servers/a0097d88-6613-416a-9f4d-1bb285e53291/os-volume_attachments => generated 194 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 03:08:01.965393 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.policy [None req-2d77f352-2bf8-4e1f-9ac5-947ee2e8ff3e tempest-AttachVolumeTestJSON-244989543 tempest-AttachVolumeTestJSON-244989543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5fb31c3d4874e13ba22e0242d4aaa58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00e76c2a092544e1a51928f1d84879b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116157) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:08:01.973678 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: INFO nova.api.openstack.requestlog [None req-2d77f352-2bf8-4e1f-9ac5-947ee2e8ff3e tempest-AttachVolumeTestJSON-244989543 tempest-AttachVolumeTestJSON-244989543-project] 10.222.0.18 "GET /compute/v2.1/servers/f22dfea6-4599-43e4-93d5-d99f1db3b4fb" status: 200 len: 1723 microversion: 2.1 time: 0.158298 Dec 15 03:08:01.974272 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: [pid: 116157|app: 0|req: 361/720] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 03:08:01 2021] GET /compute/v2.1/servers/f22dfea6-4599-43e4-93d5-d99f1db3b4fb => generated 1723 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 03:08:02.990731 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi [None req-dfe966ee-1bbe-47ba-ab45-21073a89c15d tempest-AttachVolumeTestJSON-244989543 tempest-AttachVolumeTestJSON-244989543-project] Calling method '>' {{(pid=116156) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:08:02.991443 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.compute.api [None req-dfe966ee-1bbe-47ba-ab45-21073a89c15d tempest-AttachVolumeTestJSON-244989543 tempest-AttachVolumeTestJSON-244989543-project] [instance: f22dfea6-4599-43e4-93d5-d99f1db3b4fb] Fetching instance by UUID {{(pid=116156) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:08:02.998195 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-dfe966ee-1bbe-47ba-ab45-21073a89c15d tempest-AttachVolumeTestJSON-244989543 tempest-AttachVolumeTestJSON-244989543-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:08:02.998651 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-dfe966ee-1bbe-47ba-ab45-21073a89c15d tempest-AttachVolumeTestJSON-244989543 tempest-AttachVolumeTestJSON-244989543-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:08:02.999439 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-dfe966ee-1bbe-47ba-ab45-21073a89c15d tempest-AttachVolumeTestJSON-244989543 tempest-AttachVolumeTestJSON-244989543-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:08:02.999882 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-dfe966ee-1bbe-47ba-ab45-21073a89c15d tempest-AttachVolumeTestJSON-244989543 tempest-AttachVolumeTestJSON-244989543-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:08:03.133467 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.policy [None req-dfe966ee-1bbe-47ba-ab45-21073a89c15d tempest-AttachVolumeTestJSON-244989543 tempest-AttachVolumeTestJSON-244989543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5fb31c3d4874e13ba22e0242d4aaa58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00e76c2a092544e1a51928f1d84879b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116156) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:08:03.141306 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: INFO nova.api.openstack.requestlog [None req-dfe966ee-1bbe-47ba-ab45-21073a89c15d tempest-AttachVolumeTestJSON-244989543 tempest-AttachVolumeTestJSON-244989543-project] 10.222.0.18 "GET /compute/v2.1/servers/f22dfea6-4599-43e4-93d5-d99f1db3b4fb" status: 200 len: 1723 microversion: 2.1 time: 0.155115 Dec 15 03:08:03.141883 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: [pid: 116156|app: 0|req: 360/721] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 03:08:02 2021] GET /compute/v2.1/servers/f22dfea6-4599-43e4-93d5-d99f1db3b4fb => generated 1723 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 03:08:04.157080 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi [None req-fa66ae2b-2e70-4ced-9f7a-2465278f212e tempest-AttachVolumeTestJSON-244989543 tempest-AttachVolumeTestJSON-244989543-project] Calling method '>' {{(pid=116157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:08:04.157726 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.compute.api [None req-fa66ae2b-2e70-4ced-9f7a-2465278f212e tempest-AttachVolumeTestJSON-244989543 tempest-AttachVolumeTestJSON-244989543-project] [instance: f22dfea6-4599-43e4-93d5-d99f1db3b4fb] Fetching instance by UUID {{(pid=116157) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:08:04.164489 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-fa66ae2b-2e70-4ced-9f7a-2465278f212e tempest-AttachVolumeTestJSON-244989543 tempest-AttachVolumeTestJSON-244989543-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:08:04.164946 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-fa66ae2b-2e70-4ced-9f7a-2465278f212e tempest-AttachVolumeTestJSON-244989543 tempest-AttachVolumeTestJSON-244989543-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:08:04.165729 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-fa66ae2b-2e70-4ced-9f7a-2465278f212e tempest-AttachVolumeTestJSON-244989543 tempest-AttachVolumeTestJSON-244989543-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:08:04.166205 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-fa66ae2b-2e70-4ced-9f7a-2465278f212e tempest-AttachVolumeTestJSON-244989543 tempest-AttachVolumeTestJSON-244989543-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:08:04.295179 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.policy [None req-fa66ae2b-2e70-4ced-9f7a-2465278f212e tempest-AttachVolumeTestJSON-244989543 tempest-AttachVolumeTestJSON-244989543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5fb31c3d4874e13ba22e0242d4aaa58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00e76c2a092544e1a51928f1d84879b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116157) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:08:04.303473 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: INFO nova.api.openstack.requestlog [None req-fa66ae2b-2e70-4ced-9f7a-2465278f212e tempest-AttachVolumeTestJSON-244989543 tempest-AttachVolumeTestJSON-244989543-project] 10.222.0.18 "GET /compute/v2.1/servers/f22dfea6-4599-43e4-93d5-d99f1db3b4fb" status: 200 len: 1723 microversion: 2.1 time: 0.149975 Dec 15 03:08:04.304034 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: [pid: 116157|app: 0|req: 362/722] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 03:08:04 2021] GET /compute/v2.1/servers/f22dfea6-4599-43e4-93d5-d99f1db3b4fb => generated 1723 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 03:08:05.320463 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi [None req-7985336d-4d86-4a29-9316-7a7f817cbee2 tempest-AttachVolumeTestJSON-244989543 tempest-AttachVolumeTestJSON-244989543-project] Calling method '>' {{(pid=116156) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:08:05.321800 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.compute.api [None req-7985336d-4d86-4a29-9316-7a7f817cbee2 tempest-AttachVolumeTestJSON-244989543 tempest-AttachVolumeTestJSON-244989543-project] [instance: f22dfea6-4599-43e4-93d5-d99f1db3b4fb] Fetching instance by UUID {{(pid=116156) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:08:05.328273 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-7985336d-4d86-4a29-9316-7a7f817cbee2 tempest-AttachVolumeTestJSON-244989543 tempest-AttachVolumeTestJSON-244989543-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:08:05.328753 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-7985336d-4d86-4a29-9316-7a7f817cbee2 tempest-AttachVolumeTestJSON-244989543 tempest-AttachVolumeTestJSON-244989543-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:08:05.329575 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-7985336d-4d86-4a29-9316-7a7f817cbee2 tempest-AttachVolumeTestJSON-244989543 tempest-AttachVolumeTestJSON-244989543-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:08:05.330054 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-7985336d-4d86-4a29-9316-7a7f817cbee2 tempest-AttachVolumeTestJSON-244989543 tempest-AttachVolumeTestJSON-244989543-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:08:05.460495 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.policy [None req-7985336d-4d86-4a29-9316-7a7f817cbee2 tempest-AttachVolumeTestJSON-244989543 tempest-AttachVolumeTestJSON-244989543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5fb31c3d4874e13ba22e0242d4aaa58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00e76c2a092544e1a51928f1d84879b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116156) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:08:05.468288 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: INFO nova.api.openstack.requestlog [None req-7985336d-4d86-4a29-9316-7a7f817cbee2 tempest-AttachVolumeTestJSON-244989543 tempest-AttachVolumeTestJSON-244989543-project] 10.222.0.18 "GET /compute/v2.1/servers/f22dfea6-4599-43e4-93d5-d99f1db3b4fb" status: 200 len: 1723 microversion: 2.1 time: 0.151497 Dec 15 03:08:05.474770 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: [pid: 116156|app: 0|req: 361/723] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 03:08:05 2021] GET /compute/v2.1/servers/f22dfea6-4599-43e4-93d5-d99f1db3b4fb => generated 1723 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 03:08:06.485894 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi [None req-819b1b90-3d71-4cfc-ab70-f3862c2c7f84 tempest-AttachVolumeTestJSON-244989543 tempest-AttachVolumeTestJSON-244989543-project] Calling method '>' {{(pid=116157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:08:06.486556 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.compute.api [None req-819b1b90-3d71-4cfc-ab70-f3862c2c7f84 tempest-AttachVolumeTestJSON-244989543 tempest-AttachVolumeTestJSON-244989543-project] [instance: f22dfea6-4599-43e4-93d5-d99f1db3b4fb] Fetching instance by UUID {{(pid=116157) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:08:06.493482 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-819b1b90-3d71-4cfc-ab70-f3862c2c7f84 tempest-AttachVolumeTestJSON-244989543 tempest-AttachVolumeTestJSON-244989543-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:08:06.493941 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-819b1b90-3d71-4cfc-ab70-f3862c2c7f84 tempest-AttachVolumeTestJSON-244989543 tempest-AttachVolumeTestJSON-244989543-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:08:06.494749 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-819b1b90-3d71-4cfc-ab70-f3862c2c7f84 tempest-AttachVolumeTestJSON-244989543 tempest-AttachVolumeTestJSON-244989543-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:08:06.495192 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-819b1b90-3d71-4cfc-ab70-f3862c2c7f84 tempest-AttachVolumeTestJSON-244989543 tempest-AttachVolumeTestJSON-244989543-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:08:06.621011 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.policy [None req-819b1b90-3d71-4cfc-ab70-f3862c2c7f84 tempest-AttachVolumeTestJSON-244989543 tempest-AttachVolumeTestJSON-244989543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5fb31c3d4874e13ba22e0242d4aaa58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00e76c2a092544e1a51928f1d84879b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116157) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:08:06.628615 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: INFO nova.api.openstack.requestlog [None req-819b1b90-3d71-4cfc-ab70-f3862c2c7f84 tempest-AttachVolumeTestJSON-244989543 tempest-AttachVolumeTestJSON-244989543-project] 10.222.0.18 "GET /compute/v2.1/servers/f22dfea6-4599-43e4-93d5-d99f1db3b4fb" status: 200 len: 1723 microversion: 2.1 time: 0.146425 Dec 15 03:08:06.629187 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: [pid: 116157|app: 0|req: 363/724] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 03:08:06 2021] GET /compute/v2.1/servers/f22dfea6-4599-43e4-93d5-d99f1db3b4fb => generated 1723 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 03:08:07.646399 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi [None req-edff0ec0-3aff-4893-9070-d5498372c3ec tempest-AttachVolumeTestJSON-244989543 tempest-AttachVolumeTestJSON-244989543-project] Calling method '>' {{(pid=116156) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:08:07.647014 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.compute.api [None req-edff0ec0-3aff-4893-9070-d5498372c3ec tempest-AttachVolumeTestJSON-244989543 tempest-AttachVolumeTestJSON-244989543-project] [instance: f22dfea6-4599-43e4-93d5-d99f1db3b4fb] Fetching instance by UUID {{(pid=116156) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:08:07.653251 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-edff0ec0-3aff-4893-9070-d5498372c3ec tempest-AttachVolumeTestJSON-244989543 tempest-AttachVolumeTestJSON-244989543-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:08:07.653709 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-edff0ec0-3aff-4893-9070-d5498372c3ec tempest-AttachVolumeTestJSON-244989543 tempest-AttachVolumeTestJSON-244989543-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:08:07.654525 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-edff0ec0-3aff-4893-9070-d5498372c3ec tempest-AttachVolumeTestJSON-244989543 tempest-AttachVolumeTestJSON-244989543-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:08:07.654969 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-edff0ec0-3aff-4893-9070-d5498372c3ec tempest-AttachVolumeTestJSON-244989543 tempest-AttachVolumeTestJSON-244989543-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:08:07.887291 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.policy [None req-edff0ec0-3aff-4893-9070-d5498372c3ec tempest-AttachVolumeTestJSON-244989543 tempest-AttachVolumeTestJSON-244989543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5fb31c3d4874e13ba22e0242d4aaa58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00e76c2a092544e1a51928f1d84879b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116156) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:08:07.895589 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: INFO nova.api.openstack.requestlog [None req-edff0ec0-3aff-4893-9070-d5498372c3ec tempest-AttachVolumeTestJSON-244989543 tempest-AttachVolumeTestJSON-244989543-project] 10.222.0.18 "GET /compute/v2.1/servers/f22dfea6-4599-43e4-93d5-d99f1db3b4fb" status: 200 len: 1723 microversion: 2.1 time: 0.253340 Dec 15 03:08:07.896154 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: [pid: 116156|app: 0|req: 362/725] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 03:08:07 2021] GET /compute/v2.1/servers/f22dfea6-4599-43e4-93d5-d99f1db3b4fb => generated 1723 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 03:08:08.912981 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi [None req-88478d3a-44c7-497f-ae6a-481d38eeb861 tempest-AttachVolumeTestJSON-244989543 tempest-AttachVolumeTestJSON-244989543-project] Calling method '>' {{(pid=116157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:08:08.913543 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.compute.api [None req-88478d3a-44c7-497f-ae6a-481d38eeb861 tempest-AttachVolumeTestJSON-244989543 tempest-AttachVolumeTestJSON-244989543-project] [instance: f22dfea6-4599-43e4-93d5-d99f1db3b4fb] Fetching instance by UUID {{(pid=116157) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:08:08.919674 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-88478d3a-44c7-497f-ae6a-481d38eeb861 tempest-AttachVolumeTestJSON-244989543 tempest-AttachVolumeTestJSON-244989543-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:08:08.920119 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-88478d3a-44c7-497f-ae6a-481d38eeb861 tempest-AttachVolumeTestJSON-244989543 tempest-AttachVolumeTestJSON-244989543-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:08:08.920888 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-88478d3a-44c7-497f-ae6a-481d38eeb861 tempest-AttachVolumeTestJSON-244989543 tempest-AttachVolumeTestJSON-244989543-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:08:08.921317 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-88478d3a-44c7-497f-ae6a-481d38eeb861 tempest-AttachVolumeTestJSON-244989543 tempest-AttachVolumeTestJSON-244989543-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:08:09.098016 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.policy [None req-88478d3a-44c7-497f-ae6a-481d38eeb861 tempest-AttachVolumeTestJSON-244989543 tempest-AttachVolumeTestJSON-244989543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5fb31c3d4874e13ba22e0242d4aaa58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00e76c2a092544e1a51928f1d84879b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116157) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:08:09.106198 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: INFO nova.api.openstack.requestlog [None req-88478d3a-44c7-497f-ae6a-481d38eeb861 tempest-AttachVolumeTestJSON-244989543 tempest-AttachVolumeTestJSON-244989543-project] 10.222.0.18 "GET /compute/v2.1/servers/f22dfea6-4599-43e4-93d5-d99f1db3b4fb" status: 200 len: 1700 microversion: 2.1 time: 0.197553 Dec 15 03:08:09.106753 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: [pid: 116157|app: 0|req: 364/726] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 03:08:08 2021] GET /compute/v2.1/servers/f22dfea6-4599-43e4-93d5-d99f1db3b4fb => generated 1700 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 03:08:09.124038 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi [None req-ef37b0bb-36f0-49b5-87fa-dfe8887331f1 tempest-AttachVolumeTestJSON-244989543 tempest-AttachVolumeTestJSON-244989543-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=116156) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 03:08:09.133124 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-ef37b0bb-36f0-49b5-87fa-dfe8887331f1 tempest-AttachVolumeTestJSON-244989543 tempest-AttachVolumeTestJSON-244989543-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:08:09.133581 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-ef37b0bb-36f0-49b5-87fa-dfe8887331f1 tempest-AttachVolumeTestJSON-244989543 tempest-AttachVolumeTestJSON-244989543-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:08:09.197375 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.compute.api [None req-ef37b0bb-36f0-49b5-87fa-dfe8887331f1 tempest-AttachVolumeTestJSON-244989543 tempest-AttachVolumeTestJSON-244989543-project] [instance: f22dfea6-4599-43e4-93d5-d99f1db3b4fb] Going to try to start instance {{(pid=116156) start /opt/stack/nova/nova/compute/api.py:2677}} Dec 15 03:08:09.237571 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: INFO nova.api.openstack.requestlog [None req-ef37b0bb-36f0-49b5-87fa-dfe8887331f1 tempest-AttachVolumeTestJSON-244989543 tempest-AttachVolumeTestJSON-244989543-project] 10.222.0.18 "POST /compute/v2.1/servers/f22dfea6-4599-43e4-93d5-d99f1db3b4fb/action" status: 202 len: 0 microversion: 2.1 time: 0.118571 Dec 15 03:08:09.238210 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: [pid: 116156|app: 0|req: 363/727] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Dec 15 03:08:09 2021] POST /compute/v2.1/servers/f22dfea6-4599-43e4-93d5-d99f1db3b4fb/action => generated 0 bytes in 120 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Dec 15 03:08:09.246341 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi [None req-10cddbeb-42ee-4d1e-96b2-a14e52aaeee8 tempest-AttachVolumeTestJSON-244989543 tempest-AttachVolumeTestJSON-244989543-project] Calling method '>' {{(pid=116157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:08:09.246960 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.compute.api [None req-10cddbeb-42ee-4d1e-96b2-a14e52aaeee8 tempest-AttachVolumeTestJSON-244989543 tempest-AttachVolumeTestJSON-244989543-project] [instance: f22dfea6-4599-43e4-93d5-d99f1db3b4fb] Fetching instance by UUID {{(pid=116157) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:08:09.253084 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-10cddbeb-42ee-4d1e-96b2-a14e52aaeee8 tempest-AttachVolumeTestJSON-244989543 tempest-AttachVolumeTestJSON-244989543-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:08:09.253625 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-10cddbeb-42ee-4d1e-96b2-a14e52aaeee8 tempest-AttachVolumeTestJSON-244989543 tempest-AttachVolumeTestJSON-244989543-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:08:09.254497 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-10cddbeb-42ee-4d1e-96b2-a14e52aaeee8 tempest-AttachVolumeTestJSON-244989543 tempest-AttachVolumeTestJSON-244989543-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:08:09.255651 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-10cddbeb-42ee-4d1e-96b2-a14e52aaeee8 tempest-AttachVolumeTestJSON-244989543 tempest-AttachVolumeTestJSON-244989543-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:08:09.388406 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.policy [None req-10cddbeb-42ee-4d1e-96b2-a14e52aaeee8 tempest-AttachVolumeTestJSON-244989543 tempest-AttachVolumeTestJSON-244989543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5fb31c3d4874e13ba22e0242d4aaa58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00e76c2a092544e1a51928f1d84879b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116157) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:08:09.396813 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: INFO nova.api.openstack.requestlog [None req-10cddbeb-42ee-4d1e-96b2-a14e52aaeee8 tempest-AttachVolumeTestJSON-244989543 tempest-AttachVolumeTestJSON-244989543-project] 10.222.0.18 "GET /compute/v2.1/servers/f22dfea6-4599-43e4-93d5-d99f1db3b4fb" status: 200 len: 1709 microversion: 2.1 time: 0.154550 Dec 15 03:08:09.407253 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: [pid: 116157|app: 0|req: 365/728] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 03:08:09 2021] GET /compute/v2.1/servers/f22dfea6-4599-43e4-93d5-d99f1db3b4fb => generated 1709 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 03:08:10.415600 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi [None req-117a1bed-cdfe-4a41-b264-7a3c4cf7c17c tempest-AttachVolumeTestJSON-244989543 tempest-AttachVolumeTestJSON-244989543-project] Calling method '>' {{(pid=116156) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:08:10.416305 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.compute.api [None req-117a1bed-cdfe-4a41-b264-7a3c4cf7c17c tempest-AttachVolumeTestJSON-244989543 tempest-AttachVolumeTestJSON-244989543-project] [instance: f22dfea6-4599-43e4-93d5-d99f1db3b4fb] Fetching instance by UUID {{(pid=116156) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:08:10.422673 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-117a1bed-cdfe-4a41-b264-7a3c4cf7c17c tempest-AttachVolumeTestJSON-244989543 tempest-AttachVolumeTestJSON-244989543-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:08:10.423134 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-117a1bed-cdfe-4a41-b264-7a3c4cf7c17c tempest-AttachVolumeTestJSON-244989543 tempest-AttachVolumeTestJSON-244989543-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:08:10.423947 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-117a1bed-cdfe-4a41-b264-7a3c4cf7c17c tempest-AttachVolumeTestJSON-244989543 tempest-AttachVolumeTestJSON-244989543-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:08:10.424376 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-117a1bed-cdfe-4a41-b264-7a3c4cf7c17c tempest-AttachVolumeTestJSON-244989543 tempest-AttachVolumeTestJSON-244989543-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:08:10.553935 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.policy [None req-117a1bed-cdfe-4a41-b264-7a3c4cf7c17c tempest-AttachVolumeTestJSON-244989543 tempest-AttachVolumeTestJSON-244989543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5fb31c3d4874e13ba22e0242d4aaa58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00e76c2a092544e1a51928f1d84879b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116156) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:08:10.561821 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: INFO nova.api.openstack.requestlog [None req-117a1bed-cdfe-4a41-b264-7a3c4cf7c17c tempest-AttachVolumeTestJSON-244989543 tempest-AttachVolumeTestJSON-244989543-project] 10.222.0.18 "GET /compute/v2.1/servers/f22dfea6-4599-43e4-93d5-d99f1db3b4fb" status: 200 len: 1709 microversion: 2.1 time: 0.150805 Dec 15 03:08:10.562417 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: [pid: 116156|app: 0|req: 364/729] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 03:08:10 2021] GET /compute/v2.1/servers/f22dfea6-4599-43e4-93d5-d99f1db3b4fb => generated 1709 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 03:08:11.578596 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi [None req-f90ea99f-3865-4529-8c8d-478853c1e699 tempest-AttachVolumeTestJSON-244989543 tempest-AttachVolumeTestJSON-244989543-project] Calling method '>' {{(pid=116157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:08:11.579201 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.compute.api [None req-f90ea99f-3865-4529-8c8d-478853c1e699 tempest-AttachVolumeTestJSON-244989543 tempest-AttachVolumeTestJSON-244989543-project] [instance: f22dfea6-4599-43e4-93d5-d99f1db3b4fb] Fetching instance by UUID {{(pid=116157) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:08:11.585326 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-f90ea99f-3865-4529-8c8d-478853c1e699 tempest-AttachVolumeTestJSON-244989543 tempest-AttachVolumeTestJSON-244989543-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:08:11.585773 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-f90ea99f-3865-4529-8c8d-478853c1e699 tempest-AttachVolumeTestJSON-244989543 tempest-AttachVolumeTestJSON-244989543-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:08:11.586586 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-f90ea99f-3865-4529-8c8d-478853c1e699 tempest-AttachVolumeTestJSON-244989543 tempest-AttachVolumeTestJSON-244989543-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:08:11.587020 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-f90ea99f-3865-4529-8c8d-478853c1e699 tempest-AttachVolumeTestJSON-244989543 tempest-AttachVolumeTestJSON-244989543-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:08:11.711645 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.policy [None req-f90ea99f-3865-4529-8c8d-478853c1e699 tempest-AttachVolumeTestJSON-244989543 tempest-AttachVolumeTestJSON-244989543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5fb31c3d4874e13ba22e0242d4aaa58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00e76c2a092544e1a51928f1d84879b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116157) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:08:11.719201 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: INFO nova.api.openstack.requestlog [None req-f90ea99f-3865-4529-8c8d-478853c1e699 tempest-AttachVolumeTestJSON-244989543 tempest-AttachVolumeTestJSON-244989543-project] 10.222.0.18 "GET /compute/v2.1/servers/f22dfea6-4599-43e4-93d5-d99f1db3b4fb" status: 200 len: 1709 microversion: 2.1 time: 0.144164 Dec 15 03:08:11.719755 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: [pid: 116157|app: 0|req: 366/730] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 03:08:11 2021] GET /compute/v2.1/servers/f22dfea6-4599-43e4-93d5-d99f1db3b4fb => generated 1709 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 03:08:12.736385 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi [None req-ed4a5c09-bd3e-423b-88de-41f77f481a72 tempest-AttachVolumeTestJSON-244989543 tempest-AttachVolumeTestJSON-244989543-project] Calling method '>' {{(pid=116156) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:08:12.736983 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.compute.api [None req-ed4a5c09-bd3e-423b-88de-41f77f481a72 tempest-AttachVolumeTestJSON-244989543 tempest-AttachVolumeTestJSON-244989543-project] [instance: f22dfea6-4599-43e4-93d5-d99f1db3b4fb] Fetching instance by UUID {{(pid=116156) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:08:12.744074 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-ed4a5c09-bd3e-423b-88de-41f77f481a72 tempest-AttachVolumeTestJSON-244989543 tempest-AttachVolumeTestJSON-244989543-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:08:12.744520 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-ed4a5c09-bd3e-423b-88de-41f77f481a72 tempest-AttachVolumeTestJSON-244989543 tempest-AttachVolumeTestJSON-244989543-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:08:12.745294 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-ed4a5c09-bd3e-423b-88de-41f77f481a72 tempest-AttachVolumeTestJSON-244989543 tempest-AttachVolumeTestJSON-244989543-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:08:12.745728 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-ed4a5c09-bd3e-423b-88de-41f77f481a72 tempest-AttachVolumeTestJSON-244989543 tempest-AttachVolumeTestJSON-244989543-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:08:12.874850 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.policy [None req-ed4a5c09-bd3e-423b-88de-41f77f481a72 tempest-AttachVolumeTestJSON-244989543 tempest-AttachVolumeTestJSON-244989543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5fb31c3d4874e13ba22e0242d4aaa58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00e76c2a092544e1a51928f1d84879b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116156) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:08:12.883051 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: INFO nova.api.openstack.requestlog [None req-ed4a5c09-bd3e-423b-88de-41f77f481a72 tempest-AttachVolumeTestJSON-244989543 tempest-AttachVolumeTestJSON-244989543-project] 10.222.0.18 "GET /compute/v2.1/servers/f22dfea6-4599-43e4-93d5-d99f1db3b4fb" status: 200 len: 1709 microversion: 2.1 time: 0.150342 Dec 15 03:08:12.883615 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: [pid: 116156|app: 0|req: 365/731] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 03:08:12 2021] GET /compute/v2.1/servers/f22dfea6-4599-43e4-93d5-d99f1db3b4fb => generated 1709 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 03:08:13.092323 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi [None req-7fb9a08b-8ac5-4ad2-b54e-96ba03e030c3 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Calling method '>' {{(pid=116157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:08:13.092815 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.compute.api [None req-7fb9a08b-8ac5-4ad2-b54e-96ba03e030c3 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] [instance: b89094ac-aee1-4bd6-a33d-8c4347cebfc7] Fetching instance by UUID {{(pid=116157) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:08:13.099505 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-7fb9a08b-8ac5-4ad2-b54e-96ba03e030c3 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:08:13.099952 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-7fb9a08b-8ac5-4ad2-b54e-96ba03e030c3 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:08:13.100721 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-7fb9a08b-8ac5-4ad2-b54e-96ba03e030c3 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:08:13.101152 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-7fb9a08b-8ac5-4ad2-b54e-96ba03e030c3 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:08:13.129172 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: INFO nova.api.openstack.requestlog [None req-7fb9a08b-8ac5-4ad2-b54e-96ba03e030c3 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] 10.222.0.18 "GET /compute/v2.1/servers/b89094ac-aee1-4bd6-a33d-8c4347cebfc7/os-volume_attachments/093991ee-d5d3-4c1d-a555-3556e887a00f" status: 200 len: 194 microversion: 2.20 time: 0.040616 Dec 15 03:08:13.129733 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: [pid: 116157|app: 0|req: 367/732] 10.222.0.18 () {60 vars in 1453 bytes} [Wed Dec 15 03:08:13 2021] GET /compute/v2.1/servers/b89094ac-aee1-4bd6-a33d-8c4347cebfc7/os-volume_attachments/093991ee-d5d3-4c1d-a555-3556e887a00f => generated 194 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 03:08:13.192896 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi [None req-7e8baea0-ff5e-4cc7-874f-c274f9fd1430 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Calling method '>' {{(pid=116156) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:08:13.193384 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.compute.api [None req-7e8baea0-ff5e-4cc7-874f-c274f9fd1430 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] [instance: b89094ac-aee1-4bd6-a33d-8c4347cebfc7] Fetching instance by UUID {{(pid=116156) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:08:13.199060 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-7e8baea0-ff5e-4cc7-874f-c274f9fd1430 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:08:13.199515 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-7e8baea0-ff5e-4cc7-874f-c274f9fd1430 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:08:13.200301 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-7e8baea0-ff5e-4cc7-874f-c274f9fd1430 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:08:13.200737 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-7e8baea0-ff5e-4cc7-874f-c274f9fd1430 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:08:13.282916 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.objects.instance [None req-7e8baea0-ff5e-4cc7-874f-c274f9fd1430 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lazy-loading 'services' on Instance uuid b89094ac-aee1-4bd6-a33d-8c4347cebfc7 {{(pid=116156) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Dec 15 03:08:13.354776 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: INFO nova.api.openstack.requestlog [None req-7e8baea0-ff5e-4cc7-874f-c274f9fd1430 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] 10.222.0.18 "DELETE /compute/v2.1/servers/b89094ac-aee1-4bd6-a33d-8c4347cebfc7/os-volume_attachments/093991ee-d5d3-4c1d-a555-3556e887a00f" status: 202 len: 0 microversion: 2.20 time: 0.165267 Dec 15 03:08:13.355369 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: [pid: 116156|app: 0|req: 366/733] 10.222.0.18 () {60 vars in 1456 bytes} [Wed Dec 15 03:08:13 2021] DELETE /compute/v2.1/servers/b89094ac-aee1-4bd6-a33d-8c4347cebfc7/os-volume_attachments/093991ee-d5d3-4c1d-a555-3556e887a00f => generated 0 bytes in 167 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Dec 15 03:08:13.363488 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi [None req-9fcfba42-3fbb-4c81-a8d8-283bc7f3c9fb tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Calling method '>' {{(pid=116157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:08:13.364960 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.compute.api [None req-9fcfba42-3fbb-4c81-a8d8-283bc7f3c9fb tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] [instance: b89094ac-aee1-4bd6-a33d-8c4347cebfc7] Fetching instance by UUID {{(pid=116157) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:08:13.371800 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-9fcfba42-3fbb-4c81-a8d8-283bc7f3c9fb tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:08:13.372443 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-9fcfba42-3fbb-4c81-a8d8-283bc7f3c9fb tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:08:13.373245 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-9fcfba42-3fbb-4c81-a8d8-283bc7f3c9fb tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:08:13.374313 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-9fcfba42-3fbb-4c81-a8d8-283bc7f3c9fb tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:08:13.406967 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: INFO nova.api.openstack.requestlog [None req-9fcfba42-3fbb-4c81-a8d8-283bc7f3c9fb tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] 10.222.0.18 "GET /compute/v2.1/servers/b89094ac-aee1-4bd6-a33d-8c4347cebfc7/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047264 Dec 15 03:08:13.407846 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: [pid: 116157|app: 0|req: 368/734] 10.222.0.18 () {60 vars in 1342 bytes} [Wed Dec 15 03:08:13 2021] GET /compute/v2.1/servers/b89094ac-aee1-4bd6-a33d-8c4347cebfc7/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Dec 15 03:08:13.900924 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi [None req-6caaae43-4d5b-409c-ad2c-bc0f8dcca55b tempest-AttachVolumeTestJSON-244989543 tempest-AttachVolumeTestJSON-244989543-project] Calling method '>' {{(pid=116156) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:08:13.901535 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.compute.api [None req-6caaae43-4d5b-409c-ad2c-bc0f8dcca55b tempest-AttachVolumeTestJSON-244989543 tempest-AttachVolumeTestJSON-244989543-project] [instance: f22dfea6-4599-43e4-93d5-d99f1db3b4fb] Fetching instance by UUID {{(pid=116156) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:08:13.907944 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-6caaae43-4d5b-409c-ad2c-bc0f8dcca55b tempest-AttachVolumeTestJSON-244989543 tempest-AttachVolumeTestJSON-244989543-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:08:13.908396 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-6caaae43-4d5b-409c-ad2c-bc0f8dcca55b tempest-AttachVolumeTestJSON-244989543 tempest-AttachVolumeTestJSON-244989543-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:08:13.909170 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-6caaae43-4d5b-409c-ad2c-bc0f8dcca55b tempest-AttachVolumeTestJSON-244989543 tempest-AttachVolumeTestJSON-244989543-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:08:13.909607 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-6caaae43-4d5b-409c-ad2c-bc0f8dcca55b tempest-AttachVolumeTestJSON-244989543 tempest-AttachVolumeTestJSON-244989543-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:08:14.041047 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.policy [None req-6caaae43-4d5b-409c-ad2c-bc0f8dcca55b tempest-AttachVolumeTestJSON-244989543 tempest-AttachVolumeTestJSON-244989543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5fb31c3d4874e13ba22e0242d4aaa58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00e76c2a092544e1a51928f1d84879b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116156) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:08:14.048710 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: INFO nova.api.openstack.requestlog [None req-6caaae43-4d5b-409c-ad2c-bc0f8dcca55b tempest-AttachVolumeTestJSON-244989543 tempest-AttachVolumeTestJSON-244989543-project] 10.222.0.18 "GET /compute/v2.1/servers/f22dfea6-4599-43e4-93d5-d99f1db3b4fb" status: 200 len: 1713 microversion: 2.1 time: 0.151867 Dec 15 03:08:14.049259 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: [pid: 116156|app: 0|req: 367/735] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 03:08:13 2021] GET /compute/v2.1/servers/f22dfea6-4599-43e4-93d5-d99f1db3b4fb => generated 1713 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 03:08:14.418299 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi [None req-6cfbf63f-04eb-47e1-aff4-f86a646dc693 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Calling method '>' {{(pid=116157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:08:14.419198 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.compute.api [None req-6cfbf63f-04eb-47e1-aff4-f86a646dc693 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] [instance: b89094ac-aee1-4bd6-a33d-8c4347cebfc7] Fetching instance by UUID {{(pid=116157) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:08:14.425679 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-6cfbf63f-04eb-47e1-aff4-f86a646dc693 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:08:14.426219 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-6cfbf63f-04eb-47e1-aff4-f86a646dc693 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:08:14.427531 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-6cfbf63f-04eb-47e1-aff4-f86a646dc693 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:08:14.427966 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-6cfbf63f-04eb-47e1-aff4-f86a646dc693 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:08:14.456514 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: INFO nova.api.openstack.requestlog [None req-6cfbf63f-04eb-47e1-aff4-f86a646dc693 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] 10.222.0.18 "GET /compute/v2.1/servers/b89094ac-aee1-4bd6-a33d-8c4347cebfc7/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041978 Dec 15 03:08:14.457065 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: [pid: 116157|app: 0|req: 369/736] 10.222.0.18 () {60 vars in 1342 bytes} [Wed Dec 15 03:08:14 2021] GET /compute/v2.1/servers/b89094ac-aee1-4bd6-a33d-8c4347cebfc7/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 03:08:15.468042 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi [None req-ba32c59b-2d0a-464c-b63e-2b54854d5d48 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Calling method '>' {{(pid=116156) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:08:15.468925 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.compute.api [None req-ba32c59b-2d0a-464c-b63e-2b54854d5d48 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] [instance: b89094ac-aee1-4bd6-a33d-8c4347cebfc7] Fetching instance by UUID {{(pid=116156) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:08:15.475234 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-ba32c59b-2d0a-464c-b63e-2b54854d5d48 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:08:15.475682 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-ba32c59b-2d0a-464c-b63e-2b54854d5d48 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:08:15.476451 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-ba32c59b-2d0a-464c-b63e-2b54854d5d48 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:08:15.476880 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-ba32c59b-2d0a-464c-b63e-2b54854d5d48 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:08:15.504434 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: INFO nova.api.openstack.requestlog [None req-ba32c59b-2d0a-464c-b63e-2b54854d5d48 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] 10.222.0.18 "GET /compute/v2.1/servers/b89094ac-aee1-4bd6-a33d-8c4347cebfc7/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.040263 Dec 15 03:08:15.505592 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: [pid: 116156|app: 0|req: 368/737] 10.222.0.18 () {60 vars in 1342 bytes} [Wed Dec 15 03:08:15 2021] GET /compute/v2.1/servers/b89094ac-aee1-4bd6-a33d-8c4347cebfc7/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Dec 15 03:08:16.517667 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi [None req-8d235b62-3b99-4708-8689-3291b3b2368a tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Calling method '>' {{(pid=116157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:08:16.518517 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.compute.api [None req-8d235b62-3b99-4708-8689-3291b3b2368a tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] [instance: b89094ac-aee1-4bd6-a33d-8c4347cebfc7] Fetching instance by UUID {{(pid=116157) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:08:16.525252 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-8d235b62-3b99-4708-8689-3291b3b2368a tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:08:16.525702 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-8d235b62-3b99-4708-8689-3291b3b2368a tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:08:16.526511 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-8d235b62-3b99-4708-8689-3291b3b2368a tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:08:16.526947 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-8d235b62-3b99-4708-8689-3291b3b2368a tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:08:16.555113 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: INFO nova.api.openstack.requestlog [None req-8d235b62-3b99-4708-8689-3291b3b2368a tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] 10.222.0.18 "GET /compute/v2.1/servers/b89094ac-aee1-4bd6-a33d-8c4347cebfc7/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041414 Dec 15 03:08:16.555655 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: [pid: 116157|app: 0|req: 370/738] 10.222.0.18 () {60 vars in 1342 bytes} [Wed Dec 15 03:08:16 2021] GET /compute/v2.1/servers/b89094ac-aee1-4bd6-a33d-8c4347cebfc7/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 03:08:17.566675 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi [None req-02c02c72-7ee2-4a1a-a8e5-2aba1aeae405 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Calling method '>' {{(pid=116156) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:08:17.567578 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.compute.api [None req-02c02c72-7ee2-4a1a-a8e5-2aba1aeae405 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] [instance: b89094ac-aee1-4bd6-a33d-8c4347cebfc7] Fetching instance by UUID {{(pid=116156) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:08:17.574311 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-02c02c72-7ee2-4a1a-a8e5-2aba1aeae405 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:08:17.574772 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-02c02c72-7ee2-4a1a-a8e5-2aba1aeae405 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:08:17.575553 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-02c02c72-7ee2-4a1a-a8e5-2aba1aeae405 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:08:17.575992 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-02c02c72-7ee2-4a1a-a8e5-2aba1aeae405 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:08:17.604295 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: INFO nova.api.openstack.requestlog [None req-02c02c72-7ee2-4a1a-a8e5-2aba1aeae405 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] 10.222.0.18 "GET /compute/v2.1/servers/b89094ac-aee1-4bd6-a33d-8c4347cebfc7/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041497 Dec 15 03:08:17.604835 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: [pid: 116156|app: 0|req: 369/739] 10.222.0.18 () {60 vars in 1342 bytes} [Wed Dec 15 03:08:17 2021] GET /compute/v2.1/servers/b89094ac-aee1-4bd6-a33d-8c4347cebfc7/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 03:08:18.615318 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi [None req-fd1731a9-c494-47ac-bc32-6f3698497700 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Calling method '>' {{(pid=116157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:08:18.616246 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.compute.api [None req-fd1731a9-c494-47ac-bc32-6f3698497700 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] [instance: b89094ac-aee1-4bd6-a33d-8c4347cebfc7] Fetching instance by UUID {{(pid=116157) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:08:18.623128 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-fd1731a9-c494-47ac-bc32-6f3698497700 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:08:18.623581 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-fd1731a9-c494-47ac-bc32-6f3698497700 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:08:18.624356 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-fd1731a9-c494-47ac-bc32-6f3698497700 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:08:18.624792 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-fd1731a9-c494-47ac-bc32-6f3698497700 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:08:18.653338 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: INFO nova.api.openstack.requestlog [None req-fd1731a9-c494-47ac-bc32-6f3698497700 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] 10.222.0.18 "GET /compute/v2.1/servers/b89094ac-aee1-4bd6-a33d-8c4347cebfc7/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041792 Dec 15 03:08:18.653884 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: [pid: 116157|app: 0|req: 371/740] 10.222.0.18 () {60 vars in 1342 bytes} [Wed Dec 15 03:08:18 2021] GET /compute/v2.1/servers/b89094ac-aee1-4bd6-a33d-8c4347cebfc7/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 03:08:19.665324 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi [None req-13d0ac88-a2bb-4664-be50-6d6f7c87b6a1 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Calling method '>' {{(pid=116156) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:08:19.666211 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.compute.api [None req-13d0ac88-a2bb-4664-be50-6d6f7c87b6a1 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] [instance: b89094ac-aee1-4bd6-a33d-8c4347cebfc7] Fetching instance by UUID {{(pid=116156) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:08:19.672425 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-13d0ac88-a2bb-4664-be50-6d6f7c87b6a1 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:08:19.672874 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-13d0ac88-a2bb-4664-be50-6d6f7c87b6a1 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:08:19.673652 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-13d0ac88-a2bb-4664-be50-6d6f7c87b6a1 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:08:19.674119 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-13d0ac88-a2bb-4664-be50-6d6f7c87b6a1 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:08:19.702339 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: INFO nova.api.openstack.requestlog [None req-13d0ac88-a2bb-4664-be50-6d6f7c87b6a1 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] 10.222.0.18 "GET /compute/v2.1/servers/b89094ac-aee1-4bd6-a33d-8c4347cebfc7/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041500 Dec 15 03:08:19.702887 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: [pid: 116156|app: 0|req: 370/741] 10.222.0.18 () {60 vars in 1342 bytes} [Wed Dec 15 03:08:19 2021] GET /compute/v2.1/servers/b89094ac-aee1-4bd6-a33d-8c4347cebfc7/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 03:08:20.714456 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi [None req-db958e43-be1b-42c7-93dd-968a69579ed4 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Calling method '>' {{(pid=116157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:08:20.715408 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.compute.api [None req-db958e43-be1b-42c7-93dd-968a69579ed4 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] [instance: b89094ac-aee1-4bd6-a33d-8c4347cebfc7] Fetching instance by UUID {{(pid=116157) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:08:20.721624 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-db958e43-be1b-42c7-93dd-968a69579ed4 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:08:20.722099 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-db958e43-be1b-42c7-93dd-968a69579ed4 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:08:20.722879 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-db958e43-be1b-42c7-93dd-968a69579ed4 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:08:20.723314 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-db958e43-be1b-42c7-93dd-968a69579ed4 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:08:20.751863 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: INFO nova.api.openstack.requestlog [None req-db958e43-be1b-42c7-93dd-968a69579ed4 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] 10.222.0.18 "GET /compute/v2.1/servers/b89094ac-aee1-4bd6-a33d-8c4347cebfc7/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041826 Dec 15 03:08:20.752403 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: [pid: 116157|app: 0|req: 372/742] 10.222.0.18 () {60 vars in 1342 bytes} [Wed Dec 15 03:08:20 2021] GET /compute/v2.1/servers/b89094ac-aee1-4bd6-a33d-8c4347cebfc7/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 03:08:21.764349 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi [None req-19f0db47-363f-4444-836b-8e945f793aaf tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Calling method '>' {{(pid=116156) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:08:21.765278 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.compute.api [None req-19f0db47-363f-4444-836b-8e945f793aaf tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] [instance: b89094ac-aee1-4bd6-a33d-8c4347cebfc7] Fetching instance by UUID {{(pid=116156) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:08:21.771458 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-19f0db47-363f-4444-836b-8e945f793aaf tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:08:21.771909 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-19f0db47-363f-4444-836b-8e945f793aaf tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:08:21.772685 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-19f0db47-363f-4444-836b-8e945f793aaf tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:08:21.773117 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-19f0db47-363f-4444-836b-8e945f793aaf tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:08:21.800675 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: INFO nova.api.openstack.requestlog [None req-19f0db47-363f-4444-836b-8e945f793aaf tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] 10.222.0.18 "GET /compute/v2.1/servers/b89094ac-aee1-4bd6-a33d-8c4347cebfc7/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.040124 Dec 15 03:08:21.801209 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: [pid: 116156|app: 0|req: 371/743] 10.222.0.18 () {60 vars in 1342 bytes} [Wed Dec 15 03:08:21 2021] GET /compute/v2.1/servers/b89094ac-aee1-4bd6-a33d-8c4347cebfc7/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 03:08:22.812487 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi [None req-d386ee03-118b-4a80-b215-995d61dcf3f8 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Calling method '>' {{(pid=116157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:08:22.813380 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.compute.api [None req-d386ee03-118b-4a80-b215-995d61dcf3f8 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] [instance: b89094ac-aee1-4bd6-a33d-8c4347cebfc7] Fetching instance by UUID {{(pid=116157) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:08:22.820120 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-d386ee03-118b-4a80-b215-995d61dcf3f8 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:08:22.820565 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-d386ee03-118b-4a80-b215-995d61dcf3f8 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:08:22.821330 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-d386ee03-118b-4a80-b215-995d61dcf3f8 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:08:22.821757 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-d386ee03-118b-4a80-b215-995d61dcf3f8 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:08:22.849943 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: INFO nova.api.openstack.requestlog [None req-d386ee03-118b-4a80-b215-995d61dcf3f8 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] 10.222.0.18 "GET /compute/v2.1/servers/b89094ac-aee1-4bd6-a33d-8c4347cebfc7/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041174 Dec 15 03:08:22.850507 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: [pid: 116157|app: 0|req: 373/744] 10.222.0.18 () {60 vars in 1342 bytes} [Wed Dec 15 03:08:22 2021] GET /compute/v2.1/servers/b89094ac-aee1-4bd6-a33d-8c4347cebfc7/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 03:08:23.860659 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi [None req-50d0871f-6f03-48c6-a56e-de231db75c4a tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Calling method '>' {{(pid=116156) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:08:23.861554 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.compute.api [None req-50d0871f-6f03-48c6-a56e-de231db75c4a tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] [instance: b89094ac-aee1-4bd6-a33d-8c4347cebfc7] Fetching instance by UUID {{(pid=116156) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:08:23.868063 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-50d0871f-6f03-48c6-a56e-de231db75c4a tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:08:23.868515 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-50d0871f-6f03-48c6-a56e-de231db75c4a tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:08:23.869291 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-50d0871f-6f03-48c6-a56e-de231db75c4a tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:08:23.869726 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-50d0871f-6f03-48c6-a56e-de231db75c4a tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:08:23.898916 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: INFO nova.api.openstack.requestlog [None req-50d0871f-6f03-48c6-a56e-de231db75c4a tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] 10.222.0.18 "GET /compute/v2.1/servers/b89094ac-aee1-4bd6-a33d-8c4347cebfc7/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041935 Dec 15 03:08:23.899483 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: [pid: 116156|app: 0|req: 372/745] 10.222.0.18 () {60 vars in 1342 bytes} [Wed Dec 15 03:08:23 2021] GET /compute/v2.1/servers/b89094ac-aee1-4bd6-a33d-8c4347cebfc7/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Dec 15 03:08:24.910350 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi [None req-89070e99-c36c-449b-a759-98edfc6d2297 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Calling method '>' {{(pid=116157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:08:24.911271 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.compute.api [None req-89070e99-c36c-449b-a759-98edfc6d2297 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] [instance: b89094ac-aee1-4bd6-a33d-8c4347cebfc7] Fetching instance by UUID {{(pid=116157) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:08:24.918111 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-89070e99-c36c-449b-a759-98edfc6d2297 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:08:24.918558 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-89070e99-c36c-449b-a759-98edfc6d2297 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:08:24.919335 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-89070e99-c36c-449b-a759-98edfc6d2297 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:08:24.919766 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-89070e99-c36c-449b-a759-98edfc6d2297 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:08:24.947782 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: INFO nova.api.openstack.requestlog [None req-89070e99-c36c-449b-a759-98edfc6d2297 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] 10.222.0.18 "GET /compute/v2.1/servers/b89094ac-aee1-4bd6-a33d-8c4347cebfc7/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041173 Dec 15 03:08:24.948327 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: [pid: 116157|app: 0|req: 374/746] 10.222.0.18 () {60 vars in 1342 bytes} [Wed Dec 15 03:08:24 2021] GET /compute/v2.1/servers/b89094ac-aee1-4bd6-a33d-8c4347cebfc7/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 03:08:25.959053 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi [None req-62abc2ac-a29b-4880-a5e8-17ca6aa3c596 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Calling method '>' {{(pid=116156) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:08:25.959947 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.compute.api [None req-62abc2ac-a29b-4880-a5e8-17ca6aa3c596 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] [instance: b89094ac-aee1-4bd6-a33d-8c4347cebfc7] Fetching instance by UUID {{(pid=116156) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:08:25.966141 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-62abc2ac-a29b-4880-a5e8-17ca6aa3c596 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:08:25.966587 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-62abc2ac-a29b-4880-a5e8-17ca6aa3c596 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:08:25.967353 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-62abc2ac-a29b-4880-a5e8-17ca6aa3c596 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:08:25.967781 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-62abc2ac-a29b-4880-a5e8-17ca6aa3c596 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:08:25.996455 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: INFO nova.api.openstack.requestlog [None req-62abc2ac-a29b-4880-a5e8-17ca6aa3c596 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] 10.222.0.18 "GET /compute/v2.1/servers/b89094ac-aee1-4bd6-a33d-8c4347cebfc7/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041179 Dec 15 03:08:25.996984 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: [pid: 116156|app: 0|req: 373/747] 10.222.0.18 () {60 vars in 1342 bytes} [Wed Dec 15 03:08:25 2021] GET /compute/v2.1/servers/b89094ac-aee1-4bd6-a33d-8c4347cebfc7/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 03:08:27.008556 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi [None req-1ea85bab-0605-4b85-9f52-cbbf2f2ddf6a tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Calling method '>' {{(pid=116157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:08:27.009458 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.compute.api [None req-1ea85bab-0605-4b85-9f52-cbbf2f2ddf6a tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] [instance: b89094ac-aee1-4bd6-a33d-8c4347cebfc7] Fetching instance by UUID {{(pid=116157) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:08:27.015719 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-1ea85bab-0605-4b85-9f52-cbbf2f2ddf6a tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:08:27.016170 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-1ea85bab-0605-4b85-9f52-cbbf2f2ddf6a tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:08:27.016947 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-1ea85bab-0605-4b85-9f52-cbbf2f2ddf6a tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:08:27.017385 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-1ea85bab-0605-4b85-9f52-cbbf2f2ddf6a tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:08:27.044898 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: INFO nova.api.openstack.requestlog [None req-1ea85bab-0605-4b85-9f52-cbbf2f2ddf6a tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] 10.222.0.18 "GET /compute/v2.1/servers/b89094ac-aee1-4bd6-a33d-8c4347cebfc7/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.040689 Dec 15 03:08:27.045435 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: [pid: 116157|app: 0|req: 375/748] 10.222.0.18 () {60 vars in 1342 bytes} [Wed Dec 15 03:08:27 2021] GET /compute/v2.1/servers/b89094ac-aee1-4bd6-a33d-8c4347cebfc7/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 03:08:28.056493 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi [None req-e7554330-ff0a-446a-b842-490c84dff517 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Calling method '>' {{(pid=116156) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:08:28.057383 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.compute.api [None req-e7554330-ff0a-446a-b842-490c84dff517 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] [instance: b89094ac-aee1-4bd6-a33d-8c4347cebfc7] Fetching instance by UUID {{(pid=116156) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:08:28.063555 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-e7554330-ff0a-446a-b842-490c84dff517 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:08:28.064004 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-e7554330-ff0a-446a-b842-490c84dff517 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:08:28.064773 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-e7554330-ff0a-446a-b842-490c84dff517 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:08:28.065210 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-e7554330-ff0a-446a-b842-490c84dff517 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:08:28.094814 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: INFO nova.api.openstack.requestlog [None req-e7554330-ff0a-446a-b842-490c84dff517 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] 10.222.0.18 "GET /compute/v2.1/servers/b89094ac-aee1-4bd6-a33d-8c4347cebfc7/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042038 Dec 15 03:08:28.095380 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: [pid: 116156|app: 0|req: 374/749] 10.222.0.18 () {60 vars in 1342 bytes} [Wed Dec 15 03:08:28 2021] GET /compute/v2.1/servers/b89094ac-aee1-4bd6-a33d-8c4347cebfc7/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Dec 15 03:08:29.105782 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi [None req-526b2c54-df35-4a58-b1ea-a3fb1e09a421 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Calling method '>' {{(pid=116157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:08:29.106720 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.compute.api [None req-526b2c54-df35-4a58-b1ea-a3fb1e09a421 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] [instance: b89094ac-aee1-4bd6-a33d-8c4347cebfc7] Fetching instance by UUID {{(pid=116157) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:08:29.112935 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-526b2c54-df35-4a58-b1ea-a3fb1e09a421 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:08:29.113388 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-526b2c54-df35-4a58-b1ea-a3fb1e09a421 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:08:29.114196 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-526b2c54-df35-4a58-b1ea-a3fb1e09a421 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:08:29.114625 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-526b2c54-df35-4a58-b1ea-a3fb1e09a421 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:08:29.145910 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: INFO nova.api.openstack.requestlog [None req-526b2c54-df35-4a58-b1ea-a3fb1e09a421 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] 10.222.0.18 "GET /compute/v2.1/servers/b89094ac-aee1-4bd6-a33d-8c4347cebfc7/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044078 Dec 15 03:08:29.146495 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: [pid: 116157|app: 0|req: 376/750] 10.222.0.18 () {60 vars in 1342 bytes} [Wed Dec 15 03:08:29 2021] GET /compute/v2.1/servers/b89094ac-aee1-4bd6-a33d-8c4347cebfc7/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Dec 15 03:08:30.156543 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi [None req-63d68f73-2cf5-4c19-bbf9-4519c2092e74 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Calling method '>' {{(pid=116156) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:08:30.157455 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.compute.api [None req-63d68f73-2cf5-4c19-bbf9-4519c2092e74 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] [instance: b89094ac-aee1-4bd6-a33d-8c4347cebfc7] Fetching instance by UUID {{(pid=116156) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:08:30.163761 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-63d68f73-2cf5-4c19-bbf9-4519c2092e74 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:08:30.164212 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-63d68f73-2cf5-4c19-bbf9-4519c2092e74 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:08:30.164991 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-63d68f73-2cf5-4c19-bbf9-4519c2092e74 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:08:30.165431 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-63d68f73-2cf5-4c19-bbf9-4519c2092e74 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:08:30.193717 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: INFO nova.api.openstack.requestlog [None req-63d68f73-2cf5-4c19-bbf9-4519c2092e74 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] 10.222.0.18 "GET /compute/v2.1/servers/b89094ac-aee1-4bd6-a33d-8c4347cebfc7/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.040954 Dec 15 03:08:30.195093 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: [pid: 116156|app: 0|req: 375/751] 10.222.0.18 () {60 vars in 1342 bytes} [Wed Dec 15 03:08:30 2021] GET /compute/v2.1/servers/b89094ac-aee1-4bd6-a33d-8c4347cebfc7/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 03:08:31.205645 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi [None req-ae51acae-46e8-4993-8c51-902031e8dbb0 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Calling method '>' {{(pid=116157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:08:31.206688 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.compute.api [None req-ae51acae-46e8-4993-8c51-902031e8dbb0 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] [instance: b89094ac-aee1-4bd6-a33d-8c4347cebfc7] Fetching instance by UUID {{(pid=116157) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:08:31.213331 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-ae51acae-46e8-4993-8c51-902031e8dbb0 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:08:31.213787 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-ae51acae-46e8-4993-8c51-902031e8dbb0 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:08:31.214591 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-ae51acae-46e8-4993-8c51-902031e8dbb0 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:08:31.215037 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-ae51acae-46e8-4993-8c51-902031e8dbb0 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:08:31.243329 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: INFO nova.api.openstack.requestlog [None req-ae51acae-46e8-4993-8c51-902031e8dbb0 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] 10.222.0.18 "GET /compute/v2.1/servers/b89094ac-aee1-4bd6-a33d-8c4347cebfc7/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041421 Dec 15 03:08:31.243915 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: [pid: 116157|app: 0|req: 377/752] 10.222.0.18 () {60 vars in 1342 bytes} [Wed Dec 15 03:08:31 2021] GET /compute/v2.1/servers/b89094ac-aee1-4bd6-a33d-8c4347cebfc7/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 03:08:32.254903 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi [None req-91e769b5-2c07-415e-8f70-3345d1611ac9 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Calling method '>' {{(pid=116156) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:08:32.255840 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.compute.api [None req-91e769b5-2c07-415e-8f70-3345d1611ac9 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] [instance: b89094ac-aee1-4bd6-a33d-8c4347cebfc7] Fetching instance by UUID {{(pid=116156) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:08:32.262815 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-91e769b5-2c07-415e-8f70-3345d1611ac9 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:08:32.263270 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-91e769b5-2c07-415e-8f70-3345d1611ac9 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:08:32.264053 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-91e769b5-2c07-415e-8f70-3345d1611ac9 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:08:32.264491 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-91e769b5-2c07-415e-8f70-3345d1611ac9 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:08:32.291993 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: INFO nova.api.openstack.requestlog [None req-91e769b5-2c07-415e-8f70-3345d1611ac9 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] 10.222.0.18 "GET /compute/v2.1/servers/b89094ac-aee1-4bd6-a33d-8c4347cebfc7/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.040928 Dec 15 03:08:32.292528 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: [pid: 116156|app: 0|req: 376/753] 10.222.0.18 () {60 vars in 1342 bytes} [Wed Dec 15 03:08:32 2021] GET /compute/v2.1/servers/b89094ac-aee1-4bd6-a33d-8c4347cebfc7/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 03:08:33.303339 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi [None req-d13e82a4-0716-4aaf-8eb4-44293e676ec1 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Calling method '>' {{(pid=116157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:08:33.304859 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.compute.api [None req-d13e82a4-0716-4aaf-8eb4-44293e676ec1 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] [instance: b89094ac-aee1-4bd6-a33d-8c4347cebfc7] Fetching instance by UUID {{(pid=116157) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:08:33.311086 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-d13e82a4-0716-4aaf-8eb4-44293e676ec1 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:08:33.311533 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-d13e82a4-0716-4aaf-8eb4-44293e676ec1 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:08:33.312308 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-d13e82a4-0716-4aaf-8eb4-44293e676ec1 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:08:33.312748 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-d13e82a4-0716-4aaf-8eb4-44293e676ec1 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:08:33.340243 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: INFO nova.api.openstack.requestlog [None req-d13e82a4-0716-4aaf-8eb4-44293e676ec1 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] 10.222.0.18 "GET /compute/v2.1/servers/b89094ac-aee1-4bd6-a33d-8c4347cebfc7/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.040676 Dec 15 03:08:33.340787 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: [pid: 116157|app: 0|req: 378/754] 10.222.0.18 () {60 vars in 1342 bytes} [Wed Dec 15 03:08:33 2021] GET /compute/v2.1/servers/b89094ac-aee1-4bd6-a33d-8c4347cebfc7/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 03:08:34.352080 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi [None req-f87265a1-a0bc-4867-87f2-2cd8248b1951 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Calling method '>' {{(pid=116156) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:08:34.352969 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.compute.api [None req-f87265a1-a0bc-4867-87f2-2cd8248b1951 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] [instance: b89094ac-aee1-4bd6-a33d-8c4347cebfc7] Fetching instance by UUID {{(pid=116156) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:08:34.359106 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-f87265a1-a0bc-4867-87f2-2cd8248b1951 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:08:34.359551 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-f87265a1-a0bc-4867-87f2-2cd8248b1951 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:08:34.360325 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-f87265a1-a0bc-4867-87f2-2cd8248b1951 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:08:34.360760 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-f87265a1-a0bc-4867-87f2-2cd8248b1951 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:08:34.389320 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: INFO nova.api.openstack.requestlog [None req-f87265a1-a0bc-4867-87f2-2cd8248b1951 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] 10.222.0.18 "GET /compute/v2.1/servers/b89094ac-aee1-4bd6-a33d-8c4347cebfc7/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041594 Dec 15 03:08:34.389856 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: [pid: 116156|app: 0|req: 377/755] 10.222.0.18 () {60 vars in 1342 bytes} [Wed Dec 15 03:08:34 2021] GET /compute/v2.1/servers/b89094ac-aee1-4bd6-a33d-8c4347cebfc7/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 03:08:35.400737 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi [None req-ec3b2cc3-4c3c-4d75-85bb-4a0491596658 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Calling method '>' {{(pid=116157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:08:35.401632 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.compute.api [None req-ec3b2cc3-4c3c-4d75-85bb-4a0491596658 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] [instance: b89094ac-aee1-4bd6-a33d-8c4347cebfc7] Fetching instance by UUID {{(pid=116157) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:08:35.407797 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-ec3b2cc3-4c3c-4d75-85bb-4a0491596658 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:08:35.408238 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-ec3b2cc3-4c3c-4d75-85bb-4a0491596658 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:08:35.409006 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-ec3b2cc3-4c3c-4d75-85bb-4a0491596658 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:08:35.409435 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-ec3b2cc3-4c3c-4d75-85bb-4a0491596658 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:08:35.437734 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: INFO nova.api.openstack.requestlog [None req-ec3b2cc3-4c3c-4d75-85bb-4a0491596658 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] 10.222.0.18 "GET /compute/v2.1/servers/b89094ac-aee1-4bd6-a33d-8c4347cebfc7/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.040873 Dec 15 03:08:35.438301 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: [pid: 116157|app: 0|req: 379/756] 10.222.0.18 () {60 vars in 1342 bytes} [Wed Dec 15 03:08:35 2021] GET /compute/v2.1/servers/b89094ac-aee1-4bd6-a33d-8c4347cebfc7/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 03:08:36.448714 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi [None req-b1fda627-1f03-49e1-9cfc-a2af35cbf352 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Calling method '>' {{(pid=116156) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:08:36.449607 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.compute.api [None req-b1fda627-1f03-49e1-9cfc-a2af35cbf352 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] [instance: b89094ac-aee1-4bd6-a33d-8c4347cebfc7] Fetching instance by UUID {{(pid=116156) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:08:36.455828 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-b1fda627-1f03-49e1-9cfc-a2af35cbf352 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:08:36.456278 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-b1fda627-1f03-49e1-9cfc-a2af35cbf352 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:08:36.457045 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-b1fda627-1f03-49e1-9cfc-a2af35cbf352 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:08:36.457475 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-b1fda627-1f03-49e1-9cfc-a2af35cbf352 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:08:36.485434 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: INFO nova.api.openstack.requestlog [None req-b1fda627-1f03-49e1-9cfc-a2af35cbf352 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] 10.222.0.18 "GET /compute/v2.1/servers/b89094ac-aee1-4bd6-a33d-8c4347cebfc7/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.040926 Dec 15 03:08:36.485907 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: [pid: 116156|app: 0|req: 378/757] 10.222.0.18 () {60 vars in 1342 bytes} [Wed Dec 15 03:08:36 2021] GET /compute/v2.1/servers/b89094ac-aee1-4bd6-a33d-8c4347cebfc7/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 03:08:37.496937 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi [None req-fa4ff4a9-b1aa-4154-999a-932852431e50 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Calling method '>' {{(pid=116157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:08:37.497756 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.compute.api [None req-fa4ff4a9-b1aa-4154-999a-932852431e50 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] [instance: b89094ac-aee1-4bd6-a33d-8c4347cebfc7] Fetching instance by UUID {{(pid=116157) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:08:37.504019 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-fa4ff4a9-b1aa-4154-999a-932852431e50 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:08:37.504453 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-fa4ff4a9-b1aa-4154-999a-932852431e50 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:08:37.505221 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-fa4ff4a9-b1aa-4154-999a-932852431e50 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:08:37.505652 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-fa4ff4a9-b1aa-4154-999a-932852431e50 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:08:37.533463 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: INFO nova.api.openstack.requestlog [None req-fa4ff4a9-b1aa-4154-999a-932852431e50 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] 10.222.0.18 "GET /compute/v2.1/servers/b89094ac-aee1-4bd6-a33d-8c4347cebfc7/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.040355 Dec 15 03:08:37.534014 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: [pid: 116157|app: 0|req: 380/758] 10.222.0.18 () {60 vars in 1342 bytes} [Wed Dec 15 03:08:37 2021] GET /compute/v2.1/servers/b89094ac-aee1-4bd6-a33d-8c4347cebfc7/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 03:08:38.544761 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi [None req-84f785ac-ab06-4188-9590-b517c73b7d49 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Calling method '>' {{(pid=116156) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:08:38.545582 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.compute.api [None req-84f785ac-ab06-4188-9590-b517c73b7d49 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] [instance: b89094ac-aee1-4bd6-a33d-8c4347cebfc7] Fetching instance by UUID {{(pid=116156) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:08:38.551789 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-84f785ac-ab06-4188-9590-b517c73b7d49 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:08:38.552243 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-84f785ac-ab06-4188-9590-b517c73b7d49 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:08:38.553015 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-84f785ac-ab06-4188-9590-b517c73b7d49 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:08:38.554079 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-84f785ac-ab06-4188-9590-b517c73b7d49 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:08:38.581655 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: INFO nova.api.openstack.requestlog [None req-84f785ac-ab06-4188-9590-b517c73b7d49 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] 10.222.0.18 "GET /compute/v2.1/servers/b89094ac-aee1-4bd6-a33d-8c4347cebfc7/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.040688 Dec 15 03:08:38.582238 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: [pid: 116156|app: 0|req: 379/759] 10.222.0.18 () {60 vars in 1342 bytes} [Wed Dec 15 03:08:38 2021] GET /compute/v2.1/servers/b89094ac-aee1-4bd6-a33d-8c4347cebfc7/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 03:08:39.592890 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi [None req-db1c6e42-fae1-4fb9-824b-a5cfb771f506 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Calling method '>' {{(pid=116157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:08:39.593782 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.compute.api [None req-db1c6e42-fae1-4fb9-824b-a5cfb771f506 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] [instance: b89094ac-aee1-4bd6-a33d-8c4347cebfc7] Fetching instance by UUID {{(pid=116157) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:08:39.601010 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-db1c6e42-fae1-4fb9-824b-a5cfb771f506 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:08:39.601458 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-db1c6e42-fae1-4fb9-824b-a5cfb771f506 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:08:39.602252 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-db1c6e42-fae1-4fb9-824b-a5cfb771f506 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:08:39.602686 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-db1c6e42-fae1-4fb9-824b-a5cfb771f506 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:08:39.630310 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: INFO nova.api.openstack.requestlog [None req-db1c6e42-fae1-4fb9-824b-a5cfb771f506 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] 10.222.0.18 "GET /compute/v2.1/servers/b89094ac-aee1-4bd6-a33d-8c4347cebfc7/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041028 Dec 15 03:08:39.630782 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: [pid: 116157|app: 0|req: 381/760] 10.222.0.18 () {60 vars in 1342 bytes} [Wed Dec 15 03:08:39 2021] GET /compute/v2.1/servers/b89094ac-aee1-4bd6-a33d-8c4347cebfc7/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 03:08:40.641593 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi [None req-e711df74-56c6-4ce7-aa1e-34c64659255f tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Calling method '>' {{(pid=116156) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:08:40.642539 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.compute.api [None req-e711df74-56c6-4ce7-aa1e-34c64659255f tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] [instance: b89094ac-aee1-4bd6-a33d-8c4347cebfc7] Fetching instance by UUID {{(pid=116156) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:08:40.648820 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-e711df74-56c6-4ce7-aa1e-34c64659255f tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:08:40.649260 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-e711df74-56c6-4ce7-aa1e-34c64659255f tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:08:40.650054 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-e711df74-56c6-4ce7-aa1e-34c64659255f tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:08:40.650488 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-e711df74-56c6-4ce7-aa1e-34c64659255f tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:08:40.679345 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: INFO nova.api.openstack.requestlog [None req-e711df74-56c6-4ce7-aa1e-34c64659255f tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] 10.222.0.18 "GET /compute/v2.1/servers/b89094ac-aee1-4bd6-a33d-8c4347cebfc7/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041634 Dec 15 03:08:40.679896 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: [pid: 116156|app: 0|req: 380/761] 10.222.0.18 () {60 vars in 1342 bytes} [Wed Dec 15 03:08:40 2021] GET /compute/v2.1/servers/b89094ac-aee1-4bd6-a33d-8c4347cebfc7/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 03:08:41.690946 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi [None req-50d3eb90-d3de-4c7d-bb51-5af8676134bc tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Calling method '>' {{(pid=116157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:08:41.691790 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.compute.api [None req-50d3eb90-d3de-4c7d-bb51-5af8676134bc tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] [instance: b89094ac-aee1-4bd6-a33d-8c4347cebfc7] Fetching instance by UUID {{(pid=116157) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:08:41.697966 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-50d3eb90-d3de-4c7d-bb51-5af8676134bc tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:08:41.698442 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-50d3eb90-d3de-4c7d-bb51-5af8676134bc tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:08:41.699221 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-50d3eb90-d3de-4c7d-bb51-5af8676134bc tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:08:41.699650 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-50d3eb90-d3de-4c7d-bb51-5af8676134bc tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:08:41.727417 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: INFO nova.api.openstack.requestlog [None req-50d3eb90-d3de-4c7d-bb51-5af8676134bc tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] 10.222.0.18 "GET /compute/v2.1/servers/b89094ac-aee1-4bd6-a33d-8c4347cebfc7/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.040321 Dec 15 03:08:41.727950 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: [pid: 116157|app: 0|req: 382/762] 10.222.0.18 () {60 vars in 1342 bytes} [Wed Dec 15 03:08:41 2021] GET /compute/v2.1/servers/b89094ac-aee1-4bd6-a33d-8c4347cebfc7/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 03:08:42.738670 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi [None req-e9676bb1-f4b3-44d8-84cb-80492d8651e7 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Calling method '>' {{(pid=116156) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:08:42.739569 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.compute.api [None req-e9676bb1-f4b3-44d8-84cb-80492d8651e7 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] [instance: b89094ac-aee1-4bd6-a33d-8c4347cebfc7] Fetching instance by UUID {{(pid=116156) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:08:42.746806 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-e9676bb1-f4b3-44d8-84cb-80492d8651e7 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:08:42.747285 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-e9676bb1-f4b3-44d8-84cb-80492d8651e7 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:08:42.748066 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-e9676bb1-f4b3-44d8-84cb-80492d8651e7 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:08:42.748502 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-e9676bb1-f4b3-44d8-84cb-80492d8651e7 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:08:42.776721 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: INFO nova.api.openstack.requestlog [None req-e9676bb1-f4b3-44d8-84cb-80492d8651e7 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] 10.222.0.18 "GET /compute/v2.1/servers/b89094ac-aee1-4bd6-a33d-8c4347cebfc7/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041777 Dec 15 03:08:42.777265 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: [pid: 116156|app: 0|req: 381/763] 10.222.0.18 () {60 vars in 1342 bytes} [Wed Dec 15 03:08:42 2021] GET /compute/v2.1/servers/b89094ac-aee1-4bd6-a33d-8c4347cebfc7/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 03:08:43.787992 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi [None req-627a9062-8798-48ae-99d2-b50d6eacf688 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Calling method '>' {{(pid=116157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:08:43.788810 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.compute.api [None req-627a9062-8798-48ae-99d2-b50d6eacf688 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] [instance: b89094ac-aee1-4bd6-a33d-8c4347cebfc7] Fetching instance by UUID {{(pid=116157) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:08:43.795233 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-627a9062-8798-48ae-99d2-b50d6eacf688 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:08:43.795685 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-627a9062-8798-48ae-99d2-b50d6eacf688 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:08:43.796458 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-627a9062-8798-48ae-99d2-b50d6eacf688 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:08:43.796888 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-627a9062-8798-48ae-99d2-b50d6eacf688 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:08:43.824780 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: INFO nova.api.openstack.requestlog [None req-627a9062-8798-48ae-99d2-b50d6eacf688 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] 10.222.0.18 "GET /compute/v2.1/servers/b89094ac-aee1-4bd6-a33d-8c4347cebfc7/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.040633 Dec 15 03:08:43.825321 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: [pid: 116157|app: 0|req: 383/764] 10.222.0.18 () {60 vars in 1342 bytes} [Wed Dec 15 03:08:43 2021] GET /compute/v2.1/servers/b89094ac-aee1-4bd6-a33d-8c4347cebfc7/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 03:08:44.836609 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi [None req-73ed43d2-875c-4a73-88d4-5e1b809f34a6 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Calling method '>' {{(pid=116156) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:08:44.837505 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.compute.api [None req-73ed43d2-875c-4a73-88d4-5e1b809f34a6 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] [instance: b89094ac-aee1-4bd6-a33d-8c4347cebfc7] Fetching instance by UUID {{(pid=116156) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:08:44.843721 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-73ed43d2-875c-4a73-88d4-5e1b809f34a6 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:08:44.844166 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-73ed43d2-875c-4a73-88d4-5e1b809f34a6 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:08:44.844950 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-73ed43d2-875c-4a73-88d4-5e1b809f34a6 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:08:44.845360 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-73ed43d2-875c-4a73-88d4-5e1b809f34a6 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:08:44.873684 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: INFO nova.api.openstack.requestlog [None req-73ed43d2-875c-4a73-88d4-5e1b809f34a6 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] 10.222.0.18 "GET /compute/v2.1/servers/b89094ac-aee1-4bd6-a33d-8c4347cebfc7/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041320 Dec 15 03:08:44.874267 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: [pid: 116156|app: 0|req: 382/765] 10.222.0.18 () {60 vars in 1342 bytes} [Wed Dec 15 03:08:44 2021] GET /compute/v2.1/servers/b89094ac-aee1-4bd6-a33d-8c4347cebfc7/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 03:08:45.885135 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi [None req-578b6889-2128-4983-91c3-8eeeb1f17462 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Calling method '>' {{(pid=116157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:08:45.886058 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.compute.api [None req-578b6889-2128-4983-91c3-8eeeb1f17462 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] [instance: b89094ac-aee1-4bd6-a33d-8c4347cebfc7] Fetching instance by UUID {{(pid=116157) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:08:45.892268 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-578b6889-2128-4983-91c3-8eeeb1f17462 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:08:45.892711 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-578b6889-2128-4983-91c3-8eeeb1f17462 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:08:45.893483 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-578b6889-2128-4983-91c3-8eeeb1f17462 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:08:45.893914 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-578b6889-2128-4983-91c3-8eeeb1f17462 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:08:45.923110 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: INFO nova.api.openstack.requestlog [None req-578b6889-2128-4983-91c3-8eeeb1f17462 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] 10.222.0.18 "GET /compute/v2.1/servers/b89094ac-aee1-4bd6-a33d-8c4347cebfc7/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041792 Dec 15 03:08:45.923652 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: [pid: 116157|app: 0|req: 384/766] 10.222.0.18 () {60 vars in 1342 bytes} [Wed Dec 15 03:08:45 2021] GET /compute/v2.1/servers/b89094ac-aee1-4bd6-a33d-8c4347cebfc7/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 03:08:46.933924 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi [None req-2756b32a-6c75-48af-ae19-fdedde9f4cb0 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Calling method '>' {{(pid=116156) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:08:46.934887 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.compute.api [None req-2756b32a-6c75-48af-ae19-fdedde9f4cb0 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] [instance: b89094ac-aee1-4bd6-a33d-8c4347cebfc7] Fetching instance by UUID {{(pid=116156) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:08:46.941004 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-2756b32a-6c75-48af-ae19-fdedde9f4cb0 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:08:46.941457 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-2756b32a-6c75-48af-ae19-fdedde9f4cb0 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:08:46.942261 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-2756b32a-6c75-48af-ae19-fdedde9f4cb0 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:08:46.942701 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-2756b32a-6c75-48af-ae19-fdedde9f4cb0 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:08:46.971508 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: INFO nova.api.openstack.requestlog [None req-2756b32a-6c75-48af-ae19-fdedde9f4cb0 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] 10.222.0.18 "GET /compute/v2.1/servers/b89094ac-aee1-4bd6-a33d-8c4347cebfc7/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041384 Dec 15 03:08:46.972048 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: [pid: 116156|app: 0|req: 383/767] 10.222.0.18 () {60 vars in 1342 bytes} [Wed Dec 15 03:08:46 2021] GET /compute/v2.1/servers/b89094ac-aee1-4bd6-a33d-8c4347cebfc7/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 03:08:47.022849 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi [None req-da9e7487-96c6-41b2-9dbb-87b3fd632107 tempest-AttachVolumeTestJSON-244989543 tempest-AttachVolumeTestJSON-244989543-project] Calling method '>' {{(pid=116157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:08:47.023332 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.compute.api [None req-da9e7487-96c6-41b2-9dbb-87b3fd632107 tempest-AttachVolumeTestJSON-244989543 tempest-AttachVolumeTestJSON-244989543-project] [instance: f22dfea6-4599-43e4-93d5-d99f1db3b4fb] Fetching instance by UUID {{(pid=116157) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:08:47.029497 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-da9e7487-96c6-41b2-9dbb-87b3fd632107 tempest-AttachVolumeTestJSON-244989543 tempest-AttachVolumeTestJSON-244989543-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:08:47.029954 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-da9e7487-96c6-41b2-9dbb-87b3fd632107 tempest-AttachVolumeTestJSON-244989543 tempest-AttachVolumeTestJSON-244989543-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:08:47.030764 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-da9e7487-96c6-41b2-9dbb-87b3fd632107 tempest-AttachVolumeTestJSON-244989543 tempest-AttachVolumeTestJSON-244989543-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:08:47.031204 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-da9e7487-96c6-41b2-9dbb-87b3fd632107 tempest-AttachVolumeTestJSON-244989543 tempest-AttachVolumeTestJSON-244989543-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:08:47.106131 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.objects.instance [None req-da9e7487-96c6-41b2-9dbb-87b3fd632107 tempest-AttachVolumeTestJSON-244989543 tempest-AttachVolumeTestJSON-244989543-project] Lazy-loading 'services' on Instance uuid f22dfea6-4599-43e4-93d5-d99f1db3b4fb {{(pid=116157) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Dec 15 03:08:47.172164 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: INFO nova.api.openstack.requestlog [None req-da9e7487-96c6-41b2-9dbb-87b3fd632107 tempest-AttachVolumeTestJSON-244989543 tempest-AttachVolumeTestJSON-244989543-project] 10.222.0.18 "DELETE /compute/v2.1/servers/f22dfea6-4599-43e4-93d5-d99f1db3b4fb/os-volume_attachments/4ee178c0-86f3-44b2-8895-149b7c7cd260" status: 202 len: 0 microversion: 2.1 time: 0.153496 Dec 15 03:08:47.172818 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: [pid: 116157|app: 0|req: 385/768] 10.222.0.18 () {58 vars in 1415 bytes} [Wed Dec 15 03:08:47 2021] DELETE /compute/v2.1/servers/f22dfea6-4599-43e4-93d5-d99f1db3b4fb/os-volume_attachments/4ee178c0-86f3-44b2-8895-149b7c7cd260 => generated 0 bytes in 155 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Dec 15 03:08:47.982152 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi [None req-48e0db65-28b4-4bfd-b84f-53242dfe6ffa tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Calling method '>' {{(pid=116156) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:08:47.982969 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.compute.api [None req-48e0db65-28b4-4bfd-b84f-53242dfe6ffa tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] [instance: b89094ac-aee1-4bd6-a33d-8c4347cebfc7] Fetching instance by UUID {{(pid=116156) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:08:47.989152 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-48e0db65-28b4-4bfd-b84f-53242dfe6ffa tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:08:47.989614 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-48e0db65-28b4-4bfd-b84f-53242dfe6ffa tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:08:47.990419 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-48e0db65-28b4-4bfd-b84f-53242dfe6ffa tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:08:47.991355 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-48e0db65-28b4-4bfd-b84f-53242dfe6ffa tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:08:48.019907 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: INFO nova.api.openstack.requestlog [None req-48e0db65-28b4-4bfd-b84f-53242dfe6ffa tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] 10.222.0.18 "GET /compute/v2.1/servers/b89094ac-aee1-4bd6-a33d-8c4347cebfc7/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041636 Dec 15 03:08:48.020441 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: [pid: 116156|app: 0|req: 384/769] 10.222.0.18 () {60 vars in 1342 bytes} [Wed Dec 15 03:08:47 2021] GET /compute/v2.1/servers/b89094ac-aee1-4bd6-a33d-8c4347cebfc7/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 03:08:49.032440 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi [None req-1360fcec-a3c9-45b1-be8e-a54fc0184c39 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Calling method '>' {{(pid=116157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:08:49.033384 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.compute.api [None req-1360fcec-a3c9-45b1-be8e-a54fc0184c39 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] [instance: b89094ac-aee1-4bd6-a33d-8c4347cebfc7] Fetching instance by UUID {{(pid=116157) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:08:49.039506 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-1360fcec-a3c9-45b1-be8e-a54fc0184c39 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:08:49.039954 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-1360fcec-a3c9-45b1-be8e-a54fc0184c39 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:08:49.040734 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-1360fcec-a3c9-45b1-be8e-a54fc0184c39 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:08:49.041164 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-1360fcec-a3c9-45b1-be8e-a54fc0184c39 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:08:49.069181 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: INFO nova.api.openstack.requestlog [None req-1360fcec-a3c9-45b1-be8e-a54fc0184c39 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] 10.222.0.18 "GET /compute/v2.1/servers/b89094ac-aee1-4bd6-a33d-8c4347cebfc7/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.040884 Dec 15 03:08:49.069712 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: [pid: 116157|app: 0|req: 386/770] 10.222.0.18 () {60 vars in 1342 bytes} [Wed Dec 15 03:08:49 2021] GET /compute/v2.1/servers/b89094ac-aee1-4bd6-a33d-8c4347cebfc7/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 03:08:50.079735 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi [None req-1af2e2ca-82aa-491f-b6fb-ddf30c9e88a3 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Calling method '>' {{(pid=116156) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:08:50.080665 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.compute.api [None req-1af2e2ca-82aa-491f-b6fb-ddf30c9e88a3 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] [instance: b89094ac-aee1-4bd6-a33d-8c4347cebfc7] Fetching instance by UUID {{(pid=116156) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:08:50.087355 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-1af2e2ca-82aa-491f-b6fb-ddf30c9e88a3 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:08:50.087807 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-1af2e2ca-82aa-491f-b6fb-ddf30c9e88a3 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:08:50.088589 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-1af2e2ca-82aa-491f-b6fb-ddf30c9e88a3 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:08:50.089025 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-1af2e2ca-82aa-491f-b6fb-ddf30c9e88a3 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:08:50.117557 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: INFO nova.api.openstack.requestlog [None req-1af2e2ca-82aa-491f-b6fb-ddf30c9e88a3 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] 10.222.0.18 "GET /compute/v2.1/servers/b89094ac-aee1-4bd6-a33d-8c4347cebfc7/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041602 Dec 15 03:08:50.118120 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: [pid: 116156|app: 0|req: 385/771] 10.222.0.18 () {60 vars in 1342 bytes} [Wed Dec 15 03:08:50 2021] GET /compute/v2.1/servers/b89094ac-aee1-4bd6-a33d-8c4347cebfc7/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 03:08:51.128624 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi [None req-4c630de3-cab3-4646-8b6e-ce04cc59d3b5 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Calling method '>' {{(pid=116157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:08:51.129516 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.compute.api [None req-4c630de3-cab3-4646-8b6e-ce04cc59d3b5 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] [instance: b89094ac-aee1-4bd6-a33d-8c4347cebfc7] Fetching instance by UUID {{(pid=116157) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:08:51.136802 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-4c630de3-cab3-4646-8b6e-ce04cc59d3b5 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:08:51.137243 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-4c630de3-cab3-4646-8b6e-ce04cc59d3b5 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:08:51.138031 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-4c630de3-cab3-4646-8b6e-ce04cc59d3b5 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:08:51.138498 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-4c630de3-cab3-4646-8b6e-ce04cc59d3b5 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:08:51.166199 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: INFO nova.api.openstack.requestlog [None req-4c630de3-cab3-4646-8b6e-ce04cc59d3b5 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] 10.222.0.18 "GET /compute/v2.1/servers/b89094ac-aee1-4bd6-a33d-8c4347cebfc7/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041269 Dec 15 03:08:51.166748 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: [pid: 116157|app: 0|req: 387/772] 10.222.0.18 () {60 vars in 1342 bytes} [Wed Dec 15 03:08:51 2021] GET /compute/v2.1/servers/b89094ac-aee1-4bd6-a33d-8c4347cebfc7/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 03:08:52.177829 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi [None req-b9404128-b1de-484e-89b2-3a0cfb0cc0e1 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Calling method '>' {{(pid=116156) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:08:52.179342 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.compute.api [None req-b9404128-b1de-484e-89b2-3a0cfb0cc0e1 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] [instance: b89094ac-aee1-4bd6-a33d-8c4347cebfc7] Fetching instance by UUID {{(pid=116156) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:08:52.185531 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-b9404128-b1de-484e-89b2-3a0cfb0cc0e1 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:08:52.186002 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-b9404128-b1de-484e-89b2-3a0cfb0cc0e1 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:08:52.186780 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-b9404128-b1de-484e-89b2-3a0cfb0cc0e1 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:08:52.187217 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-b9404128-b1de-484e-89b2-3a0cfb0cc0e1 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:08:52.215547 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: INFO nova.api.openstack.requestlog [None req-b9404128-b1de-484e-89b2-3a0cfb0cc0e1 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] 10.222.0.18 "GET /compute/v2.1/servers/b89094ac-aee1-4bd6-a33d-8c4347cebfc7/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041439 Dec 15 03:08:52.216109 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: [pid: 116156|app: 0|req: 386/773] 10.222.0.18 () {60 vars in 1342 bytes} [Wed Dec 15 03:08:52 2021] GET /compute/v2.1/servers/b89094ac-aee1-4bd6-a33d-8c4347cebfc7/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 03:08:53.224309 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi [None req-9978a55f-2671-480e-8a51-c94d5b6a39b2 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=116157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 03:08:53.224890 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.compute.api [None req-9978a55f-2671-480e-8a51-c94d5b6a39b2 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] [instance: fa7c86bc-c46f-4120-8f3d-d795f8d7c5cc] Fetching instance by UUID {{(pid=116157) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:08:53.226760 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi [None req-06bb05f1-bf18-45eb-b6ce-b73c4955535e tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Calling method '>' {{(pid=116156) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:08:53.227665 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.compute.api [None req-06bb05f1-bf18-45eb-b6ce-b73c4955535e tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] [instance: b89094ac-aee1-4bd6-a33d-8c4347cebfc7] Fetching instance by UUID {{(pid=116156) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:08:53.231155 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-9978a55f-2671-480e-8a51-c94d5b6a39b2 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:08:53.231606 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-9978a55f-2671-480e-8a51-c94d5b6a39b2 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:08:53.232392 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-9978a55f-2671-480e-8a51-c94d5b6a39b2 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:08:53.232830 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-9978a55f-2671-480e-8a51-c94d5b6a39b2 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:08:53.233857 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-06bb05f1-bf18-45eb-b6ce-b73c4955535e tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:08:53.234345 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-06bb05f1-bf18-45eb-b6ce-b73c4955535e tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:08:53.235132 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-06bb05f1-bf18-45eb-b6ce-b73c4955535e tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:08:53.235571 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-06bb05f1-bf18-45eb-b6ce-b73c4955535e tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:08:53.255820 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.objects.instance [None req-9978a55f-2671-480e-8a51-c94d5b6a39b2 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lazy-loading 'flavor' on Instance uuid fa7c86bc-c46f-4120-8f3d-d795f8d7c5cc {{(pid=116157) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Dec 15 03:08:53.265435 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: INFO nova.api.openstack.requestlog [None req-06bb05f1-bf18-45eb-b6ce-b73c4955535e tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] 10.222.0.18 "GET /compute/v2.1/servers/b89094ac-aee1-4bd6-a33d-8c4347cebfc7/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042367 Dec 15 03:08:53.269553 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: [pid: 116156|app: 0|req: 387/774] 10.222.0.18 () {60 vars in 1342 bytes} [Wed Dec 15 03:08:53 2021] GET /compute/v2.1/servers/b89094ac-aee1-4bd6-a33d-8c4347cebfc7/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Dec 15 03:08:53.327615 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: INFO nova.api.openstack.requestlog [None req-9978a55f-2671-480e-8a51-c94d5b6a39b2 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] 10.222.0.18 "POST /compute/v2.1/servers/fa7c86bc-c46f-4120-8f3d-d795f8d7c5cc/action" status: 202 len: 0 microversion: 2.1 time: 0.106835 Dec 15 03:08:53.328191 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: [pid: 116157|app: 0|req: 388/775] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Dec 15 03:08:53 2021] POST /compute/v2.1/servers/fa7c86bc-c46f-4120-8f3d-d795f8d7c5cc/action => generated 0 bytes in 108 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Dec 15 03:08:53.336353 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi [None req-ed91651f-3bf9-4199-b15a-7a1788b26bf0 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Calling method '>' {{(pid=116156) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:08:53.336963 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.compute.api [None req-ed91651f-3bf9-4199-b15a-7a1788b26bf0 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] [instance: fa7c86bc-c46f-4120-8f3d-d795f8d7c5cc] Fetching instance by UUID {{(pid=116156) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:08:53.342870 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-ed91651f-3bf9-4199-b15a-7a1788b26bf0 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:08:53.343328 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-ed91651f-3bf9-4199-b15a-7a1788b26bf0 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:08:53.344245 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-ed91651f-3bf9-4199-b15a-7a1788b26bf0 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:08:53.344679 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-ed91651f-3bf9-4199-b15a-7a1788b26bf0 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:08:53.476316 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.policy [None req-ed91651f-3bf9-4199-b15a-7a1788b26bf0 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c4c0c82448e40ba801c0b52ec44e74a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a093d0bf43046aaa845f3cc115f3f5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116156) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:08:53.483826 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: INFO nova.api.openstack.requestlog [None req-ed91651f-3bf9-4199-b15a-7a1788b26bf0 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] 10.222.0.18 "GET /compute/v2.1/servers/fa7c86bc-c46f-4120-8f3d-d795f8d7c5cc" status: 200 len: 1570 microversion: 2.1 time: 0.151219 Dec 15 03:08:53.484385 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: [pid: 116156|app: 0|req: 388/776] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 03:08:53 2021] GET /compute/v2.1/servers/fa7c86bc-c46f-4120-8f3d-d795f8d7c5cc => generated 1570 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 03:08:54.278587 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi [None req-cbf8dac7-b782-4c76-ad7a-f04f727e8006 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Calling method '>' {{(pid=116157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:08:54.279566 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.compute.api [None req-cbf8dac7-b782-4c76-ad7a-f04f727e8006 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] [instance: b89094ac-aee1-4bd6-a33d-8c4347cebfc7] Fetching instance by UUID {{(pid=116157) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:08:54.285499 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-cbf8dac7-b782-4c76-ad7a-f04f727e8006 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:08:54.285948 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-cbf8dac7-b782-4c76-ad7a-f04f727e8006 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:08:54.286746 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-cbf8dac7-b782-4c76-ad7a-f04f727e8006 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:08:54.287178 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-cbf8dac7-b782-4c76-ad7a-f04f727e8006 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:08:54.314977 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: INFO nova.api.openstack.requestlog [None req-cbf8dac7-b782-4c76-ad7a-f04f727e8006 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] 10.222.0.18 "GET /compute/v2.1/servers/b89094ac-aee1-4bd6-a33d-8c4347cebfc7/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041152 Dec 15 03:08:54.315510 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: [pid: 116157|app: 0|req: 389/777] 10.222.0.18 () {60 vars in 1342 bytes} [Wed Dec 15 03:08:54 2021] GET /compute/v2.1/servers/b89094ac-aee1-4bd6-a33d-8c4347cebfc7/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 03:08:54.503339 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi [None req-544deed1-d9e0-4855-aeb9-24eec65875f9 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Calling method '>' {{(pid=116156) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:08:54.503926 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.compute.api [None req-544deed1-d9e0-4855-aeb9-24eec65875f9 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] [instance: fa7c86bc-c46f-4120-8f3d-d795f8d7c5cc] Fetching instance by UUID {{(pid=116156) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:08:54.510714 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-544deed1-d9e0-4855-aeb9-24eec65875f9 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:08:54.511172 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-544deed1-d9e0-4855-aeb9-24eec65875f9 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:08:54.511955 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-544deed1-d9e0-4855-aeb9-24eec65875f9 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:08:54.512393 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-544deed1-d9e0-4855-aeb9-24eec65875f9 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:08:54.644806 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.policy [None req-544deed1-d9e0-4855-aeb9-24eec65875f9 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c4c0c82448e40ba801c0b52ec44e74a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a093d0bf43046aaa845f3cc115f3f5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116156) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:08:54.652011 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: INFO nova.api.openstack.requestlog [None req-544deed1-d9e0-4855-aeb9-24eec65875f9 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] 10.222.0.18 "GET /compute/v2.1/servers/fa7c86bc-c46f-4120-8f3d-d795f8d7c5cc" status: 200 len: 1570 microversion: 2.1 time: 0.152410 Dec 15 03:08:54.652575 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: [pid: 116156|app: 0|req: 389/778] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 03:08:54 2021] GET /compute/v2.1/servers/fa7c86bc-c46f-4120-8f3d-d795f8d7c5cc => generated 1570 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 03:08:55.326525 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi [None req-7e286d18-046f-487a-9bec-eba728c90c6d tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Calling method '>' {{(pid=116157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:08:55.327419 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.compute.api [None req-7e286d18-046f-487a-9bec-eba728c90c6d tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] [instance: b89094ac-aee1-4bd6-a33d-8c4347cebfc7] Fetching instance by UUID {{(pid=116157) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:08:55.333546 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-7e286d18-046f-487a-9bec-eba728c90c6d tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:08:55.334022 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-7e286d18-046f-487a-9bec-eba728c90c6d tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:08:55.335415 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-7e286d18-046f-487a-9bec-eba728c90c6d tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:08:55.335849 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-7e286d18-046f-487a-9bec-eba728c90c6d tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:08:55.363805 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: INFO nova.api.openstack.requestlog [None req-7e286d18-046f-487a-9bec-eba728c90c6d tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] 10.222.0.18 "GET /compute/v2.1/servers/b89094ac-aee1-4bd6-a33d-8c4347cebfc7/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041106 Dec 15 03:08:55.364344 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: [pid: 116157|app: 0|req: 390/779] 10.222.0.18 () {60 vars in 1342 bytes} [Wed Dec 15 03:08:55 2021] GET /compute/v2.1/servers/b89094ac-aee1-4bd6-a33d-8c4347cebfc7/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 03:08:55.669293 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi [None req-d31fd6f1-7e5c-4e1e-8bab-576964fb5a4a tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Calling method '>' {{(pid=116156) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:08:55.669898 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.compute.api [None req-d31fd6f1-7e5c-4e1e-8bab-576964fb5a4a tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] [instance: fa7c86bc-c46f-4120-8f3d-d795f8d7c5cc] Fetching instance by UUID {{(pid=116156) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:08:55.676135 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-d31fd6f1-7e5c-4e1e-8bab-576964fb5a4a tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:08:55.676580 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-d31fd6f1-7e5c-4e1e-8bab-576964fb5a4a tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:08:55.677351 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-d31fd6f1-7e5c-4e1e-8bab-576964fb5a4a tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:08:55.677784 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-d31fd6f1-7e5c-4e1e-8bab-576964fb5a4a tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:08:55.807047 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.policy [None req-d31fd6f1-7e5c-4e1e-8bab-576964fb5a4a tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c4c0c82448e40ba801c0b52ec44e74a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a093d0bf43046aaa845f3cc115f3f5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116156) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:08:55.814144 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: INFO nova.api.openstack.requestlog [None req-d31fd6f1-7e5c-4e1e-8bab-576964fb5a4a tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] 10.222.0.18 "GET /compute/v2.1/servers/fa7c86bc-c46f-4120-8f3d-d795f8d7c5cc" status: 200 len: 1570 microversion: 2.1 time: 0.148392 Dec 15 03:08:55.814696 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: [pid: 116156|app: 0|req: 390/780] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 03:08:55 2021] GET /compute/v2.1/servers/fa7c86bc-c46f-4120-8f3d-d795f8d7c5cc => generated 1570 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 03:08:56.375605 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi [None req-6831006e-b189-49a2-b386-db06d3e8d434 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Calling method '>' {{(pid=116157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:08:56.376503 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.compute.api [None req-6831006e-b189-49a2-b386-db06d3e8d434 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] [instance: b89094ac-aee1-4bd6-a33d-8c4347cebfc7] Fetching instance by UUID {{(pid=116157) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:08:56.383305 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-6831006e-b189-49a2-b386-db06d3e8d434 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:08:56.383751 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-6831006e-b189-49a2-b386-db06d3e8d434 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:08:56.384530 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-6831006e-b189-49a2-b386-db06d3e8d434 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:08:56.384966 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-6831006e-b189-49a2-b386-db06d3e8d434 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:08:56.412604 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: INFO nova.api.openstack.requestlog [None req-6831006e-b189-49a2-b386-db06d3e8d434 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] 10.222.0.18 "GET /compute/v2.1/servers/b89094ac-aee1-4bd6-a33d-8c4347cebfc7/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.040823 Dec 15 03:08:56.413656 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: [pid: 116157|app: 0|req: 391/781] 10.222.0.18 () {60 vars in 1342 bytes} [Wed Dec 15 03:08:56 2021] GET /compute/v2.1/servers/b89094ac-aee1-4bd6-a33d-8c4347cebfc7/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 03:08:56.831818 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi [None req-142c9915-e9e7-4b1f-a478-894638250757 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Calling method '>' {{(pid=116156) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:08:56.832487 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.compute.api [None req-142c9915-e9e7-4b1f-a478-894638250757 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] [instance: fa7c86bc-c46f-4120-8f3d-d795f8d7c5cc] Fetching instance by UUID {{(pid=116156) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:08:56.839163 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-142c9915-e9e7-4b1f-a478-894638250757 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:08:56.839618 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-142c9915-e9e7-4b1f-a478-894638250757 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:08:56.840397 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-142c9915-e9e7-4b1f-a478-894638250757 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:08:56.840838 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-142c9915-e9e7-4b1f-a478-894638250757 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:08:56.966826 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.policy [None req-142c9915-e9e7-4b1f-a478-894638250757 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c4c0c82448e40ba801c0b52ec44e74a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a093d0bf43046aaa845f3cc115f3f5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116156) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:08:56.973876 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: INFO nova.api.openstack.requestlog [None req-142c9915-e9e7-4b1f-a478-894638250757 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] 10.222.0.18 "GET /compute/v2.1/servers/fa7c86bc-c46f-4120-8f3d-d795f8d7c5cc" status: 200 len: 1570 microversion: 2.1 time: 0.146280 Dec 15 03:08:56.974463 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: [pid: 116156|app: 0|req: 391/782] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 03:08:56 2021] GET /compute/v2.1/servers/fa7c86bc-c46f-4120-8f3d-d795f8d7c5cc => generated 1570 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 03:08:57.424584 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi [None req-355238fa-3577-44b7-bdfe-546bcf383878 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Calling method '>' {{(pid=116157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:08:57.425475 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.compute.api [None req-355238fa-3577-44b7-bdfe-546bcf383878 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] [instance: b89094ac-aee1-4bd6-a33d-8c4347cebfc7] Fetching instance by UUID {{(pid=116157) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:08:57.432758 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-355238fa-3577-44b7-bdfe-546bcf383878 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:08:57.433202 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-355238fa-3577-44b7-bdfe-546bcf383878 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:08:57.433999 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-355238fa-3577-44b7-bdfe-546bcf383878 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:08:57.434476 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-355238fa-3577-44b7-bdfe-546bcf383878 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:08:57.461967 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: INFO nova.api.openstack.requestlog [None req-355238fa-3577-44b7-bdfe-546bcf383878 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] 10.222.0.18 "GET /compute/v2.1/servers/b89094ac-aee1-4bd6-a33d-8c4347cebfc7/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041149 Dec 15 03:08:57.462539 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: [pid: 116157|app: 0|req: 392/783] 10.222.0.18 () {60 vars in 1342 bytes} [Wed Dec 15 03:08:57 2021] GET /compute/v2.1/servers/b89094ac-aee1-4bd6-a33d-8c4347cebfc7/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 03:08:57.991154 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi [None req-b93d705c-2492-437b-b3e4-4a718912be55 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Calling method '>' {{(pid=116156) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:08:57.992055 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.compute.api [None req-b93d705c-2492-437b-b3e4-4a718912be55 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] [instance: fa7c86bc-c46f-4120-8f3d-d795f8d7c5cc] Fetching instance by UUID {{(pid=116156) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:08:57.998317 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-b93d705c-2492-437b-b3e4-4a718912be55 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:08:57.998768 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-b93d705c-2492-437b-b3e4-4a718912be55 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:08:57.999575 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-b93d705c-2492-437b-b3e4-4a718912be55 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:08:58.000012 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-b93d705c-2492-437b-b3e4-4a718912be55 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:08:58.131088 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.policy [None req-b93d705c-2492-437b-b3e4-4a718912be55 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c4c0c82448e40ba801c0b52ec44e74a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a093d0bf43046aaa845f3cc115f3f5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116156) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:08:58.138904 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: INFO nova.api.openstack.requestlog [None req-b93d705c-2492-437b-b3e4-4a718912be55 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] 10.222.0.18 "GET /compute/v2.1/servers/fa7c86bc-c46f-4120-8f3d-d795f8d7c5cc" status: 200 len: 1570 microversion: 2.1 time: 0.151334 Dec 15 03:08:58.139473 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: [pid: 116156|app: 0|req: 392/784] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 03:08:57 2021] GET /compute/v2.1/servers/fa7c86bc-c46f-4120-8f3d-d795f8d7c5cc => generated 1570 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 03:08:58.473488 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi [None req-e57ec6ac-ced4-4733-a6ac-ac0dbd97339a tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Calling method '>' {{(pid=116157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:08:58.474397 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.compute.api [None req-e57ec6ac-ced4-4733-a6ac-ac0dbd97339a tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] [instance: b89094ac-aee1-4bd6-a33d-8c4347cebfc7] Fetching instance by UUID {{(pid=116157) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:08:58.480582 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-e57ec6ac-ced4-4733-a6ac-ac0dbd97339a tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:08:58.481018 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-e57ec6ac-ced4-4733-a6ac-ac0dbd97339a tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:08:58.481789 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-e57ec6ac-ced4-4733-a6ac-ac0dbd97339a tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:08:58.482245 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-e57ec6ac-ced4-4733-a6ac-ac0dbd97339a tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:08:58.511013 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: INFO nova.api.openstack.requestlog [None req-e57ec6ac-ced4-4733-a6ac-ac0dbd97339a tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] 10.222.0.18 "GET /compute/v2.1/servers/b89094ac-aee1-4bd6-a33d-8c4347cebfc7/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041349 Dec 15 03:08:58.511557 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: [pid: 116157|app: 0|req: 393/785] 10.222.0.18 () {60 vars in 1342 bytes} [Wed Dec 15 03:08:58 2021] GET /compute/v2.1/servers/b89094ac-aee1-4bd6-a33d-8c4347cebfc7/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 03:08:59.156118 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi [None req-066442b4-562b-4167-a530-93163048b393 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Calling method '>' {{(pid=116156) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:08:59.156778 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.compute.api [None req-066442b4-562b-4167-a530-93163048b393 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] [instance: fa7c86bc-c46f-4120-8f3d-d795f8d7c5cc] Fetching instance by UUID {{(pid=116156) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:08:59.162958 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-066442b4-562b-4167-a530-93163048b393 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:08:59.164184 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-066442b4-562b-4167-a530-93163048b393 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:08:59.164962 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-066442b4-562b-4167-a530-93163048b393 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:08:59.165401 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-066442b4-562b-4167-a530-93163048b393 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:08:59.294957 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.policy [None req-066442b4-562b-4167-a530-93163048b393 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c4c0c82448e40ba801c0b52ec44e74a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a093d0bf43046aaa845f3cc115f3f5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116156) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:08:59.302102 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: INFO nova.api.openstack.requestlog [None req-066442b4-562b-4167-a530-93163048b393 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] 10.222.0.18 "GET /compute/v2.1/servers/fa7c86bc-c46f-4120-8f3d-d795f8d7c5cc" status: 200 len: 1570 microversion: 2.1 time: 0.149591 Dec 15 03:08:59.302676 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: [pid: 116156|app: 0|req: 393/786] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 03:08:59 2021] GET /compute/v2.1/servers/fa7c86bc-c46f-4120-8f3d-d795f8d7c5cc => generated 1570 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 03:08:59.522265 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi [None req-be265044-3249-4159-89e6-52a1e8894a47 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Calling method '>' {{(pid=116157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:08:59.523629 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.compute.api [None req-be265044-3249-4159-89e6-52a1e8894a47 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] [instance: b89094ac-aee1-4bd6-a33d-8c4347cebfc7] Fetching instance by UUID {{(pid=116157) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:08:59.529801 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-be265044-3249-4159-89e6-52a1e8894a47 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:08:59.530271 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-be265044-3249-4159-89e6-52a1e8894a47 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:08:59.531044 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-be265044-3249-4159-89e6-52a1e8894a47 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:08:59.531479 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-be265044-3249-4159-89e6-52a1e8894a47 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:08:59.559456 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: INFO nova.api.openstack.requestlog [None req-be265044-3249-4159-89e6-52a1e8894a47 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] 10.222.0.18 "GET /compute/v2.1/servers/b89094ac-aee1-4bd6-a33d-8c4347cebfc7/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041103 Dec 15 03:08:59.560000 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: [pid: 116157|app: 0|req: 394/787] 10.222.0.18 () {60 vars in 1342 bytes} [Wed Dec 15 03:08:59 2021] GET /compute/v2.1/servers/b89094ac-aee1-4bd6-a33d-8c4347cebfc7/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 03:09:00.318362 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi [None req-d973883b-d531-47bb-8f31-a296518b83c4 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Calling method '>' {{(pid=116156) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:09:00.319003 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.compute.api [None req-d973883b-d531-47bb-8f31-a296518b83c4 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] [instance: fa7c86bc-c46f-4120-8f3d-d795f8d7c5cc] Fetching instance by UUID {{(pid=116156) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:09:00.325272 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-d973883b-d531-47bb-8f31-a296518b83c4 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:09:00.325729 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-d973883b-d531-47bb-8f31-a296518b83c4 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:09:00.326540 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-d973883b-d531-47bb-8f31-a296518b83c4 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:09:00.326983 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-d973883b-d531-47bb-8f31-a296518b83c4 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:09:00.460487 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.policy [None req-d973883b-d531-47bb-8f31-a296518b83c4 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c4c0c82448e40ba801c0b52ec44e74a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a093d0bf43046aaa845f3cc115f3f5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116156) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:09:00.467819 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: INFO nova.api.openstack.requestlog [None req-d973883b-d531-47bb-8f31-a296518b83c4 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] 10.222.0.18 "GET /compute/v2.1/servers/fa7c86bc-c46f-4120-8f3d-d795f8d7c5cc" status: 200 len: 1570 microversion: 2.1 time: 0.153198 Dec 15 03:09:00.468384 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: [pid: 116156|app: 0|req: 394/788] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 03:09:00 2021] GET /compute/v2.1/servers/fa7c86bc-c46f-4120-8f3d-d795f8d7c5cc => generated 1570 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 03:09:00.572021 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi [None req-13c25776-76a2-459e-8412-3d083d33a6f6 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Calling method '>' {{(pid=116157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:09:00.572954 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.compute.api [None req-13c25776-76a2-459e-8412-3d083d33a6f6 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] [instance: b89094ac-aee1-4bd6-a33d-8c4347cebfc7] Fetching instance by UUID {{(pid=116157) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:09:00.578871 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-13c25776-76a2-459e-8412-3d083d33a6f6 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:09:00.579330 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-13c25776-76a2-459e-8412-3d083d33a6f6 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:09:00.580123 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-13c25776-76a2-459e-8412-3d083d33a6f6 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:09:00.580563 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-13c25776-76a2-459e-8412-3d083d33a6f6 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:09:00.612990 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: INFO nova.api.openstack.requestlog [None req-13c25776-76a2-459e-8412-3d083d33a6f6 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] 10.222.0.18 "GET /compute/v2.1/servers/b89094ac-aee1-4bd6-a33d-8c4347cebfc7/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045875 Dec 15 03:09:00.613553 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: [pid: 116157|app: 0|req: 395/789] 10.222.0.18 () {60 vars in 1342 bytes} [Wed Dec 15 03:09:00 2021] GET /compute/v2.1/servers/b89094ac-aee1-4bd6-a33d-8c4347cebfc7/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 03:09:01.485237 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi [None req-210a86c9-2a67-4004-a060-4b9facf72f6c tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Calling method '>' {{(pid=116156) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:09:01.485782 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.compute.api [None req-210a86c9-2a67-4004-a060-4b9facf72f6c tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] [instance: fa7c86bc-c46f-4120-8f3d-d795f8d7c5cc] Fetching instance by UUID {{(pid=116156) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:09:01.492325 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-210a86c9-2a67-4004-a060-4b9facf72f6c tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:09:01.492781 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-210a86c9-2a67-4004-a060-4b9facf72f6c tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:09:01.493563 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-210a86c9-2a67-4004-a060-4b9facf72f6c tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:09:01.494022 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-210a86c9-2a67-4004-a060-4b9facf72f6c tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:09:01.621642 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.policy [None req-210a86c9-2a67-4004-a060-4b9facf72f6c tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c4c0c82448e40ba801c0b52ec44e74a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a093d0bf43046aaa845f3cc115f3f5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116156) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:09:01.624509 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi [None req-335a7426-51dd-4e93-9051-0d6a6575415e tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Calling method '>' {{(pid=116157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:09:01.625450 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.compute.api [None req-335a7426-51dd-4e93-9051-0d6a6575415e tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] [instance: b89094ac-aee1-4bd6-a33d-8c4347cebfc7] Fetching instance by UUID {{(pid=116157) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:09:01.629156 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: INFO nova.api.openstack.requestlog [None req-210a86c9-2a67-4004-a060-4b9facf72f6c tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] 10.222.0.18 "GET /compute/v2.1/servers/fa7c86bc-c46f-4120-8f3d-d795f8d7c5cc" status: 200 len: 1570 microversion: 2.1 time: 0.147586 Dec 15 03:09:01.629718 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: [pid: 116156|app: 0|req: 395/790] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 03:09:01 2021] GET /compute/v2.1/servers/fa7c86bc-c46f-4120-8f3d-d795f8d7c5cc => generated 1570 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 03:09:01.632648 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-335a7426-51dd-4e93-9051-0d6a6575415e tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:09:01.633101 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-335a7426-51dd-4e93-9051-0d6a6575415e tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:09:01.633897 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-335a7426-51dd-4e93-9051-0d6a6575415e tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:09:01.634364 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-335a7426-51dd-4e93-9051-0d6a6575415e tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:09:01.662760 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: INFO nova.api.openstack.requestlog [None req-335a7426-51dd-4e93-9051-0d6a6575415e tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] 10.222.0.18 "GET /compute/v2.1/servers/b89094ac-aee1-4bd6-a33d-8c4347cebfc7/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042018 Dec 15 03:09:01.663993 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: [pid: 116157|app: 0|req: 396/791] 10.222.0.18 () {60 vars in 1342 bytes} [Wed Dec 15 03:09:01 2021] GET /compute/v2.1/servers/b89094ac-aee1-4bd6-a33d-8c4347cebfc7/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Dec 15 03:09:02.646000 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi [None req-1a2a887b-8b4e-4a79-a4a5-04cde780e6f0 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Calling method '>' {{(pid=116156) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:09:02.646614 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.compute.api [None req-1a2a887b-8b4e-4a79-a4a5-04cde780e6f0 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] [instance: fa7c86bc-c46f-4120-8f3d-d795f8d7c5cc] Fetching instance by UUID {{(pid=116156) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:09:02.652958 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-1a2a887b-8b4e-4a79-a4a5-04cde780e6f0 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:09:02.653408 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-1a2a887b-8b4e-4a79-a4a5-04cde780e6f0 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:09:02.654276 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-1a2a887b-8b4e-4a79-a4a5-04cde780e6f0 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:09:02.654709 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-1a2a887b-8b4e-4a79-a4a5-04cde780e6f0 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:09:02.674300 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi [None req-f0f89aa0-5989-4989-a2d8-d225af2b69a9 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Calling method '>' {{(pid=116157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:09:02.675207 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.compute.api [None req-f0f89aa0-5989-4989-a2d8-d225af2b69a9 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] [instance: b89094ac-aee1-4bd6-a33d-8c4347cebfc7] Fetching instance by UUID {{(pid=116157) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:09:02.682201 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-f0f89aa0-5989-4989-a2d8-d225af2b69a9 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:09:02.682662 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-f0f89aa0-5989-4989-a2d8-d225af2b69a9 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:09:02.683454 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-f0f89aa0-5989-4989-a2d8-d225af2b69a9 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:09:02.683904 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-f0f89aa0-5989-4989-a2d8-d225af2b69a9 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:09:02.712903 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: INFO nova.api.openstack.requestlog [None req-f0f89aa0-5989-4989-a2d8-d225af2b69a9 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] 10.222.0.18 "GET /compute/v2.1/servers/b89094ac-aee1-4bd6-a33d-8c4347cebfc7/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042208 Dec 15 03:09:02.713494 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: [pid: 116157|app: 0|req: 397/792] 10.222.0.18 () {60 vars in 1342 bytes} [Wed Dec 15 03:09:02 2021] GET /compute/v2.1/servers/b89094ac-aee1-4bd6-a33d-8c4347cebfc7/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Dec 15 03:09:02.789584 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.policy [None req-1a2a887b-8b4e-4a79-a4a5-04cde780e6f0 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c4c0c82448e40ba801c0b52ec44e74a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a093d0bf43046aaa845f3cc115f3f5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116156) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:09:02.796711 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: INFO nova.api.openstack.requestlog [None req-1a2a887b-8b4e-4a79-a4a5-04cde780e6f0 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] 10.222.0.18 "GET /compute/v2.1/servers/fa7c86bc-c46f-4120-8f3d-d795f8d7c5cc" status: 200 len: 1570 microversion: 2.1 time: 0.154451 Dec 15 03:09:02.797288 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: [pid: 116156|app: 0|req: 396/793] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 03:09:02 2021] GET /compute/v2.1/servers/fa7c86bc-c46f-4120-8f3d-d795f8d7c5cc => generated 1570 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 03:09:03.725827 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi [None req-10ebebae-776d-4b8c-9dde-e1d768dba6d2 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Calling method '>' {{(pid=116157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:09:03.726955 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.compute.api [None req-10ebebae-776d-4b8c-9dde-e1d768dba6d2 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] [instance: b89094ac-aee1-4bd6-a33d-8c4347cebfc7] Fetching instance by UUID {{(pid=116157) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:09:03.733078 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-10ebebae-776d-4b8c-9dde-e1d768dba6d2 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:09:03.733532 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-10ebebae-776d-4b8c-9dde-e1d768dba6d2 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:09:03.734339 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-10ebebae-776d-4b8c-9dde-e1d768dba6d2 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:09:03.734778 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-10ebebae-776d-4b8c-9dde-e1d768dba6d2 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:09:03.764237 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: INFO nova.api.openstack.requestlog [None req-10ebebae-776d-4b8c-9dde-e1d768dba6d2 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] 10.222.0.18 "GET /compute/v2.1/servers/b89094ac-aee1-4bd6-a33d-8c4347cebfc7/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042122 Dec 15 03:09:03.764978 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: [pid: 116157|app: 0|req: 398/794] 10.222.0.18 () {60 vars in 1342 bytes} [Wed Dec 15 03:09:03 2021] GET /compute/v2.1/servers/b89094ac-aee1-4bd6-a33d-8c4347cebfc7/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 03:09:03.813397 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi [None req-983a12bf-4446-4835-ba0c-d089828d8067 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Calling method '>' {{(pid=116156) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:09:03.814040 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.compute.api [None req-983a12bf-4446-4835-ba0c-d089828d8067 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] [instance: fa7c86bc-c46f-4120-8f3d-d795f8d7c5cc] Fetching instance by UUID {{(pid=116156) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:09:03.820868 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-983a12bf-4446-4835-ba0c-d089828d8067 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:09:03.821322 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-983a12bf-4446-4835-ba0c-d089828d8067 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:09:03.822147 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-983a12bf-4446-4835-ba0c-d089828d8067 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:09:03.822588 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-983a12bf-4446-4835-ba0c-d089828d8067 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:09:04.023322 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.policy [None req-983a12bf-4446-4835-ba0c-d089828d8067 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c4c0c82448e40ba801c0b52ec44e74a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a093d0bf43046aaa845f3cc115f3f5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116156) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:09:04.030677 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: INFO nova.api.openstack.requestlog [None req-983a12bf-4446-4835-ba0c-d089828d8067 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] 10.222.0.18 "GET /compute/v2.1/servers/fa7c86bc-c46f-4120-8f3d-d795f8d7c5cc" status: 200 len: 1570 microversion: 2.1 time: 0.220963 Dec 15 03:09:04.031261 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: [pid: 116156|app: 0|req: 397/795] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 03:09:03 2021] GET /compute/v2.1/servers/fa7c86bc-c46f-4120-8f3d-d795f8d7c5cc => generated 1570 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 03:09:04.776389 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi [None req-9ad87320-10dd-493f-a28b-dc39c22abfb2 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Calling method '>' {{(pid=116157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:09:04.777279 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.compute.api [None req-9ad87320-10dd-493f-a28b-dc39c22abfb2 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] [instance: b89094ac-aee1-4bd6-a33d-8c4347cebfc7] Fetching instance by UUID {{(pid=116157) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:09:04.783456 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-9ad87320-10dd-493f-a28b-dc39c22abfb2 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:09:04.783909 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-9ad87320-10dd-493f-a28b-dc39c22abfb2 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:09:04.784679 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-9ad87320-10dd-493f-a28b-dc39c22abfb2 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:09:04.785111 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-9ad87320-10dd-493f-a28b-dc39c22abfb2 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:09:04.812402 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: INFO nova.api.openstack.requestlog [None req-9ad87320-10dd-493f-a28b-dc39c22abfb2 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] 10.222.0.18 "GET /compute/v2.1/servers/b89094ac-aee1-4bd6-a33d-8c4347cebfc7/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.040383 Dec 15 03:09:04.812941 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: [pid: 116157|app: 0|req: 399/796] 10.222.0.18 () {60 vars in 1342 bytes} [Wed Dec 15 03:09:04 2021] GET /compute/v2.1/servers/b89094ac-aee1-4bd6-a33d-8c4347cebfc7/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 03:09:05.047411 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi [None req-f6d0fb94-f435-4c78-9d51-8652def42753 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Calling method '>' {{(pid=116156) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:09:05.048020 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.compute.api [None req-f6d0fb94-f435-4c78-9d51-8652def42753 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] [instance: fa7c86bc-c46f-4120-8f3d-d795f8d7c5cc] Fetching instance by UUID {{(pid=116156) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:09:05.054668 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-f6d0fb94-f435-4c78-9d51-8652def42753 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:09:05.055123 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-f6d0fb94-f435-4c78-9d51-8652def42753 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:09:05.055913 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-f6d0fb94-f435-4c78-9d51-8652def42753 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:09:05.056361 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-f6d0fb94-f435-4c78-9d51-8652def42753 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:09:05.184951 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.policy [None req-f6d0fb94-f435-4c78-9d51-8652def42753 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c4c0c82448e40ba801c0b52ec44e74a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a093d0bf43046aaa845f3cc115f3f5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116156) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:09:05.192193 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: INFO nova.api.openstack.requestlog [None req-f6d0fb94-f435-4c78-9d51-8652def42753 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] 10.222.0.18 "GET /compute/v2.1/servers/fa7c86bc-c46f-4120-8f3d-d795f8d7c5cc" status: 200 len: 1570 microversion: 2.1 time: 0.148386 Dec 15 03:09:05.192757 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: [pid: 116156|app: 0|req: 398/797] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 03:09:05 2021] GET /compute/v2.1/servers/fa7c86bc-c46f-4120-8f3d-d795f8d7c5cc => generated 1570 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 03:09:05.824227 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi [None req-7d59350c-a983-4b86-980c-19246a4882dd tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Calling method '>' {{(pid=116157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:09:05.825126 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.compute.api [None req-7d59350c-a983-4b86-980c-19246a4882dd tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] [instance: b89094ac-aee1-4bd6-a33d-8c4347cebfc7] Fetching instance by UUID {{(pid=116157) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:09:05.831486 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-7d59350c-a983-4b86-980c-19246a4882dd tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:09:05.831937 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-7d59350c-a983-4b86-980c-19246a4882dd tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:09:05.832743 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-7d59350c-a983-4b86-980c-19246a4882dd tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:09:05.833176 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-7d59350c-a983-4b86-980c-19246a4882dd tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:09:05.862274 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: INFO nova.api.openstack.requestlog [None req-7d59350c-a983-4b86-980c-19246a4882dd tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] 10.222.0.18 "GET /compute/v2.1/servers/b89094ac-aee1-4bd6-a33d-8c4347cebfc7/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041815 Dec 15 03:09:05.862824 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: [pid: 116157|app: 0|req: 400/798] 10.222.0.18 () {60 vars in 1342 bytes} [Wed Dec 15 03:09:05 2021] GET /compute/v2.1/servers/b89094ac-aee1-4bd6-a33d-8c4347cebfc7/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 03:09:06.209658 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi [None req-922002fb-19b3-40df-b363-a0c5179715f1 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Calling method '>' {{(pid=116156) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:09:06.210938 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.compute.api [None req-922002fb-19b3-40df-b363-a0c5179715f1 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] [instance: fa7c86bc-c46f-4120-8f3d-d795f8d7c5cc] Fetching instance by UUID {{(pid=116156) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:09:06.217150 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-922002fb-19b3-40df-b363-a0c5179715f1 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:09:06.217600 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-922002fb-19b3-40df-b363-a0c5179715f1 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:09:06.218420 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-922002fb-19b3-40df-b363-a0c5179715f1 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:09:06.218858 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-922002fb-19b3-40df-b363-a0c5179715f1 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:09:06.349503 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.policy [None req-922002fb-19b3-40df-b363-a0c5179715f1 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c4c0c82448e40ba801c0b52ec44e74a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a093d0bf43046aaa845f3cc115f3f5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116156) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:09:06.356691 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: INFO nova.api.openstack.requestlog [None req-922002fb-19b3-40df-b363-a0c5179715f1 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] 10.222.0.18 "GET /compute/v2.1/servers/fa7c86bc-c46f-4120-8f3d-d795f8d7c5cc" status: 200 len: 1570 microversion: 2.1 time: 0.150667 Dec 15 03:09:06.357258 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: [pid: 116156|app: 0|req: 399/799] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 03:09:06 2021] GET /compute/v2.1/servers/fa7c86bc-c46f-4120-8f3d-d795f8d7c5cc => generated 1570 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 03:09:06.873581 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi [None req-1370bf25-250b-4b90-b0f6-80fd55b79a97 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Calling method '>' {{(pid=116157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:09:06.874501 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.compute.api [None req-1370bf25-250b-4b90-b0f6-80fd55b79a97 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] [instance: b89094ac-aee1-4bd6-a33d-8c4347cebfc7] Fetching instance by UUID {{(pid=116157) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:09:06.880751 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-1370bf25-250b-4b90-b0f6-80fd55b79a97 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:09:06.881191 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-1370bf25-250b-4b90-b0f6-80fd55b79a97 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:09:06.882623 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-1370bf25-250b-4b90-b0f6-80fd55b79a97 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:09:06.883064 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-1370bf25-250b-4b90-b0f6-80fd55b79a97 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:09:06.910500 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: INFO nova.api.openstack.requestlog [None req-1370bf25-250b-4b90-b0f6-80fd55b79a97 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] 10.222.0.18 "GET /compute/v2.1/servers/b89094ac-aee1-4bd6-a33d-8c4347cebfc7/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.040652 Dec 15 03:09:06.911967 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: [pid: 116157|app: 0|req: 401/800] 10.222.0.18 () {60 vars in 1342 bytes} [Wed Dec 15 03:09:06 2021] GET /compute/v2.1/servers/b89094ac-aee1-4bd6-a33d-8c4347cebfc7/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 03:09:07.373531 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi [None req-7effb878-f23d-40b9-a43b-59eed43aa8db tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Calling method '>' {{(pid=116156) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:09:07.374185 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.compute.api [None req-7effb878-f23d-40b9-a43b-59eed43aa8db tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] [instance: fa7c86bc-c46f-4120-8f3d-d795f8d7c5cc] Fetching instance by UUID {{(pid=116156) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:09:07.380354 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-7effb878-f23d-40b9-a43b-59eed43aa8db tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:09:07.380807 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-7effb878-f23d-40b9-a43b-59eed43aa8db tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:09:07.381584 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-7effb878-f23d-40b9-a43b-59eed43aa8db tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:09:07.382046 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-7effb878-f23d-40b9-a43b-59eed43aa8db tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:09:07.512892 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.policy [None req-7effb878-f23d-40b9-a43b-59eed43aa8db tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c4c0c82448e40ba801c0b52ec44e74a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a093d0bf43046aaa845f3cc115f3f5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116156) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:09:07.520218 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: INFO nova.api.openstack.requestlog [None req-7effb878-f23d-40b9-a43b-59eed43aa8db tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] 10.222.0.18 "GET /compute/v2.1/servers/fa7c86bc-c46f-4120-8f3d-d795f8d7c5cc" status: 200 len: 1570 microversion: 2.1 time: 0.150288 Dec 15 03:09:07.520796 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: [pid: 116156|app: 0|req: 400/801] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 03:09:07 2021] GET /compute/v2.1/servers/fa7c86bc-c46f-4120-8f3d-d795f8d7c5cc => generated 1570 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 03:09:07.922978 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi [None req-5b93365f-48c3-4be2-96d6-f0eb57b957a5 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Calling method '>' {{(pid=116157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:09:07.923870 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.compute.api [None req-5b93365f-48c3-4be2-96d6-f0eb57b957a5 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] [instance: b89094ac-aee1-4bd6-a33d-8c4347cebfc7] Fetching instance by UUID {{(pid=116157) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:09:07.930066 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-5b93365f-48c3-4be2-96d6-f0eb57b957a5 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:09:07.930513 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-5b93365f-48c3-4be2-96d6-f0eb57b957a5 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:09:07.931282 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-5b93365f-48c3-4be2-96d6-f0eb57b957a5 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:09:07.931712 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-5b93365f-48c3-4be2-96d6-f0eb57b957a5 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:09:07.959422 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: INFO nova.api.openstack.requestlog [None req-5b93365f-48c3-4be2-96d6-f0eb57b957a5 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] 10.222.0.18 "GET /compute/v2.1/servers/b89094ac-aee1-4bd6-a33d-8c4347cebfc7/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.040249 Dec 15 03:09:07.960630 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: [pid: 116157|app: 0|req: 402/802] 10.222.0.18 () {60 vars in 1342 bytes} [Wed Dec 15 03:09:07 2021] GET /compute/v2.1/servers/b89094ac-aee1-4bd6-a33d-8c4347cebfc7/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 03:09:08.538573 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi [None req-93ac1b30-303f-4b5d-bacf-66427ad5d390 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Calling method '>' {{(pid=116156) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:09:08.539146 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.compute.api [None req-93ac1b30-303f-4b5d-bacf-66427ad5d390 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] [instance: fa7c86bc-c46f-4120-8f3d-d795f8d7c5cc] Fetching instance by UUID {{(pid=116156) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:09:08.545338 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-93ac1b30-303f-4b5d-bacf-66427ad5d390 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:09:08.545787 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-93ac1b30-303f-4b5d-bacf-66427ad5d390 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:09:08.546598 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-93ac1b30-303f-4b5d-bacf-66427ad5d390 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:09:08.547037 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-93ac1b30-303f-4b5d-bacf-66427ad5d390 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:09:08.675053 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.policy [None req-93ac1b30-303f-4b5d-bacf-66427ad5d390 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c4c0c82448e40ba801c0b52ec44e74a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a093d0bf43046aaa845f3cc115f3f5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116156) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:09:08.682775 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: INFO nova.api.openstack.requestlog [None req-93ac1b30-303f-4b5d-bacf-66427ad5d390 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] 10.222.0.18 "GET /compute/v2.1/servers/fa7c86bc-c46f-4120-8f3d-d795f8d7c5cc" status: 200 len: 1570 microversion: 2.1 time: 0.148410 Dec 15 03:09:08.683330 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: [pid: 116156|app: 0|req: 401/803] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 03:09:08 2021] GET /compute/v2.1/servers/fa7c86bc-c46f-4120-8f3d-d795f8d7c5cc => generated 1570 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 03:09:08.971189 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi [None req-572caac4-74f4-4b07-bc47-1eba8db17e1b tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Calling method '>' {{(pid=116157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:09:08.972082 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.compute.api [None req-572caac4-74f4-4b07-bc47-1eba8db17e1b tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] [instance: b89094ac-aee1-4bd6-a33d-8c4347cebfc7] Fetching instance by UUID {{(pid=116157) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:09:08.978936 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-572caac4-74f4-4b07-bc47-1eba8db17e1b tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:09:08.979389 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-572caac4-74f4-4b07-bc47-1eba8db17e1b tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:09:08.980174 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-572caac4-74f4-4b07-bc47-1eba8db17e1b tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:09:08.980613 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-572caac4-74f4-4b07-bc47-1eba8db17e1b tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:09:09.008558 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: INFO nova.api.openstack.requestlog [None req-572caac4-74f4-4b07-bc47-1eba8db17e1b tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] 10.222.0.18 "GET /compute/v2.1/servers/b89094ac-aee1-4bd6-a33d-8c4347cebfc7/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041159 Dec 15 03:09:09.009114 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: [pid: 116157|app: 0|req: 403/804] 10.222.0.18 () {60 vars in 1342 bytes} [Wed Dec 15 03:09:08 2021] GET /compute/v2.1/servers/b89094ac-aee1-4bd6-a33d-8c4347cebfc7/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 03:09:09.700223 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi [None req-abef532f-fd35-4fca-9e19-6e74862b7c97 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Calling method '>' {{(pid=116156) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:09:09.700838 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.compute.api [None req-abef532f-fd35-4fca-9e19-6e74862b7c97 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] [instance: fa7c86bc-c46f-4120-8f3d-d795f8d7c5cc] Fetching instance by UUID {{(pid=116156) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:09:09.707112 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-abef532f-fd35-4fca-9e19-6e74862b7c97 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:09:09.707566 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-abef532f-fd35-4fca-9e19-6e74862b7c97 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:09:09.708349 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-abef532f-fd35-4fca-9e19-6e74862b7c97 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:09:09.708788 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-abef532f-fd35-4fca-9e19-6e74862b7c97 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:09:09.842383 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.policy [None req-abef532f-fd35-4fca-9e19-6e74862b7c97 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c4c0c82448e40ba801c0b52ec44e74a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a093d0bf43046aaa845f3cc115f3f5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116156) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:09:09.849589 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: INFO nova.api.openstack.requestlog [None req-abef532f-fd35-4fca-9e19-6e74862b7c97 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] 10.222.0.18 "GET /compute/v2.1/servers/fa7c86bc-c46f-4120-8f3d-d795f8d7c5cc" status: 200 len: 1570 microversion: 2.1 time: 0.153026 Dec 15 03:09:09.850189 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: [pid: 116156|app: 0|req: 402/805] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 03:09:09 2021] GET /compute/v2.1/servers/fa7c86bc-c46f-4120-8f3d-d795f8d7c5cc => generated 1570 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 03:09:10.020046 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi [None req-b2768d67-618b-4270-8177-b1ddf56c7333 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Calling method '>' {{(pid=116157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:09:10.020869 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.compute.api [None req-b2768d67-618b-4270-8177-b1ddf56c7333 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] [instance: b89094ac-aee1-4bd6-a33d-8c4347cebfc7] Fetching instance by UUID {{(pid=116157) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:09:10.027070 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-b2768d67-618b-4270-8177-b1ddf56c7333 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:09:10.027525 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-b2768d67-618b-4270-8177-b1ddf56c7333 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:09:10.028306 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-b2768d67-618b-4270-8177-b1ddf56c7333 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:09:10.028746 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-b2768d67-618b-4270-8177-b1ddf56c7333 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:09:10.057325 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: INFO nova.api.openstack.requestlog [None req-b2768d67-618b-4270-8177-b1ddf56c7333 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] 10.222.0.18 "GET /compute/v2.1/servers/b89094ac-aee1-4bd6-a33d-8c4347cebfc7/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041219 Dec 15 03:09:10.057859 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: [pid: 116157|app: 0|req: 404/806] 10.222.0.18 () {60 vars in 1342 bytes} [Wed Dec 15 03:09:10 2021] GET /compute/v2.1/servers/b89094ac-aee1-4bd6-a33d-8c4347cebfc7/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 03:09:10.562712 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi [req-1bca3f23-003c-42a5-9986-8d6835c56f25 req-3f9e8710-0fbf-4ebd-ba31-6845138f3f93 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fa7c86bc-c46f-4120-8f3d-d795f8d7c5cc", "name": "network-vif-unplugged", "status": "completed", "tag": "6bbc39c5-40bb-4350-a006-fae5a1ef78a6"}]} {{(pid=116156) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 03:09:10.564253 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 15 03:09:10.564253 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: warnings.warn(msg) Dec 15 03:09:10.572392 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [req-1bca3f23-003c-42a5-9986-8d6835c56f25 req-3f9e8710-0fbf-4ebd-ba31-6845138f3f93 service nova] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:09:10.576828 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [req-1bca3f23-003c-42a5-9986-8d6835c56f25 req-3f9e8710-0fbf-4ebd-ba31-6845138f3f93 service nova] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:09:10.588525 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: INFO nova.api.openstack.compute.server_external_events [req-1bca3f23-003c-42a5-9986-8d6835c56f25 req-3f9e8710-0fbf-4ebd-ba31-6845138f3f93 service nova] Creating event network-vif-unplugged:6bbc39c5-40bb-4350-a006-fae5a1ef78a6 for instance fa7c86bc-c46f-4120-8f3d-d795f8d7c5cc on hv-cinder-81803 Dec 15 03:09:10.593786 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: INFO nova.api.openstack.requestlog [req-1bca3f23-003c-42a5-9986-8d6835c56f25 req-3f9e8710-0fbf-4ebd-ba31-6845138f3f93 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.099074 Dec 15 03:09:10.594479 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: [pid: 116156|app: 0|req: 403/807] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Dec 15 03:09:10 2021] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 15 03:09:10.866279 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi [None req-88cfad7a-31a1-4d97-832a-76de3a60449e tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Calling method '>' {{(pid=116157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:09:10.867141 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.compute.api [None req-88cfad7a-31a1-4d97-832a-76de3a60449e tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] [instance: fa7c86bc-c46f-4120-8f3d-d795f8d7c5cc] Fetching instance by UUID {{(pid=116157) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:09:10.872921 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-88cfad7a-31a1-4d97-832a-76de3a60449e tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:09:10.873365 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-88cfad7a-31a1-4d97-832a-76de3a60449e tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:09:10.874163 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-88cfad7a-31a1-4d97-832a-76de3a60449e tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:09:10.874596 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-88cfad7a-31a1-4d97-832a-76de3a60449e tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:09:11.008415 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.policy [None req-88cfad7a-31a1-4d97-832a-76de3a60449e tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c4c0c82448e40ba801c0b52ec44e74a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a093d0bf43046aaa845f3cc115f3f5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116157) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:09:11.015653 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: INFO nova.api.openstack.requestlog [None req-88cfad7a-31a1-4d97-832a-76de3a60449e tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] 10.222.0.18 "GET /compute/v2.1/servers/fa7c86bc-c46f-4120-8f3d-d795f8d7c5cc" status: 200 len: 1570 microversion: 2.1 time: 0.152988 Dec 15 03:09:11.016216 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: [pid: 116157|app: 0|req: 405/808] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 03:09:10 2021] GET /compute/v2.1/servers/fa7c86bc-c46f-4120-8f3d-d795f8d7c5cc => generated 1570 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 03:09:11.069569 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi [None req-a8392445-a269-49bd-aaab-d12cf9236780 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Calling method '>' {{(pid=116156) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:09:11.070593 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.compute.api [None req-a8392445-a269-49bd-aaab-d12cf9236780 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] [instance: b89094ac-aee1-4bd6-a33d-8c4347cebfc7] Fetching instance by UUID {{(pid=116156) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:09:11.076820 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-a8392445-a269-49bd-aaab-d12cf9236780 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:09:11.077275 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-a8392445-a269-49bd-aaab-d12cf9236780 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:09:11.078120 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-a8392445-a269-49bd-aaab-d12cf9236780 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:09:11.078563 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-a8392445-a269-49bd-aaab-d12cf9236780 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:09:11.106356 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: INFO nova.api.openstack.requestlog [None req-a8392445-a269-49bd-aaab-d12cf9236780 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] 10.222.0.18 "GET /compute/v2.1/servers/b89094ac-aee1-4bd6-a33d-8c4347cebfc7/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041421 Dec 15 03:09:11.106896 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: [pid: 116156|app: 0|req: 404/809] 10.222.0.18 () {60 vars in 1342 bytes} [Wed Dec 15 03:09:11 2021] GET /compute/v2.1/servers/b89094ac-aee1-4bd6-a33d-8c4347cebfc7/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 03:09:12.033269 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi [None req-8564b830-0b48-4bd3-9a8d-7e6f391b282d tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Calling method '>' {{(pid=116157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:09:12.033886 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.compute.api [None req-8564b830-0b48-4bd3-9a8d-7e6f391b282d tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] [instance: fa7c86bc-c46f-4120-8f3d-d795f8d7c5cc] Fetching instance by UUID {{(pid=116157) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:09:12.040788 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-8564b830-0b48-4bd3-9a8d-7e6f391b282d tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:09:12.041244 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-8564b830-0b48-4bd3-9a8d-7e6f391b282d tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:09:12.042064 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-8564b830-0b48-4bd3-9a8d-7e6f391b282d tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:09:12.042509 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-8564b830-0b48-4bd3-9a8d-7e6f391b282d tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:09:12.118003 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi [None req-88dc0b69-9f1f-42eb-9ba9-84f521d6adc0 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Calling method '>' {{(pid=116156) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:09:12.118943 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.compute.api [None req-88dc0b69-9f1f-42eb-9ba9-84f521d6adc0 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] [instance: b89094ac-aee1-4bd6-a33d-8c4347cebfc7] Fetching instance by UUID {{(pid=116156) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:09:12.125311 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-88dc0b69-9f1f-42eb-9ba9-84f521d6adc0 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:09:12.125766 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-88dc0b69-9f1f-42eb-9ba9-84f521d6adc0 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:09:12.126582 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-88dc0b69-9f1f-42eb-9ba9-84f521d6adc0 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:09:12.127023 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-88dc0b69-9f1f-42eb-9ba9-84f521d6adc0 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:09:12.155817 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: INFO nova.api.openstack.requestlog [None req-88dc0b69-9f1f-42eb-9ba9-84f521d6adc0 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] 10.222.0.18 "GET /compute/v2.1/servers/b89094ac-aee1-4bd6-a33d-8c4347cebfc7/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041769 Dec 15 03:09:12.156381 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: [pid: 116156|app: 0|req: 405/810] 10.222.0.18 () {60 vars in 1342 bytes} [Wed Dec 15 03:09:12 2021] GET /compute/v2.1/servers/b89094ac-aee1-4bd6-a33d-8c4347cebfc7/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Dec 15 03:09:12.171971 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.policy [None req-8564b830-0b48-4bd3-9a8d-7e6f391b282d tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c4c0c82448e40ba801c0b52ec44e74a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a093d0bf43046aaa845f3cc115f3f5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116157) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:09:12.179216 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: INFO nova.api.openstack.requestlog [None req-8564b830-0b48-4bd3-9a8d-7e6f391b282d tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] 10.222.0.18 "GET /compute/v2.1/servers/fa7c86bc-c46f-4120-8f3d-d795f8d7c5cc" status: 200 len: 1570 microversion: 2.1 time: 0.149632 Dec 15 03:09:12.179775 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: [pid: 116157|app: 0|req: 406/811] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 03:09:12 2021] GET /compute/v2.1/servers/fa7c86bc-c46f-4120-8f3d-d795f8d7c5cc => generated 1570 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 03:09:13.167937 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi [None req-93abd5f5-27a6-4db5-ab33-e0341a61d4e9 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Calling method '>' {{(pid=116156) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:09:13.168831 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.compute.api [None req-93abd5f5-27a6-4db5-ab33-e0341a61d4e9 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] [instance: b89094ac-aee1-4bd6-a33d-8c4347cebfc7] Fetching instance by UUID {{(pid=116156) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:09:13.174973 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-93abd5f5-27a6-4db5-ab33-e0341a61d4e9 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:09:13.175419 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-93abd5f5-27a6-4db5-ab33-e0341a61d4e9 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:09:13.176193 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-93abd5f5-27a6-4db5-ab33-e0341a61d4e9 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:09:13.176622 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-93abd5f5-27a6-4db5-ab33-e0341a61d4e9 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:09:13.195741 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi [None req-326083e6-694a-4133-9c4e-ee85362b1eb5 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Calling method '>' {{(pid=116157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:09:13.196354 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.compute.api [None req-326083e6-694a-4133-9c4e-ee85362b1eb5 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] [instance: fa7c86bc-c46f-4120-8f3d-d795f8d7c5cc] Fetching instance by UUID {{(pid=116157) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:09:13.202836 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-326083e6-694a-4133-9c4e-ee85362b1eb5 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:09:13.204788 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-326083e6-694a-4133-9c4e-ee85362b1eb5 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:09:13.204788 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-326083e6-694a-4133-9c4e-ee85362b1eb5 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:09:13.204788 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-326083e6-694a-4133-9c4e-ee85362b1eb5 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:09:13.207289 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: INFO nova.api.openstack.requestlog [None req-93abd5f5-27a6-4db5-ab33-e0341a61d4e9 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] 10.222.0.18 "GET /compute/v2.1/servers/b89094ac-aee1-4bd6-a33d-8c4347cebfc7/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043097 Dec 15 03:09:13.208040 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: [pid: 116156|app: 0|req: 406/812] 10.222.0.18 () {60 vars in 1342 bytes} [Wed Dec 15 03:09:13 2021] GET /compute/v2.1/servers/b89094ac-aee1-4bd6-a33d-8c4347cebfc7/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 03:09:13.337085 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.policy [None req-326083e6-694a-4133-9c4e-ee85362b1eb5 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c4c0c82448e40ba801c0b52ec44e74a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a093d0bf43046aaa845f3cc115f3f5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116157) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:09:13.344572 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: INFO nova.api.openstack.requestlog [None req-326083e6-694a-4133-9c4e-ee85362b1eb5 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] 10.222.0.18 "GET /compute/v2.1/servers/fa7c86bc-c46f-4120-8f3d-d795f8d7c5cc" status: 200 len: 1570 microversion: 2.1 time: 0.152447 Dec 15 03:09:13.345126 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: [pid: 116157|app: 0|req: 407/813] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 03:09:13 2021] GET /compute/v2.1/servers/fa7c86bc-c46f-4120-8f3d-d795f8d7c5cc => generated 1570 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 03:09:14.218950 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi [None req-e50a2a0b-214b-4e18-a9ef-ac32f1d1adec tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Calling method '>' {{(pid=116156) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:09:14.219870 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.compute.api [None req-e50a2a0b-214b-4e18-a9ef-ac32f1d1adec tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] [instance: b89094ac-aee1-4bd6-a33d-8c4347cebfc7] Fetching instance by UUID {{(pid=116156) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:09:14.226014 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-e50a2a0b-214b-4e18-a9ef-ac32f1d1adec tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:09:14.226461 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-e50a2a0b-214b-4e18-a9ef-ac32f1d1adec tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:09:14.227229 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-e50a2a0b-214b-4e18-a9ef-ac32f1d1adec tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:09:14.227661 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-e50a2a0b-214b-4e18-a9ef-ac32f1d1adec tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:09:14.255803 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: INFO nova.api.openstack.requestlog [None req-e50a2a0b-214b-4e18-a9ef-ac32f1d1adec tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] 10.222.0.18 "GET /compute/v2.1/servers/b89094ac-aee1-4bd6-a33d-8c4347cebfc7/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.040624 Dec 15 03:09:14.256401 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: [pid: 116156|app: 0|req: 407/814] 10.222.0.18 () {60 vars in 1342 bytes} [Wed Dec 15 03:09:14 2021] GET /compute/v2.1/servers/b89094ac-aee1-4bd6-a33d-8c4347cebfc7/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 03:09:14.361791 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi [None req-7b8ede54-b6db-402a-b1dc-ef8823e0aa4a tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Calling method '>' {{(pid=116157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:09:14.362436 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.compute.api [None req-7b8ede54-b6db-402a-b1dc-ef8823e0aa4a tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] [instance: fa7c86bc-c46f-4120-8f3d-d795f8d7c5cc] Fetching instance by UUID {{(pid=116157) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:09:14.369498 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-7b8ede54-b6db-402a-b1dc-ef8823e0aa4a tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:09:14.369953 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-7b8ede54-b6db-402a-b1dc-ef8823e0aa4a tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:09:14.370761 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-7b8ede54-b6db-402a-b1dc-ef8823e0aa4a tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:09:14.371201 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-7b8ede54-b6db-402a-b1dc-ef8823e0aa4a tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:09:14.499422 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.policy [None req-7b8ede54-b6db-402a-b1dc-ef8823e0aa4a tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c4c0c82448e40ba801c0b52ec44e74a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a093d0bf43046aaa845f3cc115f3f5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116157) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:09:14.506927 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: INFO nova.api.openstack.requestlog [None req-7b8ede54-b6db-402a-b1dc-ef8823e0aa4a tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] 10.222.0.18 "GET /compute/v2.1/servers/fa7c86bc-c46f-4120-8f3d-d795f8d7c5cc" status: 200 len: 1570 microversion: 2.1 time: 0.148729 Dec 15 03:09:14.507486 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: [pid: 116157|app: 0|req: 408/815] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 03:09:14 2021] GET /compute/v2.1/servers/fa7c86bc-c46f-4120-8f3d-d795f8d7c5cc => generated 1570 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 03:09:15.267777 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi [None req-6c72296b-1e47-438a-87dc-74b3a1f2ee5e tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Calling method '>' {{(pid=116156) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:09:15.268715 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.compute.api [None req-6c72296b-1e47-438a-87dc-74b3a1f2ee5e tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] [instance: b89094ac-aee1-4bd6-a33d-8c4347cebfc7] Fetching instance by UUID {{(pid=116156) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:09:15.275624 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-6c72296b-1e47-438a-87dc-74b3a1f2ee5e tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:09:15.276077 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-6c72296b-1e47-438a-87dc-74b3a1f2ee5e tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:09:15.276857 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-6c72296b-1e47-438a-87dc-74b3a1f2ee5e tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:09:15.277297 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-6c72296b-1e47-438a-87dc-74b3a1f2ee5e tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:09:15.305246 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: INFO nova.api.openstack.requestlog [None req-6c72296b-1e47-438a-87dc-74b3a1f2ee5e tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] 10.222.0.18 "GET /compute/v2.1/servers/b89094ac-aee1-4bd6-a33d-8c4347cebfc7/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041231 Dec 15 03:09:15.305791 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: [pid: 116156|app: 0|req: 408/816] 10.222.0.18 () {60 vars in 1342 bytes} [Wed Dec 15 03:09:15 2021] GET /compute/v2.1/servers/b89094ac-aee1-4bd6-a33d-8c4347cebfc7/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 03:09:15.523984 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi [None req-0ed74b33-d0c4-43c8-949f-83a55c39e555 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Calling method '>' {{(pid=116157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:09:15.524518 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.compute.api [None req-0ed74b33-d0c4-43c8-949f-83a55c39e555 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] [instance: fa7c86bc-c46f-4120-8f3d-d795f8d7c5cc] Fetching instance by UUID {{(pid=116157) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:09:15.530752 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-0ed74b33-d0c4-43c8-949f-83a55c39e555 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:09:15.531203 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-0ed74b33-d0c4-43c8-949f-83a55c39e555 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:09:15.531977 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-0ed74b33-d0c4-43c8-949f-83a55c39e555 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:09:15.532441 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-0ed74b33-d0c4-43c8-949f-83a55c39e555 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:09:15.659496 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.policy [None req-0ed74b33-d0c4-43c8-949f-83a55c39e555 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c4c0c82448e40ba801c0b52ec44e74a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a093d0bf43046aaa845f3cc115f3f5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116157) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:09:15.666680 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: INFO nova.api.openstack.requestlog [None req-0ed74b33-d0c4-43c8-949f-83a55c39e555 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] 10.222.0.18 "GET /compute/v2.1/servers/fa7c86bc-c46f-4120-8f3d-d795f8d7c5cc" status: 200 len: 1570 microversion: 2.1 time: 0.147049 Dec 15 03:09:15.667245 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: [pid: 116157|app: 0|req: 409/817] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 03:09:15 2021] GET /compute/v2.1/servers/fa7c86bc-c46f-4120-8f3d-d795f8d7c5cc => generated 1570 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 03:09:16.316756 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi [None req-c59d492c-b2dd-4578-8124-68da1c25b145 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Calling method '>' {{(pid=116156) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:09:16.317663 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.compute.api [None req-c59d492c-b2dd-4578-8124-68da1c25b145 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] [instance: b89094ac-aee1-4bd6-a33d-8c4347cebfc7] Fetching instance by UUID {{(pid=116156) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:09:16.324017 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-c59d492c-b2dd-4578-8124-68da1c25b145 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:09:16.324472 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-c59d492c-b2dd-4578-8124-68da1c25b145 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:09:16.325267 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-c59d492c-b2dd-4578-8124-68da1c25b145 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:09:16.325709 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-c59d492c-b2dd-4578-8124-68da1c25b145 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:09:16.354487 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: INFO nova.api.openstack.requestlog [None req-c59d492c-b2dd-4578-8124-68da1c25b145 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] 10.222.0.18 "GET /compute/v2.1/servers/b89094ac-aee1-4bd6-a33d-8c4347cebfc7/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041590 Dec 15 03:09:16.355035 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: [pid: 116156|app: 0|req: 409/818] 10.222.0.18 () {60 vars in 1342 bytes} [Wed Dec 15 03:09:16 2021] GET /compute/v2.1/servers/b89094ac-aee1-4bd6-a33d-8c4347cebfc7/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 03:09:16.683556 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi [None req-ae477ec0-1483-497a-af64-6c751b557027 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Calling method '>' {{(pid=116157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:09:16.684163 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.compute.api [None req-ae477ec0-1483-497a-af64-6c751b557027 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] [instance: fa7c86bc-c46f-4120-8f3d-d795f8d7c5cc] Fetching instance by UUID {{(pid=116157) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:09:16.690557 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-ae477ec0-1483-497a-af64-6c751b557027 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:09:16.691028 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-ae477ec0-1483-497a-af64-6c751b557027 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:09:16.691812 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-ae477ec0-1483-497a-af64-6c751b557027 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:09:16.692245 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-ae477ec0-1483-497a-af64-6c751b557027 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:09:16.822470 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.policy [None req-ae477ec0-1483-497a-af64-6c751b557027 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c4c0c82448e40ba801c0b52ec44e74a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a093d0bf43046aaa845f3cc115f3f5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116157) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:09:16.829639 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: INFO nova.api.openstack.requestlog [None req-ae477ec0-1483-497a-af64-6c751b557027 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] 10.222.0.18 "GET /compute/v2.1/servers/fa7c86bc-c46f-4120-8f3d-d795f8d7c5cc" status: 200 len: 1570 microversion: 2.1 time: 0.149758 Dec 15 03:09:16.830229 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: [pid: 116157|app: 0|req: 410/819] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 03:09:16 2021] GET /compute/v2.1/servers/fa7c86bc-c46f-4120-8f3d-d795f8d7c5cc => generated 1570 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 03:09:17.366732 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi [None req-0a4ccee7-06d2-4df6-8e82-29ef3b017633 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Calling method '>' {{(pid=116156) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:09:17.367700 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.compute.api [None req-0a4ccee7-06d2-4df6-8e82-29ef3b017633 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] [instance: b89094ac-aee1-4bd6-a33d-8c4347cebfc7] Fetching instance by UUID {{(pid=116156) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:09:17.373824 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-0a4ccee7-06d2-4df6-8e82-29ef3b017633 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:09:17.374306 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-0a4ccee7-06d2-4df6-8e82-29ef3b017633 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:09:17.375082 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-0a4ccee7-06d2-4df6-8e82-29ef3b017633 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:09:17.375509 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-0a4ccee7-06d2-4df6-8e82-29ef3b017633 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:09:17.404096 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: INFO nova.api.openstack.requestlog [None req-0a4ccee7-06d2-4df6-8e82-29ef3b017633 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] 10.222.0.18 "GET /compute/v2.1/servers/b89094ac-aee1-4bd6-a33d-8c4347cebfc7/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041916 Dec 15 03:09:17.404699 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: [pid: 116156|app: 0|req: 410/820] 10.222.0.18 () {60 vars in 1342 bytes} [Wed Dec 15 03:09:17 2021] GET /compute/v2.1/servers/b89094ac-aee1-4bd6-a33d-8c4347cebfc7/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 03:09:17.846959 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi [None req-985f81b2-c8af-4ef1-8313-06bd77279688 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Calling method '>' {{(pid=116157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:09:17.847567 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.compute.api [None req-985f81b2-c8af-4ef1-8313-06bd77279688 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] [instance: fa7c86bc-c46f-4120-8f3d-d795f8d7c5cc] Fetching instance by UUID {{(pid=116157) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:09:17.854454 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-985f81b2-c8af-4ef1-8313-06bd77279688 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:09:17.854902 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-985f81b2-c8af-4ef1-8313-06bd77279688 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:09:17.855667 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-985f81b2-c8af-4ef1-8313-06bd77279688 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:09:17.856101 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-985f81b2-c8af-4ef1-8313-06bd77279688 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:09:17.983478 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.policy [None req-985f81b2-c8af-4ef1-8313-06bd77279688 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c4c0c82448e40ba801c0b52ec44e74a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a093d0bf43046aaa845f3cc115f3f5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116157) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:09:17.990642 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: INFO nova.api.openstack.requestlog [None req-985f81b2-c8af-4ef1-8313-06bd77279688 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] 10.222.0.18 "GET /compute/v2.1/servers/fa7c86bc-c46f-4120-8f3d-d795f8d7c5cc" status: 200 len: 1570 microversion: 2.1 time: 0.147293 Dec 15 03:09:17.991200 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: [pid: 116157|app: 0|req: 411/821] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 03:09:17 2021] GET /compute/v2.1/servers/fa7c86bc-c46f-4120-8f3d-d795f8d7c5cc => generated 1570 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 03:09:18.416637 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi [None req-4f9c98bd-d17e-49ec-ad29-febc79a61a56 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Calling method '>' {{(pid=116156) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:09:18.417966 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.compute.api [None req-4f9c98bd-d17e-49ec-ad29-febc79a61a56 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] [instance: b89094ac-aee1-4bd6-a33d-8c4347cebfc7] Fetching instance by UUID {{(pid=116156) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:09:18.424151 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-4f9c98bd-d17e-49ec-ad29-febc79a61a56 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:09:18.424592 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-4f9c98bd-d17e-49ec-ad29-febc79a61a56 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:09:18.425358 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-4f9c98bd-d17e-49ec-ad29-febc79a61a56 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:09:18.425793 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-4f9c98bd-d17e-49ec-ad29-febc79a61a56 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:09:18.454869 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: INFO nova.api.openstack.requestlog [None req-4f9c98bd-d17e-49ec-ad29-febc79a61a56 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] 10.222.0.18 "GET /compute/v2.1/servers/b89094ac-aee1-4bd6-a33d-8c4347cebfc7/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043363 Dec 15 03:09:18.455407 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: [pid: 116156|app: 0|req: 411/822] 10.222.0.18 () {60 vars in 1342 bytes} [Wed Dec 15 03:09:18 2021] GET /compute/v2.1/servers/b89094ac-aee1-4bd6-a33d-8c4347cebfc7/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 03:09:19.008776 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi [None req-25e0a4c4-04a5-4ffd-a159-00e5ad8ff44f tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Calling method '>' {{(pid=116157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:09:19.009399 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.compute.api [None req-25e0a4c4-04a5-4ffd-a159-00e5ad8ff44f tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] [instance: fa7c86bc-c46f-4120-8f3d-d795f8d7c5cc] Fetching instance by UUID {{(pid=116157) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:09:19.015936 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-25e0a4c4-04a5-4ffd-a159-00e5ad8ff44f tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:09:19.016390 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-25e0a4c4-04a5-4ffd-a159-00e5ad8ff44f tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:09:19.017176 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-25e0a4c4-04a5-4ffd-a159-00e5ad8ff44f tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:09:19.017616 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-25e0a4c4-04a5-4ffd-a159-00e5ad8ff44f tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:09:19.148024 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.policy [None req-25e0a4c4-04a5-4ffd-a159-00e5ad8ff44f tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c4c0c82448e40ba801c0b52ec44e74a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a093d0bf43046aaa845f3cc115f3f5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116157) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:09:19.155287 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: INFO nova.api.openstack.requestlog [None req-25e0a4c4-04a5-4ffd-a159-00e5ad8ff44f tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] 10.222.0.18 "GET /compute/v2.1/servers/fa7c86bc-c46f-4120-8f3d-d795f8d7c5cc" status: 200 len: 1570 microversion: 2.1 time: 0.151116 Dec 15 03:09:19.155851 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: [pid: 116157|app: 0|req: 412/823] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 03:09:19 2021] GET /compute/v2.1/servers/fa7c86bc-c46f-4120-8f3d-d795f8d7c5cc => generated 1570 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 03:09:19.466352 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi [None req-cbfb8acd-b033-43d0-85aa-bc6e5f9a1683 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Calling method '>' {{(pid=116156) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:09:19.467269 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.compute.api [None req-cbfb8acd-b033-43d0-85aa-bc6e5f9a1683 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] [instance: b89094ac-aee1-4bd6-a33d-8c4347cebfc7] Fetching instance by UUID {{(pid=116156) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:09:19.473507 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-cbfb8acd-b033-43d0-85aa-bc6e5f9a1683 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:09:19.473952 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-cbfb8acd-b033-43d0-85aa-bc6e5f9a1683 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:09:19.474754 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-cbfb8acd-b033-43d0-85aa-bc6e5f9a1683 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:09:19.475746 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-cbfb8acd-b033-43d0-85aa-bc6e5f9a1683 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:09:19.504531 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: INFO nova.api.openstack.requestlog [None req-cbfb8acd-b033-43d0-85aa-bc6e5f9a1683 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] 10.222.0.18 "GET /compute/v2.1/servers/b89094ac-aee1-4bd6-a33d-8c4347cebfc7/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041990 Dec 15 03:09:19.505072 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: [pid: 116156|app: 0|req: 412/824] 10.222.0.18 () {60 vars in 1342 bytes} [Wed Dec 15 03:09:19 2021] GET /compute/v2.1/servers/b89094ac-aee1-4bd6-a33d-8c4347cebfc7/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 03:09:20.172553 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi [None req-3f3f5b56-c9e9-433e-a83c-9f90a9680e32 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Calling method '>' {{(pid=116157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:09:20.173065 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.compute.api [None req-3f3f5b56-c9e9-433e-a83c-9f90a9680e32 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] [instance: fa7c86bc-c46f-4120-8f3d-d795f8d7c5cc] Fetching instance by UUID {{(pid=116157) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:09:20.179665 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-3f3f5b56-c9e9-433e-a83c-9f90a9680e32 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:09:20.180091 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-3f3f5b56-c9e9-433e-a83c-9f90a9680e32 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:09:20.180864 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-3f3f5b56-c9e9-433e-a83c-9f90a9680e32 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:09:20.181289 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-3f3f5b56-c9e9-433e-a83c-9f90a9680e32 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:09:20.311461 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.policy [None req-3f3f5b56-c9e9-433e-a83c-9f90a9680e32 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c4c0c82448e40ba801c0b52ec44e74a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a093d0bf43046aaa845f3cc115f3f5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116157) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:09:20.319405 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: INFO nova.api.openstack.requestlog [None req-3f3f5b56-c9e9-433e-a83c-9f90a9680e32 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] 10.222.0.18 "GET /compute/v2.1/servers/fa7c86bc-c46f-4120-8f3d-d795f8d7c5cc" status: 200 len: 1570 microversion: 2.1 time: 0.149965 Dec 15 03:09:20.319981 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: [pid: 116157|app: 0|req: 413/825] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 03:09:20 2021] GET /compute/v2.1/servers/fa7c86bc-c46f-4120-8f3d-d795f8d7c5cc => generated 1570 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 03:09:20.516210 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi [None req-b21c5b3d-cfba-4acf-8737-6ead26c10175 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Calling method '>' {{(pid=116156) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:09:20.517022 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.compute.api [None req-b21c5b3d-cfba-4acf-8737-6ead26c10175 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] [instance: b89094ac-aee1-4bd6-a33d-8c4347cebfc7] Fetching instance by UUID {{(pid=116156) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:09:20.523221 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-b21c5b3d-cfba-4acf-8737-6ead26c10175 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:09:20.523671 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-b21c5b3d-cfba-4acf-8737-6ead26c10175 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:09:20.524447 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-b21c5b3d-cfba-4acf-8737-6ead26c10175 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:09:20.524881 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-b21c5b3d-cfba-4acf-8737-6ead26c10175 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:09:20.552876 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: INFO nova.api.openstack.requestlog [None req-b21c5b3d-cfba-4acf-8737-6ead26c10175 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] 10.222.0.18 "GET /compute/v2.1/servers/b89094ac-aee1-4bd6-a33d-8c4347cebfc7/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.040539 Dec 15 03:09:20.553409 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: [pid: 116156|app: 0|req: 413/826] 10.222.0.18 () {60 vars in 1342 bytes} [Wed Dec 15 03:09:20 2021] GET /compute/v2.1/servers/b89094ac-aee1-4bd6-a33d-8c4347cebfc7/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 03:09:21.336838 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi [None req-bbd541ec-e052-443c-ab1e-26ddcdad9d55 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Calling method '>' {{(pid=116157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:09:21.337450 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.compute.api [None req-bbd541ec-e052-443c-ab1e-26ddcdad9d55 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] [instance: fa7c86bc-c46f-4120-8f3d-d795f8d7c5cc] Fetching instance by UUID {{(pid=116157) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:09:21.343741 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-bbd541ec-e052-443c-ab1e-26ddcdad9d55 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:09:21.344193 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-bbd541ec-e052-443c-ab1e-26ddcdad9d55 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:09:21.344975 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-bbd541ec-e052-443c-ab1e-26ddcdad9d55 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:09:21.345415 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-bbd541ec-e052-443c-ab1e-26ddcdad9d55 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:09:21.474471 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.policy [None req-bbd541ec-e052-443c-ab1e-26ddcdad9d55 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c4c0c82448e40ba801c0b52ec44e74a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a093d0bf43046aaa845f3cc115f3f5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116157) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:09:21.481692 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: INFO nova.api.openstack.requestlog [None req-bbd541ec-e052-443c-ab1e-26ddcdad9d55 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] 10.222.0.18 "GET /compute/v2.1/servers/fa7c86bc-c46f-4120-8f3d-d795f8d7c5cc" status: 200 len: 1570 microversion: 2.1 time: 0.149160 Dec 15 03:09:21.482296 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: [pid: 116157|app: 0|req: 414/827] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 03:09:21 2021] GET /compute/v2.1/servers/fa7c86bc-c46f-4120-8f3d-d795f8d7c5cc => generated 1570 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 03:09:21.564581 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi [None req-a9caf65f-5541-4d9d-8edc-0877040d67b6 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Calling method '>' {{(pid=116156) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:09:21.565517 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.compute.api [None req-a9caf65f-5541-4d9d-8edc-0877040d67b6 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] [instance: b89094ac-aee1-4bd6-a33d-8c4347cebfc7] Fetching instance by UUID {{(pid=116156) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:09:21.572410 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-a9caf65f-5541-4d9d-8edc-0877040d67b6 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:09:21.572868 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-a9caf65f-5541-4d9d-8edc-0877040d67b6 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:09:21.573650 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-a9caf65f-5541-4d9d-8edc-0877040d67b6 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:09:21.574117 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-a9caf65f-5541-4d9d-8edc-0877040d67b6 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:09:21.601673 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: INFO nova.api.openstack.requestlog [None req-a9caf65f-5541-4d9d-8edc-0877040d67b6 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] 10.222.0.18 "GET /compute/v2.1/servers/b89094ac-aee1-4bd6-a33d-8c4347cebfc7/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.040854 Dec 15 03:09:21.602254 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: [pid: 116156|app: 0|req: 414/828] 10.222.0.18 () {60 vars in 1342 bytes} [Wed Dec 15 03:09:21 2021] GET /compute/v2.1/servers/b89094ac-aee1-4bd6-a33d-8c4347cebfc7/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 03:09:22.498616 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi [None req-e6d4dd5f-eb4b-48be-b3bb-9eb4c8be4ec0 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Calling method '>' {{(pid=116157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:09:22.499156 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.compute.api [None req-e6d4dd5f-eb4b-48be-b3bb-9eb4c8be4ec0 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] [instance: fa7c86bc-c46f-4120-8f3d-d795f8d7c5cc] Fetching instance by UUID {{(pid=116157) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:09:22.505302 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-e6d4dd5f-eb4b-48be-b3bb-9eb4c8be4ec0 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:09:22.505747 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-e6d4dd5f-eb4b-48be-b3bb-9eb4c8be4ec0 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:09:22.506555 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-e6d4dd5f-eb4b-48be-b3bb-9eb4c8be4ec0 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:09:22.506990 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-e6d4dd5f-eb4b-48be-b3bb-9eb4c8be4ec0 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:09:22.612517 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi [None req-69dee481-9348-48b8-bc5f-62296ac48514 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Calling method '>' {{(pid=116156) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:09:22.613412 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.compute.api [None req-69dee481-9348-48b8-bc5f-62296ac48514 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] [instance: b89094ac-aee1-4bd6-a33d-8c4347cebfc7] Fetching instance by UUID {{(pid=116156) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:09:22.619896 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-69dee481-9348-48b8-bc5f-62296ac48514 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:09:22.620834 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-69dee481-9348-48b8-bc5f-62296ac48514 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:09:22.621620 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-69dee481-9348-48b8-bc5f-62296ac48514 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:09:22.622076 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-69dee481-9348-48b8-bc5f-62296ac48514 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:09:22.638590 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.policy [None req-e6d4dd5f-eb4b-48be-b3bb-9eb4c8be4ec0 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c4c0c82448e40ba801c0b52ec44e74a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a093d0bf43046aaa845f3cc115f3f5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116157) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:09:22.646004 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: INFO nova.api.openstack.requestlog [None req-e6d4dd5f-eb4b-48be-b3bb-9eb4c8be4ec0 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] 10.222.0.18 "GET /compute/v2.1/servers/fa7c86bc-c46f-4120-8f3d-d795f8d7c5cc" status: 200 len: 1570 microversion: 2.1 time: 0.151077 Dec 15 03:09:22.646584 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: [pid: 116157|app: 0|req: 415/829] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 03:09:22 2021] GET /compute/v2.1/servers/fa7c86bc-c46f-4120-8f3d-d795f8d7c5cc => generated 1570 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 03:09:22.651059 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: INFO nova.api.openstack.requestlog [None req-69dee481-9348-48b8-bc5f-62296ac48514 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] 10.222.0.18 "GET /compute/v2.1/servers/b89094ac-aee1-4bd6-a33d-8c4347cebfc7/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042238 Dec 15 03:09:22.651610 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: [pid: 116156|app: 0|req: 415/830] 10.222.0.18 () {60 vars in 1342 bytes} [Wed Dec 15 03:09:22 2021] GET /compute/v2.1/servers/b89094ac-aee1-4bd6-a33d-8c4347cebfc7/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Dec 15 03:09:23.662448 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi [None req-2db2e0ef-2ba5-40a8-8a42-4e2ee81fd1b6 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Calling method '>' {{(pid=116157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:09:23.663903 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi [None req-87bc2ee2-3c3e-49f7-89fc-66d64c961b7c tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Calling method '>' {{(pid=116156) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:09:23.664303 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.compute.api [None req-2db2e0ef-2ba5-40a8-8a42-4e2ee81fd1b6 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] [instance: b89094ac-aee1-4bd6-a33d-8c4347cebfc7] Fetching instance by UUID {{(pid=116157) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:09:23.664507 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.compute.api [None req-87bc2ee2-3c3e-49f7-89fc-66d64c961b7c tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] [instance: fa7c86bc-c46f-4120-8f3d-d795f8d7c5cc] Fetching instance by UUID {{(pid=116156) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:09:23.670222 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-2db2e0ef-2ba5-40a8-8a42-4e2ee81fd1b6 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:09:23.670582 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-87bc2ee2-3c3e-49f7-89fc-66d64c961b7c tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:09:23.670697 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-2db2e0ef-2ba5-40a8-8a42-4e2ee81fd1b6 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:09:23.671028 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-87bc2ee2-3c3e-49f7-89fc-66d64c961b7c tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:09:23.671471 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-2db2e0ef-2ba5-40a8-8a42-4e2ee81fd1b6 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:09:23.671797 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-87bc2ee2-3c3e-49f7-89fc-66d64c961b7c tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:09:23.671896 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-2db2e0ef-2ba5-40a8-8a42-4e2ee81fd1b6 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:09:23.672228 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-87bc2ee2-3c3e-49f7-89fc-66d64c961b7c tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:09:23.700943 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: INFO nova.api.openstack.requestlog [None req-2db2e0ef-2ba5-40a8-8a42-4e2ee81fd1b6 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] 10.222.0.18 "GET /compute/v2.1/servers/b89094ac-aee1-4bd6-a33d-8c4347cebfc7/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042245 Dec 15 03:09:23.701501 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: [pid: 116157|app: 0|req: 416/831] 10.222.0.18 () {60 vars in 1342 bytes} [Wed Dec 15 03:09:23 2021] GET /compute/v2.1/servers/b89094ac-aee1-4bd6-a33d-8c4347cebfc7/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Dec 15 03:09:23.803435 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.policy [None req-87bc2ee2-3c3e-49f7-89fc-66d64c961b7c tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c4c0c82448e40ba801c0b52ec44e74a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a093d0bf43046aaa845f3cc115f3f5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116156) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:09:23.810659 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: INFO nova.api.openstack.requestlog [None req-87bc2ee2-3c3e-49f7-89fc-66d64c961b7c tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] 10.222.0.18 "GET /compute/v2.1/servers/fa7c86bc-c46f-4120-8f3d-d795f8d7c5cc" status: 200 len: 1570 microversion: 2.1 time: 0.150800 Dec 15 03:09:23.811219 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: [pid: 116156|app: 0|req: 416/832] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 03:09:23 2021] GET /compute/v2.1/servers/fa7c86bc-c46f-4120-8f3d-d795f8d7c5cc => generated 1570 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 03:09:24.712543 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi [None req-772287e0-5ea3-422b-92e7-abc1d431daf8 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Calling method '>' {{(pid=116157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:09:24.713430 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.compute.api [None req-772287e0-5ea3-422b-92e7-abc1d431daf8 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] [instance: b89094ac-aee1-4bd6-a33d-8c4347cebfc7] Fetching instance by UUID {{(pid=116157) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:09:24.719619 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-772287e0-5ea3-422b-92e7-abc1d431daf8 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:09:24.720069 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-772287e0-5ea3-422b-92e7-abc1d431daf8 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:09:24.720838 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-772287e0-5ea3-422b-92e7-abc1d431daf8 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:09:24.721267 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-772287e0-5ea3-422b-92e7-abc1d431daf8 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:09:24.749367 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: INFO nova.api.openstack.requestlog [None req-772287e0-5ea3-422b-92e7-abc1d431daf8 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] 10.222.0.18 "GET /compute/v2.1/servers/b89094ac-aee1-4bd6-a33d-8c4347cebfc7/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.040632 Dec 15 03:09:24.749902 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: [pid: 116157|app: 0|req: 417/833] 10.222.0.18 () {60 vars in 1342 bytes} [Wed Dec 15 03:09:24 2021] GET /compute/v2.1/servers/b89094ac-aee1-4bd6-a33d-8c4347cebfc7/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 03:09:24.827409 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi [None req-c5756c8e-ae65-4e9c-bf8f-9dac4314e79c tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Calling method '>' {{(pid=116156) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:09:24.828016 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.compute.api [None req-c5756c8e-ae65-4e9c-bf8f-9dac4314e79c tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] [instance: fa7c86bc-c46f-4120-8f3d-d795f8d7c5cc] Fetching instance by UUID {{(pid=116156) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:09:24.834332 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-c5756c8e-ae65-4e9c-bf8f-9dac4314e79c tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:09:24.834783 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-c5756c8e-ae65-4e9c-bf8f-9dac4314e79c tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:09:24.835596 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-c5756c8e-ae65-4e9c-bf8f-9dac4314e79c tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:09:24.836034 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-c5756c8e-ae65-4e9c-bf8f-9dac4314e79c tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:09:24.966967 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.policy [None req-c5756c8e-ae65-4e9c-bf8f-9dac4314e79c tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c4c0c82448e40ba801c0b52ec44e74a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a093d0bf43046aaa845f3cc115f3f5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116156) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:09:24.974888 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: INFO nova.api.openstack.requestlog [None req-c5756c8e-ae65-4e9c-bf8f-9dac4314e79c tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] 10.222.0.18 "GET /compute/v2.1/servers/fa7c86bc-c46f-4120-8f3d-d795f8d7c5cc" status: 200 len: 1570 microversion: 2.1 time: 0.151049 Dec 15 03:09:24.976266 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: [pid: 116156|app: 0|req: 417/834] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 03:09:24 2021] GET /compute/v2.1/servers/fa7c86bc-c46f-4120-8f3d-d795f8d7c5cc => generated 1570 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 03:09:25.514488 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi [None req-a3e6f376-c206-4363-81ba-8768abbae12e tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Calling method '>' {{(pid=116157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:09:25.514990 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.compute.api [None req-a3e6f376-c206-4363-81ba-8768abbae12e tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] [instance: bbb8462c-9501-4541-b67e-43ec5c5061a7] Fetching instance by UUID {{(pid=116157) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:09:25.520879 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-a3e6f376-c206-4363-81ba-8768abbae12e tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:09:25.521338 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-a3e6f376-c206-4363-81ba-8768abbae12e tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:09:25.522164 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-a3e6f376-c206-4363-81ba-8768abbae12e tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:09:25.523117 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-a3e6f376-c206-4363-81ba-8768abbae12e tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:09:25.547741 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.compute.api [None req-a3e6f376-c206-4363-81ba-8768abbae12e tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] [instance: bbb8462c-9501-4541-b67e-43ec5c5061a7] Going to try to terminate instance {{(pid=116157) delete /opt/stack/nova/nova/compute/api.py:2614}} Dec 15 03:09:25.619280 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: INFO nova.api.openstack.requestlog [None req-a3e6f376-c206-4363-81ba-8768abbae12e tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] 10.222.0.18 "DELETE /compute/v2.1/servers/bbb8462c-9501-4541-b67e-43ec5c5061a7" status: 204 len: 0 microversion: 2.1 time: 0.108188 Dec 15 03:09:25.619944 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: [pid: 116157|app: 0|req: 418/835] 10.222.0.18 () {58 vars in 1238 bytes} [Wed Dec 15 03:09:25 2021] DELETE /compute/v2.1/servers/bbb8462c-9501-4541-b67e-43ec5c5061a7 => generated 0 bytes in 110 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Dec 15 03:09:25.628233 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi [None req-24939825-940a-4c4d-830b-6cb2ef8abceb tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Calling method '>' {{(pid=116156) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:09:25.628836 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.compute.api [None req-24939825-940a-4c4d-830b-6cb2ef8abceb tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] [instance: bbb8462c-9501-4541-b67e-43ec5c5061a7] Fetching instance by UUID {{(pid=116156) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:09:25.635246 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-24939825-940a-4c4d-830b-6cb2ef8abceb tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:09:25.635690 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-24939825-940a-4c4d-830b-6cb2ef8abceb tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:09:25.636463 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-24939825-940a-4c4d-830b-6cb2ef8abceb tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:09:25.636897 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-24939825-940a-4c4d-830b-6cb2ef8abceb tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:09:25.761845 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi [None req-e6f0d5c6-7abf-4fe9-bd8c-cd65af21b064 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Calling method '>' {{(pid=116157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:09:25.762874 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.compute.api [None req-e6f0d5c6-7abf-4fe9-bd8c-cd65af21b064 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] [instance: b89094ac-aee1-4bd6-a33d-8c4347cebfc7] Fetching instance by UUID {{(pid=116157) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:09:25.763833 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.policy [None req-24939825-940a-4c4d-830b-6cb2ef8abceb tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97bdf19af9e34fc3886ff451cb9d7a27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '494b56bf5eae4d56a5591546f85bc32b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116156) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:09:25.769160 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-e6f0d5c6-7abf-4fe9-bd8c-cd65af21b064 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:09:25.769559 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-e6f0d5c6-7abf-4fe9-bd8c-cd65af21b064 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:09:25.770377 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-e6f0d5c6-7abf-4fe9-bd8c-cd65af21b064 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:09:25.770819 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-e6f0d5c6-7abf-4fe9-bd8c-cd65af21b064 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:09:25.770970 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: INFO nova.api.openstack.requestlog [None req-24939825-940a-4c4d-830b-6cb2ef8abceb tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] 10.222.0.18 "GET /compute/v2.1/servers/bbb8462c-9501-4541-b67e-43ec5c5061a7" status: 200 len: 1577 microversion: 2.1 time: 0.146518 Dec 15 03:09:25.771527 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: [pid: 116156|app: 0|req: 418/836] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 03:09:25 2021] GET /compute/v2.1/servers/bbb8462c-9501-4541-b67e-43ec5c5061a7 => generated 1577 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 03:09:25.800208 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: INFO nova.api.openstack.requestlog [None req-e6f0d5c6-7abf-4fe9-bd8c-cd65af21b064 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] 10.222.0.18 "GET /compute/v2.1/servers/b89094ac-aee1-4bd6-a33d-8c4347cebfc7/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043122 Dec 15 03:09:25.800754 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: [pid: 116157|app: 0|req: 419/837] 10.222.0.18 () {60 vars in 1342 bytes} [Wed Dec 15 03:09:25 2021] GET /compute/v2.1/servers/b89094ac-aee1-4bd6-a33d-8c4347cebfc7/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Dec 15 03:09:25.992506 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi [None req-be929486-4706-4688-9788-421421eb0714 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Calling method '>' {{(pid=116156) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:09:25.993110 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.compute.api [None req-be929486-4706-4688-9788-421421eb0714 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] [instance: fa7c86bc-c46f-4120-8f3d-d795f8d7c5cc] Fetching instance by UUID {{(pid=116156) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:09:25.999288 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-be929486-4706-4688-9788-421421eb0714 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:09:25.999735 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-be929486-4706-4688-9788-421421eb0714 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:09:26.000502 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-be929486-4706-4688-9788-421421eb0714 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:09:26.000931 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-be929486-4706-4688-9788-421421eb0714 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:09:26.131521 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.policy [None req-be929486-4706-4688-9788-421421eb0714 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c4c0c82448e40ba801c0b52ec44e74a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a093d0bf43046aaa845f3cc115f3f5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116156) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:09:26.139350 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: INFO nova.api.openstack.requestlog [None req-be929486-4706-4688-9788-421421eb0714 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] 10.222.0.18 "GET /compute/v2.1/servers/fa7c86bc-c46f-4120-8f3d-d795f8d7c5cc" status: 200 len: 1570 microversion: 2.1 time: 0.150769 Dec 15 03:09:26.139913 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: [pid: 116156|app: 0|req: 419/838] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 03:09:25 2021] GET /compute/v2.1/servers/fa7c86bc-c46f-4120-8f3d-d795f8d7c5cc => generated 1570 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 03:09:26.789401 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi [None req-30146ec0-fdb5-46e7-ac17-07cf543bb183 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Calling method '>' {{(pid=116157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:09:26.789942 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.compute.api [None req-30146ec0-fdb5-46e7-ac17-07cf543bb183 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] [instance: bbb8462c-9501-4541-b67e-43ec5c5061a7] Fetching instance by UUID {{(pid=116157) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:09:26.796294 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-30146ec0-fdb5-46e7-ac17-07cf543bb183 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:09:26.796747 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-30146ec0-fdb5-46e7-ac17-07cf543bb183 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:09:26.797524 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-30146ec0-fdb5-46e7-ac17-07cf543bb183 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:09:26.797959 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-30146ec0-fdb5-46e7-ac17-07cf543bb183 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:09:26.811455 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi [None req-51d912fa-ec44-4c47-a2ff-8a754957479d tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Calling method '>' {{(pid=116156) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:09:26.812504 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.compute.api [None req-51d912fa-ec44-4c47-a2ff-8a754957479d tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] [instance: b89094ac-aee1-4bd6-a33d-8c4347cebfc7] Fetching instance by UUID {{(pid=116156) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:09:26.818197 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-51d912fa-ec44-4c47-a2ff-8a754957479d tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:09:26.818644 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-51d912fa-ec44-4c47-a2ff-8a754957479d tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:09:26.819422 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-51d912fa-ec44-4c47-a2ff-8a754957479d tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:09:26.819854 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-51d912fa-ec44-4c47-a2ff-8a754957479d tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:09:26.850351 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: INFO nova.api.openstack.requestlog [None req-51d912fa-ec44-4c47-a2ff-8a754957479d tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] 10.222.0.18 "GET /compute/v2.1/servers/b89094ac-aee1-4bd6-a33d-8c4347cebfc7/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042493 Dec 15 03:09:26.851787 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: [pid: 116156|app: 0|req: 420/839] 10.222.0.18 () {60 vars in 1342 bytes} [Wed Dec 15 03:09:26 2021] GET /compute/v2.1/servers/b89094ac-aee1-4bd6-a33d-8c4347cebfc7/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Dec 15 03:09:26.929252 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.policy [None req-30146ec0-fdb5-46e7-ac17-07cf543bb183 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97bdf19af9e34fc3886ff451cb9d7a27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '494b56bf5eae4d56a5591546f85bc32b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116157) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:09:26.936496 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: INFO nova.api.openstack.requestlog [None req-30146ec0-fdb5-46e7-ac17-07cf543bb183 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] 10.222.0.18 "GET /compute/v2.1/servers/bbb8462c-9501-4541-b67e-43ec5c5061a7" status: 200 len: 1577 microversion: 2.1 time: 0.151391 Dec 15 03:09:26.937064 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: [pid: 116157|app: 0|req: 420/840] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 03:09:26 2021] GET /compute/v2.1/servers/bbb8462c-9501-4541-b67e-43ec5c5061a7 => generated 1577 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 03:09:27.155858 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi [None req-658cab4f-5a24-405e-9e71-acef73f122d4 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Calling method '>' {{(pid=116156) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:09:27.156466 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.compute.api [None req-658cab4f-5a24-405e-9e71-acef73f122d4 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] [instance: fa7c86bc-c46f-4120-8f3d-d795f8d7c5cc] Fetching instance by UUID {{(pid=116156) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:09:27.162984 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-658cab4f-5a24-405e-9e71-acef73f122d4 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:09:27.163430 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-658cab4f-5a24-405e-9e71-acef73f122d4 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:09:27.164194 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-658cab4f-5a24-405e-9e71-acef73f122d4 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:09:27.164645 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-658cab4f-5a24-405e-9e71-acef73f122d4 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:09:27.320240 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.policy [None req-658cab4f-5a24-405e-9e71-acef73f122d4 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c4c0c82448e40ba801c0b52ec44e74a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a093d0bf43046aaa845f3cc115f3f5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116156) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:09:27.327519 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: INFO nova.api.openstack.requestlog [None req-658cab4f-5a24-405e-9e71-acef73f122d4 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] 10.222.0.18 "GET /compute/v2.1/servers/fa7c86bc-c46f-4120-8f3d-d795f8d7c5cc" status: 200 len: 1570 microversion: 2.1 time: 0.175287 Dec 15 03:09:27.328076 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: [pid: 116156|app: 0|req: 421/841] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 03:09:27 2021] GET /compute/v2.1/servers/fa7c86bc-c46f-4120-8f3d-d795f8d7c5cc => generated 1570 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 03:09:27.863105 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi [None req-c32b627a-9922-412b-b588-58fbf7ff6040 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Calling method '>' {{(pid=116157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:09:27.864104 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.compute.api [None req-c32b627a-9922-412b-b588-58fbf7ff6040 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] [instance: b89094ac-aee1-4bd6-a33d-8c4347cebfc7] Fetching instance by UUID {{(pid=116157) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:09:27.871285 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-c32b627a-9922-412b-b588-58fbf7ff6040 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:09:27.871740 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-c32b627a-9922-412b-b588-58fbf7ff6040 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:09:27.872538 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-c32b627a-9922-412b-b588-58fbf7ff6040 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:09:27.872979 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-c32b627a-9922-412b-b588-58fbf7ff6040 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:09:27.902931 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: INFO nova.api.openstack.requestlog [None req-c32b627a-9922-412b-b588-58fbf7ff6040 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] 10.222.0.18 "GET /compute/v2.1/servers/b89094ac-aee1-4bd6-a33d-8c4347cebfc7/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043617 Dec 15 03:09:27.903494 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: [pid: 116157|app: 0|req: 421/842] 10.222.0.18 () {60 vars in 1342 bytes} [Wed Dec 15 03:09:27 2021] GET /compute/v2.1/servers/b89094ac-aee1-4bd6-a33d-8c4347cebfc7/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 03:09:27.953409 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi [None req-883bb38d-d2df-4675-b248-249f523f29a9 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Calling method '>' {{(pid=116156) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:09:27.954179 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.compute.api [None req-883bb38d-d2df-4675-b248-249f523f29a9 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] [instance: bbb8462c-9501-4541-b67e-43ec5c5061a7] Fetching instance by UUID {{(pid=116156) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:09:27.960154 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-883bb38d-d2df-4675-b248-249f523f29a9 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:09:27.960605 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-883bb38d-d2df-4675-b248-249f523f29a9 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:09:27.961384 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-883bb38d-d2df-4675-b248-249f523f29a9 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:09:27.961818 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-883bb38d-d2df-4675-b248-249f523f29a9 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:09:28.161687 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.policy [None req-883bb38d-d2df-4675-b248-249f523f29a9 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97bdf19af9e34fc3886ff451cb9d7a27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '494b56bf5eae4d56a5591546f85bc32b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116156) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:09:28.171415 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: INFO nova.api.openstack.requestlog [None req-883bb38d-d2df-4675-b248-249f523f29a9 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] 10.222.0.18 "GET /compute/v2.1/servers/bbb8462c-9501-4541-b67e-43ec5c5061a7" status: 200 len: 1577 microversion: 2.1 time: 0.221502 Dec 15 03:09:28.172231 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: [pid: 116156|app: 0|req: 422/843] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 03:09:27 2021] GET /compute/v2.1/servers/bbb8462c-9501-4541-b67e-43ec5c5061a7 => generated 1577 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 03:09:28.344469 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi [None req-902f27c9-52d4-42ff-8921-a8139f125646 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Calling method '>' {{(pid=116157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:09:28.345072 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.compute.api [None req-902f27c9-52d4-42ff-8921-a8139f125646 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] [instance: fa7c86bc-c46f-4120-8f3d-d795f8d7c5cc] Fetching instance by UUID {{(pid=116157) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:09:28.351469 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-902f27c9-52d4-42ff-8921-a8139f125646 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:09:28.351918 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-902f27c9-52d4-42ff-8921-a8139f125646 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:09:28.352695 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-902f27c9-52d4-42ff-8921-a8139f125646 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:09:28.353125 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-902f27c9-52d4-42ff-8921-a8139f125646 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:09:28.497453 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.policy [None req-902f27c9-52d4-42ff-8921-a8139f125646 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c4c0c82448e40ba801c0b52ec44e74a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a093d0bf43046aaa845f3cc115f3f5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116157) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:09:28.505250 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: INFO nova.api.openstack.requestlog [None req-902f27c9-52d4-42ff-8921-a8139f125646 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] 10.222.0.18 "GET /compute/v2.1/servers/fa7c86bc-c46f-4120-8f3d-d795f8d7c5cc" status: 200 len: 1570 microversion: 2.1 time: 0.164476 Dec 15 03:09:28.506034 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: [pid: 116157|app: 0|req: 422/844] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 03:09:28 2021] GET /compute/v2.1/servers/fa7c86bc-c46f-4120-8f3d-d795f8d7c5cc => generated 1570 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 03:09:28.594874 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi [req-c97de995-6a9e-414a-b52a-598a1e58bd91 req-33cdfdf7-74b1-42b9-a0d4-4ab1c4366273 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bbb8462c-9501-4541-b67e-43ec5c5061a7", "name": "network-vif-deleted", "tag": "e917aa72-0647-445c-a93a-04c2f02ade06"}]} {{(pid=116156) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 03:09:28.596433 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 15 03:09:28.596433 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: warnings.warn(msg) Dec 15 03:09:28.603791 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [req-c97de995-6a9e-414a-b52a-598a1e58bd91 req-33cdfdf7-74b1-42b9-a0d4-4ab1c4366273 service nova] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:09:28.604234 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [req-c97de995-6a9e-414a-b52a-598a1e58bd91 req-33cdfdf7-74b1-42b9-a0d4-4ab1c4366273 service nova] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:09:28.615064 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: INFO nova.api.openstack.compute.server_external_events [req-c97de995-6a9e-414a-b52a-598a1e58bd91 req-33cdfdf7-74b1-42b9-a0d4-4ab1c4366273 service nova] Creating event network-vif-deleted:e917aa72-0647-445c-a93a-04c2f02ade06 for instance bbb8462c-9501-4541-b67e-43ec5c5061a7 on hv-cinder-81803 Dec 15 03:09:28.620187 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: INFO nova.api.openstack.requestlog [req-c97de995-6a9e-414a-b52a-598a1e58bd91 req-33cdfdf7-74b1-42b9-a0d4-4ab1c4366273 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.092103 Dec 15 03:09:28.620774 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: [pid: 116156|app: 0|req: 423/845] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Dec 15 03:09:28 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 15 03:09:28.914710 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi [None req-6b14a82f-ecaf-4afc-bc11-fb8154f6ab40 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Calling method '>' {{(pid=116157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:09:28.915621 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.compute.api [None req-6b14a82f-ecaf-4afc-bc11-fb8154f6ab40 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] [instance: b89094ac-aee1-4bd6-a33d-8c4347cebfc7] Fetching instance by UUID {{(pid=116157) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:09:28.921851 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-6b14a82f-ecaf-4afc-bc11-fb8154f6ab40 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:09:28.922341 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-6b14a82f-ecaf-4afc-bc11-fb8154f6ab40 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:09:28.923133 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-6b14a82f-ecaf-4afc-bc11-fb8154f6ab40 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:09:28.923582 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-6b14a82f-ecaf-4afc-bc11-fb8154f6ab40 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:09:28.953577 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: INFO nova.api.openstack.requestlog [None req-6b14a82f-ecaf-4afc-bc11-fb8154f6ab40 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] 10.222.0.18 "GET /compute/v2.1/servers/b89094ac-aee1-4bd6-a33d-8c4347cebfc7/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042633 Dec 15 03:09:28.954567 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: [pid: 116157|app: 0|req: 423/846] 10.222.0.18 () {60 vars in 1342 bytes} [Wed Dec 15 03:09:28 2021] GET /compute/v2.1/servers/b89094ac-aee1-4bd6-a33d-8c4347cebfc7/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 03:09:29.189790 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi [None req-c8d277f7-5804-4faf-a4f3-aab316a21fbc tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Calling method '>' {{(pid=116156) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:09:29.190762 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.compute.api [None req-c8d277f7-5804-4faf-a4f3-aab316a21fbc tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] [instance: bbb8462c-9501-4541-b67e-43ec5c5061a7] Fetching instance by UUID {{(pid=116156) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:09:29.205084 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-c8d277f7-5804-4faf-a4f3-aab316a21fbc tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:09:29.206020 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-c8d277f7-5804-4faf-a4f3-aab316a21fbc tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:09:29.206837 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-c8d277f7-5804-4faf-a4f3-aab316a21fbc tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:09:29.207283 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-c8d277f7-5804-4faf-a4f3-aab316a21fbc tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:09:29.276385 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.policy [None req-c8d277f7-5804-4faf-a4f3-aab316a21fbc tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97bdf19af9e34fc3886ff451cb9d7a27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '494b56bf5eae4d56a5591546f85bc32b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116156) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:09:29.284530 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: INFO nova.api.openstack.requestlog [None req-c8d277f7-5804-4faf-a4f3-aab316a21fbc tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] 10.222.0.18 "GET /compute/v2.1/servers/bbb8462c-9501-4541-b67e-43ec5c5061a7" status: 200 len: 1226 microversion: 2.1 time: 0.098785 Dec 15 03:09:29.285417 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: [pid: 116156|app: 0|req: 424/847] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 03:09:29 2021] GET /compute/v2.1/servers/bbb8462c-9501-4541-b67e-43ec5c5061a7 => generated 1226 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 03:09:29.522033 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi [None req-aade91c9-854a-4b37-a9d7-f90e50782915 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Calling method '>' {{(pid=116157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:09:29.522647 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.compute.api [None req-aade91c9-854a-4b37-a9d7-f90e50782915 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] [instance: fa7c86bc-c46f-4120-8f3d-d795f8d7c5cc] Fetching instance by UUID {{(pid=116157) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:09:29.529171 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-aade91c9-854a-4b37-a9d7-f90e50782915 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:09:29.529758 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-aade91c9-854a-4b37-a9d7-f90e50782915 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:09:29.530661 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-aade91c9-854a-4b37-a9d7-f90e50782915 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:09:29.531100 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-aade91c9-854a-4b37-a9d7-f90e50782915 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:09:29.666091 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.policy [None req-aade91c9-854a-4b37-a9d7-f90e50782915 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c4c0c82448e40ba801c0b52ec44e74a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a093d0bf43046aaa845f3cc115f3f5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116157) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:09:29.673420 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: INFO nova.api.openstack.requestlog [None req-aade91c9-854a-4b37-a9d7-f90e50782915 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] 10.222.0.18 "GET /compute/v2.1/servers/fa7c86bc-c46f-4120-8f3d-d795f8d7c5cc" status: 200 len: 1570 microversion: 2.1 time: 0.155074 Dec 15 03:09:29.674003 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: [pid: 116157|app: 0|req: 424/848] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 03:09:29 2021] GET /compute/v2.1/servers/fa7c86bc-c46f-4120-8f3d-d795f8d7c5cc => generated 1570 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 03:09:29.965776 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi [None req-6c37620d-1277-457a-97eb-3db870713e15 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Calling method '>' {{(pid=116156) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:09:29.966764 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.compute.api [None req-6c37620d-1277-457a-97eb-3db870713e15 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] [instance: b89094ac-aee1-4bd6-a33d-8c4347cebfc7] Fetching instance by UUID {{(pid=116156) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:09:29.972818 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-6c37620d-1277-457a-97eb-3db870713e15 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:09:29.973264 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-6c37620d-1277-457a-97eb-3db870713e15 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:09:29.974075 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-6c37620d-1277-457a-97eb-3db870713e15 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:09:29.974507 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-6c37620d-1277-457a-97eb-3db870713e15 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:09:30.003398 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: INFO nova.api.openstack.requestlog [None req-6c37620d-1277-457a-97eb-3db870713e15 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] 10.222.0.18 "GET /compute/v2.1/servers/b89094ac-aee1-4bd6-a33d-8c4347cebfc7/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041490 Dec 15 03:09:30.003947 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: [pid: 116156|app: 0|req: 425/849] 10.222.0.18 () {60 vars in 1342 bytes} [Wed Dec 15 03:09:29 2021] GET /compute/v2.1/servers/b89094ac-aee1-4bd6-a33d-8c4347cebfc7/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 03:09:30.301176 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi [None req-01ed9455-7d6d-4700-8e18-a19ce3671728 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Calling method '>' {{(pid=116157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:09:30.301781 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.compute.api [None req-01ed9455-7d6d-4700-8e18-a19ce3671728 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] [instance: bbb8462c-9501-4541-b67e-43ec5c5061a7] Fetching instance by UUID {{(pid=116157) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:09:30.307654 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-01ed9455-7d6d-4700-8e18-a19ce3671728 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:09:30.308100 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-01ed9455-7d6d-4700-8e18-a19ce3671728 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:09:30.308870 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-01ed9455-7d6d-4700-8e18-a19ce3671728 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:09:30.309303 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-01ed9455-7d6d-4700-8e18-a19ce3671728 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:09:30.366829 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.policy [None req-01ed9455-7d6d-4700-8e18-a19ce3671728 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97bdf19af9e34fc3886ff451cb9d7a27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '494b56bf5eae4d56a5591546f85bc32b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116157) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:09:30.373832 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: INFO nova.api.openstack.requestlog [None req-01ed9455-7d6d-4700-8e18-a19ce3671728 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] 10.222.0.18 "GET /compute/v2.1/servers/bbb8462c-9501-4541-b67e-43ec5c5061a7" status: 200 len: 1226 microversion: 2.1 time: 0.076474 Dec 15 03:09:30.374424 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: [pid: 116157|app: 0|req: 425/850] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 03:09:30 2021] GET /compute/v2.1/servers/bbb8462c-9501-4541-b67e-43ec5c5061a7 => generated 1226 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 03:09:30.690603 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi [None req-88433fa0-5b3b-42cd-b842-c1bc2f068342 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Calling method '>' {{(pid=116156) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:09:30.691214 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.compute.api [None req-88433fa0-5b3b-42cd-b842-c1bc2f068342 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] [instance: fa7c86bc-c46f-4120-8f3d-d795f8d7c5cc] Fetching instance by UUID {{(pid=116156) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:09:30.697960 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-88433fa0-5b3b-42cd-b842-c1bc2f068342 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:09:30.698441 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-88433fa0-5b3b-42cd-b842-c1bc2f068342 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:09:30.699216 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-88433fa0-5b3b-42cd-b842-c1bc2f068342 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:09:30.699651 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-88433fa0-5b3b-42cd-b842-c1bc2f068342 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:09:30.827149 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.policy [None req-88433fa0-5b3b-42cd-b842-c1bc2f068342 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c4c0c82448e40ba801c0b52ec44e74a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a093d0bf43046aaa845f3cc115f3f5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116156) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:09:30.834329 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: INFO nova.api.openstack.requestlog [None req-88433fa0-5b3b-42cd-b842-c1bc2f068342 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] 10.222.0.18 "GET /compute/v2.1/servers/fa7c86bc-c46f-4120-8f3d-d795f8d7c5cc" status: 200 len: 1570 microversion: 2.1 time: 0.147327 Dec 15 03:09:30.834898 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: [pid: 116156|app: 0|req: 426/851] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 03:09:30 2021] GET /compute/v2.1/servers/fa7c86bc-c46f-4120-8f3d-d795f8d7c5cc => generated 1570 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 03:09:31.014651 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi [None req-eb7c1846-113a-4e89-871f-57b8ec98f7a1 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Calling method '>' {{(pid=116157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:09:31.015566 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.compute.api [None req-eb7c1846-113a-4e89-871f-57b8ec98f7a1 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] [instance: b89094ac-aee1-4bd6-a33d-8c4347cebfc7] Fetching instance by UUID {{(pid=116157) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:09:31.021413 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-eb7c1846-113a-4e89-871f-57b8ec98f7a1 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:09:31.021858 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-eb7c1846-113a-4e89-871f-57b8ec98f7a1 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:09:31.022707 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-eb7c1846-113a-4e89-871f-57b8ec98f7a1 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:09:31.023138 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-eb7c1846-113a-4e89-871f-57b8ec98f7a1 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:09:31.051407 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: INFO nova.api.openstack.requestlog [None req-eb7c1846-113a-4e89-871f-57b8ec98f7a1 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] 10.222.0.18 "GET /compute/v2.1/servers/b89094ac-aee1-4bd6-a33d-8c4347cebfc7/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.040540 Dec 15 03:09:31.051943 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: [pid: 116157|app: 0|req: 426/852] 10.222.0.18 () {60 vars in 1342 bytes} [Wed Dec 15 03:09:31 2021] GET /compute/v2.1/servers/b89094ac-aee1-4bd6-a33d-8c4347cebfc7/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 03:09:31.390450 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi [None req-290d1275-0698-4737-87d6-cf80abb0073d tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Calling method '>' {{(pid=116156) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:09:31.390983 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.compute.api [None req-290d1275-0698-4737-87d6-cf80abb0073d tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] [instance: bbb8462c-9501-4541-b67e-43ec5c5061a7] Fetching instance by UUID {{(pid=116156) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:09:31.397166 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-290d1275-0698-4737-87d6-cf80abb0073d tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:09:31.398176 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-290d1275-0698-4737-87d6-cf80abb0073d tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:09:31.398955 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-290d1275-0698-4737-87d6-cf80abb0073d tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:09:31.399394 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-290d1275-0698-4737-87d6-cf80abb0073d tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:09:31.458292 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.policy [None req-290d1275-0698-4737-87d6-cf80abb0073d tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97bdf19af9e34fc3886ff451cb9d7a27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '494b56bf5eae4d56a5591546f85bc32b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116156) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:09:31.465954 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: INFO nova.api.openstack.requestlog [None req-290d1275-0698-4737-87d6-cf80abb0073d tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] 10.222.0.18 "GET /compute/v2.1/servers/bbb8462c-9501-4541-b67e-43ec5c5061a7" status: 200 len: 1226 microversion: 2.1 time: 0.079185 Dec 15 03:09:31.466534 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: [pid: 116156|app: 0|req: 427/853] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 03:09:31 2021] GET /compute/v2.1/servers/bbb8462c-9501-4541-b67e-43ec5c5061a7 => generated 1226 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 03:09:31.851367 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi [None req-d05dd894-ced5-40a2-8f29-cae7198980fd tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Calling method '>' {{(pid=116157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:09:31.851971 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.compute.api [None req-d05dd894-ced5-40a2-8f29-cae7198980fd tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] [instance: fa7c86bc-c46f-4120-8f3d-d795f8d7c5cc] Fetching instance by UUID {{(pid=116157) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:09:31.858256 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-d05dd894-ced5-40a2-8f29-cae7198980fd tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:09:31.858704 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-d05dd894-ced5-40a2-8f29-cae7198980fd tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:09:31.859477 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-d05dd894-ced5-40a2-8f29-cae7198980fd tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:09:31.859910 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-d05dd894-ced5-40a2-8f29-cae7198980fd tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:09:31.989972 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.policy [None req-d05dd894-ced5-40a2-8f29-cae7198980fd tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c4c0c82448e40ba801c0b52ec44e74a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a093d0bf43046aaa845f3cc115f3f5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116157) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:09:31.997949 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: INFO nova.api.openstack.requestlog [None req-d05dd894-ced5-40a2-8f29-cae7198980fd tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] 10.222.0.18 "GET /compute/v2.1/servers/fa7c86bc-c46f-4120-8f3d-d795f8d7c5cc" status: 200 len: 1570 microversion: 2.1 time: 0.150522 Dec 15 03:09:31.998541 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: [pid: 116157|app: 0|req: 427/854] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 03:09:31 2021] GET /compute/v2.1/servers/fa7c86bc-c46f-4120-8f3d-d795f8d7c5cc => generated 1570 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 03:09:32.063292 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi [None req-9d1e5cc7-1f3a-4711-be5d-d8a5a26b7110 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Calling method '>' {{(pid=116156) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:09:32.064187 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.compute.api [None req-9d1e5cc7-1f3a-4711-be5d-d8a5a26b7110 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] [instance: b89094ac-aee1-4bd6-a33d-8c4347cebfc7] Fetching instance by UUID {{(pid=116156) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:09:32.070983 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-9d1e5cc7-1f3a-4711-be5d-d8a5a26b7110 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:09:32.071426 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-9d1e5cc7-1f3a-4711-be5d-d8a5a26b7110 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:09:32.072196 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-9d1e5cc7-1f3a-4711-be5d-d8a5a26b7110 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:09:32.072629 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-9d1e5cc7-1f3a-4711-be5d-d8a5a26b7110 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:09:32.100073 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: INFO nova.api.openstack.requestlog [None req-9d1e5cc7-1f3a-4711-be5d-d8a5a26b7110 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] 10.222.0.18 "GET /compute/v2.1/servers/b89094ac-aee1-4bd6-a33d-8c4347cebfc7/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.040572 Dec 15 03:09:32.100766 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: [pid: 116156|app: 0|req: 428/855] 10.222.0.18 () {60 vars in 1342 bytes} [Wed Dec 15 03:09:32 2021] GET /compute/v2.1/servers/b89094ac-aee1-4bd6-a33d-8c4347cebfc7/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 03:09:32.483649 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi [None req-1ca23c92-e2ca-4b1e-bf45-c79331542886 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Calling method '>' {{(pid=116157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:09:32.484261 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.compute.api [None req-1ca23c92-e2ca-4b1e-bf45-c79331542886 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] [instance: bbb8462c-9501-4541-b67e-43ec5c5061a7] Fetching instance by UUID {{(pid=116157) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:09:32.490040 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-1ca23c92-e2ca-4b1e-bf45-c79331542886 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:09:32.490500 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-1ca23c92-e2ca-4b1e-bf45-c79331542886 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:09:32.492122 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-1ca23c92-e2ca-4b1e-bf45-c79331542886 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:09:32.492571 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-1ca23c92-e2ca-4b1e-bf45-c79331542886 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:09:32.551918 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.policy [None req-1ca23c92-e2ca-4b1e-bf45-c79331542886 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97bdf19af9e34fc3886ff451cb9d7a27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '494b56bf5eae4d56a5591546f85bc32b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116157) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:09:32.559961 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: INFO nova.api.openstack.requestlog [None req-1ca23c92-e2ca-4b1e-bf45-c79331542886 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] 10.222.0.18 "GET /compute/v2.1/servers/bbb8462c-9501-4541-b67e-43ec5c5061a7" status: 200 len: 1226 microversion: 2.1 time: 0.079954 Dec 15 03:09:32.560535 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: [pid: 116157|app: 0|req: 428/856] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 03:09:32 2021] GET /compute/v2.1/servers/bbb8462c-9501-4541-b67e-43ec5c5061a7 => generated 1226 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 03:09:33.015470 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi [None req-413cd50b-65ab-4158-8e2b-6e9b1304ef6b tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Calling method '>' {{(pid=116156) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:09:33.016073 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.compute.api [None req-413cd50b-65ab-4158-8e2b-6e9b1304ef6b tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] [instance: fa7c86bc-c46f-4120-8f3d-d795f8d7c5cc] Fetching instance by UUID {{(pid=116156) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:09:33.021837 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-413cd50b-65ab-4158-8e2b-6e9b1304ef6b tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:09:33.022827 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-413cd50b-65ab-4158-8e2b-6e9b1304ef6b tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:09:33.023579 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-413cd50b-65ab-4158-8e2b-6e9b1304ef6b tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:09:33.024009 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-413cd50b-65ab-4158-8e2b-6e9b1304ef6b tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:09:33.111584 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi [None req-8ee46c93-3d53-4fd6-a737-8629f76ec582 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Calling method '>' {{(pid=116157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:09:33.112498 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.compute.api [None req-8ee46c93-3d53-4fd6-a737-8629f76ec582 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] [instance: b89094ac-aee1-4bd6-a33d-8c4347cebfc7] Fetching instance by UUID {{(pid=116157) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:09:33.118978 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-8ee46c93-3d53-4fd6-a737-8629f76ec582 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:09:33.119436 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-8ee46c93-3d53-4fd6-a737-8629f76ec582 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:09:33.120488 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-8ee46c93-3d53-4fd6-a737-8629f76ec582 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:09:33.120930 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-8ee46c93-3d53-4fd6-a737-8629f76ec582 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:09:33.150935 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: INFO nova.api.openstack.requestlog [None req-8ee46c93-3d53-4fd6-a737-8629f76ec582 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] 10.222.0.18 "GET /compute/v2.1/servers/b89094ac-aee1-4bd6-a33d-8c4347cebfc7/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042994 Dec 15 03:09:33.151498 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: [pid: 116157|app: 0|req: 429/857] 10.222.0.18 () {60 vars in 1342 bytes} [Wed Dec 15 03:09:33 2021] GET /compute/v2.1/servers/b89094ac-aee1-4bd6-a33d-8c4347cebfc7/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Dec 15 03:09:33.159241 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.policy [None req-413cd50b-65ab-4158-8e2b-6e9b1304ef6b tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c4c0c82448e40ba801c0b52ec44e74a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a093d0bf43046aaa845f3cc115f3f5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116156) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:09:33.166637 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: INFO nova.api.openstack.requestlog [None req-413cd50b-65ab-4158-8e2b-6e9b1304ef6b tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] 10.222.0.18 "GET /compute/v2.1/servers/fa7c86bc-c46f-4120-8f3d-d795f8d7c5cc" status: 200 len: 1570 microversion: 2.1 time: 0.154774 Dec 15 03:09:33.167190 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: [pid: 116156|app: 0|req: 429/858] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 03:09:33 2021] GET /compute/v2.1/servers/fa7c86bc-c46f-4120-8f3d-d795f8d7c5cc => generated 1570 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 03:09:33.576372 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi [None req-d395e9be-f4f3-44ba-be87-2a4aa3539229 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Calling method '>' {{(pid=116157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:09:33.576994 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.compute.api [None req-d395e9be-f4f3-44ba-be87-2a4aa3539229 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] [instance: bbb8462c-9501-4541-b67e-43ec5c5061a7] Fetching instance by UUID {{(pid=116157) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:09:33.582851 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-d395e9be-f4f3-44ba-be87-2a4aa3539229 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:09:33.583304 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-d395e9be-f4f3-44ba-be87-2a4aa3539229 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:09:33.584084 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-d395e9be-f4f3-44ba-be87-2a4aa3539229 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:09:33.584526 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-d395e9be-f4f3-44ba-be87-2a4aa3539229 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:09:33.642820 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.policy [None req-d395e9be-f4f3-44ba-be87-2a4aa3539229 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97bdf19af9e34fc3886ff451cb9d7a27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '494b56bf5eae4d56a5591546f85bc32b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116157) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:09:33.650155 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: INFO nova.api.openstack.requestlog [None req-d395e9be-f4f3-44ba-be87-2a4aa3539229 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] 10.222.0.18 "GET /compute/v2.1/servers/bbb8462c-9501-4541-b67e-43ec5c5061a7" status: 200 len: 1226 microversion: 2.1 time: 0.077379 Dec 15 03:09:33.650721 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: [pid: 116157|app: 0|req: 430/859] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 03:09:33 2021] GET /compute/v2.1/servers/bbb8462c-9501-4541-b67e-43ec5c5061a7 => generated 1226 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 03:09:34.162574 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi [None req-56598034-560d-4ab5-b9b7-22f9938d0602 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Calling method '>' {{(pid=116156) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:09:34.163975 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.compute.api [None req-56598034-560d-4ab5-b9b7-22f9938d0602 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] [instance: b89094ac-aee1-4bd6-a33d-8c4347cebfc7] Fetching instance by UUID {{(pid=116156) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:09:34.170294 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-56598034-560d-4ab5-b9b7-22f9938d0602 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:09:34.170750 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-56598034-560d-4ab5-b9b7-22f9938d0602 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:09:34.171532 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-56598034-560d-4ab5-b9b7-22f9938d0602 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:09:34.171972 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-56598034-560d-4ab5-b9b7-22f9938d0602 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:09:34.183659 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi [None req-994a4252-6352-4cc3-a5c2-e051b4f7de5a tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Calling method '>' {{(pid=116157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:09:34.184275 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.compute.api [None req-994a4252-6352-4cc3-a5c2-e051b4f7de5a tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] [instance: fa7c86bc-c46f-4120-8f3d-d795f8d7c5cc] Fetching instance by UUID {{(pid=116157) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:09:34.190453 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-994a4252-6352-4cc3-a5c2-e051b4f7de5a tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:09:34.190911 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-994a4252-6352-4cc3-a5c2-e051b4f7de5a tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:09:34.191705 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-994a4252-6352-4cc3-a5c2-e051b4f7de5a tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:09:34.192146 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-994a4252-6352-4cc3-a5c2-e051b4f7de5a tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:09:34.200972 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: INFO nova.api.openstack.requestlog [None req-56598034-560d-4ab5-b9b7-22f9938d0602 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] 10.222.0.18 "GET /compute/v2.1/servers/b89094ac-aee1-4bd6-a33d-8c4347cebfc7/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042130 Dec 15 03:09:34.201751 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: [pid: 116156|app: 0|req: 430/860] 10.222.0.18 () {60 vars in 1342 bytes} [Wed Dec 15 03:09:34 2021] GET /compute/v2.1/servers/b89094ac-aee1-4bd6-a33d-8c4347cebfc7/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 03:09:34.320728 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.policy [None req-994a4252-6352-4cc3-a5c2-e051b4f7de5a tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c4c0c82448e40ba801c0b52ec44e74a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a093d0bf43046aaa845f3cc115f3f5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116157) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:09:34.327951 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: INFO nova.api.openstack.requestlog [None req-994a4252-6352-4cc3-a5c2-e051b4f7de5a tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] 10.222.0.18 "GET /compute/v2.1/servers/fa7c86bc-c46f-4120-8f3d-d795f8d7c5cc" status: 200 len: 1570 microversion: 2.1 time: 0.147890 Dec 15 03:09:34.328526 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: [pid: 116157|app: 0|req: 431/861] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 03:09:34 2021] GET /compute/v2.1/servers/fa7c86bc-c46f-4120-8f3d-d795f8d7c5cc => generated 1570 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 03:09:34.666753 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi [None req-fc3130b8-a8d6-4b3d-9e4c-8ed6f22f5ca8 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Calling method '>' {{(pid=116156) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:09:34.667366 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.compute.api [None req-fc3130b8-a8d6-4b3d-9e4c-8ed6f22f5ca8 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] [instance: bbb8462c-9501-4541-b67e-43ec5c5061a7] Fetching instance by UUID {{(pid=116156) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:09:34.673108 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-fc3130b8-a8d6-4b3d-9e4c-8ed6f22f5ca8 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:09:34.673565 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-fc3130b8-a8d6-4b3d-9e4c-8ed6f22f5ca8 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:09:34.674369 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-fc3130b8-a8d6-4b3d-9e4c-8ed6f22f5ca8 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:09:34.674808 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-fc3130b8-a8d6-4b3d-9e4c-8ed6f22f5ca8 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:09:34.731852 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.policy [None req-fc3130b8-a8d6-4b3d-9e4c-8ed6f22f5ca8 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97bdf19af9e34fc3886ff451cb9d7a27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '494b56bf5eae4d56a5591546f85bc32b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116156) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:09:34.739033 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: INFO nova.api.openstack.requestlog [None req-fc3130b8-a8d6-4b3d-9e4c-8ed6f22f5ca8 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] 10.222.0.18 "GET /compute/v2.1/servers/bbb8462c-9501-4541-b67e-43ec5c5061a7" status: 200 len: 1226 microversion: 2.1 time: 0.076038 Dec 15 03:09:34.739589 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: [pid: 116156|app: 0|req: 431/862] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 03:09:34 2021] GET /compute/v2.1/servers/bbb8462c-9501-4541-b67e-43ec5c5061a7 => generated 1226 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 03:09:35.212658 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi [None req-705d8173-3e33-4d8a-948a-ee2fc1b8ee60 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Calling method '>' {{(pid=116157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:09:35.213590 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.compute.api [None req-705d8173-3e33-4d8a-948a-ee2fc1b8ee60 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] [instance: b89094ac-aee1-4bd6-a33d-8c4347cebfc7] Fetching instance by UUID {{(pid=116157) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:09:35.219916 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-705d8173-3e33-4d8a-948a-ee2fc1b8ee60 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:09:35.220370 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-705d8173-3e33-4d8a-948a-ee2fc1b8ee60 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:09:35.221149 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-705d8173-3e33-4d8a-948a-ee2fc1b8ee60 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:09:35.221590 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-705d8173-3e33-4d8a-948a-ee2fc1b8ee60 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:09:35.249751 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: INFO nova.api.openstack.requestlog [None req-705d8173-3e33-4d8a-948a-ee2fc1b8ee60 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] 10.222.0.18 "GET /compute/v2.1/servers/b89094ac-aee1-4bd6-a33d-8c4347cebfc7/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.040982 Dec 15 03:09:35.250323 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: [pid: 116157|app: 0|req: 432/863] 10.222.0.18 () {60 vars in 1342 bytes} [Wed Dec 15 03:09:35 2021] GET /compute/v2.1/servers/b89094ac-aee1-4bd6-a33d-8c4347cebfc7/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 03:09:35.344351 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi [None req-a5b524b6-b43d-40bf-9dd2-818cad1a42a2 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Calling method '>' {{(pid=116156) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:09:35.344965 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.compute.api [None req-a5b524b6-b43d-40bf-9dd2-818cad1a42a2 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] [instance: fa7c86bc-c46f-4120-8f3d-d795f8d7c5cc] Fetching instance by UUID {{(pid=116156) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:09:35.351166 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-a5b524b6-b43d-40bf-9dd2-818cad1a42a2 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:09:35.351619 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-a5b524b6-b43d-40bf-9dd2-818cad1a42a2 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:09:35.352394 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-a5b524b6-b43d-40bf-9dd2-818cad1a42a2 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:09:35.352866 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-a5b524b6-b43d-40bf-9dd2-818cad1a42a2 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:09:35.482066 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.policy [None req-a5b524b6-b43d-40bf-9dd2-818cad1a42a2 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c4c0c82448e40ba801c0b52ec44e74a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a093d0bf43046aaa845f3cc115f3f5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116156) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:09:35.489211 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: INFO nova.api.openstack.requestlog [None req-a5b524b6-b43d-40bf-9dd2-818cad1a42a2 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] 10.222.0.18 "GET /compute/v2.1/servers/fa7c86bc-c46f-4120-8f3d-d795f8d7c5cc" status: 200 len: 1570 microversion: 2.1 time: 0.148510 Dec 15 03:09:35.489770 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: [pid: 116156|app: 0|req: 432/864] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 03:09:35 2021] GET /compute/v2.1/servers/fa7c86bc-c46f-4120-8f3d-d795f8d7c5cc => generated 1570 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 03:09:35.755769 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi [None req-9c144749-89b2-4c8f-afc0-cefc8b347f2b tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Calling method '>' {{(pid=116157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:09:35.756292 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.compute.api [None req-9c144749-89b2-4c8f-afc0-cefc8b347f2b tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] [instance: bbb8462c-9501-4541-b67e-43ec5c5061a7] Fetching instance by UUID {{(pid=116157) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:09:35.762307 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-9c144749-89b2-4c8f-afc0-cefc8b347f2b tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:09:35.762764 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-9c144749-89b2-4c8f-afc0-cefc8b347f2b tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:09:35.763568 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-9c144749-89b2-4c8f-afc0-cefc8b347f2b tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:09:35.764004 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-9c144749-89b2-4c8f-afc0-cefc8b347f2b tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:09:35.824668 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.policy [None req-9c144749-89b2-4c8f-afc0-cefc8b347f2b tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97bdf19af9e34fc3886ff451cb9d7a27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '494b56bf5eae4d56a5591546f85bc32b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116157) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:09:35.831820 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: INFO nova.api.openstack.requestlog [None req-9c144749-89b2-4c8f-afc0-cefc8b347f2b tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] 10.222.0.18 "GET /compute/v2.1/servers/bbb8462c-9501-4541-b67e-43ec5c5061a7" status: 200 len: 1226 microversion: 2.1 time: 0.079687 Dec 15 03:09:35.832383 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: [pid: 116157|app: 0|req: 433/865] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 03:09:35 2021] GET /compute/v2.1/servers/bbb8462c-9501-4541-b67e-43ec5c5061a7 => generated 1226 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 03:09:36.135188 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Dec 15 03:09:36.135381 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: Wed Dec 15 03:09:36 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Dec 15 03:09:36.354700 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi [None req-497abc3f-5cde-484f-8836-7949cf8b7111 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Calling method '>' {{(pid=116156) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:09:36.355651 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.compute.api [None req-497abc3f-5cde-484f-8836-7949cf8b7111 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] [instance: b89094ac-aee1-4bd6-a33d-8c4347cebfc7] Fetching instance by UUID {{(pid=116156) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:09:36.361368 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-497abc3f-5cde-484f-8836-7949cf8b7111 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:09:36.361823 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-497abc3f-5cde-484f-8836-7949cf8b7111 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:09:36.362646 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-497abc3f-5cde-484f-8836-7949cf8b7111 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:09:36.363087 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-497abc3f-5cde-484f-8836-7949cf8b7111 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:09:36.391560 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: INFO nova.api.openstack.requestlog [None req-497abc3f-5cde-484f-8836-7949cf8b7111 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] 10.222.0.18 "GET /compute/v2.1/servers/b89094ac-aee1-4bd6-a33d-8c4347cebfc7/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.133501 Dec 15 03:09:36.392045 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: [pid: 116156|app: 0|req: 433/866] 10.222.0.18 () {60 vars in 1342 bytes} [Wed Dec 15 03:09:36 2021] GET /compute/v2.1/servers/b89094ac-aee1-4bd6-a33d-8c4347cebfc7/os-volume_attachments => generated 197 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 03:09:36.505918 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi [None req-acaa53e8-1a1e-4bcc-9320-38fa8d8a7a54 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Calling method '>' {{(pid=116157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:09:36.507049 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.compute.api [None req-acaa53e8-1a1e-4bcc-9320-38fa8d8a7a54 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] [instance: fa7c86bc-c46f-4120-8f3d-d795f8d7c5cc] Fetching instance by UUID {{(pid=116157) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:09:36.513212 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-acaa53e8-1a1e-4bcc-9320-38fa8d8a7a54 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:09:36.513658 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-acaa53e8-1a1e-4bcc-9320-38fa8d8a7a54 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:09:36.514464 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-acaa53e8-1a1e-4bcc-9320-38fa8d8a7a54 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:09:36.514899 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-acaa53e8-1a1e-4bcc-9320-38fa8d8a7a54 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:09:36.643771 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.policy [None req-acaa53e8-1a1e-4bcc-9320-38fa8d8a7a54 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c4c0c82448e40ba801c0b52ec44e74a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a093d0bf43046aaa845f3cc115f3f5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116157) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:09:36.651003 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: INFO nova.api.openstack.requestlog [None req-acaa53e8-1a1e-4bcc-9320-38fa8d8a7a54 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] 10.222.0.18 "GET /compute/v2.1/servers/fa7c86bc-c46f-4120-8f3d-d795f8d7c5cc" status: 200 len: 1570 microversion: 2.1 time: 0.148695 Dec 15 03:09:36.651556 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: [pid: 116157|app: 0|req: 434/867] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 03:09:36 2021] GET /compute/v2.1/servers/fa7c86bc-c46f-4120-8f3d-d795f8d7c5cc => generated 1570 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 03:09:36.848279 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi [None req-e4c846df-b286-4dc0-bb6c-cad5d40a5020 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Calling method '>' {{(pid=116156) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:09:36.848886 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.compute.api [None req-e4c846df-b286-4dc0-bb6c-cad5d40a5020 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] [instance: bbb8462c-9501-4541-b67e-43ec5c5061a7] Fetching instance by UUID {{(pid=116156) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:09:36.854671 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-e4c846df-b286-4dc0-bb6c-cad5d40a5020 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:09:36.855124 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-e4c846df-b286-4dc0-bb6c-cad5d40a5020 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:09:36.855896 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-e4c846df-b286-4dc0-bb6c-cad5d40a5020 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:09:36.856334 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-e4c846df-b286-4dc0-bb6c-cad5d40a5020 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:09:36.914687 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.policy [None req-e4c846df-b286-4dc0-bb6c-cad5d40a5020 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97bdf19af9e34fc3886ff451cb9d7a27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '494b56bf5eae4d56a5591546f85bc32b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116156) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:09:36.921802 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: INFO nova.api.openstack.requestlog [None req-e4c846df-b286-4dc0-bb6c-cad5d40a5020 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] 10.222.0.18 "GET /compute/v2.1/servers/bbb8462c-9501-4541-b67e-43ec5c5061a7" status: 200 len: 1226 microversion: 2.1 time: 0.077147 Dec 15 03:09:36.922406 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: [pid: 116156|app: 0|req: 434/868] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 03:09:36 2021] GET /compute/v2.1/servers/bbb8462c-9501-4541-b67e-43ec5c5061a7 => generated 1226 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 03:09:37.403507 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi [None req-4df2ae6d-76d6-4459-8982-857cfb3c4e61 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Calling method '>' {{(pid=116157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:09:37.404402 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.compute.api [None req-4df2ae6d-76d6-4459-8982-857cfb3c4e61 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] [instance: b89094ac-aee1-4bd6-a33d-8c4347cebfc7] Fetching instance by UUID {{(pid=116157) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:09:37.410188 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-4df2ae6d-76d6-4459-8982-857cfb3c4e61 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:09:37.410671 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-4df2ae6d-76d6-4459-8982-857cfb3c4e61 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:09:37.411444 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-4df2ae6d-76d6-4459-8982-857cfb3c4e61 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:09:37.411880 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-4df2ae6d-76d6-4459-8982-857cfb3c4e61 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:09:37.440770 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: INFO nova.api.openstack.requestlog [None req-4df2ae6d-76d6-4459-8982-857cfb3c4e61 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] 10.222.0.18 "GET /compute/v2.1/servers/b89094ac-aee1-4bd6-a33d-8c4347cebfc7/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041088 Dec 15 03:09:37.441308 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: [pid: 116157|app: 0|req: 435/869] 10.222.0.18 () {60 vars in 1342 bytes} [Wed Dec 15 03:09:37 2021] GET /compute/v2.1/servers/b89094ac-aee1-4bd6-a33d-8c4347cebfc7/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Dec 15 03:09:37.667803 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi [None req-7df1b11a-d395-44a8-93b5-1a1fafd838b4 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Calling method '>' {{(pid=116156) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:09:37.668452 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.compute.api [None req-7df1b11a-d395-44a8-93b5-1a1fafd838b4 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] [instance: fa7c86bc-c46f-4120-8f3d-d795f8d7c5cc] Fetching instance by UUID {{(pid=116156) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:09:37.674739 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-7df1b11a-d395-44a8-93b5-1a1fafd838b4 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:09:37.675190 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-7df1b11a-d395-44a8-93b5-1a1fafd838b4 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:09:37.675972 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-7df1b11a-d395-44a8-93b5-1a1fafd838b4 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:09:37.676409 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-7df1b11a-d395-44a8-93b5-1a1fafd838b4 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:09:37.806574 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.policy [None req-7df1b11a-d395-44a8-93b5-1a1fafd838b4 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c4c0c82448e40ba801c0b52ec44e74a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a093d0bf43046aaa845f3cc115f3f5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116156) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:09:37.813848 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: INFO nova.api.openstack.requestlog [None req-7df1b11a-d395-44a8-93b5-1a1fafd838b4 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] 10.222.0.18 "GET /compute/v2.1/servers/fa7c86bc-c46f-4120-8f3d-d795f8d7c5cc" status: 200 len: 1570 microversion: 2.1 time: 0.149681 Dec 15 03:09:37.814443 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: [pid: 116156|app: 0|req: 435/870] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 03:09:37 2021] GET /compute/v2.1/servers/fa7c86bc-c46f-4120-8f3d-d795f8d7c5cc => generated 1570 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 03:09:37.939104 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi [None req-49449150-ade7-4363-9f37-380fbbe20198 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Calling method '>' {{(pid=116157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:09:37.939642 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.compute.api [None req-49449150-ade7-4363-9f37-380fbbe20198 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] [instance: bbb8462c-9501-4541-b67e-43ec5c5061a7] Fetching instance by UUID {{(pid=116157) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:09:37.946355 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-49449150-ade7-4363-9f37-380fbbe20198 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:09:37.946808 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-49449150-ade7-4363-9f37-380fbbe20198 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:09:37.947584 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-49449150-ade7-4363-9f37-380fbbe20198 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:09:37.948028 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-49449150-ade7-4363-9f37-380fbbe20198 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:09:38.008646 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.policy [None req-49449150-ade7-4363-9f37-380fbbe20198 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97bdf19af9e34fc3886ff451cb9d7a27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '494b56bf5eae4d56a5591546f85bc32b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116157) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:09:38.015868 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: INFO nova.api.openstack.requestlog [None req-49449150-ade7-4363-9f37-380fbbe20198 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] 10.222.0.18 "GET /compute/v2.1/servers/bbb8462c-9501-4541-b67e-43ec5c5061a7" status: 200 len: 1226 microversion: 2.1 time: 0.080523 Dec 15 03:09:38.016434 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: [pid: 116157|app: 0|req: 436/871] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 03:09:37 2021] GET /compute/v2.1/servers/bbb8462c-9501-4541-b67e-43ec5c5061a7 => generated 1226 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 03:09:38.452165 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi [None req-a8720335-e7e8-4954-a143-d3cb8d77e034 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Calling method '>' {{(pid=116156) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:09:38.453117 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.compute.api [None req-a8720335-e7e8-4954-a143-d3cb8d77e034 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] [instance: b89094ac-aee1-4bd6-a33d-8c4347cebfc7] Fetching instance by UUID {{(pid=116156) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:09:38.459042 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-a8720335-e7e8-4954-a143-d3cb8d77e034 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:09:38.459436 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-a8720335-e7e8-4954-a143-d3cb8d77e034 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:09:38.460204 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-a8720335-e7e8-4954-a143-d3cb8d77e034 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:09:38.461287 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-a8720335-e7e8-4954-a143-d3cb8d77e034 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:09:38.489787 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: INFO nova.api.openstack.requestlog [None req-a8720335-e7e8-4954-a143-d3cb8d77e034 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] 10.222.0.18 "GET /compute/v2.1/servers/b89094ac-aee1-4bd6-a33d-8c4347cebfc7/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041389 Dec 15 03:09:38.490349 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: [pid: 116156|app: 0|req: 436/872] 10.222.0.18 () {60 vars in 1342 bytes} [Wed Dec 15 03:09:38 2021] GET /compute/v2.1/servers/b89094ac-aee1-4bd6-a33d-8c4347cebfc7/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 03:09:38.831280 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi [None req-f5daed4d-b2a8-46a5-a04a-9ea6ee76b8c0 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Calling method '>' {{(pid=116157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:09:38.831897 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.compute.api [None req-f5daed4d-b2a8-46a5-a04a-9ea6ee76b8c0 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] [instance: fa7c86bc-c46f-4120-8f3d-d795f8d7c5cc] Fetching instance by UUID {{(pid=116157) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:09:38.837786 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-f5daed4d-b2a8-46a5-a04a-9ea6ee76b8c0 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:09:38.838280 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-f5daed4d-b2a8-46a5-a04a-9ea6ee76b8c0 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:09:38.839062 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-f5daed4d-b2a8-46a5-a04a-9ea6ee76b8c0 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:09:38.839505 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-f5daed4d-b2a8-46a5-a04a-9ea6ee76b8c0 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:09:38.968551 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.policy [None req-f5daed4d-b2a8-46a5-a04a-9ea6ee76b8c0 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c4c0c82448e40ba801c0b52ec44e74a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a093d0bf43046aaa845f3cc115f3f5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116157) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:09:38.975663 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: INFO nova.api.openstack.requestlog [None req-f5daed4d-b2a8-46a5-a04a-9ea6ee76b8c0 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] 10.222.0.18 "GET /compute/v2.1/servers/fa7c86bc-c46f-4120-8f3d-d795f8d7c5cc" status: 200 len: 1570 microversion: 2.1 time: 0.148044 Dec 15 03:09:38.976254 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: [pid: 116157|app: 0|req: 437/873] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 03:09:38 2021] GET /compute/v2.1/servers/fa7c86bc-c46f-4120-8f3d-d795f8d7c5cc => generated 1570 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 03:09:39.032199 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi [None req-b1f7d973-0168-4e9e-9b72-0a76535acad9 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Calling method '>' {{(pid=116156) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:09:39.032813 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.compute.api [None req-b1f7d973-0168-4e9e-9b72-0a76535acad9 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] [instance: bbb8462c-9501-4541-b67e-43ec5c5061a7] Fetching instance by UUID {{(pid=116156) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:09:39.039075 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-b1f7d973-0168-4e9e-9b72-0a76535acad9 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:09:39.039531 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-b1f7d973-0168-4e9e-9b72-0a76535acad9 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:09:39.040311 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-b1f7d973-0168-4e9e-9b72-0a76535acad9 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:09:39.040750 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-b1f7d973-0168-4e9e-9b72-0a76535acad9 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:09:39.098236 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.policy [None req-b1f7d973-0168-4e9e-9b72-0a76535acad9 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97bdf19af9e34fc3886ff451cb9d7a27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '494b56bf5eae4d56a5591546f85bc32b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116156) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:09:39.105799 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: INFO nova.api.openstack.requestlog [None req-b1f7d973-0168-4e9e-9b72-0a76535acad9 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] 10.222.0.18 "GET /compute/v2.1/servers/bbb8462c-9501-4541-b67e-43ec5c5061a7" status: 200 len: 1226 microversion: 2.1 time: 0.077225 Dec 15 03:09:39.106391 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: [pid: 116156|app: 0|req: 437/874] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 03:09:39 2021] GET /compute/v2.1/servers/bbb8462c-9501-4541-b67e-43ec5c5061a7 => generated 1226 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 03:09:39.501610 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi [None req-ede1e27e-7959-4404-8ef3-af3beb96549b tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Calling method '>' {{(pid=116157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:09:39.502445 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.compute.api [None req-ede1e27e-7959-4404-8ef3-af3beb96549b tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] [instance: b89094ac-aee1-4bd6-a33d-8c4347cebfc7] Fetching instance by UUID {{(pid=116157) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:09:39.508539 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-ede1e27e-7959-4404-8ef3-af3beb96549b tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:09:39.508987 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-ede1e27e-7959-4404-8ef3-af3beb96549b tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:09:39.509759 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-ede1e27e-7959-4404-8ef3-af3beb96549b tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:09:39.510222 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-ede1e27e-7959-4404-8ef3-af3beb96549b tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:09:39.540479 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: INFO nova.api.openstack.requestlog [None req-ede1e27e-7959-4404-8ef3-af3beb96549b tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] 10.222.0.18 "GET /compute/v2.1/servers/b89094ac-aee1-4bd6-a33d-8c4347cebfc7/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042661 Dec 15 03:09:39.541027 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: [pid: 116157|app: 0|req: 438/875] 10.222.0.18 () {60 vars in 1342 bytes} [Wed Dec 15 03:09:39 2021] GET /compute/v2.1/servers/b89094ac-aee1-4bd6-a33d-8c4347cebfc7/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 03:09:39.992571 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi [None req-d71bb1ba-d90e-447b-ad9c-d51119b3923e tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Calling method '>' {{(pid=116156) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:09:39.993185 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.compute.api [None req-d71bb1ba-d90e-447b-ad9c-d51119b3923e tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] [instance: fa7c86bc-c46f-4120-8f3d-d795f8d7c5cc] Fetching instance by UUID {{(pid=116156) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:09:39.999093 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-d71bb1ba-d90e-447b-ad9c-d51119b3923e tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:09:39.999545 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-d71bb1ba-d90e-447b-ad9c-d51119b3923e tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:09:40.000320 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-d71bb1ba-d90e-447b-ad9c-d51119b3923e tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:09:40.000759 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-d71bb1ba-d90e-447b-ad9c-d51119b3923e tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:09:40.122699 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi [None req-fc661cb7-8208-4e9c-a480-2fbf178e9248 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Calling method '>' {{(pid=116157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:09:40.123312 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.compute.api [None req-fc661cb7-8208-4e9c-a480-2fbf178e9248 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] [instance: bbb8462c-9501-4541-b67e-43ec5c5061a7] Fetching instance by UUID {{(pid=116157) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:09:40.128105 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.policy [None req-d71bb1ba-d90e-447b-ad9c-d51119b3923e tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c4c0c82448e40ba801c0b52ec44e74a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a093d0bf43046aaa845f3cc115f3f5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116156) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:09:40.129657 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-fc661cb7-8208-4e9c-a480-2fbf178e9248 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:09:40.130147 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-fc661cb7-8208-4e9c-a480-2fbf178e9248 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:09:40.130940 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-fc661cb7-8208-4e9c-a480-2fbf178e9248 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:09:40.131381 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-fc661cb7-8208-4e9c-a480-2fbf178e9248 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:09:40.135970 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: INFO nova.api.openstack.requestlog [None req-d71bb1ba-d90e-447b-ad9c-d51119b3923e tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] 10.222.0.18 "GET /compute/v2.1/servers/fa7c86bc-c46f-4120-8f3d-d795f8d7c5cc" status: 200 len: 1570 microversion: 2.1 time: 0.147288 Dec 15 03:09:40.136540 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: [pid: 116156|app: 0|req: 438/876] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 03:09:39 2021] GET /compute/v2.1/servers/fa7c86bc-c46f-4120-8f3d-d795f8d7c5cc => generated 1570 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 03:09:40.189515 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.policy [None req-fc661cb7-8208-4e9c-a480-2fbf178e9248 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97bdf19af9e34fc3886ff451cb9d7a27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '494b56bf5eae4d56a5591546f85bc32b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116157) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:09:40.197196 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: INFO nova.api.openstack.requestlog [None req-fc661cb7-8208-4e9c-a480-2fbf178e9248 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] 10.222.0.18 "GET /compute/v2.1/servers/bbb8462c-9501-4541-b67e-43ec5c5061a7" status: 200 len: 1226 microversion: 2.1 time: 0.078148 Dec 15 03:09:40.197756 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: [pid: 116157|app: 0|req: 439/877] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 03:09:40 2021] GET /compute/v2.1/servers/bbb8462c-9501-4541-b67e-43ec5c5061a7 => generated 1226 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 03:09:40.554675 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi [None req-1298d30c-607a-4d04-9fd5-5b1692357e1f tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Calling method '>' {{(pid=116156) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:09:40.555620 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.compute.api [None req-1298d30c-607a-4d04-9fd5-5b1692357e1f tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] [instance: b89094ac-aee1-4bd6-a33d-8c4347cebfc7] Fetching instance by UUID {{(pid=116156) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:09:40.561476 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-1298d30c-607a-4d04-9fd5-5b1692357e1f tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:09:40.561931 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-1298d30c-607a-4d04-9fd5-5b1692357e1f tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:09:40.562742 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-1298d30c-607a-4d04-9fd5-5b1692357e1f tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:09:40.563180 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-1298d30c-607a-4d04-9fd5-5b1692357e1f tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:09:40.591313 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: INFO nova.api.openstack.requestlog [None req-1298d30c-607a-4d04-9fd5-5b1692357e1f tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] 10.222.0.18 "GET /compute/v2.1/servers/b89094ac-aee1-4bd6-a33d-8c4347cebfc7/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.040938 Dec 15 03:09:40.591855 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: [pid: 116156|app: 0|req: 439/878] 10.222.0.18 () {60 vars in 1342 bytes} [Wed Dec 15 03:09:40 2021] GET /compute/v2.1/servers/b89094ac-aee1-4bd6-a33d-8c4347cebfc7/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 03:09:41.152854 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi [None req-8e07c2ed-ad67-4efe-9a81-3573a33cad41 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Calling method '>' {{(pid=116157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:09:41.153505 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.compute.api [None req-8e07c2ed-ad67-4efe-9a81-3573a33cad41 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] [instance: fa7c86bc-c46f-4120-8f3d-d795f8d7c5cc] Fetching instance by UUID {{(pid=116157) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:09:41.159775 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-8e07c2ed-ad67-4efe-9a81-3573a33cad41 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:09:41.160226 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-8e07c2ed-ad67-4efe-9a81-3573a33cad41 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:09:41.161009 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-8e07c2ed-ad67-4efe-9a81-3573a33cad41 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:09:41.161443 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-8e07c2ed-ad67-4efe-9a81-3573a33cad41 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:09:41.214142 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi [None req-5abecbfb-9a1d-407f-b70b-3bdbf2222274 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Calling method '>' {{(pid=116156) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:09:41.214747 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.compute.api [None req-5abecbfb-9a1d-407f-b70b-3bdbf2222274 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] [instance: bbb8462c-9501-4541-b67e-43ec5c5061a7] Fetching instance by UUID {{(pid=116156) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:09:41.220481 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-5abecbfb-9a1d-407f-b70b-3bdbf2222274 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:09:41.220933 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-5abecbfb-9a1d-407f-b70b-3bdbf2222274 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:09:41.221706 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-5abecbfb-9a1d-407f-b70b-3bdbf2222274 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:09:41.222174 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-5abecbfb-9a1d-407f-b70b-3bdbf2222274 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:09:41.283709 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.policy [None req-5abecbfb-9a1d-407f-b70b-3bdbf2222274 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97bdf19af9e34fc3886ff451cb9d7a27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '494b56bf5eae4d56a5591546f85bc32b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116156) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:09:41.291535 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: INFO nova.api.openstack.requestlog [None req-5abecbfb-9a1d-407f-b70b-3bdbf2222274 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] 10.222.0.18 "GET /compute/v2.1/servers/bbb8462c-9501-4541-b67e-43ec5c5061a7" status: 200 len: 1226 microversion: 2.1 time: 0.081508 Dec 15 03:09:41.292100 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: [pid: 116156|app: 0|req: 440/879] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 03:09:41 2021] GET /compute/v2.1/servers/bbb8462c-9501-4541-b67e-43ec5c5061a7 => generated 1226 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 03:09:41.293141 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.policy [None req-8e07c2ed-ad67-4efe-9a81-3573a33cad41 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c4c0c82448e40ba801c0b52ec44e74a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a093d0bf43046aaa845f3cc115f3f5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116157) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:09:41.300313 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: INFO nova.api.openstack.requestlog [None req-8e07c2ed-ad67-4efe-9a81-3573a33cad41 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] 10.222.0.18 "GET /compute/v2.1/servers/fa7c86bc-c46f-4120-8f3d-d795f8d7c5cc" status: 200 len: 1570 microversion: 2.1 time: 0.151649 Dec 15 03:09:41.301013 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: [pid: 116157|app: 0|req: 440/880] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 03:09:41 2021] GET /compute/v2.1/servers/fa7c86bc-c46f-4120-8f3d-d795f8d7c5cc => generated 1570 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 03:09:41.603326 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi [None req-dede7b23-0fad-4741-a3db-389f089342a1 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Calling method '>' {{(pid=116156) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:09:41.604236 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.compute.api [None req-dede7b23-0fad-4741-a3db-389f089342a1 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] [instance: b89094ac-aee1-4bd6-a33d-8c4347cebfc7] Fetching instance by UUID {{(pid=116156) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:09:41.610482 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-dede7b23-0fad-4741-a3db-389f089342a1 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:09:41.610930 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-dede7b23-0fad-4741-a3db-389f089342a1 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:09:41.611706 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-dede7b23-0fad-4741-a3db-389f089342a1 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:09:41.612140 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-dede7b23-0fad-4741-a3db-389f089342a1 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:09:41.641917 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: INFO nova.api.openstack.requestlog [None req-dede7b23-0fad-4741-a3db-389f089342a1 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] 10.222.0.18 "GET /compute/v2.1/servers/b89094ac-aee1-4bd6-a33d-8c4347cebfc7/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043008 Dec 15 03:09:41.642519 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: [pid: 116156|app: 0|req: 441/881] 10.222.0.18 () {60 vars in 1342 bytes} [Wed Dec 15 03:09:41 2021] GET /compute/v2.1/servers/b89094ac-aee1-4bd6-a33d-8c4347cebfc7/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 03:09:42.308029 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi [None req-e38a7d97-fe8f-4a1a-8008-ac502a731a63 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Calling method '>' {{(pid=116157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:09:42.308668 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.compute.api [None req-e38a7d97-fe8f-4a1a-8008-ac502a731a63 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] [instance: bbb8462c-9501-4541-b67e-43ec5c5061a7] Fetching instance by UUID {{(pid=116157) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:09:42.315054 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-e38a7d97-fe8f-4a1a-8008-ac502a731a63 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:09:42.315508 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-e38a7d97-fe8f-4a1a-8008-ac502a731a63 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:09:42.316295 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-e38a7d97-fe8f-4a1a-8008-ac502a731a63 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:09:42.316735 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-e38a7d97-fe8f-4a1a-8008-ac502a731a63 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:09:42.317452 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi [None req-fa315009-8811-4b19-b41e-5ba2f6f68c6a tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Calling method '>' {{(pid=116156) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:09:42.318128 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.compute.api [None req-fa315009-8811-4b19-b41e-5ba2f6f68c6a tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] [instance: fa7c86bc-c46f-4120-8f3d-d795f8d7c5cc] Fetching instance by UUID {{(pid=116156) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:09:42.323852 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-fa315009-8811-4b19-b41e-5ba2f6f68c6a tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:09:42.324308 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-fa315009-8811-4b19-b41e-5ba2f6f68c6a tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:09:42.325086 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-fa315009-8811-4b19-b41e-5ba2f6f68c6a tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:09:42.325525 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-fa315009-8811-4b19-b41e-5ba2f6f68c6a tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:09:42.375491 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.policy [None req-e38a7d97-fe8f-4a1a-8008-ac502a731a63 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97bdf19af9e34fc3886ff451cb9d7a27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '494b56bf5eae4d56a5591546f85bc32b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116157) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:09:42.382842 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: INFO nova.api.openstack.requestlog [None req-e38a7d97-fe8f-4a1a-8008-ac502a731a63 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] 10.222.0.18 "GET /compute/v2.1/servers/bbb8462c-9501-4541-b67e-43ec5c5061a7" status: 200 len: 1226 microversion: 2.1 time: 0.079088 Dec 15 03:09:42.383407 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: [pid: 116157|app: 0|req: 441/882] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 03:09:42 2021] GET /compute/v2.1/servers/bbb8462c-9501-4541-b67e-43ec5c5061a7 => generated 1226 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 03:09:42.455749 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.policy [None req-fa315009-8811-4b19-b41e-5ba2f6f68c6a tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c4c0c82448e40ba801c0b52ec44e74a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a093d0bf43046aaa845f3cc115f3f5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116156) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:09:42.462951 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: INFO nova.api.openstack.requestlog [None req-fa315009-8811-4b19-b41e-5ba2f6f68c6a tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] 10.222.0.18 "GET /compute/v2.1/servers/fa7c86bc-c46f-4120-8f3d-d795f8d7c5cc" status: 200 len: 1570 microversion: 2.1 time: 0.149108 Dec 15 03:09:42.463449 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: [pid: 116156|app: 0|req: 442/883] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 03:09:42 2021] GET /compute/v2.1/servers/fa7c86bc-c46f-4120-8f3d-d795f8d7c5cc => generated 1570 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 03:09:42.653581 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi [None req-151fefcd-e920-40d1-b7b7-54400c003424 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Calling method '>' {{(pid=116157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:09:42.654502 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.compute.api [None req-151fefcd-e920-40d1-b7b7-54400c003424 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] [instance: b89094ac-aee1-4bd6-a33d-8c4347cebfc7] Fetching instance by UUID {{(pid=116157) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:09:42.660348 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-151fefcd-e920-40d1-b7b7-54400c003424 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:09:42.660802 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-151fefcd-e920-40d1-b7b7-54400c003424 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:09:42.661580 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-151fefcd-e920-40d1-b7b7-54400c003424 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:09:42.662038 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-151fefcd-e920-40d1-b7b7-54400c003424 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:09:42.690361 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: INFO nova.api.openstack.requestlog [None req-151fefcd-e920-40d1-b7b7-54400c003424 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] 10.222.0.18 "GET /compute/v2.1/servers/b89094ac-aee1-4bd6-a33d-8c4347cebfc7/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.040535 Dec 15 03:09:42.690907 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: [pid: 116157|app: 0|req: 442/884] 10.222.0.18 () {60 vars in 1342 bytes} [Wed Dec 15 03:09:42 2021] GET /compute/v2.1/servers/b89094ac-aee1-4bd6-a33d-8c4347cebfc7/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 03:09:43.399477 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi [None req-4bbaf646-1c8a-47cc-97f0-7ced73c74b88 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Calling method '>' {{(pid=116156) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:09:43.399997 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.compute.api [None req-4bbaf646-1c8a-47cc-97f0-7ced73c74b88 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] [instance: bbb8462c-9501-4541-b67e-43ec5c5061a7] Fetching instance by UUID {{(pid=116156) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:09:43.406183 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-4bbaf646-1c8a-47cc-97f0-7ced73c74b88 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:09:43.406632 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-4bbaf646-1c8a-47cc-97f0-7ced73c74b88 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:09:43.407410 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-4bbaf646-1c8a-47cc-97f0-7ced73c74b88 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:09:43.407844 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-4bbaf646-1c8a-47cc-97f0-7ced73c74b88 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:09:43.465933 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.policy [None req-4bbaf646-1c8a-47cc-97f0-7ced73c74b88 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97bdf19af9e34fc3886ff451cb9d7a27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '494b56bf5eae4d56a5591546f85bc32b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116156) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:09:43.473071 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: INFO nova.api.openstack.requestlog [None req-4bbaf646-1c8a-47cc-97f0-7ced73c74b88 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] 10.222.0.18 "GET /compute/v2.1/servers/bbb8462c-9501-4541-b67e-43ec5c5061a7" status: 200 len: 1226 microversion: 2.1 time: 0.077387 Dec 15 03:09:43.473655 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: [pid: 116156|app: 0|req: 443/885] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 03:09:43 2021] GET /compute/v2.1/servers/bbb8462c-9501-4541-b67e-43ec5c5061a7 => generated 1226 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 03:09:43.480490 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi [None req-0e59b753-46f8-495a-9c66-1e9857745d40 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Calling method '>' {{(pid=116157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:09:43.481190 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.compute.api [None req-0e59b753-46f8-495a-9c66-1e9857745d40 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] [instance: fa7c86bc-c46f-4120-8f3d-d795f8d7c5cc] Fetching instance by UUID {{(pid=116157) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:09:43.487630 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-0e59b753-46f8-495a-9c66-1e9857745d40 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:09:43.488087 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-0e59b753-46f8-495a-9c66-1e9857745d40 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:09:43.488874 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-0e59b753-46f8-495a-9c66-1e9857745d40 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:09:43.489313 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-0e59b753-46f8-495a-9c66-1e9857745d40 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:09:43.619986 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.policy [None req-0e59b753-46f8-495a-9c66-1e9857745d40 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c4c0c82448e40ba801c0b52ec44e74a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a093d0bf43046aaa845f3cc115f3f5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116157) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:09:43.627202 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: INFO nova.api.openstack.requestlog [None req-0e59b753-46f8-495a-9c66-1e9857745d40 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] 10.222.0.18 "GET /compute/v2.1/servers/fa7c86bc-c46f-4120-8f3d-d795f8d7c5cc" status: 200 len: 1570 microversion: 2.1 time: 0.151096 Dec 15 03:09:43.627771 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: [pid: 116157|app: 0|req: 443/886] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 03:09:43 2021] GET /compute/v2.1/servers/fa7c86bc-c46f-4120-8f3d-d795f8d7c5cc => generated 1570 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 03:09:43.701730 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi [None req-aa99ecab-4546-4a35-91cf-0aa028964cc3 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Calling method '>' {{(pid=116156) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:09:43.702595 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.compute.api [None req-aa99ecab-4546-4a35-91cf-0aa028964cc3 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] [instance: b89094ac-aee1-4bd6-a33d-8c4347cebfc7] Fetching instance by UUID {{(pid=116156) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:09:43.708389 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-aa99ecab-4546-4a35-91cf-0aa028964cc3 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:09:43.708845 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-aa99ecab-4546-4a35-91cf-0aa028964cc3 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:09:43.709627 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-aa99ecab-4546-4a35-91cf-0aa028964cc3 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:09:43.710091 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-aa99ecab-4546-4a35-91cf-0aa028964cc3 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:09:43.738481 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: INFO nova.api.openstack.requestlog [None req-aa99ecab-4546-4a35-91cf-0aa028964cc3 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] 10.222.0.18 "GET /compute/v2.1/servers/b89094ac-aee1-4bd6-a33d-8c4347cebfc7/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.040537 Dec 15 03:09:43.739028 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: [pid: 116156|app: 0|req: 444/887] 10.222.0.18 () {60 vars in 1342 bytes} [Wed Dec 15 03:09:43 2021] GET /compute/v2.1/servers/b89094ac-aee1-4bd6-a33d-8c4347cebfc7/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 03:09:44.490605 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi [None req-dadd5445-4d83-43f7-8ee0-492d99162e94 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Calling method '>' {{(pid=116157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:09:44.491403 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.compute.api [None req-dadd5445-4d83-43f7-8ee0-492d99162e94 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] [instance: bbb8462c-9501-4541-b67e-43ec5c5061a7] Fetching instance by UUID {{(pid=116157) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:09:44.498274 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-dadd5445-4d83-43f7-8ee0-492d99162e94 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:09:44.498726 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-dadd5445-4d83-43f7-8ee0-492d99162e94 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:09:44.499501 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-dadd5445-4d83-43f7-8ee0-492d99162e94 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:09:44.499934 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-dadd5445-4d83-43f7-8ee0-492d99162e94 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:09:44.557203 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.policy [None req-dadd5445-4d83-43f7-8ee0-492d99162e94 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97bdf19af9e34fc3886ff451cb9d7a27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '494b56bf5eae4d56a5591546f85bc32b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116157) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:09:44.564447 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: INFO nova.api.openstack.requestlog [None req-dadd5445-4d83-43f7-8ee0-492d99162e94 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] 10.222.0.18 "GET /compute/v2.1/servers/bbb8462c-9501-4541-b67e-43ec5c5061a7" status: 200 len: 1226 microversion: 2.1 time: 0.077575 Dec 15 03:09:44.565006 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: [pid: 116157|app: 0|req: 444/888] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 03:09:44 2021] GET /compute/v2.1/servers/bbb8462c-9501-4541-b67e-43ec5c5061a7 => generated 1226 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 03:09:44.644297 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi [None req-78b63ffc-19ed-4712-911e-377aa1f3f832 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Calling method '>' {{(pid=116156) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:09:44.644917 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.compute.api [None req-78b63ffc-19ed-4712-911e-377aa1f3f832 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] [instance: fa7c86bc-c46f-4120-8f3d-d795f8d7c5cc] Fetching instance by UUID {{(pid=116156) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:09:44.651368 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-78b63ffc-19ed-4712-911e-377aa1f3f832 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:09:44.651821 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-78b63ffc-19ed-4712-911e-377aa1f3f832 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:09:44.652605 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-78b63ffc-19ed-4712-911e-377aa1f3f832 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:09:44.653050 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-78b63ffc-19ed-4712-911e-377aa1f3f832 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:09:44.750026 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi [None req-0045b458-7edf-42bc-b644-82d01636f552 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Calling method '>' {{(pid=116157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:09:44.750868 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.compute.api [None req-0045b458-7edf-42bc-b644-82d01636f552 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] [instance: b89094ac-aee1-4bd6-a33d-8c4347cebfc7] Fetching instance by UUID {{(pid=116157) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:09:44.756520 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-0045b458-7edf-42bc-b644-82d01636f552 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:09:44.756972 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-0045b458-7edf-42bc-b644-82d01636f552 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:09:44.757749 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-0045b458-7edf-42bc-b644-82d01636f552 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:09:44.758210 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-0045b458-7edf-42bc-b644-82d01636f552 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:09:44.784404 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.policy [None req-78b63ffc-19ed-4712-911e-377aa1f3f832 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c4c0c82448e40ba801c0b52ec44e74a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a093d0bf43046aaa845f3cc115f3f5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116156) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:09:44.787183 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: INFO nova.api.openstack.requestlog [None req-0045b458-7edf-42bc-b644-82d01636f552 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] 10.222.0.18 "GET /compute/v2.1/servers/b89094ac-aee1-4bd6-a33d-8c4347cebfc7/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.040903 Dec 15 03:09:44.787754 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: [pid: 116157|app: 0|req: 445/889] 10.222.0.18 () {60 vars in 1342 bytes} [Wed Dec 15 03:09:44 2021] GET /compute/v2.1/servers/b89094ac-aee1-4bd6-a33d-8c4347cebfc7/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Dec 15 03:09:44.792257 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: INFO nova.api.openstack.requestlog [None req-78b63ffc-19ed-4712-911e-377aa1f3f832 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] 10.222.0.18 "GET /compute/v2.1/servers/fa7c86bc-c46f-4120-8f3d-d795f8d7c5cc" status: 200 len: 1570 microversion: 2.1 time: 0.151577 Dec 15 03:09:44.792810 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: [pid: 116156|app: 0|req: 445/890] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 03:09:44 2021] GET /compute/v2.1/servers/fa7c86bc-c46f-4120-8f3d-d795f8d7c5cc => generated 1570 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 03:09:45.580114 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi [None req-edb595d2-182b-4896-a0c8-2e5689977bee tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Calling method '>' {{(pid=116157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:09:45.580712 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.compute.api [None req-edb595d2-182b-4896-a0c8-2e5689977bee tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] [instance: bbb8462c-9501-4541-b67e-43ec5c5061a7] Fetching instance by UUID {{(pid=116157) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:09:45.586959 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-edb595d2-182b-4896-a0c8-2e5689977bee tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:09:45.587403 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-edb595d2-182b-4896-a0c8-2e5689977bee tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:09:45.588179 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-edb595d2-182b-4896-a0c8-2e5689977bee tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:09:45.588610 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-edb595d2-182b-4896-a0c8-2e5689977bee tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:09:45.646285 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.policy [None req-edb595d2-182b-4896-a0c8-2e5689977bee tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97bdf19af9e34fc3886ff451cb9d7a27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '494b56bf5eae4d56a5591546f85bc32b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116157) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:09:45.653500 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: INFO nova.api.openstack.requestlog [None req-edb595d2-182b-4896-a0c8-2e5689977bee tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] 10.222.0.18 "GET /compute/v2.1/servers/bbb8462c-9501-4541-b67e-43ec5c5061a7" status: 200 len: 1226 microversion: 2.1 time: 0.076997 Dec 15 03:09:45.654081 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: [pid: 116157|app: 0|req: 446/891] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 03:09:45 2021] GET /compute/v2.1/servers/bbb8462c-9501-4541-b67e-43ec5c5061a7 => generated 1226 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 03:09:45.799117 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi [None req-ebf26c01-2ef7-44ea-aa92-8c6380ec8699 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Calling method '>' {{(pid=116156) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:09:45.800051 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.compute.api [None req-ebf26c01-2ef7-44ea-aa92-8c6380ec8699 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] [instance: b89094ac-aee1-4bd6-a33d-8c4347cebfc7] Fetching instance by UUID {{(pid=116156) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:09:45.806873 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-ebf26c01-2ef7-44ea-aa92-8c6380ec8699 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:09:45.807330 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-ebf26c01-2ef7-44ea-aa92-8c6380ec8699 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:09:45.808145 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-ebf26c01-2ef7-44ea-aa92-8c6380ec8699 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:09:45.808522 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi [None req-5f53cc7d-2173-4ef1-bd35-4c2af4de0265 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Calling method '>' {{(pid=116157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:09:45.808634 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-ebf26c01-2ef7-44ea-aa92-8c6380ec8699 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:09:45.809130 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.compute.api [None req-5f53cc7d-2173-4ef1-bd35-4c2af4de0265 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] [instance: fa7c86bc-c46f-4120-8f3d-d795f8d7c5cc] Fetching instance by UUID {{(pid=116157) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:09:45.814796 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-5f53cc7d-2173-4ef1-bd35-4c2af4de0265 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:09:45.815243 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-5f53cc7d-2173-4ef1-bd35-4c2af4de0265 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:09:45.816010 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-5f53cc7d-2173-4ef1-bd35-4c2af4de0265 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:09:45.816439 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-5f53cc7d-2173-4ef1-bd35-4c2af4de0265 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:09:45.837472 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: INFO nova.api.openstack.requestlog [None req-ebf26c01-2ef7-44ea-aa92-8c6380ec8699 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] 10.222.0.18 "GET /compute/v2.1/servers/b89094ac-aee1-4bd6-a33d-8c4347cebfc7/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042048 Dec 15 03:09:45.837960 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: [pid: 116156|app: 0|req: 446/892] 10.222.0.18 () {60 vars in 1342 bytes} [Wed Dec 15 03:09:45 2021] GET /compute/v2.1/servers/b89094ac-aee1-4bd6-a33d-8c4347cebfc7/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 03:09:45.947695 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.policy [None req-5f53cc7d-2173-4ef1-bd35-4c2af4de0265 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c4c0c82448e40ba801c0b52ec44e74a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a093d0bf43046aaa845f3cc115f3f5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116157) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:09:45.954893 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: INFO nova.api.openstack.requestlog [None req-5f53cc7d-2173-4ef1-bd35-4c2af4de0265 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] 10.222.0.18 "GET /compute/v2.1/servers/fa7c86bc-c46f-4120-8f3d-d795f8d7c5cc" status: 200 len: 1570 microversion: 2.1 time: 0.149877 Dec 15 03:09:45.955450 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: [pid: 116157|app: 0|req: 447/893] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 03:09:45 2021] GET /compute/v2.1/servers/fa7c86bc-c46f-4120-8f3d-d795f8d7c5cc => generated 1570 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 03:09:46.670121 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi [None req-f1180c6b-7ac1-41d7-b2e0-6491b3295a46 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Calling method '>' {{(pid=116156) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:09:46.670732 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.compute.api [None req-f1180c6b-7ac1-41d7-b2e0-6491b3295a46 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] [instance: bbb8462c-9501-4541-b67e-43ec5c5061a7] Fetching instance by UUID {{(pid=116156) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:09:46.676497 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-f1180c6b-7ac1-41d7-b2e0-6491b3295a46 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:09:46.676947 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-f1180c6b-7ac1-41d7-b2e0-6491b3295a46 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:09:46.677717 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-f1180c6b-7ac1-41d7-b2e0-6491b3295a46 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:09:46.678178 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-f1180c6b-7ac1-41d7-b2e0-6491b3295a46 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:09:46.735324 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.policy [None req-f1180c6b-7ac1-41d7-b2e0-6491b3295a46 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97bdf19af9e34fc3886ff451cb9d7a27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '494b56bf5eae4d56a5591546f85bc32b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116156) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:09:46.742683 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: INFO nova.api.openstack.requestlog [None req-f1180c6b-7ac1-41d7-b2e0-6491b3295a46 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] 10.222.0.18 "GET /compute/v2.1/servers/bbb8462c-9501-4541-b67e-43ec5c5061a7" status: 200 len: 1226 microversion: 2.1 time: 0.076269 Dec 15 03:09:46.743233 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: [pid: 116156|app: 0|req: 447/894] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 03:09:46 2021] GET /compute/v2.1/servers/bbb8462c-9501-4541-b67e-43ec5c5061a7 => generated 1226 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 03:09:46.848704 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi [None req-831f9115-2856-41d0-9780-5f8094eea579 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Calling method '>' {{(pid=116157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:09:46.849601 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.compute.api [None req-831f9115-2856-41d0-9780-5f8094eea579 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] [instance: b89094ac-aee1-4bd6-a33d-8c4347cebfc7] Fetching instance by UUID {{(pid=116157) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:09:46.855751 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-831f9115-2856-41d0-9780-5f8094eea579 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:09:46.856197 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-831f9115-2856-41d0-9780-5f8094eea579 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:09:46.856964 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-831f9115-2856-41d0-9780-5f8094eea579 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:09:46.857395 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-831f9115-2856-41d0-9780-5f8094eea579 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:09:46.885909 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: INFO nova.api.openstack.requestlog [None req-831f9115-2856-41d0-9780-5f8094eea579 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] 10.222.0.18 "GET /compute/v2.1/servers/b89094ac-aee1-4bd6-a33d-8c4347cebfc7/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.040908 Dec 15 03:09:46.886487 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: [pid: 116157|app: 0|req: 448/895] 10.222.0.18 () {60 vars in 1342 bytes} [Wed Dec 15 03:09:46 2021] GET /compute/v2.1/servers/b89094ac-aee1-4bd6-a33d-8c4347cebfc7/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Dec 15 03:09:46.971561 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi [None req-337842e3-a603-44ea-bd71-2d661490d952 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Calling method '>' {{(pid=116156) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:09:46.972114 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.compute.api [None req-337842e3-a603-44ea-bd71-2d661490d952 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] [instance: fa7c86bc-c46f-4120-8f3d-d795f8d7c5cc] Fetching instance by UUID {{(pid=116156) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:09:46.978319 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-337842e3-a603-44ea-bd71-2d661490d952 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:09:46.978780 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-337842e3-a603-44ea-bd71-2d661490d952 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:09:46.979565 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-337842e3-a603-44ea-bd71-2d661490d952 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:09:46.980006 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-337842e3-a603-44ea-bd71-2d661490d952 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:09:47.108411 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.policy [None req-337842e3-a603-44ea-bd71-2d661490d952 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c4c0c82448e40ba801c0b52ec44e74a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a093d0bf43046aaa845f3cc115f3f5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116156) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:09:47.115631 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: INFO nova.api.openstack.requestlog [None req-337842e3-a603-44ea-bd71-2d661490d952 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] 10.222.0.18 "GET /compute/v2.1/servers/fa7c86bc-c46f-4120-8f3d-d795f8d7c5cc" status: 200 len: 1570 microversion: 2.1 time: 0.147714 Dec 15 03:09:47.116446 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: [pid: 116156|app: 0|req: 448/896] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 03:09:46 2021] GET /compute/v2.1/servers/fa7c86bc-c46f-4120-8f3d-d795f8d7c5cc => generated 1570 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 03:09:47.759180 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi [None req-2bd7bf5d-f46e-4086-9240-f9b1ca2b34cc tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Calling method '>' {{(pid=116157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:09:47.759791 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.compute.api [None req-2bd7bf5d-f46e-4086-9240-f9b1ca2b34cc tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] [instance: bbb8462c-9501-4541-b67e-43ec5c5061a7] Fetching instance by UUID {{(pid=116157) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:09:47.765611 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-2bd7bf5d-f46e-4086-9240-f9b1ca2b34cc tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:09:47.766104 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-2bd7bf5d-f46e-4086-9240-f9b1ca2b34cc tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:09:47.766894 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-2bd7bf5d-f46e-4086-9240-f9b1ca2b34cc tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:09:47.767330 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-2bd7bf5d-f46e-4086-9240-f9b1ca2b34cc tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:09:47.825268 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.policy [None req-2bd7bf5d-f46e-4086-9240-f9b1ca2b34cc tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97bdf19af9e34fc3886ff451cb9d7a27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '494b56bf5eae4d56a5591546f85bc32b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116157) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:09:47.832434 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: INFO nova.api.openstack.requestlog [None req-2bd7bf5d-f46e-4086-9240-f9b1ca2b34cc tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] 10.222.0.18 "GET /compute/v2.1/servers/bbb8462c-9501-4541-b67e-43ec5c5061a7" status: 200 len: 1226 microversion: 2.1 time: 0.076964 Dec 15 03:09:47.832998 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: [pid: 116157|app: 0|req: 449/897] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 03:09:47 2021] GET /compute/v2.1/servers/bbb8462c-9501-4541-b67e-43ec5c5061a7 => generated 1226 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 03:09:47.896400 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi [None req-5b7f8f45-dc20-4cfb-8a87-61bc14d7b36f tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Calling method '>' {{(pid=116156) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:09:47.897296 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.compute.api [None req-5b7f8f45-dc20-4cfb-8a87-61bc14d7b36f tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] [instance: b89094ac-aee1-4bd6-a33d-8c4347cebfc7] Fetching instance by UUID {{(pid=116156) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:09:47.903535 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-5b7f8f45-dc20-4cfb-8a87-61bc14d7b36f tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:09:47.903987 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-5b7f8f45-dc20-4cfb-8a87-61bc14d7b36f tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:09:47.904757 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-5b7f8f45-dc20-4cfb-8a87-61bc14d7b36f tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:09:47.905195 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-5b7f8f45-dc20-4cfb-8a87-61bc14d7b36f tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:09:47.933301 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: INFO nova.api.openstack.requestlog [None req-5b7f8f45-dc20-4cfb-8a87-61bc14d7b36f tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] 10.222.0.18 "GET /compute/v2.1/servers/b89094ac-aee1-4bd6-a33d-8c4347cebfc7/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.040620 Dec 15 03:09:47.933836 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: [pid: 116156|app: 0|req: 449/898] 10.222.0.18 () {60 vars in 1342 bytes} [Wed Dec 15 03:09:47 2021] GET /compute/v2.1/servers/b89094ac-aee1-4bd6-a33d-8c4347cebfc7/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 03:09:48.133689 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi [None req-9c475135-a58b-4044-83af-db546ef0176c tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Calling method '>' {{(pid=116157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:09:48.134328 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.compute.api [None req-9c475135-a58b-4044-83af-db546ef0176c tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] [instance: fa7c86bc-c46f-4120-8f3d-d795f8d7c5cc] Fetching instance by UUID {{(pid=116157) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:09:48.140579 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-9c475135-a58b-4044-83af-db546ef0176c tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:09:48.141033 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-9c475135-a58b-4044-83af-db546ef0176c tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:09:48.141815 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-9c475135-a58b-4044-83af-db546ef0176c tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:09:48.142288 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-9c475135-a58b-4044-83af-db546ef0176c tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:09:48.271189 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.policy [None req-9c475135-a58b-4044-83af-db546ef0176c tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c4c0c82448e40ba801c0b52ec44e74a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a093d0bf43046aaa845f3cc115f3f5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116157) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:09:48.278927 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: INFO nova.api.openstack.requestlog [None req-9c475135-a58b-4044-83af-db546ef0176c tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] 10.222.0.18 "GET /compute/v2.1/servers/fa7c86bc-c46f-4120-8f3d-d795f8d7c5cc" status: 200 len: 1570 microversion: 2.1 time: 0.149388 Dec 15 03:09:48.279486 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: [pid: 116157|app: 0|req: 450/899] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 03:09:48 2021] GET /compute/v2.1/servers/fa7c86bc-c46f-4120-8f3d-d795f8d7c5cc => generated 1570 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 03:09:48.849350 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi [None req-e9e61af6-7438-4e4e-822c-79cc5b8c190c tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Calling method '>' {{(pid=116156) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:09:48.849964 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.compute.api [None req-e9e61af6-7438-4e4e-822c-79cc5b8c190c tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] [instance: bbb8462c-9501-4541-b67e-43ec5c5061a7] Fetching instance by UUID {{(pid=116156) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:09:48.856695 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-e9e61af6-7438-4e4e-822c-79cc5b8c190c tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:09:48.857162 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-e9e61af6-7438-4e4e-822c-79cc5b8c190c tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:09:48.857944 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-e9e61af6-7438-4e4e-822c-79cc5b8c190c tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:09:48.858409 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-e9e61af6-7438-4e4e-822c-79cc5b8c190c tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:09:48.916809 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.policy [None req-e9e61af6-7438-4e4e-822c-79cc5b8c190c tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97bdf19af9e34fc3886ff451cb9d7a27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '494b56bf5eae4d56a5591546f85bc32b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116156) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:09:48.924029 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: INFO nova.api.openstack.requestlog [None req-e9e61af6-7438-4e4e-822c-79cc5b8c190c tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] 10.222.0.18 "GET /compute/v2.1/servers/bbb8462c-9501-4541-b67e-43ec5c5061a7" status: 200 len: 1226 microversion: 2.1 time: 0.078364 Dec 15 03:09:48.924591 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: [pid: 116156|app: 0|req: 450/900] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 03:09:48 2021] GET /compute/v2.1/servers/bbb8462c-9501-4541-b67e-43ec5c5061a7 => generated 1226 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 03:09:48.944351 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi [None req-0dbfd144-3d11-4b29-8828-3ddbcd163ceb tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Calling method '>' {{(pid=116157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:09:48.945267 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.compute.api [None req-0dbfd144-3d11-4b29-8828-3ddbcd163ceb tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] [instance: b89094ac-aee1-4bd6-a33d-8c4347cebfc7] Fetching instance by UUID {{(pid=116157) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:09:48.950983 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-0dbfd144-3d11-4b29-8828-3ddbcd163ceb tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:09:48.951428 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-0dbfd144-3d11-4b29-8828-3ddbcd163ceb tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:09:48.952199 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-0dbfd144-3d11-4b29-8828-3ddbcd163ceb tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:09:48.952632 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-0dbfd144-3d11-4b29-8828-3ddbcd163ceb tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:09:48.980559 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: INFO nova.api.openstack.requestlog [None req-0dbfd144-3d11-4b29-8828-3ddbcd163ceb tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] 10.222.0.18 "GET /compute/v2.1/servers/b89094ac-aee1-4bd6-a33d-8c4347cebfc7/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.039883 Dec 15 03:09:48.981096 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: [pid: 116157|app: 0|req: 451/901] 10.222.0.18 () {60 vars in 1342 bytes} [Wed Dec 15 03:09:48 2021] GET /compute/v2.1/servers/b89094ac-aee1-4bd6-a33d-8c4347cebfc7/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Dec 15 03:09:49.295834 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi [None req-3104b7bc-ab8f-4469-8b1a-947d65d48d30 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Calling method '>' {{(pid=116156) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:09:49.296446 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.compute.api [None req-3104b7bc-ab8f-4469-8b1a-947d65d48d30 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] [instance: fa7c86bc-c46f-4120-8f3d-d795f8d7c5cc] Fetching instance by UUID {{(pid=116156) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:09:49.302209 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-3104b7bc-ab8f-4469-8b1a-947d65d48d30 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:09:49.302659 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-3104b7bc-ab8f-4469-8b1a-947d65d48d30 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:09:49.303435 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-3104b7bc-ab8f-4469-8b1a-947d65d48d30 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:09:49.303900 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-3104b7bc-ab8f-4469-8b1a-947d65d48d30 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:09:49.433335 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.policy [None req-3104b7bc-ab8f-4469-8b1a-947d65d48d30 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c4c0c82448e40ba801c0b52ec44e74a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a093d0bf43046aaa845f3cc115f3f5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116156) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:09:49.440710 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: INFO nova.api.openstack.requestlog [None req-3104b7bc-ab8f-4469-8b1a-947d65d48d30 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] 10.222.0.18 "GET /compute/v2.1/servers/fa7c86bc-c46f-4120-8f3d-d795f8d7c5cc" status: 200 len: 1570 microversion: 2.1 time: 0.148484 Dec 15 03:09:49.441276 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: [pid: 116156|app: 0|req: 451/902] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 03:09:49 2021] GET /compute/v2.1/servers/fa7c86bc-c46f-4120-8f3d-d795f8d7c5cc => generated 1570 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 03:09:49.467040 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Dec 15 03:09:49.467499 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: Wed Dec 15 03:09:49 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Dec 15 03:09:49.941088 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi [None req-d4abe921-58af-4ad7-8ae4-0701abcafa64 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Calling method '>' {{(pid=116157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:09:49.941705 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.compute.api [None req-d4abe921-58af-4ad7-8ae4-0701abcafa64 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] [instance: bbb8462c-9501-4541-b67e-43ec5c5061a7] Fetching instance by UUID {{(pid=116157) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:09:49.948406 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-d4abe921-58af-4ad7-8ae4-0701abcafa64 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:09:49.948851 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-d4abe921-58af-4ad7-8ae4-0701abcafa64 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:09:49.949615 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-d4abe921-58af-4ad7-8ae4-0701abcafa64 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:09:49.950076 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-d4abe921-58af-4ad7-8ae4-0701abcafa64 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:09:49.992949 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi [None req-2575027a-6640-4a93-834c-66f7e98aac56 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Calling method '>' {{(pid=116156) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:09:49.993845 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.compute.api [None req-2575027a-6640-4a93-834c-66f7e98aac56 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] [instance: b89094ac-aee1-4bd6-a33d-8c4347cebfc7] Fetching instance by UUID {{(pid=116156) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:09:50.000026 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-2575027a-6640-4a93-834c-66f7e98aac56 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:09:50.000472 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-2575027a-6640-4a93-834c-66f7e98aac56 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:09:50.001247 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-2575027a-6640-4a93-834c-66f7e98aac56 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:09:50.001679 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-2575027a-6640-4a93-834c-66f7e98aac56 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:09:50.008529 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.policy [None req-d4abe921-58af-4ad7-8ae4-0701abcafa64 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97bdf19af9e34fc3886ff451cb9d7a27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '494b56bf5eae4d56a5591546f85bc32b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116157) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:09:50.015609 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: INFO nova.api.openstack.requestlog [None req-d4abe921-58af-4ad7-8ae4-0701abcafa64 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] 10.222.0.18 "GET /compute/v2.1/servers/bbb8462c-9501-4541-b67e-43ec5c5061a7" status: 200 len: 1226 microversion: 2.1 time: 0.078114 Dec 15 03:09:50.016165 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: [pid: 116157|app: 0|req: 452/903] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 03:09:49 2021] GET /compute/v2.1/servers/bbb8462c-9501-4541-b67e-43ec5c5061a7 => generated 1226 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 03:09:50.030809 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: INFO nova.api.openstack.requestlog [None req-2575027a-6640-4a93-834c-66f7e98aac56 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] 10.222.0.18 "GET /compute/v2.1/servers/b89094ac-aee1-4bd6-a33d-8c4347cebfc7/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042281 Dec 15 03:09:50.031352 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: [pid: 116156|app: 0|req: 452/904] 10.222.0.18 () {60 vars in 1342 bytes} [Wed Dec 15 03:09:49 2021] GET /compute/v2.1/servers/b89094ac-aee1-4bd6-a33d-8c4347cebfc7/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Dec 15 03:09:50.457557 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi [None req-0328064d-8dd6-4e3f-a331-016c00f0f4ff tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Calling method '>' {{(pid=116157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:09:50.458117 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.compute.api [None req-0328064d-8dd6-4e3f-a331-016c00f0f4ff tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] [instance: fa7c86bc-c46f-4120-8f3d-d795f8d7c5cc] Fetching instance by UUID {{(pid=116157) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:09:50.463999 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-0328064d-8dd6-4e3f-a331-016c00f0f4ff tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:09:50.464449 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-0328064d-8dd6-4e3f-a331-016c00f0f4ff tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:09:50.465226 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-0328064d-8dd6-4e3f-a331-016c00f0f4ff tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:09:50.465662 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-0328064d-8dd6-4e3f-a331-016c00f0f4ff tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:09:50.595963 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.policy [None req-0328064d-8dd6-4e3f-a331-016c00f0f4ff tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c4c0c82448e40ba801c0b52ec44e74a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a093d0bf43046aaa845f3cc115f3f5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116157) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:09:50.603776 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: INFO nova.api.openstack.requestlog [None req-0328064d-8dd6-4e3f-a331-016c00f0f4ff tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] 10.222.0.18 "GET /compute/v2.1/servers/fa7c86bc-c46f-4120-8f3d-d795f8d7c5cc" status: 200 len: 1570 microversion: 2.1 time: 0.149939 Dec 15 03:09:50.604333 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: [pid: 116157|app: 0|req: 453/905] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 03:09:50 2021] GET /compute/v2.1/servers/fa7c86bc-c46f-4120-8f3d-d795f8d7c5cc => generated 1570 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 03:09:51.032075 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi [None req-cd17a7c9-6790-4cd1-b14e-2006dbe30508 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Calling method '>' {{(pid=116156) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:09:51.032744 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.compute.api [None req-cd17a7c9-6790-4cd1-b14e-2006dbe30508 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] [instance: bbb8462c-9501-4541-b67e-43ec5c5061a7] Fetching instance by UUID {{(pid=116156) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:09:51.039820 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-cd17a7c9-6790-4cd1-b14e-2006dbe30508 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:09:51.040301 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-cd17a7c9-6790-4cd1-b14e-2006dbe30508 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:09:51.041145 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-cd17a7c9-6790-4cd1-b14e-2006dbe30508 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:09:51.041586 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-cd17a7c9-6790-4cd1-b14e-2006dbe30508 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:09:51.042551 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi [None req-ac5bcb0f-d4a4-4ff4-bb3a-d53d04099f6c tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Calling method '>' {{(pid=116157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:09:51.043450 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.compute.api [None req-ac5bcb0f-d4a4-4ff4-bb3a-d53d04099f6c tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] [instance: b89094ac-aee1-4bd6-a33d-8c4347cebfc7] Fetching instance by UUID {{(pid=116157) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:09:51.049546 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-ac5bcb0f-d4a4-4ff4-bb3a-d53d04099f6c tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:09:51.050010 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-ac5bcb0f-d4a4-4ff4-bb3a-d53d04099f6c tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:09:51.050787 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-ac5bcb0f-d4a4-4ff4-bb3a-d53d04099f6c tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:09:51.051219 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-ac5bcb0f-d4a4-4ff4-bb3a-d53d04099f6c tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:09:51.079108 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: INFO nova.api.openstack.requestlog [None req-ac5bcb0f-d4a4-4ff4-bb3a-d53d04099f6c tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] 10.222.0.18 "GET /compute/v2.1/servers/b89094ac-aee1-4bd6-a33d-8c4347cebfc7/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.040777 Dec 15 03:09:51.079654 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: [pid: 116157|app: 0|req: 454/906] 10.222.0.18 () {60 vars in 1342 bytes} [Wed Dec 15 03:09:51 2021] GET /compute/v2.1/servers/b89094ac-aee1-4bd6-a33d-8c4347cebfc7/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Dec 15 03:09:51.099300 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.policy [None req-cd17a7c9-6790-4cd1-b14e-2006dbe30508 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97bdf19af9e34fc3886ff451cb9d7a27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '494b56bf5eae4d56a5591546f85bc32b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116156) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:09:51.107168 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: INFO nova.api.openstack.requestlog [None req-cd17a7c9-6790-4cd1-b14e-2006dbe30508 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] 10.222.0.18 "GET /compute/v2.1/servers/bbb8462c-9501-4541-b67e-43ec5c5061a7" status: 200 len: 1226 microversion: 2.1 time: 0.078732 Dec 15 03:09:51.107728 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: [pid: 116156|app: 0|req: 453/907] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 03:09:51 2021] GET /compute/v2.1/servers/bbb8462c-9501-4541-b67e-43ec5c5061a7 => generated 1226 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 03:09:51.621325 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi [None req-f9528642-d957-4ca4-a7c1-d384dbddf113 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Calling method '>' {{(pid=116157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:09:51.621959 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.compute.api [None req-f9528642-d957-4ca4-a7c1-d384dbddf113 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] [instance: fa7c86bc-c46f-4120-8f3d-d795f8d7c5cc] Fetching instance by UUID {{(pid=116157) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:09:51.627779 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-f9528642-d957-4ca4-a7c1-d384dbddf113 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:09:51.628221 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-f9528642-d957-4ca4-a7c1-d384dbddf113 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:09:51.628998 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-f9528642-d957-4ca4-a7c1-d384dbddf113 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:09:51.629427 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-f9528642-d957-4ca4-a7c1-d384dbddf113 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:09:51.755167 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.policy [None req-f9528642-d957-4ca4-a7c1-d384dbddf113 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c4c0c82448e40ba801c0b52ec44e74a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a093d0bf43046aaa845f3cc115f3f5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116157) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:09:51.762960 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: INFO nova.api.openstack.requestlog [None req-f9528642-d957-4ca4-a7c1-d384dbddf113 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] 10.222.0.18 "GET /compute/v2.1/servers/fa7c86bc-c46f-4120-8f3d-d795f8d7c5cc" status: 200 len: 1570 microversion: 2.1 time: 0.145327 Dec 15 03:09:51.763521 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: [pid: 116157|app: 0|req: 455/908] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 03:09:51 2021] GET /compute/v2.1/servers/fa7c86bc-c46f-4120-8f3d-d795f8d7c5cc => generated 1570 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 03:09:52.090521 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi [None req-03f45147-fb07-43a9-804e-ce83ed8ab5a0 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Calling method '>' {{(pid=116156) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:09:52.091422 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.compute.api [None req-03f45147-fb07-43a9-804e-ce83ed8ab5a0 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] [instance: b89094ac-aee1-4bd6-a33d-8c4347cebfc7] Fetching instance by UUID {{(pid=116156) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:09:52.097642 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-03f45147-fb07-43a9-804e-ce83ed8ab5a0 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:09:52.098127 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-03f45147-fb07-43a9-804e-ce83ed8ab5a0 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:09:52.098907 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-03f45147-fb07-43a9-804e-ce83ed8ab5a0 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:09:52.099343 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-03f45147-fb07-43a9-804e-ce83ed8ab5a0 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:09:52.123829 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi [None req-d400c856-f636-45f4-a486-8364ec29a574 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Calling method '>' {{(pid=116157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:09:52.124439 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.compute.api [None req-d400c856-f636-45f4-a486-8364ec29a574 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] [instance: bbb8462c-9501-4541-b67e-43ec5c5061a7] Fetching instance by UUID {{(pid=116157) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:09:52.128902 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: INFO nova.api.openstack.requestlog [None req-03f45147-fb07-43a9-804e-ce83ed8ab5a0 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] 10.222.0.18 "GET /compute/v2.1/servers/b89094ac-aee1-4bd6-a33d-8c4347cebfc7/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042115 Dec 15 03:09:52.129468 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: [pid: 116156|app: 0|req: 454/909] 10.222.0.18 () {60 vars in 1342 bytes} [Wed Dec 15 03:09:52 2021] GET /compute/v2.1/servers/b89094ac-aee1-4bd6-a33d-8c4347cebfc7/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 03:09:52.130619 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-d400c856-f636-45f4-a486-8364ec29a574 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:09:52.131067 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-d400c856-f636-45f4-a486-8364ec29a574 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:09:52.131839 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-d400c856-f636-45f4-a486-8364ec29a574 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:09:52.132266 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-d400c856-f636-45f4-a486-8364ec29a574 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:09:52.188942 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.policy [None req-d400c856-f636-45f4-a486-8364ec29a574 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97bdf19af9e34fc3886ff451cb9d7a27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '494b56bf5eae4d56a5591546f85bc32b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116157) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:09:52.196030 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: INFO nova.api.openstack.requestlog [None req-d400c856-f636-45f4-a486-8364ec29a574 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] 10.222.0.18 "GET /compute/v2.1/servers/bbb8462c-9501-4541-b67e-43ec5c5061a7" status: 200 len: 1226 microversion: 2.1 time: 0.075763 Dec 15 03:09:52.196580 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: [pid: 116157|app: 0|req: 456/910] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 03:09:52 2021] GET /compute/v2.1/servers/bbb8462c-9501-4541-b67e-43ec5c5061a7 => generated 1226 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 03:09:52.780206 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi [None req-fa31a77c-c0a6-4e4f-88f9-5973f1284227 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Calling method '>' {{(pid=116156) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:09:52.780848 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.compute.api [None req-fa31a77c-c0a6-4e4f-88f9-5973f1284227 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] [instance: fa7c86bc-c46f-4120-8f3d-d795f8d7c5cc] Fetching instance by UUID {{(pid=116156) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:09:52.786694 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-fa31a77c-c0a6-4e4f-88f9-5973f1284227 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:09:52.787150 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-fa31a77c-c0a6-4e4f-88f9-5973f1284227 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:09:52.787936 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-fa31a77c-c0a6-4e4f-88f9-5973f1284227 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:09:52.788373 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-fa31a77c-c0a6-4e4f-88f9-5973f1284227 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:09:52.916216 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.policy [None req-fa31a77c-c0a6-4e4f-88f9-5973f1284227 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c4c0c82448e40ba801c0b52ec44e74a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a093d0bf43046aaa845f3cc115f3f5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116156) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:09:52.923450 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: INFO nova.api.openstack.requestlog [None req-fa31a77c-c0a6-4e4f-88f9-5973f1284227 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] 10.222.0.18 "GET /compute/v2.1/servers/fa7c86bc-c46f-4120-8f3d-d795f8d7c5cc" status: 200 len: 1570 microversion: 2.1 time: 0.146908 Dec 15 03:09:52.924023 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: [pid: 116156|app: 0|req: 455/911] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 03:09:52 2021] GET /compute/v2.1/servers/fa7c86bc-c46f-4120-8f3d-d795f8d7c5cc => generated 1570 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 03:09:53.140343 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi [None req-1d8f9b8f-36ea-42b7-aec4-6a0fc9999217 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Calling method '>' {{(pid=116157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:09:53.141244 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.compute.api [None req-1d8f9b8f-36ea-42b7-aec4-6a0fc9999217 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] [instance: b89094ac-aee1-4bd6-a33d-8c4347cebfc7] Fetching instance by UUID {{(pid=116157) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:09:53.147626 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-1d8f9b8f-36ea-42b7-aec4-6a0fc9999217 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:09:53.148072 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-1d8f9b8f-36ea-42b7-aec4-6a0fc9999217 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:09:53.148852 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-1d8f9b8f-36ea-42b7-aec4-6a0fc9999217 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:09:53.149286 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-1d8f9b8f-36ea-42b7-aec4-6a0fc9999217 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:09:53.176856 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: INFO nova.api.openstack.requestlog [None req-1d8f9b8f-36ea-42b7-aec4-6a0fc9999217 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] 10.222.0.18 "GET /compute/v2.1/servers/b89094ac-aee1-4bd6-a33d-8c4347cebfc7/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.040222 Dec 15 03:09:53.177336 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: [pid: 116157|app: 0|req: 457/912] 10.222.0.18 () {60 vars in 1342 bytes} [Wed Dec 15 03:09:53 2021] GET /compute/v2.1/servers/b89094ac-aee1-4bd6-a33d-8c4347cebfc7/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 03:09:53.212486 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi [None req-48884e19-48e7-4c90-8fff-f9a8c86cd778 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Calling method '>' {{(pid=116156) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:09:53.213119 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.compute.api [None req-48884e19-48e7-4c90-8fff-f9a8c86cd778 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] [instance: bbb8462c-9501-4541-b67e-43ec5c5061a7] Fetching instance by UUID {{(pid=116156) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:09:53.219486 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-48884e19-48e7-4c90-8fff-f9a8c86cd778 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:09:53.219941 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-48884e19-48e7-4c90-8fff-f9a8c86cd778 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:09:53.220718 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-48884e19-48e7-4c90-8fff-f9a8c86cd778 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:09:53.221152 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-48884e19-48e7-4c90-8fff-f9a8c86cd778 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:09:53.279880 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.policy [None req-48884e19-48e7-4c90-8fff-f9a8c86cd778 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97bdf19af9e34fc3886ff451cb9d7a27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '494b56bf5eae4d56a5591546f85bc32b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116156) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:09:53.286348 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: INFO nova.api.openstack.requestlog [None req-48884e19-48e7-4c90-8fff-f9a8c86cd778 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] 10.222.0.18 "GET /compute/v2.1/servers/bbb8462c-9501-4541-b67e-43ec5c5061a7" status: 200 len: 1226 microversion: 2.1 time: 0.077577 Dec 15 03:09:53.286910 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: [pid: 116156|app: 0|req: 456/913] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 03:09:53 2021] GET /compute/v2.1/servers/bbb8462c-9501-4541-b67e-43ec5c5061a7 => generated 1226 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 03:09:53.939472 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi [None req-a34d1223-4d24-45a7-9ee1-40e568ed6d21 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Calling method '>' {{(pid=116157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:09:53.940110 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.compute.api [None req-a34d1223-4d24-45a7-9ee1-40e568ed6d21 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] [instance: fa7c86bc-c46f-4120-8f3d-d795f8d7c5cc] Fetching instance by UUID {{(pid=116157) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:09:53.945849 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-a34d1223-4d24-45a7-9ee1-40e568ed6d21 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:09:53.946339 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-a34d1223-4d24-45a7-9ee1-40e568ed6d21 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:09:53.947213 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-a34d1223-4d24-45a7-9ee1-40e568ed6d21 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:09:53.947551 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-a34d1223-4d24-45a7-9ee1-40e568ed6d21 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:09:54.083189 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.policy [None req-a34d1223-4d24-45a7-9ee1-40e568ed6d21 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c4c0c82448e40ba801c0b52ec44e74a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a093d0bf43046aaa845f3cc115f3f5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116157) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:09:54.090932 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: INFO nova.api.openstack.requestlog [None req-a34d1223-4d24-45a7-9ee1-40e568ed6d21 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] 10.222.0.18 "GET /compute/v2.1/servers/fa7c86bc-c46f-4120-8f3d-d795f8d7c5cc" status: 200 len: 1570 microversion: 2.1 time: 0.155077 Dec 15 03:09:54.091495 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: [pid: 116157|app: 0|req: 458/914] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 03:09:53 2021] GET /compute/v2.1/servers/fa7c86bc-c46f-4120-8f3d-d795f8d7c5cc => generated 1570 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 03:09:54.188451 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi [None req-95f0c0d7-f9de-47d9-97ad-2f61aff59a40 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Calling method '>' {{(pid=116156) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:09:54.189343 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.compute.api [None req-95f0c0d7-f9de-47d9-97ad-2f61aff59a40 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] [instance: b89094ac-aee1-4bd6-a33d-8c4347cebfc7] Fetching instance by UUID {{(pid=116156) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:09:54.195544 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-95f0c0d7-f9de-47d9-97ad-2f61aff59a40 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:09:54.195955 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-95f0c0d7-f9de-47d9-97ad-2f61aff59a40 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:09:54.196724 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-95f0c0d7-f9de-47d9-97ad-2f61aff59a40 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:09:54.197150 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-95f0c0d7-f9de-47d9-97ad-2f61aff59a40 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:09:54.226250 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: INFO nova.api.openstack.requestlog [None req-95f0c0d7-f9de-47d9-97ad-2f61aff59a40 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] 10.222.0.18 "GET /compute/v2.1/servers/b89094ac-aee1-4bd6-a33d-8c4347cebfc7/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041488 Dec 15 03:09:54.227347 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: [pid: 116156|app: 0|req: 457/915] 10.222.0.18 () {60 vars in 1342 bytes} [Wed Dec 15 03:09:54 2021] GET /compute/v2.1/servers/b89094ac-aee1-4bd6-a33d-8c4347cebfc7/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 03:09:54.302734 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi [None req-7b3d64af-e758-4020-b2b0-301a0958b7ef tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Calling method '>' {{(pid=116157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:09:54.303331 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.compute.api [None req-7b3d64af-e758-4020-b2b0-301a0958b7ef tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] [instance: bbb8462c-9501-4541-b67e-43ec5c5061a7] Fetching instance by UUID {{(pid=116157) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:09:54.310088 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-7b3d64af-e758-4020-b2b0-301a0958b7ef tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:09:54.310536 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-7b3d64af-e758-4020-b2b0-301a0958b7ef tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:09:54.311303 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-7b3d64af-e758-4020-b2b0-301a0958b7ef tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:09:54.311731 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-7b3d64af-e758-4020-b2b0-301a0958b7ef tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:09:54.369482 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.policy [None req-7b3d64af-e758-4020-b2b0-301a0958b7ef tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97bdf19af9e34fc3886ff451cb9d7a27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '494b56bf5eae4d56a5591546f85bc32b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116157) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:09:54.376551 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: INFO nova.api.openstack.requestlog [None req-7b3d64af-e758-4020-b2b0-301a0958b7ef tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] 10.222.0.18 "GET /compute/v2.1/servers/bbb8462c-9501-4541-b67e-43ec5c5061a7" status: 200 len: 1226 microversion: 2.1 time: 0.077424 Dec 15 03:09:54.377113 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: [pid: 116157|app: 0|req: 459/916] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 03:09:54 2021] GET /compute/v2.1/servers/bbb8462c-9501-4541-b67e-43ec5c5061a7 => generated 1226 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 03:09:55.107839 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi [None req-1d76d88c-8384-41f6-86c5-f7bfaee40f57 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Calling method '>' {{(pid=116156) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:09:55.108445 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.compute.api [None req-1d76d88c-8384-41f6-86c5-f7bfaee40f57 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] [instance: fa7c86bc-c46f-4120-8f3d-d795f8d7c5cc] Fetching instance by UUID {{(pid=116156) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:09:55.114290 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-1d76d88c-8384-41f6-86c5-f7bfaee40f57 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:09:55.114737 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-1d76d88c-8384-41f6-86c5-f7bfaee40f57 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:09:55.115752 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-1d76d88c-8384-41f6-86c5-f7bfaee40f57 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:09:55.116194 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-1d76d88c-8384-41f6-86c5-f7bfaee40f57 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:09:55.238310 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi [None req-8e99d612-e5e0-4b6c-a60b-382255f85f9d tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Calling method '>' {{(pid=116157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:09:55.239127 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.compute.api [None req-8e99d612-e5e0-4b6c-a60b-382255f85f9d tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] [instance: b89094ac-aee1-4bd6-a33d-8c4347cebfc7] Fetching instance by UUID {{(pid=116157) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:09:55.245542 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-8e99d612-e5e0-4b6c-a60b-382255f85f9d tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:09:55.246006 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-8e99d612-e5e0-4b6c-a60b-382255f85f9d tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:09:55.246830 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-8e99d612-e5e0-4b6c-a60b-382255f85f9d tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:09:55.247266 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-8e99d612-e5e0-4b6c-a60b-382255f85f9d tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:09:55.252130 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.policy [None req-1d76d88c-8384-41f6-86c5-f7bfaee40f57 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c4c0c82448e40ba801c0b52ec44e74a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a093d0bf43046aaa845f3cc115f3f5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116156) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:09:55.259985 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: INFO nova.api.openstack.requestlog [None req-1d76d88c-8384-41f6-86c5-f7bfaee40f57 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] 10.222.0.18 "GET /compute/v2.1/servers/fa7c86bc-c46f-4120-8f3d-d795f8d7c5cc" status: 200 len: 1570 microversion: 2.1 time: 0.155820 Dec 15 03:09:55.260549 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: [pid: 116156|app: 0|req: 458/917] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 03:09:55 2021] GET /compute/v2.1/servers/fa7c86bc-c46f-4120-8f3d-d795f8d7c5cc => generated 1570 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 03:09:55.275983 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: INFO nova.api.openstack.requestlog [None req-8e99d612-e5e0-4b6c-a60b-382255f85f9d tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] 10.222.0.18 "GET /compute/v2.1/servers/b89094ac-aee1-4bd6-a33d-8c4347cebfc7/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041648 Dec 15 03:09:55.276525 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: [pid: 116157|app: 0|req: 460/918] 10.222.0.18 () {60 vars in 1342 bytes} [Wed Dec 15 03:09:55 2021] GET /compute/v2.1/servers/b89094ac-aee1-4bd6-a33d-8c4347cebfc7/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Dec 15 03:09:55.392947 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi [None req-907ae0a4-5fd3-45fe-bed5-dcb8c01df810 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Calling method '>' {{(pid=116156) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:09:55.393597 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.compute.api [None req-907ae0a4-5fd3-45fe-bed5-dcb8c01df810 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] [instance: bbb8462c-9501-4541-b67e-43ec5c5061a7] Fetching instance by UUID {{(pid=116156) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:09:55.399419 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-907ae0a4-5fd3-45fe-bed5-dcb8c01df810 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:09:55.399875 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-907ae0a4-5fd3-45fe-bed5-dcb8c01df810 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:09:55.400662 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-907ae0a4-5fd3-45fe-bed5-dcb8c01df810 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:09:55.401100 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-907ae0a4-5fd3-45fe-bed5-dcb8c01df810 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:09:55.460630 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.policy [None req-907ae0a4-5fd3-45fe-bed5-dcb8c01df810 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97bdf19af9e34fc3886ff451cb9d7a27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '494b56bf5eae4d56a5591546f85bc32b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116156) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:09:55.467890 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: INFO nova.api.openstack.requestlog [None req-907ae0a4-5fd3-45fe-bed5-dcb8c01df810 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] 10.222.0.18 "GET /compute/v2.1/servers/bbb8462c-9501-4541-b67e-43ec5c5061a7" status: 200 len: 1226 microversion: 2.1 time: 0.078572 Dec 15 03:09:55.468456 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: [pid: 116156|app: 0|req: 459/919] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 03:09:55 2021] GET /compute/v2.1/servers/bbb8462c-9501-4541-b67e-43ec5c5061a7 => generated 1226 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 03:09:56.276845 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi [None req-372733b3-f8c8-44e5-80ab-ed93c86b364e tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Calling method '>' {{(pid=116157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:09:56.277468 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.compute.api [None req-372733b3-f8c8-44e5-80ab-ed93c86b364e tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] [instance: fa7c86bc-c46f-4120-8f3d-d795f8d7c5cc] Fetching instance by UUID {{(pid=116157) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:09:56.283737 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-372733b3-f8c8-44e5-80ab-ed93c86b364e tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:09:56.284193 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-372733b3-f8c8-44e5-80ab-ed93c86b364e tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:09:56.284977 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-372733b3-f8c8-44e5-80ab-ed93c86b364e tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:09:56.285418 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-372733b3-f8c8-44e5-80ab-ed93c86b364e tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:09:56.287332 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi [None req-778b5449-95d8-4d1c-8edc-c06348d14bbe tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Calling method '>' {{(pid=116156) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:09:56.288228 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.compute.api [None req-778b5449-95d8-4d1c-8edc-c06348d14bbe tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] [instance: b89094ac-aee1-4bd6-a33d-8c4347cebfc7] Fetching instance by UUID {{(pid=116156) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:09:56.294967 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-778b5449-95d8-4d1c-8edc-c06348d14bbe tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:09:56.295407 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-778b5449-95d8-4d1c-8edc-c06348d14bbe tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:09:56.296185 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-778b5449-95d8-4d1c-8edc-c06348d14bbe tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:09:56.296614 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-778b5449-95d8-4d1c-8edc-c06348d14bbe tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:09:56.325130 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: INFO nova.api.openstack.requestlog [None req-778b5449-95d8-4d1c-8edc-c06348d14bbe tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] 10.222.0.18 "GET /compute/v2.1/servers/b89094ac-aee1-4bd6-a33d-8c4347cebfc7/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041391 Dec 15 03:09:56.325681 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: [pid: 116156|app: 0|req: 460/920] 10.222.0.18 () {60 vars in 1342 bytes} [Wed Dec 15 03:09:56 2021] GET /compute/v2.1/servers/b89094ac-aee1-4bd6-a33d-8c4347cebfc7/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Dec 15 03:09:56.415770 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.policy [None req-372733b3-f8c8-44e5-80ab-ed93c86b364e tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c4c0c82448e40ba801c0b52ec44e74a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a093d0bf43046aaa845f3cc115f3f5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116157) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:09:56.422969 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: INFO nova.api.openstack.requestlog [None req-372733b3-f8c8-44e5-80ab-ed93c86b364e tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] 10.222.0.18 "GET /compute/v2.1/servers/fa7c86bc-c46f-4120-8f3d-d795f8d7c5cc" status: 200 len: 1570 microversion: 2.1 time: 0.150281 Dec 15 03:09:56.423536 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: [pid: 116157|app: 0|req: 461/921] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 03:09:56 2021] GET /compute/v2.1/servers/fa7c86bc-c46f-4120-8f3d-d795f8d7c5cc => generated 1570 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 03:09:56.484200 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi [None req-6b72cb1a-cf8e-4df1-a0d8-009a000dcc36 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Calling method '>' {{(pid=116156) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:09:56.484770 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.compute.api [None req-6b72cb1a-cf8e-4df1-a0d8-009a000dcc36 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] [instance: bbb8462c-9501-4541-b67e-43ec5c5061a7] Fetching instance by UUID {{(pid=116156) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:09:56.490844 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-6b72cb1a-cf8e-4df1-a0d8-009a000dcc36 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:09:56.491290 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-6b72cb1a-cf8e-4df1-a0d8-009a000dcc36 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:09:56.492059 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-6b72cb1a-cf8e-4df1-a0d8-009a000dcc36 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:09:56.492486 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-6b72cb1a-cf8e-4df1-a0d8-009a000dcc36 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:09:56.549922 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.policy [None req-6b72cb1a-cf8e-4df1-a0d8-009a000dcc36 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97bdf19af9e34fc3886ff451cb9d7a27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '494b56bf5eae4d56a5591546f85bc32b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116156) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:09:56.557236 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: INFO nova.api.openstack.requestlog [None req-6b72cb1a-cf8e-4df1-a0d8-009a000dcc36 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] 10.222.0.18 "GET /compute/v2.1/servers/bbb8462c-9501-4541-b67e-43ec5c5061a7" status: 200 len: 1226 microversion: 2.1 time: 0.076666 Dec 15 03:09:56.557800 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: [pid: 116156|app: 0|req: 461/922] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 03:09:56 2021] GET /compute/v2.1/servers/bbb8462c-9501-4541-b67e-43ec5c5061a7 => generated 1226 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 03:09:57.336727 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi [None req-53ece387-0810-495d-bf2e-b0ae6cc4dfd9 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Calling method '>' {{(pid=116157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:09:57.337628 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.compute.api [None req-53ece387-0810-495d-bf2e-b0ae6cc4dfd9 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] [instance: b89094ac-aee1-4bd6-a33d-8c4347cebfc7] Fetching instance by UUID {{(pid=116157) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:09:57.343955 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-53ece387-0810-495d-bf2e-b0ae6cc4dfd9 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:09:57.344401 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-53ece387-0810-495d-bf2e-b0ae6cc4dfd9 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:09:57.345174 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-53ece387-0810-495d-bf2e-b0ae6cc4dfd9 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:09:57.345606 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-53ece387-0810-495d-bf2e-b0ae6cc4dfd9 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:09:57.374695 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: INFO nova.api.openstack.requestlog [None req-53ece387-0810-495d-bf2e-b0ae6cc4dfd9 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] 10.222.0.18 "GET /compute/v2.1/servers/b89094ac-aee1-4bd6-a33d-8c4347cebfc7/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041851 Dec 15 03:09:57.375237 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: [pid: 116157|app: 0|req: 462/923] 10.222.0.18 () {60 vars in 1342 bytes} [Wed Dec 15 03:09:57 2021] GET /compute/v2.1/servers/b89094ac-aee1-4bd6-a33d-8c4347cebfc7/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 03:09:57.440139 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi [None req-c115dbb6-ef56-49d6-8c2c-451a4c657000 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Calling method '>' {{(pid=116156) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:09:57.440679 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.compute.api [None req-c115dbb6-ef56-49d6-8c2c-451a4c657000 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] [instance: fa7c86bc-c46f-4120-8f3d-d795f8d7c5cc] Fetching instance by UUID {{(pid=116156) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:09:57.447065 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-c115dbb6-ef56-49d6-8c2c-451a4c657000 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:09:57.447519 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-c115dbb6-ef56-49d6-8c2c-451a4c657000 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:09:57.448296 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-c115dbb6-ef56-49d6-8c2c-451a4c657000 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:09:57.448733 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-c115dbb6-ef56-49d6-8c2c-451a4c657000 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:09:57.574311 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi [None req-f3917a8c-af0e-4e16-ad06-df68f75ce8fd tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Calling method '>' {{(pid=116157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:09:57.574947 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.compute.api [None req-f3917a8c-af0e-4e16-ad06-df68f75ce8fd tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] [instance: bbb8462c-9501-4541-b67e-43ec5c5061a7] Fetching instance by UUID {{(pid=116157) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:09:57.580652 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-f3917a8c-af0e-4e16-ad06-df68f75ce8fd tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:09:57.581101 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-f3917a8c-af0e-4e16-ad06-df68f75ce8fd tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:09:57.581882 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-f3917a8c-af0e-4e16-ad06-df68f75ce8fd tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:09:57.582344 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-f3917a8c-af0e-4e16-ad06-df68f75ce8fd tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:09:57.582632 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.policy [None req-c115dbb6-ef56-49d6-8c2c-451a4c657000 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c4c0c82448e40ba801c0b52ec44e74a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a093d0bf43046aaa845f3cc115f3f5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116156) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:09:57.589919 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: INFO nova.api.openstack.requestlog [None req-c115dbb6-ef56-49d6-8c2c-451a4c657000 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] 10.222.0.18 "GET /compute/v2.1/servers/fa7c86bc-c46f-4120-8f3d-d795f8d7c5cc" status: 200 len: 1570 microversion: 2.1 time: 0.153420 Dec 15 03:09:57.590579 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: [pid: 116156|app: 0|req: 462/924] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 03:09:57 2021] GET /compute/v2.1/servers/fa7c86bc-c46f-4120-8f3d-d795f8d7c5cc => generated 1570 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 03:09:57.643769 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.policy [None req-f3917a8c-af0e-4e16-ad06-df68f75ce8fd tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97bdf19af9e34fc3886ff451cb9d7a27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '494b56bf5eae4d56a5591546f85bc32b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116157) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:09:57.650937 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: INFO nova.api.openstack.requestlog [None req-f3917a8c-af0e-4e16-ad06-df68f75ce8fd tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] 10.222.0.18 "GET /compute/v2.1/servers/bbb8462c-9501-4541-b67e-43ec5c5061a7" status: 200 len: 1226 microversion: 2.1 time: 0.080864 Dec 15 03:09:57.651497 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: [pid: 116157|app: 0|req: 463/925] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 03:09:57 2021] GET /compute/v2.1/servers/bbb8462c-9501-4541-b67e-43ec5c5061a7 => generated 1226 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 03:09:58.385265 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi [None req-1efa2ece-273f-4efd-91f9-c818c1d92276 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Calling method '>' {{(pid=116156) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:09:58.386189 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.compute.api [None req-1efa2ece-273f-4efd-91f9-c818c1d92276 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] [instance: b89094ac-aee1-4bd6-a33d-8c4347cebfc7] Fetching instance by UUID {{(pid=116156) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:09:58.392178 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-1efa2ece-273f-4efd-91f9-c818c1d92276 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:09:58.392625 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-1efa2ece-273f-4efd-91f9-c818c1d92276 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:09:58.393449 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-1efa2ece-273f-4efd-91f9-c818c1d92276 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:09:58.393889 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-1efa2ece-273f-4efd-91f9-c818c1d92276 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:09:58.403090 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Dec 15 03:09:58.408134 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: Wed Dec 15 03:09:58 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/b89094ac-aee1-4bd6-a33d-8c4347cebfc7/os-volume_attachments (ip 10.222.0.18) !!! Dec 15 03:09:58.436727 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: INFO nova.api.openstack.requestlog [None req-1efa2ece-273f-4efd-91f9-c818c1d92276 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] 10.222.0.18 "GET /compute/v2.1/servers/b89094ac-aee1-4bd6-a33d-8c4347cebfc7/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.055171 Dec 15 03:09:58.437218 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: [pid: 116156|app: 0|req: 463/926] 10.222.0.18 () {60 vars in 1342 bytes} [Wed Dec 15 03:09:58 2021] GET /compute/v2.1/servers/b89094ac-aee1-4bd6-a33d-8c4347cebfc7/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 03:09:58.606659 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi [None req-2ec75b0d-dcac-49c3-97c8-f77a1100bcd8 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Calling method '>' {{(pid=116157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:09:58.607270 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.compute.api [None req-2ec75b0d-dcac-49c3-97c8-f77a1100bcd8 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] [instance: fa7c86bc-c46f-4120-8f3d-d795f8d7c5cc] Fetching instance by UUID {{(pid=116157) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:09:58.613523 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-2ec75b0d-dcac-49c3-97c8-f77a1100bcd8 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:09:58.614000 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-2ec75b0d-dcac-49c3-97c8-f77a1100bcd8 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:09:58.614780 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-2ec75b0d-dcac-49c3-97c8-f77a1100bcd8 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:09:58.615215 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-2ec75b0d-dcac-49c3-97c8-f77a1100bcd8 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:09:58.668355 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi [None req-b7f8d4ec-aca0-4d3d-8482-69294a41d204 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Calling method '>' {{(pid=116156) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:09:58.669123 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.compute.api [None req-b7f8d4ec-aca0-4d3d-8482-69294a41d204 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] [instance: bbb8462c-9501-4541-b67e-43ec5c5061a7] Fetching instance by UUID {{(pid=116156) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:09:58.676357 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-b7f8d4ec-aca0-4d3d-8482-69294a41d204 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:09:58.676825 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-b7f8d4ec-aca0-4d3d-8482-69294a41d204 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:09:58.677604 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-b7f8d4ec-aca0-4d3d-8482-69294a41d204 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:09:58.678069 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-b7f8d4ec-aca0-4d3d-8482-69294a41d204 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:09:58.736837 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.policy [None req-b7f8d4ec-aca0-4d3d-8482-69294a41d204 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97bdf19af9e34fc3886ff451cb9d7a27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '494b56bf5eae4d56a5591546f85bc32b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116156) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:09:58.745455 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: INFO nova.api.openstack.requestlog [None req-b7f8d4ec-aca0-4d3d-8482-69294a41d204 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] 10.222.0.18 "GET /compute/v2.1/servers/bbb8462c-9501-4541-b67e-43ec5c5061a7" status: 200 len: 1226 microversion: 2.1 time: 0.080800 Dec 15 03:09:58.745946 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.policy [None req-2ec75b0d-dcac-49c3-97c8-f77a1100bcd8 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c4c0c82448e40ba801c0b52ec44e74a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a093d0bf43046aaa845f3cc115f3f5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116157) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:09:58.746247 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: [pid: 116156|app: 0|req: 464/927] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 03:09:58 2021] GET /compute/v2.1/servers/bbb8462c-9501-4541-b67e-43ec5c5061a7 => generated 1226 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 03:09:58.753216 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: INFO nova.api.openstack.requestlog [None req-2ec75b0d-dcac-49c3-97c8-f77a1100bcd8 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] 10.222.0.18 "GET /compute/v2.1/servers/fa7c86bc-c46f-4120-8f3d-d795f8d7c5cc" status: 200 len: 1570 microversion: 2.1 time: 0.150286 Dec 15 03:09:58.753765 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: [pid: 116157|app: 0|req: 464/928] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 03:09:58 2021] GET /compute/v2.1/servers/fa7c86bc-c46f-4120-8f3d-d795f8d7c5cc => generated 1570 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 03:09:59.447861 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi [None req-40fd8b0d-4f25-419b-855c-6fea825e1dbd tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Calling method '>' {{(pid=116156) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:09:59.448690 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.compute.api [None req-40fd8b0d-4f25-419b-855c-6fea825e1dbd tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] [instance: b89094ac-aee1-4bd6-a33d-8c4347cebfc7] Fetching instance by UUID {{(pid=116156) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:09:59.454538 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-40fd8b0d-4f25-419b-855c-6fea825e1dbd tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:09:59.454988 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-40fd8b0d-4f25-419b-855c-6fea825e1dbd tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:09:59.455765 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-40fd8b0d-4f25-419b-855c-6fea825e1dbd tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:09:59.456200 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-40fd8b0d-4f25-419b-855c-6fea825e1dbd tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:09:59.484159 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: INFO nova.api.openstack.requestlog [None req-40fd8b0d-4f25-419b-855c-6fea825e1dbd tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] 10.222.0.18 "GET /compute/v2.1/servers/b89094ac-aee1-4bd6-a33d-8c4347cebfc7/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.040179 Dec 15 03:09:59.484690 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: [pid: 116156|app: 0|req: 465/929] 10.222.0.18 () {60 vars in 1342 bytes} [Wed Dec 15 03:09:59 2021] GET /compute/v2.1/servers/b89094ac-aee1-4bd6-a33d-8c4347cebfc7/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 03:09:59.762079 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi [None req-2e70c544-f373-4b6f-a9f0-70569f66cd6d tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Calling method '>' {{(pid=116157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:09:59.762629 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.compute.api [None req-2e70c544-f373-4b6f-a9f0-70569f66cd6d tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] [instance: bbb8462c-9501-4541-b67e-43ec5c5061a7] Fetching instance by UUID {{(pid=116157) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:09:59.769272 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-2e70c544-f373-4b6f-a9f0-70569f66cd6d tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:09:59.769724 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-2e70c544-f373-4b6f-a9f0-70569f66cd6d tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:09:59.770553 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-2e70c544-f373-4b6f-a9f0-70569f66cd6d tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:09:59.770745 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi [None req-a47d12b2-6494-4bad-9812-93d32e34b549 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Calling method '>' {{(pid=116156) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:09:59.771128 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-2e70c544-f373-4b6f-a9f0-70569f66cd6d tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:09:59.771357 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.compute.api [None req-a47d12b2-6494-4bad-9812-93d32e34b549 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] [instance: fa7c86bc-c46f-4120-8f3d-d795f8d7c5cc] Fetching instance by UUID {{(pid=116156) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:09:59.778011 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-a47d12b2-6494-4bad-9812-93d32e34b549 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:09:59.778475 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-a47d12b2-6494-4bad-9812-93d32e34b549 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:09:59.779248 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-a47d12b2-6494-4bad-9812-93d32e34b549 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:09:59.779680 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-a47d12b2-6494-4bad-9812-93d32e34b549 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:09:59.829437 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.policy [None req-2e70c544-f373-4b6f-a9f0-70569f66cd6d tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97bdf19af9e34fc3886ff451cb9d7a27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '494b56bf5eae4d56a5591546f85bc32b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116157) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:09:59.837669 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: INFO nova.api.openstack.requestlog [None req-2e70c544-f373-4b6f-a9f0-70569f66cd6d tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] 10.222.0.18 "GET /compute/v2.1/servers/bbb8462c-9501-4541-b67e-43ec5c5061a7" status: 200 len: 1226 microversion: 2.1 time: 0.078850 Dec 15 03:09:59.838471 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: [pid: 116157|app: 0|req: 465/930] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 03:09:59 2021] GET /compute/v2.1/servers/bbb8462c-9501-4541-b67e-43ec5c5061a7 => generated 1226 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 03:09:59.912798 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.policy [None req-a47d12b2-6494-4bad-9812-93d32e34b549 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c4c0c82448e40ba801c0b52ec44e74a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a093d0bf43046aaa845f3cc115f3f5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116156) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:09:59.920573 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: INFO nova.api.openstack.requestlog [None req-a47d12b2-6494-4bad-9812-93d32e34b549 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] 10.222.0.18 "GET /compute/v2.1/servers/fa7c86bc-c46f-4120-8f3d-d795f8d7c5cc" status: 200 len: 1570 microversion: 2.1 time: 0.153403 Dec 15 03:09:59.921129 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: [pid: 116156|app: 0|req: 466/931] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 03:09:59 2021] GET /compute/v2.1/servers/fa7c86bc-c46f-4120-8f3d-d795f8d7c5cc => generated 1570 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 03:10:00.496380 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi [None req-67f347dd-6559-4407-9737-152b153a0334 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Calling method '>' {{(pid=116157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:10:00.497189 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.compute.api [None req-67f347dd-6559-4407-9737-152b153a0334 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] [instance: b89094ac-aee1-4bd6-a33d-8c4347cebfc7] Fetching instance by UUID {{(pid=116157) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:10:00.503082 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-67f347dd-6559-4407-9737-152b153a0334 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:10:00.503527 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-67f347dd-6559-4407-9737-152b153a0334 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:10:00.504294 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-67f347dd-6559-4407-9737-152b153a0334 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:10:00.504727 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-67f347dd-6559-4407-9737-152b153a0334 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:10:00.532900 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: INFO nova.api.openstack.requestlog [None req-67f347dd-6559-4407-9737-152b153a0334 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] 10.222.0.18 "GET /compute/v2.1/servers/b89094ac-aee1-4bd6-a33d-8c4347cebfc7/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.040896 Dec 15 03:10:00.533441 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: [pid: 116157|app: 0|req: 466/932] 10.222.0.18 () {60 vars in 1342 bytes} [Wed Dec 15 03:10:00 2021] GET /compute/v2.1/servers/b89094ac-aee1-4bd6-a33d-8c4347cebfc7/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Dec 15 03:10:00.854676 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi [None req-9036d1c7-26a8-4523-8ecc-bbc6cd3bbb2c tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Calling method '>' {{(pid=116156) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:10:00.855286 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.compute.api [None req-9036d1c7-26a8-4523-8ecc-bbc6cd3bbb2c tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] [instance: bbb8462c-9501-4541-b67e-43ec5c5061a7] Fetching instance by UUID {{(pid=116156) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:10:00.861461 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-9036d1c7-26a8-4523-8ecc-bbc6cd3bbb2c tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:10:00.861907 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-9036d1c7-26a8-4523-8ecc-bbc6cd3bbb2c tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:10:00.862781 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-9036d1c7-26a8-4523-8ecc-bbc6cd3bbb2c tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:10:00.863219 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-9036d1c7-26a8-4523-8ecc-bbc6cd3bbb2c tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:10:00.921060 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.policy [None req-9036d1c7-26a8-4523-8ecc-bbc6cd3bbb2c tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97bdf19af9e34fc3886ff451cb9d7a27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '494b56bf5eae4d56a5591546f85bc32b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116156) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:10:00.928161 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: INFO nova.api.openstack.requestlog [None req-9036d1c7-26a8-4523-8ecc-bbc6cd3bbb2c tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] 10.222.0.18 "GET /compute/v2.1/servers/bbb8462c-9501-4541-b67e-43ec5c5061a7" status: 200 len: 1226 microversion: 2.1 time: 0.077642 Dec 15 03:10:00.928718 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: [pid: 116156|app: 0|req: 467/933] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 03:10:00 2021] GET /compute/v2.1/servers/bbb8462c-9501-4541-b67e-43ec5c5061a7 => generated 1226 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 03:10:00.936839 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi [None req-52517a62-c03f-497f-bb94-663ec90c6b35 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Calling method '>' {{(pid=116157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:10:00.937447 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.compute.api [None req-52517a62-c03f-497f-bb94-663ec90c6b35 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] [instance: fa7c86bc-c46f-4120-8f3d-d795f8d7c5cc] Fetching instance by UUID {{(pid=116157) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:10:00.943080 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-52517a62-c03f-497f-bb94-663ec90c6b35 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:10:00.943524 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-52517a62-c03f-497f-bb94-663ec90c6b35 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:10:00.944292 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-52517a62-c03f-497f-bb94-663ec90c6b35 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:10:00.944719 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-52517a62-c03f-497f-bb94-663ec90c6b35 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:10:01.073881 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.policy [None req-52517a62-c03f-497f-bb94-663ec90c6b35 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c4c0c82448e40ba801c0b52ec44e74a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a093d0bf43046aaa845f3cc115f3f5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116157) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:10:01.081149 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: INFO nova.api.openstack.requestlog [None req-52517a62-c03f-497f-bb94-663ec90c6b35 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] 10.222.0.18 "GET /compute/v2.1/servers/fa7c86bc-c46f-4120-8f3d-d795f8d7c5cc" status: 200 len: 1570 microversion: 2.1 time: 0.147895 Dec 15 03:10:01.081720 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: [pid: 116157|app: 0|req: 467/934] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 03:10:00 2021] GET /compute/v2.1/servers/fa7c86bc-c46f-4120-8f3d-d795f8d7c5cc => generated 1570 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 03:10:01.545043 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi [None req-cd83b383-c261-4e32-989c-54b4971ea096 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Calling method '>' {{(pid=116156) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:10:01.545934 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.compute.api [None req-cd83b383-c261-4e32-989c-54b4971ea096 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] [instance: b89094ac-aee1-4bd6-a33d-8c4347cebfc7] Fetching instance by UUID {{(pid=116156) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:10:01.551918 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-cd83b383-c261-4e32-989c-54b4971ea096 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:10:01.552368 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-cd83b383-c261-4e32-989c-54b4971ea096 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:10:01.553137 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-cd83b383-c261-4e32-989c-54b4971ea096 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:10:01.553569 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-cd83b383-c261-4e32-989c-54b4971ea096 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:10:01.581589 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: INFO nova.api.openstack.requestlog [None req-cd83b383-c261-4e32-989c-54b4971ea096 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] 10.222.0.18 "GET /compute/v2.1/servers/b89094ac-aee1-4bd6-a33d-8c4347cebfc7/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.040318 Dec 15 03:10:01.582159 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: [pid: 116156|app: 0|req: 468/935] 10.222.0.18 () {60 vars in 1342 bytes} [Wed Dec 15 03:10:01 2021] GET /compute/v2.1/servers/b89094ac-aee1-4bd6-a33d-8c4347cebfc7/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 03:10:01.945201 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi [None req-6c376b51-237c-4f8f-bb32-876e33743609 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Calling method '>' {{(pid=116157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:10:01.945812 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.compute.api [None req-6c376b51-237c-4f8f-bb32-876e33743609 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] [instance: bbb8462c-9501-4541-b67e-43ec5c5061a7] Fetching instance by UUID {{(pid=116157) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:10:01.952628 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-6c376b51-237c-4f8f-bb32-876e33743609 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:10:01.953078 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-6c376b51-237c-4f8f-bb32-876e33743609 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:10:01.953856 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-6c376b51-237c-4f8f-bb32-876e33743609 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:10:01.954323 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-6c376b51-237c-4f8f-bb32-876e33743609 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:10:02.011870 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.policy [None req-6c376b51-237c-4f8f-bb32-876e33743609 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97bdf19af9e34fc3886ff451cb9d7a27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '494b56bf5eae4d56a5591546f85bc32b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116157) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:10:02.019101 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: INFO nova.api.openstack.requestlog [None req-6c376b51-237c-4f8f-bb32-876e33743609 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] 10.222.0.18 "GET /compute/v2.1/servers/bbb8462c-9501-4541-b67e-43ec5c5061a7" status: 200 len: 1226 microversion: 2.1 time: 0.077519 Dec 15 03:10:02.019665 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: [pid: 116157|app: 0|req: 468/936] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 03:10:01 2021] GET /compute/v2.1/servers/bbb8462c-9501-4541-b67e-43ec5c5061a7 => generated 1226 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 03:10:02.096822 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi [None req-a55c8e7a-86ab-41d9-af2e-5a92763bca25 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Calling method '>' {{(pid=116156) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:10:02.097433 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.compute.api [None req-a55c8e7a-86ab-41d9-af2e-5a92763bca25 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] [instance: fa7c86bc-c46f-4120-8f3d-d795f8d7c5cc] Fetching instance by UUID {{(pid=116156) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:10:02.103604 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-a55c8e7a-86ab-41d9-af2e-5a92763bca25 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:10:02.104052 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-a55c8e7a-86ab-41d9-af2e-5a92763bca25 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:10:02.104820 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-a55c8e7a-86ab-41d9-af2e-5a92763bca25 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:10:02.105248 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-a55c8e7a-86ab-41d9-af2e-5a92763bca25 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:10:02.237812 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.policy [None req-a55c8e7a-86ab-41d9-af2e-5a92763bca25 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c4c0c82448e40ba801c0b52ec44e74a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a093d0bf43046aaa845f3cc115f3f5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116156) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:10:02.245844 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: INFO nova.api.openstack.requestlog [None req-a55c8e7a-86ab-41d9-af2e-5a92763bca25 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] 10.222.0.18 "GET /compute/v2.1/servers/fa7c86bc-c46f-4120-8f3d-d795f8d7c5cc" status: 200 len: 1570 microversion: 2.1 time: 0.152599 Dec 15 03:10:02.246430 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: [pid: 116156|app: 0|req: 469/937] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 03:10:02 2021] GET /compute/v2.1/servers/fa7c86bc-c46f-4120-8f3d-d795f8d7c5cc => generated 1570 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 03:10:02.593002 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi [None req-37f083f0-1409-4c4b-ada5-ac1d8bfec642 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Calling method '>' {{(pid=116157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:10:02.593904 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.compute.api [None req-37f083f0-1409-4c4b-ada5-ac1d8bfec642 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] [instance: b89094ac-aee1-4bd6-a33d-8c4347cebfc7] Fetching instance by UUID {{(pid=116157) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:10:02.599707 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-37f083f0-1409-4c4b-ada5-ac1d8bfec642 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:10:02.600153 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-37f083f0-1409-4c4b-ada5-ac1d8bfec642 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:10:02.600935 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-37f083f0-1409-4c4b-ada5-ac1d8bfec642 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:10:02.601371 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-37f083f0-1409-4c4b-ada5-ac1d8bfec642 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:10:02.630715 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: INFO nova.api.openstack.requestlog [None req-37f083f0-1409-4c4b-ada5-ac1d8bfec642 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] 10.222.0.18 "GET /compute/v2.1/servers/b89094ac-aee1-4bd6-a33d-8c4347cebfc7/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041444 Dec 15 03:10:02.631264 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: [pid: 116157|app: 0|req: 469/938] 10.222.0.18 () {60 vars in 1342 bytes} [Wed Dec 15 03:10:02 2021] GET /compute/v2.1/servers/b89094ac-aee1-4bd6-a33d-8c4347cebfc7/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 03:10:03.035652 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi [None req-3c7d2aa9-e26e-4c60-ad84-602ac82d951d tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Calling method '>' {{(pid=116156) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:10:03.036186 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.compute.api [None req-3c7d2aa9-e26e-4c60-ad84-602ac82d951d tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] [instance: bbb8462c-9501-4541-b67e-43ec5c5061a7] Fetching instance by UUID {{(pid=116156) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:10:03.042069 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-3c7d2aa9-e26e-4c60-ad84-602ac82d951d tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:10:03.042526 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-3c7d2aa9-e26e-4c60-ad84-602ac82d951d tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:10:03.043306 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-3c7d2aa9-e26e-4c60-ad84-602ac82d951d tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:10:03.043745 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-3c7d2aa9-e26e-4c60-ad84-602ac82d951d tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:10:03.101186 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.policy [None req-3c7d2aa9-e26e-4c60-ad84-602ac82d951d tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97bdf19af9e34fc3886ff451cb9d7a27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '494b56bf5eae4d56a5591546f85bc32b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116156) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:10:03.109385 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: INFO nova.api.openstack.requestlog [None req-3c7d2aa9-e26e-4c60-ad84-602ac82d951d tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] 10.222.0.18 "GET /compute/v2.1/servers/bbb8462c-9501-4541-b67e-43ec5c5061a7" status: 200 len: 1226 microversion: 2.1 time: 0.077460 Dec 15 03:10:03.109942 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: [pid: 116156|app: 0|req: 470/939] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 03:10:03 2021] GET /compute/v2.1/servers/bbb8462c-9501-4541-b67e-43ec5c5061a7 => generated 1226 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 03:10:03.262604 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi [None req-b38d2f53-9c5d-4802-89de-fd5c05f7c549 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Calling method '>' {{(pid=116157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:10:03.263227 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.compute.api [None req-b38d2f53-9c5d-4802-89de-fd5c05f7c549 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] [instance: fa7c86bc-c46f-4120-8f3d-d795f8d7c5cc] Fetching instance by UUID {{(pid=116157) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:10:03.269381 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-b38d2f53-9c5d-4802-89de-fd5c05f7c549 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:10:03.269833 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-b38d2f53-9c5d-4802-89de-fd5c05f7c549 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:10:03.270633 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-b38d2f53-9c5d-4802-89de-fd5c05f7c549 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:10:03.271067 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-b38d2f53-9c5d-4802-89de-fd5c05f7c549 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:10:03.398805 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.policy [None req-b38d2f53-9c5d-4802-89de-fd5c05f7c549 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c4c0c82448e40ba801c0b52ec44e74a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a093d0bf43046aaa845f3cc115f3f5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116157) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:10:03.405865 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: INFO nova.api.openstack.requestlog [None req-b38d2f53-9c5d-4802-89de-fd5c05f7c549 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] 10.222.0.18 "GET /compute/v2.1/servers/fa7c86bc-c46f-4120-8f3d-d795f8d7c5cc" status: 200 len: 1570 microversion: 2.1 time: 0.146926 Dec 15 03:10:03.406456 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: [pid: 116157|app: 0|req: 470/940] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 03:10:03 2021] GET /compute/v2.1/servers/fa7c86bc-c46f-4120-8f3d-d795f8d7c5cc => generated 1570 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 03:10:03.642593 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi [None req-e1cca908-05a1-424c-bc82-3d24dfb21fb7 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Calling method '>' {{(pid=116156) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:10:03.643430 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.compute.api [None req-e1cca908-05a1-424c-bc82-3d24dfb21fb7 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] [instance: b89094ac-aee1-4bd6-a33d-8c4347cebfc7] Fetching instance by UUID {{(pid=116156) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:10:03.649718 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-e1cca908-05a1-424c-bc82-3d24dfb21fb7 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:10:03.650238 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-e1cca908-05a1-424c-bc82-3d24dfb21fb7 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:10:03.651016 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-e1cca908-05a1-424c-bc82-3d24dfb21fb7 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:10:03.651446 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-e1cca908-05a1-424c-bc82-3d24dfb21fb7 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:10:03.679801 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: INFO nova.api.openstack.requestlog [None req-e1cca908-05a1-424c-bc82-3d24dfb21fb7 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] 10.222.0.18 "GET /compute/v2.1/servers/b89094ac-aee1-4bd6-a33d-8c4347cebfc7/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041129 Dec 15 03:10:03.680338 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: [pid: 116156|app: 0|req: 471/941] 10.222.0.18 () {60 vars in 1342 bytes} [Wed Dec 15 03:10:03 2021] GET /compute/v2.1/servers/b89094ac-aee1-4bd6-a33d-8c4347cebfc7/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 03:10:04.127006 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi [None req-5da50dd7-059c-4f7d-910d-0414c3d0ded6 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Calling method '>' {{(pid=116157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:10:04.127621 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.compute.api [None req-5da50dd7-059c-4f7d-910d-0414c3d0ded6 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] [instance: bbb8462c-9501-4541-b67e-43ec5c5061a7] Fetching instance by UUID {{(pid=116157) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:10:04.134131 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-5da50dd7-059c-4f7d-910d-0414c3d0ded6 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:10:04.134590 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-5da50dd7-059c-4f7d-910d-0414c3d0ded6 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:10:04.135393 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-5da50dd7-059c-4f7d-910d-0414c3d0ded6 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:10:04.135821 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-5da50dd7-059c-4f7d-910d-0414c3d0ded6 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:10:04.193334 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.policy [None req-5da50dd7-059c-4f7d-910d-0414c3d0ded6 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97bdf19af9e34fc3886ff451cb9d7a27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '494b56bf5eae4d56a5591546f85bc32b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116157) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:10:04.201037 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: INFO nova.api.openstack.requestlog [None req-5da50dd7-059c-4f7d-910d-0414c3d0ded6 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] 10.222.0.18 "GET /compute/v2.1/servers/bbb8462c-9501-4541-b67e-43ec5c5061a7" status: 200 len: 1226 microversion: 2.1 time: 0.077706 Dec 15 03:10:04.201605 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: [pid: 116157|app: 0|req: 471/942] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 03:10:04 2021] GET /compute/v2.1/servers/bbb8462c-9501-4541-b67e-43ec5c5061a7 => generated 1226 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 03:10:04.422923 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi [None req-a929adfa-492d-40e3-a7c6-f26b2d62cb19 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Calling method '>' {{(pid=116156) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:10:04.423462 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.compute.api [None req-a929adfa-492d-40e3-a7c6-f26b2d62cb19 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] [instance: fa7c86bc-c46f-4120-8f3d-d795f8d7c5cc] Fetching instance by UUID {{(pid=116156) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:10:04.429704 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-a929adfa-492d-40e3-a7c6-f26b2d62cb19 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:10:04.430173 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-a929adfa-492d-40e3-a7c6-f26b2d62cb19 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:10:04.431577 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-a929adfa-492d-40e3-a7c6-f26b2d62cb19 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:10:04.432004 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-a929adfa-492d-40e3-a7c6-f26b2d62cb19 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:10:04.558708 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.policy [None req-a929adfa-492d-40e3-a7c6-f26b2d62cb19 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c4c0c82448e40ba801c0b52ec44e74a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a093d0bf43046aaa845f3cc115f3f5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116156) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:10:04.565819 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: INFO nova.api.openstack.requestlog [None req-a929adfa-492d-40e3-a7c6-f26b2d62cb19 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] 10.222.0.18 "GET /compute/v2.1/servers/fa7c86bc-c46f-4120-8f3d-d795f8d7c5cc" status: 200 len: 1570 microversion: 2.1 time: 0.146545 Dec 15 03:10:04.566415 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: [pid: 116156|app: 0|req: 472/943] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 03:10:04 2021] GET /compute/v2.1/servers/fa7c86bc-c46f-4120-8f3d-d795f8d7c5cc => generated 1570 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 03:10:04.690558 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi [None req-0c897a30-5cea-43f7-b61c-e91381636d33 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Calling method '>' {{(pid=116157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:10:04.691393 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.compute.api [None req-0c897a30-5cea-43f7-b61c-e91381636d33 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] [instance: b89094ac-aee1-4bd6-a33d-8c4347cebfc7] Fetching instance by UUID {{(pid=116157) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:10:04.698065 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-0c897a30-5cea-43f7-b61c-e91381636d33 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:10:04.698517 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-0c897a30-5cea-43f7-b61c-e91381636d33 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:10:04.699299 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-0c897a30-5cea-43f7-b61c-e91381636d33 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:10:04.699738 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-0c897a30-5cea-43f7-b61c-e91381636d33 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:10:04.727932 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: INFO nova.api.openstack.requestlog [None req-0c897a30-5cea-43f7-b61c-e91381636d33 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] 10.222.0.18 "GET /compute/v2.1/servers/b89094ac-aee1-4bd6-a33d-8c4347cebfc7/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041187 Dec 15 03:10:04.728469 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: [pid: 116157|app: 0|req: 472/944] 10.222.0.18 () {60 vars in 1342 bytes} [Wed Dec 15 03:10:04 2021] GET /compute/v2.1/servers/b89094ac-aee1-4bd6-a33d-8c4347cebfc7/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 03:10:05.217449 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi [None req-a346da8b-2ccb-4b49-b37b-8ff974f722a3 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Calling method '>' {{(pid=116156) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:10:05.218103 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.compute.api [None req-a346da8b-2ccb-4b49-b37b-8ff974f722a3 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] [instance: bbb8462c-9501-4541-b67e-43ec5c5061a7] Fetching instance by UUID {{(pid=116156) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:10:05.223956 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-a346da8b-2ccb-4b49-b37b-8ff974f722a3 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:10:05.224413 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-a346da8b-2ccb-4b49-b37b-8ff974f722a3 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:10:05.225196 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-a346da8b-2ccb-4b49-b37b-8ff974f722a3 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:10:05.225636 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-a346da8b-2ccb-4b49-b37b-8ff974f722a3 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:10:05.287187 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.policy [None req-a346da8b-2ccb-4b49-b37b-8ff974f722a3 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97bdf19af9e34fc3886ff451cb9d7a27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '494b56bf5eae4d56a5591546f85bc32b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116156) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:10:05.294350 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: INFO nova.api.openstack.requestlog [None req-a346da8b-2ccb-4b49-b37b-8ff974f722a3 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] 10.222.0.18 "GET /compute/v2.1/servers/bbb8462c-9501-4541-b67e-43ec5c5061a7" status: 200 len: 1226 microversion: 2.1 time: 0.080543 Dec 15 03:10:05.294910 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: [pid: 116156|app: 0|req: 473/945] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 03:10:05 2021] GET /compute/v2.1/servers/bbb8462c-9501-4541-b67e-43ec5c5061a7 => generated 1226 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 03:10:05.583371 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi [None req-02e859ca-b27f-41c8-b251-6530d5996609 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Calling method '>' {{(pid=116157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:10:05.583983 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.compute.api [None req-02e859ca-b27f-41c8-b251-6530d5996609 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] [instance: fa7c86bc-c46f-4120-8f3d-d795f8d7c5cc] Fetching instance by UUID {{(pid=116157) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:10:05.589855 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-02e859ca-b27f-41c8-b251-6530d5996609 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:10:05.590338 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-02e859ca-b27f-41c8-b251-6530d5996609 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:10:05.591122 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-02e859ca-b27f-41c8-b251-6530d5996609 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:10:05.591564 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-02e859ca-b27f-41c8-b251-6530d5996609 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:10:05.723541 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.policy [None req-02e859ca-b27f-41c8-b251-6530d5996609 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c4c0c82448e40ba801c0b52ec44e74a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a093d0bf43046aaa845f3cc115f3f5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116157) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:10:05.731430 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: INFO nova.api.openstack.requestlog [None req-02e859ca-b27f-41c8-b251-6530d5996609 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] 10.222.0.18 "GET /compute/v2.1/servers/fa7c86bc-c46f-4120-8f3d-d795f8d7c5cc" status: 200 len: 1570 microversion: 2.1 time: 0.151737 Dec 15 03:10:05.731991 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: [pid: 116157|app: 0|req: 473/946] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 03:10:05 2021] GET /compute/v2.1/servers/fa7c86bc-c46f-4120-8f3d-d795f8d7c5cc => generated 1570 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 03:10:05.738530 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi [None req-859796c3-68a5-458e-9438-48ce93d0895b tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Calling method '>' {{(pid=116156) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:10:05.739491 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.compute.api [None req-859796c3-68a5-458e-9438-48ce93d0895b tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] [instance: b89094ac-aee1-4bd6-a33d-8c4347cebfc7] Fetching instance by UUID {{(pid=116156) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:10:05.745953 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-859796c3-68a5-458e-9438-48ce93d0895b tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:10:05.746432 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-859796c3-68a5-458e-9438-48ce93d0895b tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:10:05.747234 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-859796c3-68a5-458e-9438-48ce93d0895b tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:10:05.747670 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-859796c3-68a5-458e-9438-48ce93d0895b tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:10:05.779029 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: INFO nova.api.openstack.requestlog [None req-859796c3-68a5-458e-9438-48ce93d0895b tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] 10.222.0.18 "GET /compute/v2.1/servers/b89094ac-aee1-4bd6-a33d-8c4347cebfc7/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044162 Dec 15 03:10:05.779773 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: [pid: 116156|app: 0|req: 474/947] 10.222.0.18 () {60 vars in 1342 bytes} [Wed Dec 15 03:10:05 2021] GET /compute/v2.1/servers/b89094ac-aee1-4bd6-a33d-8c4347cebfc7/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 03:10:06.311351 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi [None req-e2fa4318-556a-46cb-b2e0-f477457b6ebe tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Calling method '>' {{(pid=116157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:10:06.311966 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.compute.api [None req-e2fa4318-556a-46cb-b2e0-f477457b6ebe tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] [instance: bbb8462c-9501-4541-b67e-43ec5c5061a7] Fetching instance by UUID {{(pid=116157) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:10:06.317822 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-e2fa4318-556a-46cb-b2e0-f477457b6ebe tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:10:06.318307 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-e2fa4318-556a-46cb-b2e0-f477457b6ebe tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:10:06.319090 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-e2fa4318-556a-46cb-b2e0-f477457b6ebe tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:10:06.319529 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-e2fa4318-556a-46cb-b2e0-f477457b6ebe tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:10:06.376894 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.policy [None req-e2fa4318-556a-46cb-b2e0-f477457b6ebe tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97bdf19af9e34fc3886ff451cb9d7a27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '494b56bf5eae4d56a5591546f85bc32b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116157) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:10:06.384053 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: INFO nova.api.openstack.requestlog [None req-e2fa4318-556a-46cb-b2e0-f477457b6ebe tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] 10.222.0.18 "GET /compute/v2.1/servers/bbb8462c-9501-4541-b67e-43ec5c5061a7" status: 200 len: 1226 microversion: 2.1 time: 0.076366 Dec 15 03:10:06.384605 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: [pid: 116157|app: 0|req: 474/948] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 03:10:06 2021] GET /compute/v2.1/servers/bbb8462c-9501-4541-b67e-43ec5c5061a7 => generated 1226 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 03:10:06.748319 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi [None req-0cc0be71-de5f-4725-a8bf-8ab4f69f218b tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Calling method '>' {{(pid=116156) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:10:06.748925 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.compute.api [None req-0cc0be71-de5f-4725-a8bf-8ab4f69f218b tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] [instance: fa7c86bc-c46f-4120-8f3d-d795f8d7c5cc] Fetching instance by UUID {{(pid=116156) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:10:06.755100 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-0cc0be71-de5f-4725-a8bf-8ab4f69f218b tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:10:06.755543 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-0cc0be71-de5f-4725-a8bf-8ab4f69f218b tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:10:06.756307 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-0cc0be71-de5f-4725-a8bf-8ab4f69f218b tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:10:06.756734 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-0cc0be71-de5f-4725-a8bf-8ab4f69f218b tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:10:06.791027 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi [None req-041114eb-f22a-41db-88db-faf1ef570b9a tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Calling method '>' {{(pid=116157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:10:06.791931 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.compute.api [None req-041114eb-f22a-41db-88db-faf1ef570b9a tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] [instance: b89094ac-aee1-4bd6-a33d-8c4347cebfc7] Fetching instance by UUID {{(pid=116157) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:10:06.798251 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-041114eb-f22a-41db-88db-faf1ef570b9a tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:10:06.798715 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-041114eb-f22a-41db-88db-faf1ef570b9a tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:10:06.799509 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-041114eb-f22a-41db-88db-faf1ef570b9a tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:10:06.799946 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-041114eb-f22a-41db-88db-faf1ef570b9a tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:10:06.829224 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: INFO nova.api.openstack.requestlog [None req-041114eb-f22a-41db-88db-faf1ef570b9a tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] 10.222.0.18 "GET /compute/v2.1/servers/b89094ac-aee1-4bd6-a33d-8c4347cebfc7/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042455 Dec 15 03:10:06.830006 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: [pid: 116157|app: 0|req: 475/949] 10.222.0.18 () {60 vars in 1342 bytes} [Wed Dec 15 03:10:06 2021] GET /compute/v2.1/servers/b89094ac-aee1-4bd6-a33d-8c4347cebfc7/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Dec 15 03:10:06.886177 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.policy [None req-0cc0be71-de5f-4725-a8bf-8ab4f69f218b tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c4c0c82448e40ba801c0b52ec44e74a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a093d0bf43046aaa845f3cc115f3f5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116156) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:10:06.893334 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: INFO nova.api.openstack.requestlog [None req-0cc0be71-de5f-4725-a8bf-8ab4f69f218b tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] 10.222.0.18 "GET /compute/v2.1/servers/fa7c86bc-c46f-4120-8f3d-d795f8d7c5cc" status: 200 len: 1570 microversion: 2.1 time: 0.148630 Dec 15 03:10:06.893894 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: [pid: 116156|app: 0|req: 475/950] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 03:10:06 2021] GET /compute/v2.1/servers/fa7c86bc-c46f-4120-8f3d-d795f8d7c5cc => generated 1570 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 03:10:07.400608 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi [None req-6ee3dd2e-184a-4323-bd3c-725b8b93d192 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Calling method '>' {{(pid=116157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:10:07.401161 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.compute.api [None req-6ee3dd2e-184a-4323-bd3c-725b8b93d192 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] [instance: bbb8462c-9501-4541-b67e-43ec5c5061a7] Fetching instance by UUID {{(pid=116157) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:10:07.406894 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-6ee3dd2e-184a-4323-bd3c-725b8b93d192 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:10:07.407338 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-6ee3dd2e-184a-4323-bd3c-725b8b93d192 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:10:07.408107 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-6ee3dd2e-184a-4323-bd3c-725b8b93d192 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:10:07.408625 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-6ee3dd2e-184a-4323-bd3c-725b8b93d192 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:10:07.466626 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.policy [None req-6ee3dd2e-184a-4323-bd3c-725b8b93d192 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97bdf19af9e34fc3886ff451cb9d7a27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '494b56bf5eae4d56a5591546f85bc32b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116157) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:10:07.473729 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: INFO nova.api.openstack.requestlog [None req-6ee3dd2e-184a-4323-bd3c-725b8b93d192 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] 10.222.0.18 "GET /compute/v2.1/servers/bbb8462c-9501-4541-b67e-43ec5c5061a7" status: 200 len: 1226 microversion: 2.1 time: 0.076838 Dec 15 03:10:07.474321 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: [pid: 116157|app: 0|req: 476/951] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 03:10:07 2021] GET /compute/v2.1/servers/bbb8462c-9501-4541-b67e-43ec5c5061a7 => generated 1226 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 03:10:07.840867 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi [None req-4f47d0f5-ad60-4989-b659-fbd0bb8cecab tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Calling method '>' {{(pid=116156) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:10:07.841795 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.compute.api [None req-4f47d0f5-ad60-4989-b659-fbd0bb8cecab tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] [instance: b89094ac-aee1-4bd6-a33d-8c4347cebfc7] Fetching instance by UUID {{(pid=116156) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:10:07.848029 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-4f47d0f5-ad60-4989-b659-fbd0bb8cecab tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:10:07.848483 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-4f47d0f5-ad60-4989-b659-fbd0bb8cecab tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:10:07.849296 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-4f47d0f5-ad60-4989-b659-fbd0bb8cecab tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:10:07.849733 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-4f47d0f5-ad60-4989-b659-fbd0bb8cecab tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:10:07.878808 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: INFO nova.api.openstack.requestlog [None req-4f47d0f5-ad60-4989-b659-fbd0bb8cecab tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] 10.222.0.18 "GET /compute/v2.1/servers/b89094ac-aee1-4bd6-a33d-8c4347cebfc7/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041948 Dec 15 03:10:07.879347 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: [pid: 116156|app: 0|req: 476/952] 10.222.0.18 () {60 vars in 1342 bytes} [Wed Dec 15 03:10:07 2021] GET /compute/v2.1/servers/b89094ac-aee1-4bd6-a33d-8c4347cebfc7/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 03:10:07.910569 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi [None req-e9a10b55-8e09-4b1b-bb7a-f07500e8ed42 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Calling method '>' {{(pid=116157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:10:07.911176 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.compute.api [None req-e9a10b55-8e09-4b1b-bb7a-f07500e8ed42 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] [instance: fa7c86bc-c46f-4120-8f3d-d795f8d7c5cc] Fetching instance by UUID {{(pid=116157) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:10:07.917925 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-e9a10b55-8e09-4b1b-bb7a-f07500e8ed42 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:10:07.918400 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-e9a10b55-8e09-4b1b-bb7a-f07500e8ed42 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:10:07.919171 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-e9a10b55-8e09-4b1b-bb7a-f07500e8ed42 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:10:07.919603 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-e9a10b55-8e09-4b1b-bb7a-f07500e8ed42 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:10:08.050360 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.policy [None req-e9a10b55-8e09-4b1b-bb7a-f07500e8ed42 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c4c0c82448e40ba801c0b52ec44e74a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a093d0bf43046aaa845f3cc115f3f5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116157) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:10:08.057508 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: INFO nova.api.openstack.requestlog [None req-e9a10b55-8e09-4b1b-bb7a-f07500e8ed42 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] 10.222.0.18 "GET /compute/v2.1/servers/fa7c86bc-c46f-4120-8f3d-d795f8d7c5cc" status: 200 len: 1570 microversion: 2.1 time: 0.150601 Dec 15 03:10:08.058082 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: [pid: 116157|app: 0|req: 477/953] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 03:10:07 2021] GET /compute/v2.1/servers/fa7c86bc-c46f-4120-8f3d-d795f8d7c5cc => generated 1570 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 03:10:08.490761 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi [None req-801debdc-8530-44fd-b61a-adffab597a27 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Calling method '>' {{(pid=116156) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:10:08.491283 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.compute.api [None req-801debdc-8530-44fd-b61a-adffab597a27 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] [instance: bbb8462c-9501-4541-b67e-43ec5c5061a7] Fetching instance by UUID {{(pid=116156) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:10:08.497552 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-801debdc-8530-44fd-b61a-adffab597a27 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:10:08.498023 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-801debdc-8530-44fd-b61a-adffab597a27 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:10:08.498832 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-801debdc-8530-44fd-b61a-adffab597a27 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:10:08.499258 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-801debdc-8530-44fd-b61a-adffab597a27 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:10:08.556368 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.policy [None req-801debdc-8530-44fd-b61a-adffab597a27 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97bdf19af9e34fc3886ff451cb9d7a27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '494b56bf5eae4d56a5591546f85bc32b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116156) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:10:08.563414 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: INFO nova.api.openstack.requestlog [None req-801debdc-8530-44fd-b61a-adffab597a27 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] 10.222.0.18 "GET /compute/v2.1/servers/bbb8462c-9501-4541-b67e-43ec5c5061a7" status: 200 len: 1226 microversion: 2.1 time: 0.076694 Dec 15 03:10:08.563982 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: [pid: 116156|app: 0|req: 477/954] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 03:10:08 2021] GET /compute/v2.1/servers/bbb8462c-9501-4541-b67e-43ec5c5061a7 => generated 1226 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 03:10:08.890590 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi [None req-912426e1-480e-4844-babf-5e13971f9b91 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Calling method '>' {{(pid=116157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:10:08.891489 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.compute.api [None req-912426e1-480e-4844-babf-5e13971f9b91 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] [instance: b89094ac-aee1-4bd6-a33d-8c4347cebfc7] Fetching instance by UUID {{(pid=116157) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:10:08.897262 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-912426e1-480e-4844-babf-5e13971f9b91 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:10:08.897711 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-912426e1-480e-4844-babf-5e13971f9b91 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:10:08.898516 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-912426e1-480e-4844-babf-5e13971f9b91 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:10:08.898952 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-912426e1-480e-4844-babf-5e13971f9b91 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:10:08.927022 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: INFO nova.api.openstack.requestlog [None req-912426e1-480e-4844-babf-5e13971f9b91 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] 10.222.0.18 "GET /compute/v2.1/servers/b89094ac-aee1-4bd6-a33d-8c4347cebfc7/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.040181 Dec 15 03:10:08.927609 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: [pid: 116157|app: 0|req: 478/955] 10.222.0.18 () {60 vars in 1342 bytes} [Wed Dec 15 03:10:08 2021] GET /compute/v2.1/servers/b89094ac-aee1-4bd6-a33d-8c4347cebfc7/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 03:10:09.074911 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi [None req-47a747c7-8ad5-4c99-b103-b32200f1b046 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Calling method '>' {{(pid=116156) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:10:09.075516 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.compute.api [None req-47a747c7-8ad5-4c99-b103-b32200f1b046 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] [instance: fa7c86bc-c46f-4120-8f3d-d795f8d7c5cc] Fetching instance by UUID {{(pid=116156) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:10:09.081675 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-47a747c7-8ad5-4c99-b103-b32200f1b046 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:10:09.082175 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-47a747c7-8ad5-4c99-b103-b32200f1b046 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:10:09.082949 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-47a747c7-8ad5-4c99-b103-b32200f1b046 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:10:09.083377 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-47a747c7-8ad5-4c99-b103-b32200f1b046 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:10:09.215882 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.policy [None req-47a747c7-8ad5-4c99-b103-b32200f1b046 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c4c0c82448e40ba801c0b52ec44e74a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a093d0bf43046aaa845f3cc115f3f5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116156) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:10:09.223046 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: INFO nova.api.openstack.requestlog [None req-47a747c7-8ad5-4c99-b103-b32200f1b046 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] 10.222.0.18 "GET /compute/v2.1/servers/fa7c86bc-c46f-4120-8f3d-d795f8d7c5cc" status: 200 len: 1570 microversion: 2.1 time: 0.152394 Dec 15 03:10:09.223603 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: [pid: 116156|app: 0|req: 478/956] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 03:10:09 2021] GET /compute/v2.1/servers/fa7c86bc-c46f-4120-8f3d-d795f8d7c5cc => generated 1570 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 03:10:09.580344 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi [None req-a6ad8734-a753-4c73-ac72-f12953664cad tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Calling method '>' {{(pid=116157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:10:09.580977 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.compute.api [None req-a6ad8734-a753-4c73-ac72-f12953664cad tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] [instance: bbb8462c-9501-4541-b67e-43ec5c5061a7] Fetching instance by UUID {{(pid=116157) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:10:09.587375 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-a6ad8734-a753-4c73-ac72-f12953664cad tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:10:09.587832 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-a6ad8734-a753-4c73-ac72-f12953664cad tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:10:09.588632 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-a6ad8734-a753-4c73-ac72-f12953664cad tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:10:09.589071 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-a6ad8734-a753-4c73-ac72-f12953664cad tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:10:09.650286 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.policy [None req-a6ad8734-a753-4c73-ac72-f12953664cad tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97bdf19af9e34fc3886ff451cb9d7a27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '494b56bf5eae4d56a5591546f85bc32b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116157) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:10:09.657520 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: INFO nova.api.openstack.requestlog [None req-a6ad8734-a753-4c73-ac72-f12953664cad tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] 10.222.0.18 "GET /compute/v2.1/servers/bbb8462c-9501-4541-b67e-43ec5c5061a7" status: 200 len: 1226 microversion: 2.1 time: 0.080853 Dec 15 03:10:09.658106 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: [pid: 116157|app: 0|req: 479/957] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 03:10:09 2021] GET /compute/v2.1/servers/bbb8462c-9501-4541-b67e-43ec5c5061a7 => generated 1226 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 03:10:09.938636 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi [None req-92276660-dbea-4eed-82d6-6e288e3ebab3 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Calling method '>' {{(pid=116156) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:10:09.939452 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.compute.api [None req-92276660-dbea-4eed-82d6-6e288e3ebab3 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] [instance: b89094ac-aee1-4bd6-a33d-8c4347cebfc7] Fetching instance by UUID {{(pid=116156) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:10:09.945200 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-92276660-dbea-4eed-82d6-6e288e3ebab3 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:10:09.945653 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-92276660-dbea-4eed-82d6-6e288e3ebab3 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:10:09.946943 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-92276660-dbea-4eed-82d6-6e288e3ebab3 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:10:09.947369 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-92276660-dbea-4eed-82d6-6e288e3ebab3 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:10:09.975355 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: INFO nova.api.openstack.requestlog [None req-92276660-dbea-4eed-82d6-6e288e3ebab3 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] 10.222.0.18 "GET /compute/v2.1/servers/b89094ac-aee1-4bd6-a33d-8c4347cebfc7/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.040482 Dec 15 03:10:09.975880 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: [pid: 116156|app: 0|req: 479/958] 10.222.0.18 () {60 vars in 1342 bytes} [Wed Dec 15 03:10:09 2021] GET /compute/v2.1/servers/b89094ac-aee1-4bd6-a33d-8c4347cebfc7/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 03:10:10.240748 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi [None req-d12dcdaa-6331-4dbc-bfa9-28fb507438f0 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Calling method '>' {{(pid=116157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:10:10.241354 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.compute.api [None req-d12dcdaa-6331-4dbc-bfa9-28fb507438f0 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] [instance: fa7c86bc-c46f-4120-8f3d-d795f8d7c5cc] Fetching instance by UUID {{(pid=116157) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:10:10.248112 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-d12dcdaa-6331-4dbc-bfa9-28fb507438f0 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:10:10.248557 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-d12dcdaa-6331-4dbc-bfa9-28fb507438f0 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:10:10.249331 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-d12dcdaa-6331-4dbc-bfa9-28fb507438f0 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:10:10.249766 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-d12dcdaa-6331-4dbc-bfa9-28fb507438f0 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:10:10.377043 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.policy [None req-d12dcdaa-6331-4dbc-bfa9-28fb507438f0 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c4c0c82448e40ba801c0b52ec44e74a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a093d0bf43046aaa845f3cc115f3f5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116157) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:10:10.384942 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: INFO nova.api.openstack.requestlog [None req-d12dcdaa-6331-4dbc-bfa9-28fb507438f0 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] 10.222.0.18 "GET /compute/v2.1/servers/fa7c86bc-c46f-4120-8f3d-d795f8d7c5cc" status: 200 len: 1570 microversion: 2.1 time: 0.148143 Dec 15 03:10:10.385507 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: [pid: 116157|app: 0|req: 480/959] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 03:10:10 2021] GET /compute/v2.1/servers/fa7c86bc-c46f-4120-8f3d-d795f8d7c5cc => generated 1570 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 03:10:10.674942 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi [None req-0e442129-e38e-4c98-8a10-bb75f56d5afb tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Calling method '>' {{(pid=116156) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:10:10.675560 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.compute.api [None req-0e442129-e38e-4c98-8a10-bb75f56d5afb tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] [instance: bbb8462c-9501-4541-b67e-43ec5c5061a7] Fetching instance by UUID {{(pid=116156) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:10:10.682139 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-0e442129-e38e-4c98-8a10-bb75f56d5afb tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:10:10.682592 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-0e442129-e38e-4c98-8a10-bb75f56d5afb tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:10:10.683374 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-0e442129-e38e-4c98-8a10-bb75f56d5afb tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:10:10.683816 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-0e442129-e38e-4c98-8a10-bb75f56d5afb tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:10:10.741713 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.policy [None req-0e442129-e38e-4c98-8a10-bb75f56d5afb tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97bdf19af9e34fc3886ff451cb9d7a27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '494b56bf5eae4d56a5591546f85bc32b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116156) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:10:10.749490 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: INFO nova.api.openstack.requestlog [None req-0e442129-e38e-4c98-8a10-bb75f56d5afb tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] 10.222.0.18 "GET /compute/v2.1/servers/bbb8462c-9501-4541-b67e-43ec5c5061a7" status: 200 len: 1226 microversion: 2.1 time: 0.078215 Dec 15 03:10:10.750075 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: [pid: 116156|app: 0|req: 480/960] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 03:10:10 2021] GET /compute/v2.1/servers/bbb8462c-9501-4541-b67e-43ec5c5061a7 => generated 1226 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 03:10:10.986810 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi [None req-5017cafd-1286-4c0c-a04d-1c05dc672e3c tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Calling method '>' {{(pid=116157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:10:10.987644 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.compute.api [None req-5017cafd-1286-4c0c-a04d-1c05dc672e3c tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] [instance: b89094ac-aee1-4bd6-a33d-8c4347cebfc7] Fetching instance by UUID {{(pid=116157) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:10:10.993754 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-5017cafd-1286-4c0c-a04d-1c05dc672e3c tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:10:10.994237 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-5017cafd-1286-4c0c-a04d-1c05dc672e3c tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:10:10.995046 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-5017cafd-1286-4c0c-a04d-1c05dc672e3c tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:10:10.995485 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-5017cafd-1286-4c0c-a04d-1c05dc672e3c tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:10:11.023585 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: INFO nova.api.openstack.requestlog [None req-5017cafd-1286-4c0c-a04d-1c05dc672e3c tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] 10.222.0.18 "GET /compute/v2.1/servers/b89094ac-aee1-4bd6-a33d-8c4347cebfc7/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.040571 Dec 15 03:10:11.024596 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: [pid: 116157|app: 0|req: 481/961] 10.222.0.18 () {60 vars in 1342 bytes} [Wed Dec 15 03:10:10 2021] GET /compute/v2.1/servers/b89094ac-aee1-4bd6-a33d-8c4347cebfc7/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 03:10:11.402421 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi [None req-0368992e-366b-4007-997e-17a114b75299 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Calling method '>' {{(pid=116156) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:10:11.403065 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.compute.api [None req-0368992e-366b-4007-997e-17a114b75299 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] [instance: fa7c86bc-c46f-4120-8f3d-d795f8d7c5cc] Fetching instance by UUID {{(pid=116156) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:10:11.408899 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-0368992e-366b-4007-997e-17a114b75299 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:10:11.409355 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-0368992e-366b-4007-997e-17a114b75299 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:10:11.410169 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-0368992e-366b-4007-997e-17a114b75299 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:10:11.410611 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-0368992e-366b-4007-997e-17a114b75299 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:10:11.538280 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.policy [None req-0368992e-366b-4007-997e-17a114b75299 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c4c0c82448e40ba801c0b52ec44e74a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a093d0bf43046aaa845f3cc115f3f5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116156) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:10:11.545497 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: INFO nova.api.openstack.requestlog [None req-0368992e-366b-4007-997e-17a114b75299 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] 10.222.0.18 "GET /compute/v2.1/servers/fa7c86bc-c46f-4120-8f3d-d795f8d7c5cc" status: 200 len: 1570 microversion: 2.1 time: 0.147316 Dec 15 03:10:11.546059 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: [pid: 116156|app: 0|req: 481/962] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 03:10:11 2021] GET /compute/v2.1/servers/fa7c86bc-c46f-4120-8f3d-d795f8d7c5cc => generated 1570 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 03:10:11.766637 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi [None req-0707f7d9-4ecd-4a47-854e-356713494f9c tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Calling method '>' {{(pid=116157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:10:11.767172 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.compute.api [None req-0707f7d9-4ecd-4a47-854e-356713494f9c tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] [instance: bbb8462c-9501-4541-b67e-43ec5c5061a7] Fetching instance by UUID {{(pid=116157) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:10:11.773262 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-0707f7d9-4ecd-4a47-854e-356713494f9c tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:10:11.773705 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-0707f7d9-4ecd-4a47-854e-356713494f9c tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:10:11.774574 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-0707f7d9-4ecd-4a47-854e-356713494f9c tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:10:11.775009 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-0707f7d9-4ecd-4a47-854e-356713494f9c tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:10:11.832229 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.policy [None req-0707f7d9-4ecd-4a47-854e-356713494f9c tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97bdf19af9e34fc3886ff451cb9d7a27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '494b56bf5eae4d56a5591546f85bc32b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116157) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:10:11.839364 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: INFO nova.api.openstack.requestlog [None req-0707f7d9-4ecd-4a47-854e-356713494f9c tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] 10.222.0.18 "GET /compute/v2.1/servers/bbb8462c-9501-4541-b67e-43ec5c5061a7" status: 200 len: 1226 microversion: 2.1 time: 0.076377 Dec 15 03:10:11.839928 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: [pid: 116157|app: 0|req: 482/963] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 03:10:11 2021] GET /compute/v2.1/servers/bbb8462c-9501-4541-b67e-43ec5c5061a7 => generated 1226 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 03:10:12.035792 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi [None req-4e5e5c93-845d-4aa0-829d-05e24fe1aadf tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Calling method '>' {{(pid=116156) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:10:12.036621 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.compute.api [None req-4e5e5c93-845d-4aa0-829d-05e24fe1aadf tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] [instance: b89094ac-aee1-4bd6-a33d-8c4347cebfc7] Fetching instance by UUID {{(pid=116156) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:10:12.042875 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-4e5e5c93-845d-4aa0-829d-05e24fe1aadf tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:10:12.043338 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-4e5e5c93-845d-4aa0-829d-05e24fe1aadf tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:10:12.044118 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-4e5e5c93-845d-4aa0-829d-05e24fe1aadf tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:10:12.044565 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-4e5e5c93-845d-4aa0-829d-05e24fe1aadf tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:10:12.073329 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: INFO nova.api.openstack.requestlog [None req-4e5e5c93-845d-4aa0-829d-05e24fe1aadf tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] 10.222.0.18 "GET /compute/v2.1/servers/b89094ac-aee1-4bd6-a33d-8c4347cebfc7/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041421 Dec 15 03:10:12.073867 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: [pid: 116156|app: 0|req: 482/964] 10.222.0.18 () {60 vars in 1342 bytes} [Wed Dec 15 03:10:12 2021] GET /compute/v2.1/servers/b89094ac-aee1-4bd6-a33d-8c4347cebfc7/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 03:10:12.562434 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi [None req-13bf0517-29ed-4455-abb4-f0eb1b6df15d tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Calling method '>' {{(pid=116157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:10:12.563036 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.compute.api [None req-13bf0517-29ed-4455-abb4-f0eb1b6df15d tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] [instance: fa7c86bc-c46f-4120-8f3d-d795f8d7c5cc] Fetching instance by UUID {{(pid=116157) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:10:12.568864 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-13bf0517-29ed-4455-abb4-f0eb1b6df15d tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:10:12.569314 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-13bf0517-29ed-4455-abb4-f0eb1b6df15d tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:10:12.570131 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-13bf0517-29ed-4455-abb4-f0eb1b6df15d tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:10:12.570552 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-13bf0517-29ed-4455-abb4-f0eb1b6df15d tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:10:12.703538 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.policy [None req-13bf0517-29ed-4455-abb4-f0eb1b6df15d tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c4c0c82448e40ba801c0b52ec44e74a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a093d0bf43046aaa845f3cc115f3f5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116157) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:10:12.710694 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: INFO nova.api.openstack.requestlog [None req-13bf0517-29ed-4455-abb4-f0eb1b6df15d tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] 10.222.0.18 "GET /compute/v2.1/servers/fa7c86bc-c46f-4120-8f3d-d795f8d7c5cc" status: 200 len: 1570 microversion: 2.1 time: 0.151871 Dec 15 03:10:12.711267 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: [pid: 116157|app: 0|req: 483/965] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 03:10:12 2021] GET /compute/v2.1/servers/fa7c86bc-c46f-4120-8f3d-d795f8d7c5cc => generated 1570 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 03:10:12.855350 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi [None req-d2648eef-3e9c-4bf6-9870-53182209ec0b tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Calling method '>' {{(pid=116156) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:10:12.855879 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.compute.api [None req-d2648eef-3e9c-4bf6-9870-53182209ec0b tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] [instance: bbb8462c-9501-4541-b67e-43ec5c5061a7] Fetching instance by UUID {{(pid=116156) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:10:12.861603 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-d2648eef-3e9c-4bf6-9870-53182209ec0b tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:10:12.862083 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-d2648eef-3e9c-4bf6-9870-53182209ec0b tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:10:12.862939 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-d2648eef-3e9c-4bf6-9870-53182209ec0b tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:10:12.863375 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-d2648eef-3e9c-4bf6-9870-53182209ec0b tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:10:12.920805 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.policy [None req-d2648eef-3e9c-4bf6-9870-53182209ec0b tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97bdf19af9e34fc3886ff451cb9d7a27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '494b56bf5eae4d56a5591546f85bc32b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116156) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:10:12.927916 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: INFO nova.api.openstack.requestlog [None req-d2648eef-3e9c-4bf6-9870-53182209ec0b tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] 10.222.0.18 "GET /compute/v2.1/servers/bbb8462c-9501-4541-b67e-43ec5c5061a7" status: 200 len: 1226 microversion: 2.1 time: 0.076757 Dec 15 03:10:12.928469 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: [pid: 116156|app: 0|req: 483/966] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 03:10:12 2021] GET /compute/v2.1/servers/bbb8462c-9501-4541-b67e-43ec5c5061a7 => generated 1226 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 03:10:13.084520 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi [None req-25a1403b-54d8-48e7-bf8e-f142fe16a951 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Calling method '>' {{(pid=116157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:10:13.085419 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.compute.api [None req-25a1403b-54d8-48e7-bf8e-f142fe16a951 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] [instance: b89094ac-aee1-4bd6-a33d-8c4347cebfc7] Fetching instance by UUID {{(pid=116157) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:10:13.091751 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-25a1403b-54d8-48e7-bf8e-f142fe16a951 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:10:13.092202 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-25a1403b-54d8-48e7-bf8e-f142fe16a951 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:10:13.092976 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-25a1403b-54d8-48e7-bf8e-f142fe16a951 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:10:13.093407 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-25a1403b-54d8-48e7-bf8e-f142fe16a951 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:10:13.122348 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: INFO nova.api.openstack.requestlog [None req-25a1403b-54d8-48e7-bf8e-f142fe16a951 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] 10.222.0.18 "GET /compute/v2.1/servers/b89094ac-aee1-4bd6-a33d-8c4347cebfc7/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041478 Dec 15 03:10:13.122817 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: [pid: 116157|app: 0|req: 484/967] 10.222.0.18 () {60 vars in 1342 bytes} [Wed Dec 15 03:10:13 2021] GET /compute/v2.1/servers/b89094ac-aee1-4bd6-a33d-8c4347cebfc7/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 03:10:13.727567 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi [None req-9f04913c-75cd-4700-b190-2140d008cf75 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Calling method '>' {{(pid=116156) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:10:13.728182 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.compute.api [None req-9f04913c-75cd-4700-b190-2140d008cf75 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] [instance: fa7c86bc-c46f-4120-8f3d-d795f8d7c5cc] Fetching instance by UUID {{(pid=116156) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:10:13.734460 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-9f04913c-75cd-4700-b190-2140d008cf75 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:10:13.734916 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-9f04913c-75cd-4700-b190-2140d008cf75 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:10:13.735703 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-9f04913c-75cd-4700-b190-2140d008cf75 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:10:13.736138 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-9f04913c-75cd-4700-b190-2140d008cf75 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:10:13.865955 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.policy [None req-9f04913c-75cd-4700-b190-2140d008cf75 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c4c0c82448e40ba801c0b52ec44e74a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a093d0bf43046aaa845f3cc115f3f5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116156) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:10:13.873199 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: INFO nova.api.openstack.requestlog [None req-9f04913c-75cd-4700-b190-2140d008cf75 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] 10.222.0.18 "GET /compute/v2.1/servers/fa7c86bc-c46f-4120-8f3d-d795f8d7c5cc" status: 200 len: 1570 microversion: 2.1 time: 0.149314 Dec 15 03:10:13.873767 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: [pid: 116156|app: 0|req: 484/968] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 03:10:13 2021] GET /compute/v2.1/servers/fa7c86bc-c46f-4120-8f3d-d795f8d7c5cc => generated 1570 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 03:10:13.944317 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi [None req-d49fd9d3-2e33-4842-a7dd-4a8c220548a9 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Calling method '>' {{(pid=116157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:10:13.944916 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.compute.api [None req-d49fd9d3-2e33-4842-a7dd-4a8c220548a9 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] [instance: bbb8462c-9501-4541-b67e-43ec5c5061a7] Fetching instance by UUID {{(pid=116157) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:10:13.951214 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-d49fd9d3-2e33-4842-a7dd-4a8c220548a9 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:10:13.951659 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-d49fd9d3-2e33-4842-a7dd-4a8c220548a9 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:10:13.952426 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-d49fd9d3-2e33-4842-a7dd-4a8c220548a9 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:10:13.952858 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-d49fd9d3-2e33-4842-a7dd-4a8c220548a9 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:10:14.009766 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.policy [None req-d49fd9d3-2e33-4842-a7dd-4a8c220548a9 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97bdf19af9e34fc3886ff451cb9d7a27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '494b56bf5eae4d56a5591546f85bc32b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116157) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:10:14.016735 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: INFO nova.api.openstack.requestlog [None req-d49fd9d3-2e33-4842-a7dd-4a8c220548a9 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] 10.222.0.18 "GET /compute/v2.1/servers/bbb8462c-9501-4541-b67e-43ec5c5061a7" status: 200 len: 1226 microversion: 2.1 time: 0.075997 Dec 15 03:10:14.017291 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: [pid: 116157|app: 0|req: 485/969] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 03:10:13 2021] GET /compute/v2.1/servers/bbb8462c-9501-4541-b67e-43ec5c5061a7 => generated 1226 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 03:10:14.134159 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi [None req-6d70e005-be34-429d-9fc8-f72bc2232b95 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Calling method '>' {{(pid=116156) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:10:14.135097 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.compute.api [None req-6d70e005-be34-429d-9fc8-f72bc2232b95 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] [instance: b89094ac-aee1-4bd6-a33d-8c4347cebfc7] Fetching instance by UUID {{(pid=116156) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:10:14.140884 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-6d70e005-be34-429d-9fc8-f72bc2232b95 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:10:14.141339 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-6d70e005-be34-429d-9fc8-f72bc2232b95 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:10:14.142154 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-6d70e005-be34-429d-9fc8-f72bc2232b95 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:10:14.142595 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-6d70e005-be34-429d-9fc8-f72bc2232b95 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:10:14.170167 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: INFO nova.api.openstack.requestlog [None req-6d70e005-be34-429d-9fc8-f72bc2232b95 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] 10.222.0.18 "GET /compute/v2.1/servers/b89094ac-aee1-4bd6-a33d-8c4347cebfc7/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.040343 Dec 15 03:10:14.170706 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: [pid: 116156|app: 0|req: 485/970] 10.222.0.18 () {60 vars in 1342 bytes} [Wed Dec 15 03:10:14 2021] GET /compute/v2.1/servers/b89094ac-aee1-4bd6-a33d-8c4347cebfc7/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 03:10:14.891174 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi [None req-86e3dabf-3a7b-4ac3-8028-7f164b8925cc tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Calling method '>' {{(pid=116157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:10:14.891781 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.compute.api [None req-86e3dabf-3a7b-4ac3-8028-7f164b8925cc tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] [instance: fa7c86bc-c46f-4120-8f3d-d795f8d7c5cc] Fetching instance by UUID {{(pid=116157) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:10:14.898002 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-86e3dabf-3a7b-4ac3-8028-7f164b8925cc tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:10:14.898458 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-86e3dabf-3a7b-4ac3-8028-7f164b8925cc tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:10:14.899745 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-86e3dabf-3a7b-4ac3-8028-7f164b8925cc tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:10:14.900177 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-86e3dabf-3a7b-4ac3-8028-7f164b8925cc tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:10:15.029141 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.policy [None req-86e3dabf-3a7b-4ac3-8028-7f164b8925cc tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c4c0c82448e40ba801c0b52ec44e74a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a093d0bf43046aaa845f3cc115f3f5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116157) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:10:15.032447 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi [None req-e0cc1d9d-1d6e-4602-8d67-b73f7e590dd3 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Calling method '>' {{(pid=116156) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:10:15.033069 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.compute.api [None req-e0cc1d9d-1d6e-4602-8d67-b73f7e590dd3 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] [instance: bbb8462c-9501-4541-b67e-43ec5c5061a7] Fetching instance by UUID {{(pid=116156) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:10:15.036755 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: INFO nova.api.openstack.requestlog [None req-86e3dabf-3a7b-4ac3-8028-7f164b8925cc tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] 10.222.0.18 "GET /compute/v2.1/servers/fa7c86bc-c46f-4120-8f3d-d795f8d7c5cc" status: 200 len: 1570 microversion: 2.1 time: 0.149254 Dec 15 03:10:15.037315 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: [pid: 116157|app: 0|req: 486/971] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 03:10:14 2021] GET /compute/v2.1/servers/fa7c86bc-c46f-4120-8f3d-d795f8d7c5cc => generated 1570 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 03:10:15.039365 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-e0cc1d9d-1d6e-4602-8d67-b73f7e590dd3 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:10:15.040414 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-e0cc1d9d-1d6e-4602-8d67-b73f7e590dd3 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:10:15.041215 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-e0cc1d9d-1d6e-4602-8d67-b73f7e590dd3 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:10:15.041652 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-e0cc1d9d-1d6e-4602-8d67-b73f7e590dd3 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:10:15.099368 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.policy [None req-e0cc1d9d-1d6e-4602-8d67-b73f7e590dd3 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97bdf19af9e34fc3886ff451cb9d7a27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '494b56bf5eae4d56a5591546f85bc32b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116156) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:10:15.106665 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: INFO nova.api.openstack.requestlog [None req-e0cc1d9d-1d6e-4602-8d67-b73f7e590dd3 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] 10.222.0.18 "GET /compute/v2.1/servers/bbb8462c-9501-4541-b67e-43ec5c5061a7" status: 200 len: 1226 microversion: 2.1 time: 0.078029 Dec 15 03:10:15.107230 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: [pid: 116156|app: 0|req: 486/972] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 03:10:15 2021] GET /compute/v2.1/servers/bbb8462c-9501-4541-b67e-43ec5c5061a7 => generated 1226 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 03:10:15.180554 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi [None req-fd64011f-0f5d-4301-8621-75706a8b6d75 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Calling method '>' {{(pid=116157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:10:15.181452 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.compute.api [None req-fd64011f-0f5d-4301-8621-75706a8b6d75 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] [instance: b89094ac-aee1-4bd6-a33d-8c4347cebfc7] Fetching instance by UUID {{(pid=116157) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:10:15.187233 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-fd64011f-0f5d-4301-8621-75706a8b6d75 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:10:15.187676 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-fd64011f-0f5d-4301-8621-75706a8b6d75 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:10:15.188449 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-fd64011f-0f5d-4301-8621-75706a8b6d75 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:10:15.188966 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-fd64011f-0f5d-4301-8621-75706a8b6d75 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:10:15.219329 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: INFO nova.api.openstack.requestlog [None req-fd64011f-0f5d-4301-8621-75706a8b6d75 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] 10.222.0.18 "GET /compute/v2.1/servers/b89094ac-aee1-4bd6-a33d-8c4347cebfc7/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042530 Dec 15 03:10:15.219913 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: [pid: 116157|app: 0|req: 487/973] 10.222.0.18 () {60 vars in 1342 bytes} [Wed Dec 15 03:10:15 2021] GET /compute/v2.1/servers/b89094ac-aee1-4bd6-a33d-8c4347cebfc7/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 03:10:16.054088 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi [None req-7181982c-8d38-4aee-b3f2-602cfb792032 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Calling method '>' {{(pid=116156) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:10:16.054693 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.compute.api [None req-7181982c-8d38-4aee-b3f2-602cfb792032 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] [instance: fa7c86bc-c46f-4120-8f3d-d795f8d7c5cc] Fetching instance by UUID {{(pid=116156) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:10:16.061401 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-7181982c-8d38-4aee-b3f2-602cfb792032 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:10:16.061852 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-7181982c-8d38-4aee-b3f2-602cfb792032 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:10:16.062655 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-7181982c-8d38-4aee-b3f2-602cfb792032 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:10:16.063089 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-7181982c-8d38-4aee-b3f2-602cfb792032 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:10:16.124259 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi [None req-65c5abe7-a4a2-483a-b9b7-27e47cd69322 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Calling method '>' {{(pid=116157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:10:16.125018 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.compute.api [None req-65c5abe7-a4a2-483a-b9b7-27e47cd69322 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] [instance: bbb8462c-9501-4541-b67e-43ec5c5061a7] Fetching instance by UUID {{(pid=116157) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:10:16.131203 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-65c5abe7-a4a2-483a-b9b7-27e47cd69322 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:10:16.131652 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-65c5abe7-a4a2-483a-b9b7-27e47cd69322 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:10:16.132482 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-65c5abe7-a4a2-483a-b9b7-27e47cd69322 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:10:16.132915 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-65c5abe7-a4a2-483a-b9b7-27e47cd69322 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:10:16.190433 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.policy [None req-65c5abe7-a4a2-483a-b9b7-27e47cd69322 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97bdf19af9e34fc3886ff451cb9d7a27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '494b56bf5eae4d56a5591546f85bc32b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116157) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:10:16.195066 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.policy [None req-7181982c-8d38-4aee-b3f2-602cfb792032 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c4c0c82448e40ba801c0b52ec44e74a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a093d0bf43046aaa845f3cc115f3f5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116156) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:10:16.197798 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: INFO nova.api.openstack.requestlog [None req-65c5abe7-a4a2-483a-b9b7-27e47cd69322 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] 10.222.0.18 "GET /compute/v2.1/servers/bbb8462c-9501-4541-b67e-43ec5c5061a7" status: 200 len: 1226 microversion: 2.1 time: 0.077203 Dec 15 03:10:16.198527 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: [pid: 116157|app: 0|req: 488/974] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 03:10:16 2021] GET /compute/v2.1/servers/bbb8462c-9501-4541-b67e-43ec5c5061a7 => generated 1226 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 03:10:16.208217 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: INFO nova.api.openstack.requestlog [None req-7181982c-8d38-4aee-b3f2-602cfb792032 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] 10.222.0.18 "GET /compute/v2.1/servers/fa7c86bc-c46f-4120-8f3d-d795f8d7c5cc" status: 200 len: 1570 microversion: 2.1 time: 0.157602 Dec 15 03:10:16.208701 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: [pid: 116156|app: 0|req: 487/975] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 03:10:16 2021] GET /compute/v2.1/servers/fa7c86bc-c46f-4120-8f3d-d795f8d7c5cc => generated 1570 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 03:10:16.231214 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi [None req-ab9004cc-f52d-4093-bd16-63603ecba49d tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Calling method '>' {{(pid=116157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:10:16.232116 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.compute.api [None req-ab9004cc-f52d-4093-bd16-63603ecba49d tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] [instance: b89094ac-aee1-4bd6-a33d-8c4347cebfc7] Fetching instance by UUID {{(pid=116157) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:10:16.237901 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-ab9004cc-f52d-4093-bd16-63603ecba49d tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:10:16.238377 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-ab9004cc-f52d-4093-bd16-63603ecba49d tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:10:16.239141 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-ab9004cc-f52d-4093-bd16-63603ecba49d tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:10:16.239570 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-ab9004cc-f52d-4093-bd16-63603ecba49d tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:10:16.267243 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: INFO nova.api.openstack.requestlog [None req-ab9004cc-f52d-4093-bd16-63603ecba49d tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] 10.222.0.18 "GET /compute/v2.1/servers/b89094ac-aee1-4bd6-a33d-8c4347cebfc7/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.040303 Dec 15 03:10:16.267774 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: [pid: 116157|app: 0|req: 489/976] 10.222.0.18 () {60 vars in 1342 bytes} [Wed Dec 15 03:10:16 2021] GET /compute/v2.1/servers/b89094ac-aee1-4bd6-a33d-8c4347cebfc7/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 03:10:17.214951 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi [None req-8b6e49b3-5cc2-44c4-b06c-207b02df50a0 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Calling method '>' {{(pid=116156) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:10:17.215555 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.compute.api [None req-8b6e49b3-5cc2-44c4-b06c-207b02df50a0 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] [instance: bbb8462c-9501-4541-b67e-43ec5c5061a7] Fetching instance by UUID {{(pid=116156) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:10:17.221735 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-8b6e49b3-5cc2-44c4-b06c-207b02df50a0 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:10:17.222218 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-8b6e49b3-5cc2-44c4-b06c-207b02df50a0 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:10:17.222996 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-8b6e49b3-5cc2-44c4-b06c-207b02df50a0 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:10:17.223425 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-8b6e49b3-5cc2-44c4-b06c-207b02df50a0 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:10:17.225627 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi [None req-6a361a69-d073-4b66-8d51-92ce9d30c94b tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Calling method '>' {{(pid=116157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:10:17.226354 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.compute.api [None req-6a361a69-d073-4b66-8d51-92ce9d30c94b tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] [instance: fa7c86bc-c46f-4120-8f3d-d795f8d7c5cc] Fetching instance by UUID {{(pid=116157) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:10:17.232437 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-6a361a69-d073-4b66-8d51-92ce9d30c94b tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:10:17.232884 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-6a361a69-d073-4b66-8d51-92ce9d30c94b tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:10:17.233663 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-6a361a69-d073-4b66-8d51-92ce9d30c94b tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:10:17.234116 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-6a361a69-d073-4b66-8d51-92ce9d30c94b tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:10:17.288627 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.policy [None req-8b6e49b3-5cc2-44c4-b06c-207b02df50a0 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97bdf19af9e34fc3886ff451cb9d7a27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '494b56bf5eae4d56a5591546f85bc32b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116156) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:10:17.296122 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: INFO nova.api.openstack.requestlog [None req-8b6e49b3-5cc2-44c4-b06c-207b02df50a0 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] 10.222.0.18 "GET /compute/v2.1/servers/bbb8462c-9501-4541-b67e-43ec5c5061a7" status: 200 len: 1226 microversion: 2.1 time: 0.084744 Dec 15 03:10:17.296771 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: [pid: 116156|app: 0|req: 488/977] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 03:10:17 2021] GET /compute/v2.1/servers/bbb8462c-9501-4541-b67e-43ec5c5061a7 => generated 1226 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 03:10:17.301305 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi [None req-3a3070d9-99c1-4f20-89f5-dffa44c39399 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Calling method '>' {{(pid=116156) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:10:17.302360 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.compute.api [None req-3a3070d9-99c1-4f20-89f5-dffa44c39399 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] [instance: b89094ac-aee1-4bd6-a33d-8c4347cebfc7] Fetching instance by UUID {{(pid=116156) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:10:17.308683 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-3a3070d9-99c1-4f20-89f5-dffa44c39399 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:10:17.309206 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-3a3070d9-99c1-4f20-89f5-dffa44c39399 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:10:17.310086 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-3a3070d9-99c1-4f20-89f5-dffa44c39399 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:10:17.310592 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-3a3070d9-99c1-4f20-89f5-dffa44c39399 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:10:17.340077 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: INFO nova.api.openstack.requestlog [None req-3a3070d9-99c1-4f20-89f5-dffa44c39399 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] 10.222.0.18 "GET /compute/v2.1/servers/b89094ac-aee1-4bd6-a33d-8c4347cebfc7/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042179 Dec 15 03:10:17.340639 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: [pid: 116156|app: 0|req: 489/978] 10.222.0.18 () {60 vars in 1342 bytes} [Wed Dec 15 03:10:17 2021] GET /compute/v2.1/servers/b89094ac-aee1-4bd6-a33d-8c4347cebfc7/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 03:10:17.368690 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.policy [None req-6a361a69-d073-4b66-8d51-92ce9d30c94b tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c4c0c82448e40ba801c0b52ec44e74a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a093d0bf43046aaa845f3cc115f3f5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116157) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:10:17.375791 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: INFO nova.api.openstack.requestlog [None req-6a361a69-d073-4b66-8d51-92ce9d30c94b tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] 10.222.0.18 "GET /compute/v2.1/servers/fa7c86bc-c46f-4120-8f3d-d795f8d7c5cc" status: 200 len: 1570 microversion: 2.1 time: 0.153691 Dec 15 03:10:17.376345 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: [pid: 116157|app: 0|req: 490/979] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 03:10:17 2021] GET /compute/v2.1/servers/fa7c86bc-c46f-4120-8f3d-d795f8d7c5cc => generated 1570 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 03:10:18.312355 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi [None req-6fba4e28-3e90-4d8d-8039-d75335e271e9 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Calling method '>' {{(pid=116156) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:10:18.313242 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.compute.api [None req-6fba4e28-3e90-4d8d-8039-d75335e271e9 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] [instance: bbb8462c-9501-4541-b67e-43ec5c5061a7] Fetching instance by UUID {{(pid=116156) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:10:18.319489 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-6fba4e28-3e90-4d8d-8039-d75335e271e9 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:10:18.319934 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-6fba4e28-3e90-4d8d-8039-d75335e271e9 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:10:18.320713 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-6fba4e28-3e90-4d8d-8039-d75335e271e9 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:10:18.321643 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-6fba4e28-3e90-4d8d-8039-d75335e271e9 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:10:18.351411 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi [None req-845eb422-5d7a-40aa-bfbe-33f4b13c355f tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Calling method '>' {{(pid=116157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:10:18.352303 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.compute.api [None req-845eb422-5d7a-40aa-bfbe-33f4b13c355f tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] [instance: b89094ac-aee1-4bd6-a33d-8c4347cebfc7] Fetching instance by UUID {{(pid=116157) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:10:18.358518 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-845eb422-5d7a-40aa-bfbe-33f4b13c355f tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:10:18.358958 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-845eb422-5d7a-40aa-bfbe-33f4b13c355f tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:10:18.359734 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-845eb422-5d7a-40aa-bfbe-33f4b13c355f tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:10:18.360188 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-845eb422-5d7a-40aa-bfbe-33f4b13c355f tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:10:18.379804 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.policy [None req-6fba4e28-3e90-4d8d-8039-d75335e271e9 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97bdf19af9e34fc3886ff451cb9d7a27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '494b56bf5eae4d56a5591546f85bc32b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116156) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:10:18.387554 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: INFO nova.api.openstack.requestlog [None req-6fba4e28-3e90-4d8d-8039-d75335e271e9 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] 10.222.0.18 "GET /compute/v2.1/servers/bbb8462c-9501-4541-b67e-43ec5c5061a7" status: 200 len: 1226 microversion: 2.1 time: 0.078824 Dec 15 03:10:18.388120 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: [pid: 116156|app: 0|req: 490/980] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 03:10:18 2021] GET /compute/v2.1/servers/bbb8462c-9501-4541-b67e-43ec5c5061a7 => generated 1226 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 03:10:18.389264 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: INFO nova.api.openstack.requestlog [None req-845eb422-5d7a-40aa-bfbe-33f4b13c355f tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] 10.222.0.18 "GET /compute/v2.1/servers/b89094ac-aee1-4bd6-a33d-8c4347cebfc7/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041488 Dec 15 03:10:18.389962 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: [pid: 116157|app: 0|req: 491/981] 10.222.0.18 () {60 vars in 1342 bytes} [Wed Dec 15 03:10:18 2021] GET /compute/v2.1/servers/b89094ac-aee1-4bd6-a33d-8c4347cebfc7/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Dec 15 03:10:18.392419 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi [None req-7c5e4de1-2aec-498a-833a-5c840be77f9f tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Calling method '>' {{(pid=116156) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:10:18.393024 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.compute.api [None req-7c5e4de1-2aec-498a-833a-5c840be77f9f tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] [instance: fa7c86bc-c46f-4120-8f3d-d795f8d7c5cc] Fetching instance by UUID {{(pid=116156) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:10:18.398665 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-7c5e4de1-2aec-498a-833a-5c840be77f9f tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:10:18.399785 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-7c5e4de1-2aec-498a-833a-5c840be77f9f tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:10:18.400562 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-7c5e4de1-2aec-498a-833a-5c840be77f9f tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:10:18.400993 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-7c5e4de1-2aec-498a-833a-5c840be77f9f tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:10:18.529604 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.policy [None req-7c5e4de1-2aec-498a-833a-5c840be77f9f tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c4c0c82448e40ba801c0b52ec44e74a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a093d0bf43046aaa845f3cc115f3f5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116156) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:10:18.536849 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: INFO nova.api.openstack.requestlog [None req-7c5e4de1-2aec-498a-833a-5c840be77f9f tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] 10.222.0.18 "GET /compute/v2.1/servers/fa7c86bc-c46f-4120-8f3d-d795f8d7c5cc" status: 200 len: 1570 microversion: 2.1 time: 0.147771 Dec 15 03:10:18.537404 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: [pid: 116156|app: 0|req: 491/982] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 03:10:18 2021] GET /compute/v2.1/servers/fa7c86bc-c46f-4120-8f3d-d795f8d7c5cc => generated 1570 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 03:10:19.401230 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi [None req-a2aeaa5a-25c9-48ae-ab3e-ff1ba02ab351 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Calling method '>' {{(pid=116157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:10:19.402150 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.compute.api [None req-a2aeaa5a-25c9-48ae-ab3e-ff1ba02ab351 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] [instance: b89094ac-aee1-4bd6-a33d-8c4347cebfc7] Fetching instance by UUID {{(pid=116157) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:10:19.404249 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi [None req-c99054f4-4214-48d2-8c21-0f1facf2e781 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Calling method '>' {{(pid=116156) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:10:19.404918 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.compute.api [None req-c99054f4-4214-48d2-8c21-0f1facf2e781 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] [instance: bbb8462c-9501-4541-b67e-43ec5c5061a7] Fetching instance by UUID {{(pid=116156) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:10:19.408884 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-a2aeaa5a-25c9-48ae-ab3e-ff1ba02ab351 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:10:19.409328 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-a2aeaa5a-25c9-48ae-ab3e-ff1ba02ab351 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:10:19.410133 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-a2aeaa5a-25c9-48ae-ab3e-ff1ba02ab351 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:10:19.410565 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-a2aeaa5a-25c9-48ae-ab3e-ff1ba02ab351 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:10:19.410998 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-c99054f4-4214-48d2-8c21-0f1facf2e781 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:10:19.411457 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-c99054f4-4214-48d2-8c21-0f1facf2e781 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:10:19.412235 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-c99054f4-4214-48d2-8c21-0f1facf2e781 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:10:19.412677 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-c99054f4-4214-48d2-8c21-0f1facf2e781 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:10:19.440924 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: INFO nova.api.openstack.requestlog [None req-a2aeaa5a-25c9-48ae-ab3e-ff1ba02ab351 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] 10.222.0.18 "GET /compute/v2.1/servers/b89094ac-aee1-4bd6-a33d-8c4347cebfc7/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043983 Dec 15 03:10:19.441493 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: [pid: 116157|app: 0|req: 492/983] 10.222.0.18 () {60 vars in 1342 bytes} [Wed Dec 15 03:10:19 2021] GET /compute/v2.1/servers/b89094ac-aee1-4bd6-a33d-8c4347cebfc7/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 03:10:19.470962 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.policy [None req-c99054f4-4214-48d2-8c21-0f1facf2e781 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97bdf19af9e34fc3886ff451cb9d7a27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '494b56bf5eae4d56a5591546f85bc32b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116156) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:10:19.478985 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: INFO nova.api.openstack.requestlog [None req-c99054f4-4214-48d2-8c21-0f1facf2e781 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] 10.222.0.18 "GET /compute/v2.1/servers/bbb8462c-9501-4541-b67e-43ec5c5061a7" status: 200 len: 1226 microversion: 2.1 time: 0.078279 Dec 15 03:10:19.479543 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: [pid: 116156|app: 0|req: 492/984] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 03:10:19 2021] GET /compute/v2.1/servers/bbb8462c-9501-4541-b67e-43ec5c5061a7 => generated 1226 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 03:10:19.553544 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi [None req-0543eef1-cfcd-4059-8d0b-79deada211ad tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Calling method '>' {{(pid=116157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:10:19.554186 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.compute.api [None req-0543eef1-cfcd-4059-8d0b-79deada211ad tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] [instance: fa7c86bc-c46f-4120-8f3d-d795f8d7c5cc] Fetching instance by UUID {{(pid=116157) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:10:19.559917 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-0543eef1-cfcd-4059-8d0b-79deada211ad tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:10:19.560367 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-0543eef1-cfcd-4059-8d0b-79deada211ad tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:10:19.561147 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-0543eef1-cfcd-4059-8d0b-79deada211ad tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:10:19.561581 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-0543eef1-cfcd-4059-8d0b-79deada211ad tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:10:19.693596 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.policy [None req-0543eef1-cfcd-4059-8d0b-79deada211ad tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c4c0c82448e40ba801c0b52ec44e74a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a093d0bf43046aaa845f3cc115f3f5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116157) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:10:19.701389 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: INFO nova.api.openstack.requestlog [None req-0543eef1-cfcd-4059-8d0b-79deada211ad tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] 10.222.0.18 "GET /compute/v2.1/servers/fa7c86bc-c46f-4120-8f3d-d795f8d7c5cc" status: 200 len: 1570 microversion: 2.1 time: 0.151369 Dec 15 03:10:19.701951 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: [pid: 116157|app: 0|req: 493/985] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 03:10:19 2021] GET /compute/v2.1/servers/fa7c86bc-c46f-4120-8f3d-d795f8d7c5cc => generated 1570 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 03:10:20.452438 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi [None req-7455b442-e358-42ce-a608-66d8db426ae0 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Calling method '>' {{(pid=116156) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:10:20.453365 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.compute.api [None req-7455b442-e358-42ce-a608-66d8db426ae0 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] [instance: b89094ac-aee1-4bd6-a33d-8c4347cebfc7] Fetching instance by UUID {{(pid=116156) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:10:20.459679 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-7455b442-e358-42ce-a608-66d8db426ae0 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:10:20.460074 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-7455b442-e358-42ce-a608-66d8db426ae0 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:10:20.460856 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-7455b442-e358-42ce-a608-66d8db426ae0 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:10:20.461297 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-7455b442-e358-42ce-a608-66d8db426ae0 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:10:20.489792 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: INFO nova.api.openstack.requestlog [None req-7455b442-e358-42ce-a608-66d8db426ae0 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] 10.222.0.18 "GET /compute/v2.1/servers/b89094ac-aee1-4bd6-a33d-8c4347cebfc7/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041170 Dec 15 03:10:20.490635 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: [pid: 116156|app: 0|req: 493/986] 10.222.0.18 () {60 vars in 1342 bytes} [Wed Dec 15 03:10:20 2021] GET /compute/v2.1/servers/b89094ac-aee1-4bd6-a33d-8c4347cebfc7/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 03:10:20.497097 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi [None req-33242a3e-3e13-46f5-a080-c7c68fe67615 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Calling method '>' {{(pid=116157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:10:20.497698 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.compute.api [None req-33242a3e-3e13-46f5-a080-c7c68fe67615 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] [instance: bbb8462c-9501-4541-b67e-43ec5c5061a7] Fetching instance by UUID {{(pid=116157) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:10:20.503883 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-33242a3e-3e13-46f5-a080-c7c68fe67615 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:10:20.504323 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-33242a3e-3e13-46f5-a080-c7c68fe67615 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:10:20.505088 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-33242a3e-3e13-46f5-a080-c7c68fe67615 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:10:20.505515 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-33242a3e-3e13-46f5-a080-c7c68fe67615 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:10:20.563570 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.policy [None req-33242a3e-3e13-46f5-a080-c7c68fe67615 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97bdf19af9e34fc3886ff451cb9d7a27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '494b56bf5eae4d56a5591546f85bc32b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116157) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:10:20.570679 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: INFO nova.api.openstack.requestlog [None req-33242a3e-3e13-46f5-a080-c7c68fe67615 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] 10.222.0.18 "GET /compute/v2.1/servers/bbb8462c-9501-4541-b67e-43ec5c5061a7" status: 200 len: 1226 microversion: 2.1 time: 0.077851 Dec 15 03:10:20.571236 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: [pid: 116157|app: 0|req: 494/987] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 03:10:20 2021] GET /compute/v2.1/servers/bbb8462c-9501-4541-b67e-43ec5c5061a7 => generated 1226 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 03:10:20.718120 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi [None req-9591fecc-3612-40db-8885-31bc10551ad3 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Calling method '>' {{(pid=116156) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:10:20.718666 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.compute.api [None req-9591fecc-3612-40db-8885-31bc10551ad3 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] [instance: fa7c86bc-c46f-4120-8f3d-d795f8d7c5cc] Fetching instance by UUID {{(pid=116156) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:10:20.724455 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-9591fecc-3612-40db-8885-31bc10551ad3 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:10:20.724913 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-9591fecc-3612-40db-8885-31bc10551ad3 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:10:20.725695 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-9591fecc-3612-40db-8885-31bc10551ad3 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:10:20.726173 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-9591fecc-3612-40db-8885-31bc10551ad3 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:10:20.856702 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.policy [None req-9591fecc-3612-40db-8885-31bc10551ad3 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c4c0c82448e40ba801c0b52ec44e74a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a093d0bf43046aaa845f3cc115f3f5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116156) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:10:20.864034 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: INFO nova.api.openstack.requestlog [None req-9591fecc-3612-40db-8885-31bc10551ad3 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] 10.222.0.18 "GET /compute/v2.1/servers/fa7c86bc-c46f-4120-8f3d-d795f8d7c5cc" status: 200 len: 1570 microversion: 2.1 time: 0.149695 Dec 15 03:10:20.864592 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: [pid: 116156|app: 0|req: 494/988] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 03:10:20 2021] GET /compute/v2.1/servers/fa7c86bc-c46f-4120-8f3d-d795f8d7c5cc => generated 1570 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 03:10:21.501505 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi [None req-86e761b4-74c6-44ca-9a93-44b108dd965f tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Calling method '>' {{(pid=116157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:10:21.502347 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.compute.api [None req-86e761b4-74c6-44ca-9a93-44b108dd965f tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] [instance: b89094ac-aee1-4bd6-a33d-8c4347cebfc7] Fetching instance by UUID {{(pid=116157) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:10:21.509467 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-86e761b4-74c6-44ca-9a93-44b108dd965f tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:10:21.509914 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-86e761b4-74c6-44ca-9a93-44b108dd965f tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:10:21.510730 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-86e761b4-74c6-44ca-9a93-44b108dd965f tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:10:21.511165 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-86e761b4-74c6-44ca-9a93-44b108dd965f tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:10:21.538816 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: INFO nova.api.openstack.requestlog [None req-86e761b4-74c6-44ca-9a93-44b108dd965f tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] 10.222.0.18 "GET /compute/v2.1/servers/b89094ac-aee1-4bd6-a33d-8c4347cebfc7/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041216 Dec 15 03:10:21.539385 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: [pid: 116157|app: 0|req: 495/989] 10.222.0.18 () {60 vars in 1342 bytes} [Wed Dec 15 03:10:21 2021] GET /compute/v2.1/servers/b89094ac-aee1-4bd6-a33d-8c4347cebfc7/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 03:10:21.587414 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi [None req-e354eea4-91b2-40b8-ad0b-8107b53f7d94 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Calling method '>' {{(pid=116156) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:10:21.588040 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.compute.api [None req-e354eea4-91b2-40b8-ad0b-8107b53f7d94 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] [instance: bbb8462c-9501-4541-b67e-43ec5c5061a7] Fetching instance by UUID {{(pid=116156) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:10:21.594446 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-e354eea4-91b2-40b8-ad0b-8107b53f7d94 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:10:21.594899 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-e354eea4-91b2-40b8-ad0b-8107b53f7d94 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:10:21.595679 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-e354eea4-91b2-40b8-ad0b-8107b53f7d94 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:10:21.596120 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-e354eea4-91b2-40b8-ad0b-8107b53f7d94 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:10:21.654535 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.policy [None req-e354eea4-91b2-40b8-ad0b-8107b53f7d94 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97bdf19af9e34fc3886ff451cb9d7a27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '494b56bf5eae4d56a5591546f85bc32b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116156) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:10:21.661777 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: INFO nova.api.openstack.requestlog [None req-e354eea4-91b2-40b8-ad0b-8107b53f7d94 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] 10.222.0.18 "GET /compute/v2.1/servers/bbb8462c-9501-4541-b67e-43ec5c5061a7" status: 200 len: 1226 microversion: 2.1 time: 0.078455 Dec 15 03:10:21.662440 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: [pid: 116156|app: 0|req: 495/990] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 03:10:21 2021] GET /compute/v2.1/servers/bbb8462c-9501-4541-b67e-43ec5c5061a7 => generated 1226 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 03:10:21.880745 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi [None req-36d4e061-d510-440f-869e-cd27885aeb46 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Calling method '>' {{(pid=116157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:10:21.881340 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.compute.api [None req-36d4e061-d510-440f-869e-cd27885aeb46 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] [instance: fa7c86bc-c46f-4120-8f3d-d795f8d7c5cc] Fetching instance by UUID {{(pid=116157) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:10:21.887785 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-36d4e061-d510-440f-869e-cd27885aeb46 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:10:21.888237 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-36d4e061-d510-440f-869e-cd27885aeb46 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:10:21.889016 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-36d4e061-d510-440f-869e-cd27885aeb46 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:10:21.889509 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-36d4e061-d510-440f-869e-cd27885aeb46 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:10:22.019901 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.policy [None req-36d4e061-d510-440f-869e-cd27885aeb46 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c4c0c82448e40ba801c0b52ec44e74a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a093d0bf43046aaa845f3cc115f3f5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116157) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:10:22.027681 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: INFO nova.api.openstack.requestlog [None req-36d4e061-d510-440f-869e-cd27885aeb46 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] 10.222.0.18 "GET /compute/v2.1/servers/fa7c86bc-c46f-4120-8f3d-d795f8d7c5cc" status: 200 len: 1570 microversion: 2.1 time: 0.150629 Dec 15 03:10:22.028240 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: [pid: 116157|app: 0|req: 496/991] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 03:10:21 2021] GET /compute/v2.1/servers/fa7c86bc-c46f-4120-8f3d-d795f8d7c5cc => generated 1570 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 03:10:22.550828 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi [None req-1b5ce1db-4adf-48ea-b640-e8e4f0960104 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Calling method '>' {{(pid=116156) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:10:22.551715 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.compute.api [None req-1b5ce1db-4adf-48ea-b640-e8e4f0960104 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] [instance: b89094ac-aee1-4bd6-a33d-8c4347cebfc7] Fetching instance by UUID {{(pid=116156) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:10:22.558251 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-1b5ce1db-4adf-48ea-b640-e8e4f0960104 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:10:22.558695 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-1b5ce1db-4adf-48ea-b640-e8e4f0960104 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:10:22.559464 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-1b5ce1db-4adf-48ea-b640-e8e4f0960104 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:10:22.559897 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-1b5ce1db-4adf-48ea-b640-e8e4f0960104 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:10:22.587193 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: INFO nova.api.openstack.requestlog [None req-1b5ce1db-4adf-48ea-b640-e8e4f0960104 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] 10.222.0.18 "GET /compute/v2.1/servers/b89094ac-aee1-4bd6-a33d-8c4347cebfc7/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.040133 Dec 15 03:10:22.587747 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: [pid: 116156|app: 0|req: 496/992] 10.222.0.18 () {60 vars in 1342 bytes} [Wed Dec 15 03:10:22 2021] GET /compute/v2.1/servers/b89094ac-aee1-4bd6-a33d-8c4347cebfc7/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 03:10:22.678899 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi [None req-2521fd6e-a378-45d9-96d7-7a3d07d91225 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Calling method '>' {{(pid=116157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:10:22.679517 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.compute.api [None req-2521fd6e-a378-45d9-96d7-7a3d07d91225 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] [instance: bbb8462c-9501-4541-b67e-43ec5c5061a7] Fetching instance by UUID {{(pid=116157) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:10:22.686466 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-2521fd6e-a378-45d9-96d7-7a3d07d91225 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:10:22.686920 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-2521fd6e-a378-45d9-96d7-7a3d07d91225 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:10:22.687711 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-2521fd6e-a378-45d9-96d7-7a3d07d91225 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:10:22.688158 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-2521fd6e-a378-45d9-96d7-7a3d07d91225 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:10:22.745945 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.policy [None req-2521fd6e-a378-45d9-96d7-7a3d07d91225 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97bdf19af9e34fc3886ff451cb9d7a27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '494b56bf5eae4d56a5591546f85bc32b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116157) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:10:22.752970 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: INFO nova.api.openstack.requestlog [None req-2521fd6e-a378-45d9-96d7-7a3d07d91225 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] 10.222.0.18 "GET /compute/v2.1/servers/bbb8462c-9501-4541-b67e-43ec5c5061a7" status: 200 len: 1226 microversion: 2.1 time: 0.077753 Dec 15 03:10:22.753537 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: [pid: 116157|app: 0|req: 497/993] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 03:10:22 2021] GET /compute/v2.1/servers/bbb8462c-9501-4541-b67e-43ec5c5061a7 => generated 1226 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 03:10:23.044290 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi [None req-c216caa9-4fcb-4e55-b3f4-01b7044b9890 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Calling method '>' {{(pid=116156) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:10:23.044823 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.compute.api [None req-c216caa9-4fcb-4e55-b3f4-01b7044b9890 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] [instance: fa7c86bc-c46f-4120-8f3d-d795f8d7c5cc] Fetching instance by UUID {{(pid=116156) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:10:23.051061 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-c216caa9-4fcb-4e55-b3f4-01b7044b9890 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:10:23.051511 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-c216caa9-4fcb-4e55-b3f4-01b7044b9890 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:10:23.052296 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-c216caa9-4fcb-4e55-b3f4-01b7044b9890 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:10:23.052736 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-c216caa9-4fcb-4e55-b3f4-01b7044b9890 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:10:23.180164 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.policy [None req-c216caa9-4fcb-4e55-b3f4-01b7044b9890 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c4c0c82448e40ba801c0b52ec44e74a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a093d0bf43046aaa845f3cc115f3f5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116156) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:10:23.187410 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: INFO nova.api.openstack.requestlog [None req-c216caa9-4fcb-4e55-b3f4-01b7044b9890 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] 10.222.0.18 "GET /compute/v2.1/servers/fa7c86bc-c46f-4120-8f3d-d795f8d7c5cc" status: 200 len: 1570 microversion: 2.1 time: 0.146759 Dec 15 03:10:23.187975 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: [pid: 116156|app: 0|req: 497/994] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 03:10:23 2021] GET /compute/v2.1/servers/fa7c86bc-c46f-4120-8f3d-d795f8d7c5cc => generated 1570 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 03:10:23.598689 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi [None req-cc8f2d31-5846-4fb2-991a-19147ce4587b tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Calling method '>' {{(pid=116157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:10:23.599577 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.compute.api [None req-cc8f2d31-5846-4fb2-991a-19147ce4587b tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] [instance: b89094ac-aee1-4bd6-a33d-8c4347cebfc7] Fetching instance by UUID {{(pid=116157) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:10:23.605377 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-cc8f2d31-5846-4fb2-991a-19147ce4587b tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:10:23.605819 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-cc8f2d31-5846-4fb2-991a-19147ce4587b tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:10:23.606636 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-cc8f2d31-5846-4fb2-991a-19147ce4587b tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:10:23.607064 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-cc8f2d31-5846-4fb2-991a-19147ce4587b tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:10:23.635821 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: INFO nova.api.openstack.requestlog [None req-cc8f2d31-5846-4fb2-991a-19147ce4587b tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] 10.222.0.18 "GET /compute/v2.1/servers/b89094ac-aee1-4bd6-a33d-8c4347cebfc7/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.040865 Dec 15 03:10:23.636364 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: [pid: 116157|app: 0|req: 498/995] 10.222.0.18 () {60 vars in 1342 bytes} [Wed Dec 15 03:10:23 2021] GET /compute/v2.1/servers/b89094ac-aee1-4bd6-a33d-8c4347cebfc7/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 03:10:23.769571 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi [None req-be68836e-d7b1-4622-87d6-ce12d979dd39 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Calling method '>' {{(pid=116156) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:10:23.770219 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.compute.api [None req-be68836e-d7b1-4622-87d6-ce12d979dd39 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] [instance: bbb8462c-9501-4541-b67e-43ec5c5061a7] Fetching instance by UUID {{(pid=116156) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:10:23.776053 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-be68836e-d7b1-4622-87d6-ce12d979dd39 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:10:23.776508 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-be68836e-d7b1-4622-87d6-ce12d979dd39 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:10:23.777284 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-be68836e-d7b1-4622-87d6-ce12d979dd39 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:10:23.777723 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-be68836e-d7b1-4622-87d6-ce12d979dd39 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:10:23.838481 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.policy [None req-be68836e-d7b1-4622-87d6-ce12d979dd39 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97bdf19af9e34fc3886ff451cb9d7a27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '494b56bf5eae4d56a5591546f85bc32b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116156) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:10:23.845595 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: INFO nova.api.openstack.requestlog [None req-be68836e-d7b1-4622-87d6-ce12d979dd39 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] 10.222.0.18 "GET /compute/v2.1/servers/bbb8462c-9501-4541-b67e-43ec5c5061a7" status: 200 len: 1226 microversion: 2.1 time: 0.079681 Dec 15 03:10:23.846188 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: [pid: 116156|app: 0|req: 498/996] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 03:10:23 2021] GET /compute/v2.1/servers/bbb8462c-9501-4541-b67e-43ec5c5061a7 => generated 1226 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 03:10:24.204965 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi [None req-0dbc6bd2-6f3e-44f1-bb47-8f570bd5ea87 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Calling method '>' {{(pid=116157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:10:24.204965 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.compute.api [None req-0dbc6bd2-6f3e-44f1-bb47-8f570bd5ea87 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] [instance: fa7c86bc-c46f-4120-8f3d-d795f8d7c5cc] Fetching instance by UUID {{(pid=116157) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:10:24.211051 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-0dbc6bd2-6f3e-44f1-bb47-8f570bd5ea87 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:10:24.211493 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-0dbc6bd2-6f3e-44f1-bb47-8f570bd5ea87 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:10:24.212275 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-0dbc6bd2-6f3e-44f1-bb47-8f570bd5ea87 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:10:24.212702 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-0dbc6bd2-6f3e-44f1-bb47-8f570bd5ea87 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:10:24.340669 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.policy [None req-0dbc6bd2-6f3e-44f1-bb47-8f570bd5ea87 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c4c0c82448e40ba801c0b52ec44e74a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a093d0bf43046aaa845f3cc115f3f5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116157) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:10:24.348073 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: INFO nova.api.openstack.requestlog [None req-0dbc6bd2-6f3e-44f1-bb47-8f570bd5ea87 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] 10.222.0.18 "GET /compute/v2.1/servers/fa7c86bc-c46f-4120-8f3d-d795f8d7c5cc" status: 200 len: 1570 microversion: 2.1 time: 0.147387 Dec 15 03:10:24.348632 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: [pid: 116157|app: 0|req: 499/997] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 03:10:24 2021] GET /compute/v2.1/servers/fa7c86bc-c46f-4120-8f3d-d795f8d7c5cc => generated 1570 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 03:10:24.647159 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi [None req-ef144aa8-24da-42a4-9062-ac8421410849 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Calling method '>' {{(pid=116156) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:10:24.648087 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.compute.api [None req-ef144aa8-24da-42a4-9062-ac8421410849 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] [instance: b89094ac-aee1-4bd6-a33d-8c4347cebfc7] Fetching instance by UUID {{(pid=116156) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:10:24.654785 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-ef144aa8-24da-42a4-9062-ac8421410849 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:10:24.655235 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-ef144aa8-24da-42a4-9062-ac8421410849 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:10:24.656003 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-ef144aa8-24da-42a4-9062-ac8421410849 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:10:24.656434 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-ef144aa8-24da-42a4-9062-ac8421410849 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:10:24.684591 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: INFO nova.api.openstack.requestlog [None req-ef144aa8-24da-42a4-9062-ac8421410849 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] 10.222.0.18 "GET /compute/v2.1/servers/b89094ac-aee1-4bd6-a33d-8c4347cebfc7/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041198 Dec 15 03:10:24.685125 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: [pid: 116156|app: 0|req: 499/998] 10.222.0.18 () {60 vars in 1342 bytes} [Wed Dec 15 03:10:24 2021] GET /compute/v2.1/servers/b89094ac-aee1-4bd6-a33d-8c4347cebfc7/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 03:10:24.861472 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi [None req-9909d66c-69ca-4911-a71e-682f1f4631aa tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Calling method '>' {{(pid=116157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:10:24.862170 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.compute.api [None req-9909d66c-69ca-4911-a71e-682f1f4631aa tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] [instance: bbb8462c-9501-4541-b67e-43ec5c5061a7] Fetching instance by UUID {{(pid=116157) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:10:24.868196 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-9909d66c-69ca-4911-a71e-682f1f4631aa tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:10:24.868643 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-9909d66c-69ca-4911-a71e-682f1f4631aa tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:10:24.869422 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-9909d66c-69ca-4911-a71e-682f1f4631aa tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:10:24.869860 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-9909d66c-69ca-4911-a71e-682f1f4631aa tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:10:24.931098 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.policy [None req-9909d66c-69ca-4911-a71e-682f1f4631aa tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97bdf19af9e34fc3886ff451cb9d7a27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '494b56bf5eae4d56a5591546f85bc32b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116157) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:10:24.938258 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: INFO nova.api.openstack.requestlog [None req-9909d66c-69ca-4911-a71e-682f1f4631aa tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] 10.222.0.18 "GET /compute/v2.1/servers/bbb8462c-9501-4541-b67e-43ec5c5061a7" status: 200 len: 1226 microversion: 2.1 time: 0.080367 Dec 15 03:10:24.938816 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: [pid: 116157|app: 0|req: 500/999] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 03:10:24 2021] GET /compute/v2.1/servers/bbb8462c-9501-4541-b67e-43ec5c5061a7 => generated 1226 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 03:10:25.365604 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi [None req-495c9bf5-473a-4090-819d-29cdf07b4751 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Calling method '>' {{(pid=116156) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:10:25.366230 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.compute.api [None req-495c9bf5-473a-4090-819d-29cdf07b4751 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] [instance: fa7c86bc-c46f-4120-8f3d-d795f8d7c5cc] Fetching instance by UUID {{(pid=116156) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:10:25.372489 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-495c9bf5-473a-4090-819d-29cdf07b4751 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:10:25.372936 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-495c9bf5-473a-4090-819d-29cdf07b4751 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:10:25.373707 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-495c9bf5-473a-4090-819d-29cdf07b4751 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:10:25.374247 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-495c9bf5-473a-4090-819d-29cdf07b4751 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:10:25.501778 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.policy [None req-495c9bf5-473a-4090-819d-29cdf07b4751 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c4c0c82448e40ba801c0b52ec44e74a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a093d0bf43046aaa845f3cc115f3f5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116156) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:10:25.509631 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: INFO nova.api.openstack.requestlog [None req-495c9bf5-473a-4090-819d-29cdf07b4751 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] 10.222.0.18 "GET /compute/v2.1/servers/fa7c86bc-c46f-4120-8f3d-d795f8d7c5cc" status: 200 len: 1570 microversion: 2.1 time: 0.147880 Dec 15 03:10:25.510212 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: [pid: 116156|app: 0|req: 500/1000] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 03:10:25 2021] GET /compute/v2.1/servers/fa7c86bc-c46f-4120-8f3d-d795f8d7c5cc => generated 1570 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 03:10:25.695891 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi [None req-e62b94ac-e4e3-4c8b-8edd-ad3a4dae482f tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Calling method '>' {{(pid=116157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:10:25.696786 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.compute.api [None req-e62b94ac-e4e3-4c8b-8edd-ad3a4dae482f tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] [instance: b89094ac-aee1-4bd6-a33d-8c4347cebfc7] Fetching instance by UUID {{(pid=116157) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:10:25.702957 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-e62b94ac-e4e3-4c8b-8edd-ad3a4dae482f tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:10:25.703402 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-e62b94ac-e4e3-4c8b-8edd-ad3a4dae482f tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:10:25.704172 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-e62b94ac-e4e3-4c8b-8edd-ad3a4dae482f tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:10:25.704606 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-e62b94ac-e4e3-4c8b-8edd-ad3a4dae482f tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:10:25.733465 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: INFO nova.api.openstack.requestlog [None req-e62b94ac-e4e3-4c8b-8edd-ad3a4dae482f tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] 10.222.0.18 "GET /compute/v2.1/servers/b89094ac-aee1-4bd6-a33d-8c4347cebfc7/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041342 Dec 15 03:10:25.734037 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: [pid: 116157|app: 0|req: 501/1001] 10.222.0.18 () {60 vars in 1342 bytes} [Wed Dec 15 03:10:25 2021] GET /compute/v2.1/servers/b89094ac-aee1-4bd6-a33d-8c4347cebfc7/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 03:10:25.955355 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi [None req-97759b21-20fb-46cd-aa7f-7c07a7a88bf0 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Calling method '>' {{(pid=116156) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:10:25.955964 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.compute.api [None req-97759b21-20fb-46cd-aa7f-7c07a7a88bf0 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] [instance: bbb8462c-9501-4541-b67e-43ec5c5061a7] Fetching instance by UUID {{(pid=116156) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:10:25.962656 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-97759b21-20fb-46cd-aa7f-7c07a7a88bf0 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:10:25.963104 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-97759b21-20fb-46cd-aa7f-7c07a7a88bf0 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:10:25.963882 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-97759b21-20fb-46cd-aa7f-7c07a7a88bf0 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:10:25.964319 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-97759b21-20fb-46cd-aa7f-7c07a7a88bf0 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:10:26.021457 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.policy [None req-97759b21-20fb-46cd-aa7f-7c07a7a88bf0 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97bdf19af9e34fc3886ff451cb9d7a27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '494b56bf5eae4d56a5591546f85bc32b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116156) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:10:26.029122 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: INFO nova.api.openstack.requestlog [None req-97759b21-20fb-46cd-aa7f-7c07a7a88bf0 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] 10.222.0.18 "GET /compute/v2.1/servers/bbb8462c-9501-4541-b67e-43ec5c5061a7" status: 200 len: 1226 microversion: 2.1 time: 0.077366 Dec 15 03:10:26.029635 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: [pid: 116156|app: 0|req: 501/1002] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 03:10:25 2021] GET /compute/v2.1/servers/bbb8462c-9501-4541-b67e-43ec5c5061a7 => generated 1226 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 03:10:26.526064 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi [None req-8bf1351e-2259-44ac-99f9-cbc8b84efd0f tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Calling method '>' {{(pid=116157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:10:26.526666 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.compute.api [None req-8bf1351e-2259-44ac-99f9-cbc8b84efd0f tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] [instance: fa7c86bc-c46f-4120-8f3d-d795f8d7c5cc] Fetching instance by UUID {{(pid=116157) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:10:26.532435 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-8bf1351e-2259-44ac-99f9-cbc8b84efd0f tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:10:26.532879 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-8bf1351e-2259-44ac-99f9-cbc8b84efd0f tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:10:26.533646 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-8bf1351e-2259-44ac-99f9-cbc8b84efd0f tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:10:26.534114 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-8bf1351e-2259-44ac-99f9-cbc8b84efd0f tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:10:26.660909 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.policy [None req-8bf1351e-2259-44ac-99f9-cbc8b84efd0f tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c4c0c82448e40ba801c0b52ec44e74a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a093d0bf43046aaa845f3cc115f3f5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116157) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:10:26.668077 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: INFO nova.api.openstack.requestlog [None req-8bf1351e-2259-44ac-99f9-cbc8b84efd0f tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] 10.222.0.18 "GET /compute/v2.1/servers/fa7c86bc-c46f-4120-8f3d-d795f8d7c5cc" status: 200 len: 1570 microversion: 2.1 time: 0.146221 Dec 15 03:10:26.668664 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: [pid: 116157|app: 0|req: 502/1003] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 03:10:26 2021] GET /compute/v2.1/servers/fa7c86bc-c46f-4120-8f3d-d795f8d7c5cc => generated 1570 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 03:10:26.745325 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi [None req-f5881c66-65ff-49c5-8a40-6da57e224a92 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Calling method '>' {{(pid=116156) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:10:26.746176 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.compute.api [None req-f5881c66-65ff-49c5-8a40-6da57e224a92 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] [instance: b89094ac-aee1-4bd6-a33d-8c4347cebfc7] Fetching instance by UUID {{(pid=116156) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:10:26.751937 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-f5881c66-65ff-49c5-8a40-6da57e224a92 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:10:26.752379 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-f5881c66-65ff-49c5-8a40-6da57e224a92 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:10:26.753153 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-f5881c66-65ff-49c5-8a40-6da57e224a92 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:10:26.753581 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-f5881c66-65ff-49c5-8a40-6da57e224a92 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:10:26.782713 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: INFO nova.api.openstack.requestlog [None req-f5881c66-65ff-49c5-8a40-6da57e224a92 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] 10.222.0.18 "GET /compute/v2.1/servers/b89094ac-aee1-4bd6-a33d-8c4347cebfc7/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041797 Dec 15 03:10:26.783246 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: [pid: 116156|app: 0|req: 502/1004] 10.222.0.18 () {60 vars in 1342 bytes} [Wed Dec 15 03:10:26 2021] GET /compute/v2.1/servers/b89094ac-aee1-4bd6-a33d-8c4347cebfc7/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Dec 15 03:10:27.045965 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi [None req-222d8cb5-9e3a-4373-ab81-db57fcfddefe tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Calling method '>' {{(pid=116157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:10:27.046539 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.compute.api [None req-222d8cb5-9e3a-4373-ab81-db57fcfddefe tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] [instance: bbb8462c-9501-4541-b67e-43ec5c5061a7] Fetching instance by UUID {{(pid=116157) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:10:27.052680 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-222d8cb5-9e3a-4373-ab81-db57fcfddefe tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:10:27.053129 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-222d8cb5-9e3a-4373-ab81-db57fcfddefe tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:10:27.053898 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-222d8cb5-9e3a-4373-ab81-db57fcfddefe tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:10:27.054351 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-222d8cb5-9e3a-4373-ab81-db57fcfddefe tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:10:27.112002 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.policy [None req-222d8cb5-9e3a-4373-ab81-db57fcfddefe tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97bdf19af9e34fc3886ff451cb9d7a27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '494b56bf5eae4d56a5591546f85bc32b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116157) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:10:27.119999 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: INFO nova.api.openstack.requestlog [None req-222d8cb5-9e3a-4373-ab81-db57fcfddefe tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] 10.222.0.18 "GET /compute/v2.1/servers/bbb8462c-9501-4541-b67e-43ec5c5061a7" status: 200 len: 1226 microversion: 2.1 time: 0.077673 Dec 15 03:10:27.120557 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: [pid: 116157|app: 0|req: 503/1005] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 03:10:27 2021] GET /compute/v2.1/servers/bbb8462c-9501-4541-b67e-43ec5c5061a7 => generated 1226 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 03:10:27.684830 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi [None req-29024268-12ba-4754-bcd4-df229a26c2e9 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Calling method '>' {{(pid=116156) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:10:27.685442 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.compute.api [None req-29024268-12ba-4754-bcd4-df229a26c2e9 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] [instance: fa7c86bc-c46f-4120-8f3d-d795f8d7c5cc] Fetching instance by UUID {{(pid=116156) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:10:27.691706 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-29024268-12ba-4754-bcd4-df229a26c2e9 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:10:27.692164 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-29024268-12ba-4754-bcd4-df229a26c2e9 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:10:27.692941 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-29024268-12ba-4754-bcd4-df229a26c2e9 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:10:27.693378 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-29024268-12ba-4754-bcd4-df229a26c2e9 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:10:27.794651 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi [None req-33d440dd-ba9c-4199-ad19-aa52c5ff3c5a tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Calling method '>' {{(pid=116157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:10:27.795547 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.compute.api [None req-33d440dd-ba9c-4199-ad19-aa52c5ff3c5a tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] [instance: b89094ac-aee1-4bd6-a33d-8c4347cebfc7] Fetching instance by UUID {{(pid=116157) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:10:27.801134 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-33d440dd-ba9c-4199-ad19-aa52c5ff3c5a tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:10:27.801576 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-33d440dd-ba9c-4199-ad19-aa52c5ff3c5a tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:10:27.802381 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-33d440dd-ba9c-4199-ad19-aa52c5ff3c5a tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:10:27.802814 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-33d440dd-ba9c-4199-ad19-aa52c5ff3c5a tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:10:27.826098 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.policy [None req-29024268-12ba-4754-bcd4-df229a26c2e9 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c4c0c82448e40ba801c0b52ec44e74a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a093d0bf43046aaa845f3cc115f3f5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116156) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:10:27.831748 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: INFO nova.api.openstack.requestlog [None req-33d440dd-ba9c-4199-ad19-aa52c5ff3c5a tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] 10.222.0.18 "GET /compute/v2.1/servers/b89094ac-aee1-4bd6-a33d-8c4347cebfc7/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.040772 Dec 15 03:10:27.832511 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: [pid: 116157|app: 0|req: 504/1006] 10.222.0.18 () {60 vars in 1342 bytes} [Wed Dec 15 03:10:27 2021] GET /compute/v2.1/servers/b89094ac-aee1-4bd6-a33d-8c4347cebfc7/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 03:10:27.833271 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: INFO nova.api.openstack.requestlog [None req-29024268-12ba-4754-bcd4-df229a26c2e9 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] 10.222.0.18 "GET /compute/v2.1/servers/fa7c86bc-c46f-4120-8f3d-d795f8d7c5cc" status: 200 len: 1570 microversion: 2.1 time: 0.152075 Dec 15 03:10:27.833828 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: [pid: 116156|app: 0|req: 503/1007] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 03:10:27 2021] GET /compute/v2.1/servers/fa7c86bc-c46f-4120-8f3d-d795f8d7c5cc => generated 1570 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 03:10:28.136891 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi [None req-fc3413a7-df3e-4420-af30-7d314c2ba99d tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Calling method '>' {{(pid=116157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:10:28.137493 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.compute.api [None req-fc3413a7-df3e-4420-af30-7d314c2ba99d tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] [instance: bbb8462c-9501-4541-b67e-43ec5c5061a7] Fetching instance by UUID {{(pid=116157) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:10:28.143626 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-fc3413a7-df3e-4420-af30-7d314c2ba99d tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:10:28.144071 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-fc3413a7-df3e-4420-af30-7d314c2ba99d tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:10:28.144835 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-fc3413a7-df3e-4420-af30-7d314c2ba99d tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:10:28.145296 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-fc3413a7-df3e-4420-af30-7d314c2ba99d tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:10:28.203895 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.policy [None req-fc3413a7-df3e-4420-af30-7d314c2ba99d tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97bdf19af9e34fc3886ff451cb9d7a27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '494b56bf5eae4d56a5591546f85bc32b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116157) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:10:28.211253 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: INFO nova.api.openstack.requestlog [None req-fc3413a7-df3e-4420-af30-7d314c2ba99d tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] 10.222.0.18 "GET /compute/v2.1/servers/bbb8462c-9501-4541-b67e-43ec5c5061a7" status: 200 len: 1226 microversion: 2.1 time: 0.078451 Dec 15 03:10:28.211813 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: [pid: 116157|app: 0|req: 505/1008] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 03:10:28 2021] GET /compute/v2.1/servers/bbb8462c-9501-4541-b67e-43ec5c5061a7 => generated 1226 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 03:10:28.843446 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi [None req-2c53cbd4-14a3-4203-b76c-6fc98dbfae75 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Calling method '>' {{(pid=116156) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:10:28.844382 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.compute.api [None req-2c53cbd4-14a3-4203-b76c-6fc98dbfae75 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] [instance: b89094ac-aee1-4bd6-a33d-8c4347cebfc7] Fetching instance by UUID {{(pid=116156) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:10:28.850129 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi [None req-4b78d494-1203-468f-a078-26be2f71676d tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Calling method '>' {{(pid=116157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:10:28.850632 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-2c53cbd4-14a3-4203-b76c-6fc98dbfae75 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:10:28.850766 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.compute.api [None req-4b78d494-1203-468f-a078-26be2f71676d tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] [instance: fa7c86bc-c46f-4120-8f3d-d795f8d7c5cc] Fetching instance by UUID {{(pid=116157) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:10:28.851084 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-2c53cbd4-14a3-4203-b76c-6fc98dbfae75 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:10:28.852363 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-2c53cbd4-14a3-4203-b76c-6fc98dbfae75 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:10:28.852797 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-2c53cbd4-14a3-4203-b76c-6fc98dbfae75 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:10:28.856994 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-4b78d494-1203-468f-a078-26be2f71676d tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:10:28.857448 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-4b78d494-1203-468f-a078-26be2f71676d tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:10:28.858281 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-4b78d494-1203-468f-a078-26be2f71676d tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:10:28.858721 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-4b78d494-1203-468f-a078-26be2f71676d tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:10:28.881746 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: INFO nova.api.openstack.requestlog [None req-2c53cbd4-14a3-4203-b76c-6fc98dbfae75 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] 10.222.0.18 "GET /compute/v2.1/servers/b89094ac-aee1-4bd6-a33d-8c4347cebfc7/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042027 Dec 15 03:10:28.882335 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: [pid: 116156|app: 0|req: 504/1009] 10.222.0.18 () {60 vars in 1342 bytes} [Wed Dec 15 03:10:28 2021] GET /compute/v2.1/servers/b89094ac-aee1-4bd6-a33d-8c4347cebfc7/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 03:10:28.990582 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.policy [None req-4b78d494-1203-468f-a078-26be2f71676d tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c4c0c82448e40ba801c0b52ec44e74a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a093d0bf43046aaa845f3cc115f3f5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116157) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:10:28.997817 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: INFO nova.api.openstack.requestlog [None req-4b78d494-1203-468f-a078-26be2f71676d tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] 10.222.0.18 "GET /compute/v2.1/servers/fa7c86bc-c46f-4120-8f3d-d795f8d7c5cc" status: 200 len: 1570 microversion: 2.1 time: 0.151249 Dec 15 03:10:28.998407 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: [pid: 116157|app: 0|req: 506/1010] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 03:10:28 2021] GET /compute/v2.1/servers/fa7c86bc-c46f-4120-8f3d-d795f8d7c5cc => generated 1570 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 03:10:29.227889 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi [None req-f2729dee-957f-455f-8505-fba17919461a tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Calling method '>' {{(pid=116156) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:10:29.228531 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.compute.api [None req-f2729dee-957f-455f-8505-fba17919461a tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] [instance: bbb8462c-9501-4541-b67e-43ec5c5061a7] Fetching instance by UUID {{(pid=116156) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:10:29.234302 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-f2729dee-957f-455f-8505-fba17919461a tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:10:29.234748 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-f2729dee-957f-455f-8505-fba17919461a tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:10:29.235520 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-f2729dee-957f-455f-8505-fba17919461a tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:10:29.235951 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-f2729dee-957f-455f-8505-fba17919461a tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:10:29.292999 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.policy [None req-f2729dee-957f-455f-8505-fba17919461a tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97bdf19af9e34fc3886ff451cb9d7a27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '494b56bf5eae4d56a5591546f85bc32b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116156) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:10:29.300209 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: INFO nova.api.openstack.requestlog [None req-f2729dee-957f-455f-8505-fba17919461a tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] 10.222.0.18 "GET /compute/v2.1/servers/bbb8462c-9501-4541-b67e-43ec5c5061a7" status: 200 len: 1226 microversion: 2.1 time: 0.076607 Dec 15 03:10:29.300776 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: [pid: 116156|app: 0|req: 505/1011] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 03:10:29 2021] GET /compute/v2.1/servers/bbb8462c-9501-4541-b67e-43ec5c5061a7 => generated 1226 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 03:10:29.892604 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi [None req-c146a619-ac4c-4df0-9622-1e4390ffb66b tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Calling method '>' {{(pid=116157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:10:29.893496 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.compute.api [None req-c146a619-ac4c-4df0-9622-1e4390ffb66b tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] [instance: b89094ac-aee1-4bd6-a33d-8c4347cebfc7] Fetching instance by UUID {{(pid=116157) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:10:29.899702 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-c146a619-ac4c-4df0-9622-1e4390ffb66b tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:10:29.900146 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-c146a619-ac4c-4df0-9622-1e4390ffb66b tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:10:29.900917 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-c146a619-ac4c-4df0-9622-1e4390ffb66b tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:10:29.901360 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-c146a619-ac4c-4df0-9622-1e4390ffb66b tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:10:29.928771 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: INFO nova.api.openstack.requestlog [None req-c146a619-ac4c-4df0-9622-1e4390ffb66b tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] 10.222.0.18 "GET /compute/v2.1/servers/b89094ac-aee1-4bd6-a33d-8c4347cebfc7/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.039944 Dec 15 03:10:29.929309 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: [pid: 116157|app: 0|req: 507/1012] 10.222.0.18 () {60 vars in 1342 bytes} [Wed Dec 15 03:10:29 2021] GET /compute/v2.1/servers/b89094ac-aee1-4bd6-a33d-8c4347cebfc7/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 03:10:30.014920 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi [None req-396b0b3c-7ee4-4226-b11b-32c48c74c905 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Calling method '>' {{(pid=116156) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:10:30.015540 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.compute.api [None req-396b0b3c-7ee4-4226-b11b-32c48c74c905 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] [instance: fa7c86bc-c46f-4120-8f3d-d795f8d7c5cc] Fetching instance by UUID {{(pid=116156) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:10:30.021883 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-396b0b3c-7ee4-4226-b11b-32c48c74c905 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:10:30.022361 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-396b0b3c-7ee4-4226-b11b-32c48c74c905 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:10:30.023139 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-396b0b3c-7ee4-4226-b11b-32c48c74c905 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:10:30.023701 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-396b0b3c-7ee4-4226-b11b-32c48c74c905 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:10:30.150376 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.policy [None req-396b0b3c-7ee4-4226-b11b-32c48c74c905 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c4c0c82448e40ba801c0b52ec44e74a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a093d0bf43046aaa845f3cc115f3f5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116156) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:10:30.157464 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: INFO nova.api.openstack.requestlog [None req-396b0b3c-7ee4-4226-b11b-32c48c74c905 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] 10.222.0.18 "GET /compute/v2.1/servers/fa7c86bc-c46f-4120-8f3d-d795f8d7c5cc" status: 200 len: 1570 microversion: 2.1 time: 0.146283 Dec 15 03:10:30.158117 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: [pid: 116156|app: 0|req: 506/1013] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 03:10:30 2021] GET /compute/v2.1/servers/fa7c86bc-c46f-4120-8f3d-d795f8d7c5cc => generated 1570 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 03:10:30.316441 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi [None req-549cc655-75fa-425f-9134-d86135a46676 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Calling method '>' {{(pid=116157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:10:30.317045 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.compute.api [None req-549cc655-75fa-425f-9134-d86135a46676 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] [instance: bbb8462c-9501-4541-b67e-43ec5c5061a7] Fetching instance by UUID {{(pid=116157) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:10:30.322923 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-549cc655-75fa-425f-9134-d86135a46676 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:10:30.323367 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-549cc655-75fa-425f-9134-d86135a46676 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:10:30.324136 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-549cc655-75fa-425f-9134-d86135a46676 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:10:30.324569 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-549cc655-75fa-425f-9134-d86135a46676 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:10:30.381606 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.policy [None req-549cc655-75fa-425f-9134-d86135a46676 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97bdf19af9e34fc3886ff451cb9d7a27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '494b56bf5eae4d56a5591546f85bc32b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116157) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:10:30.388752 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: INFO nova.api.openstack.requestlog [None req-549cc655-75fa-425f-9134-d86135a46676 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] 10.222.0.18 "GET /compute/v2.1/servers/bbb8462c-9501-4541-b67e-43ec5c5061a7" status: 200 len: 1226 microversion: 2.1 time: 0.076037 Dec 15 03:10:30.389312 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: [pid: 116157|app: 0|req: 508/1014] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 03:10:30 2021] GET /compute/v2.1/servers/bbb8462c-9501-4541-b67e-43ec5c5061a7 => generated 1226 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 03:10:30.940500 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi [None req-9bbccfe4-6d65-4706-ad96-c91c27d2a5b4 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Calling method '>' {{(pid=116156) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:10:30.941389 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.compute.api [None req-9bbccfe4-6d65-4706-ad96-c91c27d2a5b4 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] [instance: b89094ac-aee1-4bd6-a33d-8c4347cebfc7] Fetching instance by UUID {{(pid=116156) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:10:30.947854 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-9bbccfe4-6d65-4706-ad96-c91c27d2a5b4 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:10:30.948294 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-9bbccfe4-6d65-4706-ad96-c91c27d2a5b4 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:10:30.949061 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-9bbccfe4-6d65-4706-ad96-c91c27d2a5b4 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:10:30.949485 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-9bbccfe4-6d65-4706-ad96-c91c27d2a5b4 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:10:30.977473 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: INFO nova.api.openstack.requestlog [None req-9bbccfe4-6d65-4706-ad96-c91c27d2a5b4 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] 10.222.0.18 "GET /compute/v2.1/servers/b89094ac-aee1-4bd6-a33d-8c4347cebfc7/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.040712 Dec 15 03:10:30.978027 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: [pid: 116156|app: 0|req: 507/1015] 10.222.0.18 () {60 vars in 1342 bytes} [Wed Dec 15 03:10:30 2021] GET /compute/v2.1/servers/b89094ac-aee1-4bd6-a33d-8c4347cebfc7/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 03:10:31.174636 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi [None req-42fd4ff5-dd64-4872-aab2-4144f16dc98d tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Calling method '>' {{(pid=116157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:10:31.175276 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.compute.api [None req-42fd4ff5-dd64-4872-aab2-4144f16dc98d tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] [instance: fa7c86bc-c46f-4120-8f3d-d795f8d7c5cc] Fetching instance by UUID {{(pid=116157) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:10:31.181591 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-42fd4ff5-dd64-4872-aab2-4144f16dc98d tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:10:31.182063 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-42fd4ff5-dd64-4872-aab2-4144f16dc98d tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:10:31.182842 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-42fd4ff5-dd64-4872-aab2-4144f16dc98d tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:10:31.183279 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-42fd4ff5-dd64-4872-aab2-4144f16dc98d tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:10:31.309405 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.policy [None req-42fd4ff5-dd64-4872-aab2-4144f16dc98d tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c4c0c82448e40ba801c0b52ec44e74a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a093d0bf43046aaa845f3cc115f3f5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116157) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:10:31.317035 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: INFO nova.api.openstack.requestlog [None req-42fd4ff5-dd64-4872-aab2-4144f16dc98d tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] 10.222.0.18 "GET /compute/v2.1/servers/fa7c86bc-c46f-4120-8f3d-d795f8d7c5cc" status: 200 len: 1570 microversion: 2.1 time: 0.146032 Dec 15 03:10:31.317629 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: [pid: 116157|app: 0|req: 509/1016] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 03:10:31 2021] GET /compute/v2.1/servers/fa7c86bc-c46f-4120-8f3d-d795f8d7c5cc => generated 1570 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 03:10:31.404411 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi [None req-87e38324-ddce-442a-af33-1e60a53a0116 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Calling method '>' {{(pid=116156) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:10:31.405007 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.compute.api [None req-87e38324-ddce-442a-af33-1e60a53a0116 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] [instance: bbb8462c-9501-4541-b67e-43ec5c5061a7] Fetching instance by UUID {{(pid=116156) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:10:31.411096 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-87e38324-ddce-442a-af33-1e60a53a0116 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:10:31.411541 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-87e38324-ddce-442a-af33-1e60a53a0116 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:10:31.412307 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-87e38324-ddce-442a-af33-1e60a53a0116 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:10:31.412738 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-87e38324-ddce-442a-af33-1e60a53a0116 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:10:31.470875 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.policy [None req-87e38324-ddce-442a-af33-1e60a53a0116 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97bdf19af9e34fc3886ff451cb9d7a27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '494b56bf5eae4d56a5591546f85bc32b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116156) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:10:31.477950 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: INFO nova.api.openstack.requestlog [None req-87e38324-ddce-442a-af33-1e60a53a0116 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] 10.222.0.18 "GET /compute/v2.1/servers/bbb8462c-9501-4541-b67e-43ec5c5061a7" status: 200 len: 1226 microversion: 2.1 time: 0.077154 Dec 15 03:10:31.478535 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: [pid: 116156|app: 0|req: 508/1017] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 03:10:31 2021] GET /compute/v2.1/servers/bbb8462c-9501-4541-b67e-43ec5c5061a7 => generated 1226 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 03:10:31.989008 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi [None req-b7e15473-2800-45ea-bb99-b270b8eab9ef tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Calling method '>' {{(pid=116157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:10:31.990198 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.compute.api [None req-b7e15473-2800-45ea-bb99-b270b8eab9ef tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] [instance: b89094ac-aee1-4bd6-a33d-8c4347cebfc7] Fetching instance by UUID {{(pid=116157) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:10:31.996132 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-b7e15473-2800-45ea-bb99-b270b8eab9ef tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:10:31.996588 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-b7e15473-2800-45ea-bb99-b270b8eab9ef tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:10:31.997374 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-b7e15473-2800-45ea-bb99-b270b8eab9ef tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:10:31.997814 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-b7e15473-2800-45ea-bb99-b270b8eab9ef tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:10:32.025937 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: INFO nova.api.openstack.requestlog [None req-b7e15473-2800-45ea-bb99-b270b8eab9ef tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] 10.222.0.18 "GET /compute/v2.1/servers/b89094ac-aee1-4bd6-a33d-8c4347cebfc7/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.040694 Dec 15 03:10:32.026504 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: [pid: 116157|app: 0|req: 510/1018] 10.222.0.18 () {60 vars in 1342 bytes} [Wed Dec 15 03:10:31 2021] GET /compute/v2.1/servers/b89094ac-aee1-4bd6-a33d-8c4347cebfc7/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 03:10:32.334623 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi [None req-899f32f8-3017-4a57-8497-532b6a3ac30b tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Calling method '>' {{(pid=116156) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:10:32.335235 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.compute.api [None req-899f32f8-3017-4a57-8497-532b6a3ac30b tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] [instance: fa7c86bc-c46f-4120-8f3d-d795f8d7c5cc] Fetching instance by UUID {{(pid=116156) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:10:32.341876 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-899f32f8-3017-4a57-8497-532b6a3ac30b tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:10:32.342371 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-899f32f8-3017-4a57-8497-532b6a3ac30b tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:10:32.343154 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-899f32f8-3017-4a57-8497-532b6a3ac30b tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:10:32.343590 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-899f32f8-3017-4a57-8497-532b6a3ac30b tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:10:32.475446 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.policy [None req-899f32f8-3017-4a57-8497-532b6a3ac30b tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c4c0c82448e40ba801c0b52ec44e74a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a093d0bf43046aaa845f3cc115f3f5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116156) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:10:32.483243 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: INFO nova.api.openstack.requestlog [None req-899f32f8-3017-4a57-8497-532b6a3ac30b tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] 10.222.0.18 "GET /compute/v2.1/servers/fa7c86bc-c46f-4120-8f3d-d795f8d7c5cc" status: 200 len: 1570 microversion: 2.1 time: 0.152221 Dec 15 03:10:32.483800 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: [pid: 116156|app: 0|req: 509/1019] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 03:10:32 2021] GET /compute/v2.1/servers/fa7c86bc-c46f-4120-8f3d-d795f8d7c5cc => generated 1570 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 03:10:32.495426 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi [None req-8de3a0a1-f334-4a3a-94d8-30cc87b48149 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Calling method '>' {{(pid=116157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:10:32.496027 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.compute.api [None req-8de3a0a1-f334-4a3a-94d8-30cc87b48149 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] [instance: bbb8462c-9501-4541-b67e-43ec5c5061a7] Fetching instance by UUID {{(pid=116157) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:10:32.502160 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-8de3a0a1-f334-4a3a-94d8-30cc87b48149 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:10:32.502607 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-8de3a0a1-f334-4a3a-94d8-30cc87b48149 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:10:32.503377 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-8de3a0a1-f334-4a3a-94d8-30cc87b48149 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:10:32.503807 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-8de3a0a1-f334-4a3a-94d8-30cc87b48149 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:10:32.566559 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.policy [None req-8de3a0a1-f334-4a3a-94d8-30cc87b48149 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97bdf19af9e34fc3886ff451cb9d7a27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '494b56bf5eae4d56a5591546f85bc32b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116157) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:10:32.573778 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: INFO nova.api.openstack.requestlog [None req-8de3a0a1-f334-4a3a-94d8-30cc87b48149 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] 10.222.0.18 "GET /compute/v2.1/servers/bbb8462c-9501-4541-b67e-43ec5c5061a7" status: 200 len: 1226 microversion: 2.1 time: 0.082605 Dec 15 03:10:32.574398 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: [pid: 116157|app: 0|req: 511/1020] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 03:10:32 2021] GET /compute/v2.1/servers/bbb8462c-9501-4541-b67e-43ec5c5061a7 => generated 1226 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 03:10:33.037200 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi [None req-021b9c46-fac1-4eb9-a239-cc9e47d9cd27 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Calling method '>' {{(pid=116156) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:10:33.038166 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.compute.api [None req-021b9c46-fac1-4eb9-a239-cc9e47d9cd27 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] [instance: b89094ac-aee1-4bd6-a33d-8c4347cebfc7] Fetching instance by UUID {{(pid=116156) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:10:33.044665 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-021b9c46-fac1-4eb9-a239-cc9e47d9cd27 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:10:33.045122 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-021b9c46-fac1-4eb9-a239-cc9e47d9cd27 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:10:33.045903 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-021b9c46-fac1-4eb9-a239-cc9e47d9cd27 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:10:33.046366 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-021b9c46-fac1-4eb9-a239-cc9e47d9cd27 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:10:33.075027 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: INFO nova.api.openstack.requestlog [None req-021b9c46-fac1-4eb9-a239-cc9e47d9cd27 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] 10.222.0.18 "GET /compute/v2.1/servers/b89094ac-aee1-4bd6-a33d-8c4347cebfc7/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041660 Dec 15 03:10:33.075578 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: [pid: 116156|app: 0|req: 510/1021] 10.222.0.18 () {60 vars in 1342 bytes} [Wed Dec 15 03:10:33 2021] GET /compute/v2.1/servers/b89094ac-aee1-4bd6-a33d-8c4347cebfc7/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 03:10:33.501058 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi [None req-22641f18-8c14-48d7-a3f6-f4f8d5ffa62d tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Calling method '>' {{(pid=116157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:10:33.501657 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.compute.api [None req-22641f18-8c14-48d7-a3f6-f4f8d5ffa62d tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] [instance: fa7c86bc-c46f-4120-8f3d-d795f8d7c5cc] Fetching instance by UUID {{(pid=116157) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:10:33.508589 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-22641f18-8c14-48d7-a3f6-f4f8d5ffa62d tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:10:33.509040 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-22641f18-8c14-48d7-a3f6-f4f8d5ffa62d tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:10:33.509821 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-22641f18-8c14-48d7-a3f6-f4f8d5ffa62d tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:10:33.510293 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-22641f18-8c14-48d7-a3f6-f4f8d5ffa62d tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:10:33.590536 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi [None req-b1d60aa3-78b2-4abc-a502-ac497e66c952 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Calling method '>' {{(pid=116156) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:10:33.591146 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.compute.api [None req-b1d60aa3-78b2-4abc-a502-ac497e66c952 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] [instance: bbb8462c-9501-4541-b67e-43ec5c5061a7] Fetching instance by UUID {{(pid=116156) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:10:33.597363 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-b1d60aa3-78b2-4abc-a502-ac497e66c952 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:10:33.597809 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-b1d60aa3-78b2-4abc-a502-ac497e66c952 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:10:33.599739 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-b1d60aa3-78b2-4abc-a502-ac497e66c952 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:10:33.600189 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-b1d60aa3-78b2-4abc-a502-ac497e66c952 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:10:33.640566 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.policy [None req-22641f18-8c14-48d7-a3f6-f4f8d5ffa62d tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c4c0c82448e40ba801c0b52ec44e74a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a093d0bf43046aaa845f3cc115f3f5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116157) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:10:33.648042 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: INFO nova.api.openstack.requestlog [None req-22641f18-8c14-48d7-a3f6-f4f8d5ffa62d tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] 10.222.0.18 "GET /compute/v2.1/servers/fa7c86bc-c46f-4120-8f3d-d795f8d7c5cc" status: 200 len: 1570 microversion: 2.1 time: 0.150695 Dec 15 03:10:33.648663 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: [pid: 116157|app: 0|req: 512/1022] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 03:10:33 2021] GET /compute/v2.1/servers/fa7c86bc-c46f-4120-8f3d-d795f8d7c5cc => generated 1570 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 03:10:33.659497 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.policy [None req-b1d60aa3-78b2-4abc-a502-ac497e66c952 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97bdf19af9e34fc3886ff451cb9d7a27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '494b56bf5eae4d56a5591546f85bc32b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116156) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:10:33.666809 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: INFO nova.api.openstack.requestlog [None req-b1d60aa3-78b2-4abc-a502-ac497e66c952 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] 10.222.0.18 "GET /compute/v2.1/servers/bbb8462c-9501-4541-b67e-43ec5c5061a7" status: 200 len: 1226 microversion: 2.1 time: 0.079835 Dec 15 03:10:33.667362 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: [pid: 116156|app: 0|req: 511/1023] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 03:10:33 2021] GET /compute/v2.1/servers/bbb8462c-9501-4541-b67e-43ec5c5061a7 => generated 1226 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 03:10:34.086868 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi [None req-34971ad5-2c82-4c0c-88f4-c26b028006bb tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Calling method '>' {{(pid=116157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:10:34.087764 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.compute.api [None req-34971ad5-2c82-4c0c-88f4-c26b028006bb tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] [instance: b89094ac-aee1-4bd6-a33d-8c4347cebfc7] Fetching instance by UUID {{(pid=116157) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:10:34.093543 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-34971ad5-2c82-4c0c-88f4-c26b028006bb tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:10:34.094011 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-34971ad5-2c82-4c0c-88f4-c26b028006bb tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:10:34.094796 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-34971ad5-2c82-4c0c-88f4-c26b028006bb tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:10:34.095232 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-34971ad5-2c82-4c0c-88f4-c26b028006bb tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:10:34.124141 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: INFO nova.api.openstack.requestlog [None req-34971ad5-2c82-4c0c-88f4-c26b028006bb tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] 10.222.0.18 "GET /compute/v2.1/servers/b89094ac-aee1-4bd6-a33d-8c4347cebfc7/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041085 Dec 15 03:10:34.124678 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: [pid: 116157|app: 0|req: 513/1024] 10.222.0.18 () {60 vars in 1342 bytes} [Wed Dec 15 03:10:34 2021] GET /compute/v2.1/servers/b89094ac-aee1-4bd6-a33d-8c4347cebfc7/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 03:10:34.665433 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi [None req-0861f4e0-b833-4362-b8bf-fb3e543759d1 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Calling method '>' {{(pid=116156) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:10:34.666064 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.compute.api [None req-0861f4e0-b833-4362-b8bf-fb3e543759d1 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] [instance: fa7c86bc-c46f-4120-8f3d-d795f8d7c5cc] Fetching instance by UUID {{(pid=116156) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:10:34.672256 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-0861f4e0-b833-4362-b8bf-fb3e543759d1 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:10:34.672698 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-0861f4e0-b833-4362-b8bf-fb3e543759d1 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:10:34.673467 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-0861f4e0-b833-4362-b8bf-fb3e543759d1 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:10:34.673897 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-0861f4e0-b833-4362-b8bf-fb3e543759d1 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:10:34.683289 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi [None req-8698caed-9d6c-4844-b428-ed013a0d4d6b tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Calling method '>' {{(pid=116157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:10:34.683934 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.compute.api [None req-8698caed-9d6c-4844-b428-ed013a0d4d6b tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] [instance: bbb8462c-9501-4541-b67e-43ec5c5061a7] Fetching instance by UUID {{(pid=116157) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:10:34.690148 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-8698caed-9d6c-4844-b428-ed013a0d4d6b tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:10:34.690606 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-8698caed-9d6c-4844-b428-ed013a0d4d6b tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:10:34.691389 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-8698caed-9d6c-4844-b428-ed013a0d4d6b tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:10:34.691825 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-8698caed-9d6c-4844-b428-ed013a0d4d6b tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:10:34.750232 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.policy [None req-8698caed-9d6c-4844-b428-ed013a0d4d6b tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97bdf19af9e34fc3886ff451cb9d7a27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '494b56bf5eae4d56a5591546f85bc32b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116157) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:10:34.757486 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: INFO nova.api.openstack.requestlog [None req-8698caed-9d6c-4844-b428-ed013a0d4d6b tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] 10.222.0.18 "GET /compute/v2.1/servers/bbb8462c-9501-4541-b67e-43ec5c5061a7" status: 200 len: 1226 microversion: 2.1 time: 0.077809 Dec 15 03:10:34.758667 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: [pid: 116157|app: 0|req: 514/1025] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 03:10:34 2021] GET /compute/v2.1/servers/bbb8462c-9501-4541-b67e-43ec5c5061a7 => generated 1226 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 03:10:34.805148 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.policy [None req-0861f4e0-b833-4362-b8bf-fb3e543759d1 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c4c0c82448e40ba801c0b52ec44e74a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a093d0bf43046aaa845f3cc115f3f5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116156) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:10:34.812244 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: INFO nova.api.openstack.requestlog [None req-0861f4e0-b833-4362-b8bf-fb3e543759d1 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] 10.222.0.18 "GET /compute/v2.1/servers/fa7c86bc-c46f-4120-8f3d-d795f8d7c5cc" status: 200 len: 1570 microversion: 2.1 time: 0.150416 Dec 15 03:10:34.812791 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: [pid: 116156|app: 0|req: 512/1026] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 03:10:34 2021] GET /compute/v2.1/servers/fa7c86bc-c46f-4120-8f3d-d795f8d7c5cc => generated 1570 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 03:10:35.135599 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi [None req-1a3b1440-ff70-4caf-a7e9-8357eeea0873 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Calling method '>' {{(pid=116157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:10:35.136520 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.compute.api [None req-1a3b1440-ff70-4caf-a7e9-8357eeea0873 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] [instance: b89094ac-aee1-4bd6-a33d-8c4347cebfc7] Fetching instance by UUID {{(pid=116157) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:10:35.142334 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-1a3b1440-ff70-4caf-a7e9-8357eeea0873 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:10:35.142783 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-1a3b1440-ff70-4caf-a7e9-8357eeea0873 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:10:35.143549 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-1a3b1440-ff70-4caf-a7e9-8357eeea0873 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:10:35.143979 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-1a3b1440-ff70-4caf-a7e9-8357eeea0873 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:10:35.173222 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: INFO nova.api.openstack.requestlog [None req-1a3b1440-ff70-4caf-a7e9-8357eeea0873 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] 10.222.0.18 "GET /compute/v2.1/servers/b89094ac-aee1-4bd6-a33d-8c4347cebfc7/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041990 Dec 15 03:10:35.173768 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: [pid: 116157|app: 0|req: 515/1027] 10.222.0.18 () {60 vars in 1342 bytes} [Wed Dec 15 03:10:35 2021] GET /compute/v2.1/servers/b89094ac-aee1-4bd6-a33d-8c4347cebfc7/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 03:10:35.775087 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi [None req-775d0a31-c8d0-462f-ae1a-f3b3628f9cb6 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Calling method '>' {{(pid=116156) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:10:35.775690 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.compute.api [None req-775d0a31-c8d0-462f-ae1a-f3b3628f9cb6 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] [instance: bbb8462c-9501-4541-b67e-43ec5c5061a7] Fetching instance by UUID {{(pid=116156) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:10:35.782037 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-775d0a31-c8d0-462f-ae1a-f3b3628f9cb6 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:10:35.782489 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-775d0a31-c8d0-462f-ae1a-f3b3628f9cb6 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:10:35.783258 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-775d0a31-c8d0-462f-ae1a-f3b3628f9cb6 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:10:35.783688 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-775d0a31-c8d0-462f-ae1a-f3b3628f9cb6 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:10:35.829325 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi [None req-bf424e47-cf5c-4fab-8898-0df19bdd9238 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Calling method '>' {{(pid=116157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:10:35.829926 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.compute.api [None req-bf424e47-cf5c-4fab-8898-0df19bdd9238 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] [instance: fa7c86bc-c46f-4120-8f3d-d795f8d7c5cc] Fetching instance by UUID {{(pid=116157) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:10:35.836068 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-bf424e47-cf5c-4fab-8898-0df19bdd9238 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:10:35.836508 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-bf424e47-cf5c-4fab-8898-0df19bdd9238 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:10:35.837276 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-bf424e47-cf5c-4fab-8898-0df19bdd9238 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:10:35.837707 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-bf424e47-cf5c-4fab-8898-0df19bdd9238 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:10:35.845573 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.policy [None req-775d0a31-c8d0-462f-ae1a-f3b3628f9cb6 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97bdf19af9e34fc3886ff451cb9d7a27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '494b56bf5eae4d56a5591546f85bc32b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116156) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:10:35.852788 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: INFO nova.api.openstack.requestlog [None req-775d0a31-c8d0-462f-ae1a-f3b3628f9cb6 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] 10.222.0.18 "GET /compute/v2.1/servers/bbb8462c-9501-4541-b67e-43ec5c5061a7" status: 200 len: 1226 microversion: 2.1 time: 0.081310 Dec 15 03:10:35.853340 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: [pid: 116156|app: 0|req: 513/1028] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 03:10:35 2021] GET /compute/v2.1/servers/bbb8462c-9501-4541-b67e-43ec5c5061a7 => generated 1226 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 03:10:35.970812 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.policy [None req-bf424e47-cf5c-4fab-8898-0df19bdd9238 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c4c0c82448e40ba801c0b52ec44e74a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a093d0bf43046aaa845f3cc115f3f5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116157) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:10:35.978003 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: INFO nova.api.openstack.requestlog [None req-bf424e47-cf5c-4fab-8898-0df19bdd9238 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] 10.222.0.18 "GET /compute/v2.1/servers/fa7c86bc-c46f-4120-8f3d-d795f8d7c5cc" status: 200 len: 1570 microversion: 2.1 time: 0.152203 Dec 15 03:10:35.978564 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: [pid: 116157|app: 0|req: 516/1029] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 03:10:35 2021] GET /compute/v2.1/servers/fa7c86bc-c46f-4120-8f3d-d795f8d7c5cc => generated 1570 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 03:10:36.185134 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi [None req-460e8dc8-4023-461d-b939-f038f3feb908 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Calling method '>' {{(pid=116156) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:10:36.186068 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.compute.api [None req-460e8dc8-4023-461d-b939-f038f3feb908 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] [instance: b89094ac-aee1-4bd6-a33d-8c4347cebfc7] Fetching instance by UUID {{(pid=116156) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:10:36.191844 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-460e8dc8-4023-461d-b939-f038f3feb908 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:10:36.192292 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-460e8dc8-4023-461d-b939-f038f3feb908 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:10:36.193069 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-460e8dc8-4023-461d-b939-f038f3feb908 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:10:36.193503 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-460e8dc8-4023-461d-b939-f038f3feb908 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:10:36.221473 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: INFO nova.api.openstack.requestlog [None req-460e8dc8-4023-461d-b939-f038f3feb908 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] 10.222.0.18 "GET /compute/v2.1/servers/b89094ac-aee1-4bd6-a33d-8c4347cebfc7/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.040129 Dec 15 03:10:36.222036 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: [pid: 116156|app: 0|req: 514/1030] 10.222.0.18 () {60 vars in 1342 bytes} [Wed Dec 15 03:10:36 2021] GET /compute/v2.1/servers/b89094ac-aee1-4bd6-a33d-8c4347cebfc7/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 03:10:36.869527 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi [None req-f151919b-191a-4ece-a587-93af3ed02d82 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Calling method '>' {{(pid=116157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:10:36.870180 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.compute.api [None req-f151919b-191a-4ece-a587-93af3ed02d82 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] [instance: bbb8462c-9501-4541-b67e-43ec5c5061a7] Fetching instance by UUID {{(pid=116157) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:10:36.876400 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-f151919b-191a-4ece-a587-93af3ed02d82 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:10:36.876865 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-f151919b-191a-4ece-a587-93af3ed02d82 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:10:36.877631 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-f151919b-191a-4ece-a587-93af3ed02d82 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:10:36.878097 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-f151919b-191a-4ece-a587-93af3ed02d82 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:10:36.995290 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi [None req-a5c99648-4ddd-450c-8c4d-6c364de979b1 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Calling method '>' {{(pid=116156) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:10:36.995906 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.compute.api [None req-a5c99648-4ddd-450c-8c4d-6c364de979b1 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] [instance: fa7c86bc-c46f-4120-8f3d-d795f8d7c5cc] Fetching instance by UUID {{(pid=116156) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:10:37.002394 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-a5c99648-4ddd-450c-8c4d-6c364de979b1 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:10:37.002844 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-a5c99648-4ddd-450c-8c4d-6c364de979b1 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:10:37.003754 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-a5c99648-4ddd-450c-8c4d-6c364de979b1 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:10:37.004192 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-a5c99648-4ddd-450c-8c4d-6c364de979b1 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:10:37.138746 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.policy [None req-a5c99648-4ddd-450c-8c4d-6c364de979b1 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c4c0c82448e40ba801c0b52ec44e74a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a093d0bf43046aaa845f3cc115f3f5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116156) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:10:37.146459 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: INFO nova.api.openstack.requestlog [None req-a5c99648-4ddd-450c-8c4d-6c364de979b1 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] 10.222.0.18 "GET /compute/v2.1/servers/fa7c86bc-c46f-4120-8f3d-d795f8d7c5cc" status: 200 len: 1570 microversion: 2.1 time: 0.154761 Dec 15 03:10:37.147047 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: [pid: 116156|app: 0|req: 515/1031] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 03:10:36 2021] GET /compute/v2.1/servers/fa7c86bc-c46f-4120-8f3d-d795f8d7c5cc => generated 1570 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 03:10:37.161402 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.policy [None req-f151919b-191a-4ece-a587-93af3ed02d82 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97bdf19af9e34fc3886ff451cb9d7a27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '494b56bf5eae4d56a5591546f85bc32b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116157) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:10:37.169011 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: INFO nova.api.openstack.requestlog [None req-f151919b-191a-4ece-a587-93af3ed02d82 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] 10.222.0.18 "GET /compute/v2.1/servers/bbb8462c-9501-4541-b67e-43ec5c5061a7" status: 200 len: 1226 microversion: 2.1 time: 0.303092 Dec 15 03:10:37.169556 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: [pid: 116157|app: 0|req: 517/1032] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 03:10:36 2021] GET /compute/v2.1/servers/bbb8462c-9501-4541-b67e-43ec5c5061a7 => generated 1226 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 03:10:37.232832 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi [None req-b52b1470-3ab0-46fb-bbb5-f3166d37f5be tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Calling method '>' {{(pid=116156) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:10:37.233741 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.compute.api [None req-b52b1470-3ab0-46fb-bbb5-f3166d37f5be tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] [instance: b89094ac-aee1-4bd6-a33d-8c4347cebfc7] Fetching instance by UUID {{(pid=116156) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:10:37.239577 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-b52b1470-3ab0-46fb-bbb5-f3166d37f5be tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:10:37.240279 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-b52b1470-3ab0-46fb-bbb5-f3166d37f5be tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:10:37.241057 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-b52b1470-3ab0-46fb-bbb5-f3166d37f5be tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:10:37.241489 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-b52b1470-3ab0-46fb-bbb5-f3166d37f5be tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:10:37.270634 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: INFO nova.api.openstack.requestlog [None req-b52b1470-3ab0-46fb-bbb5-f3166d37f5be tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] 10.222.0.18 "GET /compute/v2.1/servers/b89094ac-aee1-4bd6-a33d-8c4347cebfc7/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041518 Dec 15 03:10:37.271192 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: [pid: 116156|app: 0|req: 516/1033] 10.222.0.18 () {60 vars in 1342 bytes} [Wed Dec 15 03:10:37 2021] GET /compute/v2.1/servers/b89094ac-aee1-4bd6-a33d-8c4347cebfc7/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 03:10:38.164746 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi [None req-43026a06-159f-4a33-8c63-7b09161e0c80 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Calling method '>' {{(pid=116157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:10:38.165354 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.compute.api [None req-43026a06-159f-4a33-8c63-7b09161e0c80 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] [instance: fa7c86bc-c46f-4120-8f3d-d795f8d7c5cc] Fetching instance by UUID {{(pid=116157) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:10:38.171502 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-43026a06-159f-4a33-8c63-7b09161e0c80 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:10:38.171948 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-43026a06-159f-4a33-8c63-7b09161e0c80 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:10:38.172720 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-43026a06-159f-4a33-8c63-7b09161e0c80 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:10:38.173149 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-43026a06-159f-4a33-8c63-7b09161e0c80 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:10:38.185774 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi [None req-7a2b1d3c-33df-4867-8db9-5d201b458b60 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Calling method '>' {{(pid=116156) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:10:38.186421 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.compute.api [None req-7a2b1d3c-33df-4867-8db9-5d201b458b60 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] [instance: bbb8462c-9501-4541-b67e-43ec5c5061a7] Fetching instance by UUID {{(pid=116156) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:10:38.192457 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-7a2b1d3c-33df-4867-8db9-5d201b458b60 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:10:38.192912 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-7a2b1d3c-33df-4867-8db9-5d201b458b60 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:10:38.193688 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-7a2b1d3c-33df-4867-8db9-5d201b458b60 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:10:38.194152 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-7a2b1d3c-33df-4867-8db9-5d201b458b60 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:10:38.254138 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.policy [None req-7a2b1d3c-33df-4867-8db9-5d201b458b60 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97bdf19af9e34fc3886ff451cb9d7a27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '494b56bf5eae4d56a5591546f85bc32b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116156) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:10:38.261436 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: INFO nova.api.openstack.requestlog [None req-7a2b1d3c-33df-4867-8db9-5d201b458b60 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] 10.222.0.18 "GET /compute/v2.1/servers/bbb8462c-9501-4541-b67e-43ec5c5061a7" status: 200 len: 1226 microversion: 2.1 time: 0.079685 Dec 15 03:10:38.262095 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: [pid: 116156|app: 0|req: 517/1034] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 03:10:38 2021] GET /compute/v2.1/servers/bbb8462c-9501-4541-b67e-43ec5c5061a7 => generated 1226 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 03:10:38.281656 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi [None req-65df33e3-c77b-4ae6-8ac4-f70ae0682e24 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Calling method '>' {{(pid=116156) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:10:38.282582 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.compute.api [None req-65df33e3-c77b-4ae6-8ac4-f70ae0682e24 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] [instance: b89094ac-aee1-4bd6-a33d-8c4347cebfc7] Fetching instance by UUID {{(pid=116156) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:10:38.288185 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-65df33e3-c77b-4ae6-8ac4-f70ae0682e24 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:10:38.288632 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-65df33e3-c77b-4ae6-8ac4-f70ae0682e24 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:10:38.290036 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-65df33e3-c77b-4ae6-8ac4-f70ae0682e24 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:10:38.290470 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-65df33e3-c77b-4ae6-8ac4-f70ae0682e24 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:10:38.306261 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.policy [None req-43026a06-159f-4a33-8c63-7b09161e0c80 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c4c0c82448e40ba801c0b52ec44e74a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a093d0bf43046aaa845f3cc115f3f5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116157) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:10:38.313671 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: INFO nova.api.openstack.requestlog [None req-43026a06-159f-4a33-8c63-7b09161e0c80 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] 10.222.0.18 "GET /compute/v2.1/servers/fa7c86bc-c46f-4120-8f3d-d795f8d7c5cc" status: 200 len: 1570 microversion: 2.1 time: 0.153272 Dec 15 03:10:38.314606 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: [pid: 116157|app: 0|req: 518/1035] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 03:10:38 2021] GET /compute/v2.1/servers/fa7c86bc-c46f-4120-8f3d-d795f8d7c5cc => generated 1570 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 03:10:38.320043 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: INFO nova.api.openstack.requestlog [None req-65df33e3-c77b-4ae6-8ac4-f70ae0682e24 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] 10.222.0.18 "GET /compute/v2.1/servers/b89094ac-aee1-4bd6-a33d-8c4347cebfc7/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041922 Dec 15 03:10:38.321117 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: [pid: 116156|app: 0|req: 518/1036] 10.222.0.18 () {60 vars in 1342 bytes} [Wed Dec 15 03:10:38 2021] GET /compute/v2.1/servers/b89094ac-aee1-4bd6-a33d-8c4347cebfc7/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Dec 15 03:10:39.277765 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi [None req-8a2ea897-cc50-43f7-b9c3-09357c7be6f6 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Calling method '>' {{(pid=116157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:10:39.278393 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.compute.api [None req-8a2ea897-cc50-43f7-b9c3-09357c7be6f6 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] [instance: bbb8462c-9501-4541-b67e-43ec5c5061a7] Fetching instance by UUID {{(pid=116157) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:10:39.284521 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-8a2ea897-cc50-43f7-b9c3-09357c7be6f6 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:10:39.284967 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-8a2ea897-cc50-43f7-b9c3-09357c7be6f6 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:10:39.285744 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-8a2ea897-cc50-43f7-b9c3-09357c7be6f6 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:10:39.286207 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-8a2ea897-cc50-43f7-b9c3-09357c7be6f6 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:10:39.331091 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi [None req-d668de09-31dc-4f22-b7dd-fcf9aa8c9779 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Calling method '>' {{(pid=116156) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:10:39.331680 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.compute.api [None req-d668de09-31dc-4f22-b7dd-fcf9aa8c9779 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] [instance: fa7c86bc-c46f-4120-8f3d-d795f8d7c5cc] Fetching instance by UUID {{(pid=116156) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:10:39.338086 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-d668de09-31dc-4f22-b7dd-fcf9aa8c9779 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:10:39.338535 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-d668de09-31dc-4f22-b7dd-fcf9aa8c9779 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:10:39.339306 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-d668de09-31dc-4f22-b7dd-fcf9aa8c9779 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:10:39.339734 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-d668de09-31dc-4f22-b7dd-fcf9aa8c9779 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:10:39.343718 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.policy [None req-8a2ea897-cc50-43f7-b9c3-09357c7be6f6 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97bdf19af9e34fc3886ff451cb9d7a27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '494b56bf5eae4d56a5591546f85bc32b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116157) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:10:39.350857 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: INFO nova.api.openstack.requestlog [None req-8a2ea897-cc50-43f7-b9c3-09357c7be6f6 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] 10.222.0.18 "GET /compute/v2.1/servers/bbb8462c-9501-4541-b67e-43ec5c5061a7" status: 200 len: 1226 microversion: 2.1 time: 0.076690 Dec 15 03:10:39.351904 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: [pid: 116157|app: 0|req: 519/1037] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 03:10:39 2021] GET /compute/v2.1/servers/bbb8462c-9501-4541-b67e-43ec5c5061a7 => generated 1226 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 03:10:39.356385 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi [None req-cfe8d6e3-459d-4e0b-b24f-789d8699c7a6 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Calling method '>' {{(pid=116157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:10:39.357268 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.compute.api [None req-cfe8d6e3-459d-4e0b-b24f-789d8699c7a6 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] [instance: b89094ac-aee1-4bd6-a33d-8c4347cebfc7] Fetching instance by UUID {{(pid=116157) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:10:39.362744 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-cfe8d6e3-459d-4e0b-b24f-789d8699c7a6 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:10:39.363198 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-cfe8d6e3-459d-4e0b-b24f-789d8699c7a6 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:10:39.363975 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-cfe8d6e3-459d-4e0b-b24f-789d8699c7a6 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:10:39.364418 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-cfe8d6e3-459d-4e0b-b24f-789d8699c7a6 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:10:39.393656 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: INFO nova.api.openstack.requestlog [None req-cfe8d6e3-459d-4e0b-b24f-789d8699c7a6 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] 10.222.0.18 "GET /compute/v2.1/servers/b89094ac-aee1-4bd6-a33d-8c4347cebfc7/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.040578 Dec 15 03:10:39.394240 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: [pid: 116157|app: 0|req: 520/1038] 10.222.0.18 () {60 vars in 1342 bytes} [Wed Dec 15 03:10:39 2021] GET /compute/v2.1/servers/b89094ac-aee1-4bd6-a33d-8c4347cebfc7/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 03:10:39.471066 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.policy [None req-d668de09-31dc-4f22-b7dd-fcf9aa8c9779 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c4c0c82448e40ba801c0b52ec44e74a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a093d0bf43046aaa845f3cc115f3f5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116156) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:10:39.478895 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: INFO nova.api.openstack.requestlog [None req-d668de09-31dc-4f22-b7dd-fcf9aa8c9779 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] 10.222.0.18 "GET /compute/v2.1/servers/fa7c86bc-c46f-4120-8f3d-d795f8d7c5cc" status: 200 len: 1570 microversion: 2.1 time: 0.151378 Dec 15 03:10:39.479449 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: [pid: 116156|app: 0|req: 519/1039] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 03:10:39 2021] GET /compute/v2.1/servers/fa7c86bc-c46f-4120-8f3d-d795f8d7c5cc => generated 1570 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 03:10:40.368360 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi [None req-629ef4dd-a84f-4d56-a3d9-2622b0120f80 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Calling method '>' {{(pid=116157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:10:40.368956 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.compute.api [None req-629ef4dd-a84f-4d56-a3d9-2622b0120f80 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] [instance: bbb8462c-9501-4541-b67e-43ec5c5061a7] Fetching instance by UUID {{(pid=116157) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:10:40.375120 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-629ef4dd-a84f-4d56-a3d9-2622b0120f80 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:10:40.375568 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-629ef4dd-a84f-4d56-a3d9-2622b0120f80 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:10:40.376337 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-629ef4dd-a84f-4d56-a3d9-2622b0120f80 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:10:40.376769 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-629ef4dd-a84f-4d56-a3d9-2622b0120f80 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:10:40.404657 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi [None req-46ff821b-709d-4a1f-91de-7289fc527c9e tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Calling method '>' {{(pid=116156) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:10:40.405563 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.compute.api [None req-46ff821b-709d-4a1f-91de-7289fc527c9e tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] [instance: b89094ac-aee1-4bd6-a33d-8c4347cebfc7] Fetching instance by UUID {{(pid=116156) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:10:40.411358 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-46ff821b-709d-4a1f-91de-7289fc527c9e tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:10:40.411813 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-46ff821b-709d-4a1f-91de-7289fc527c9e tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:10:40.412606 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-46ff821b-709d-4a1f-91de-7289fc527c9e tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:10:40.413042 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-46ff821b-709d-4a1f-91de-7289fc527c9e tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:10:40.437577 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.policy [None req-629ef4dd-a84f-4d56-a3d9-2622b0120f80 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97bdf19af9e34fc3886ff451cb9d7a27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '494b56bf5eae4d56a5591546f85bc32b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116157) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:10:40.443374 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: INFO nova.api.openstack.requestlog [None req-46ff821b-709d-4a1f-91de-7289fc527c9e tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] 10.222.0.18 "GET /compute/v2.1/servers/b89094ac-aee1-4bd6-a33d-8c4347cebfc7/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042619 Dec 15 03:10:40.443944 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: [pid: 116156|app: 0|req: 520/1040] 10.222.0.18 () {60 vars in 1342 bytes} [Wed Dec 15 03:10:40 2021] GET /compute/v2.1/servers/b89094ac-aee1-4bd6-a33d-8c4347cebfc7/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Dec 15 03:10:40.444986 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: INFO nova.api.openstack.requestlog [None req-629ef4dd-a84f-4d56-a3d9-2622b0120f80 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] 10.222.0.18 "GET /compute/v2.1/servers/bbb8462c-9501-4541-b67e-43ec5c5061a7" status: 200 len: 1226 microversion: 2.1 time: 0.081027 Dec 15 03:10:40.446207 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: [pid: 116157|app: 0|req: 521/1041] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 03:10:40 2021] GET /compute/v2.1/servers/bbb8462c-9501-4541-b67e-43ec5c5061a7 => generated 1226 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 03:10:40.496123 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi [None req-4fc683f2-adab-413e-aef8-b19ae06e560f tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Calling method '>' {{(pid=116156) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:10:40.496698 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.compute.api [None req-4fc683f2-adab-413e-aef8-b19ae06e560f tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] [instance: fa7c86bc-c46f-4120-8f3d-d795f8d7c5cc] Fetching instance by UUID {{(pid=116156) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:10:40.502383 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-4fc683f2-adab-413e-aef8-b19ae06e560f tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:10:40.502839 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-4fc683f2-adab-413e-aef8-b19ae06e560f tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:10:40.503616 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-4fc683f2-adab-413e-aef8-b19ae06e560f tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:10:40.504055 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-4fc683f2-adab-413e-aef8-b19ae06e560f tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:10:40.632135 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.policy [None req-4fc683f2-adab-413e-aef8-b19ae06e560f tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c4c0c82448e40ba801c0b52ec44e74a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a093d0bf43046aaa845f3cc115f3f5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116156) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:10:40.639556 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: INFO nova.api.openstack.requestlog [None req-4fc683f2-adab-413e-aef8-b19ae06e560f tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] 10.222.0.18 "GET /compute/v2.1/servers/fa7c86bc-c46f-4120-8f3d-d795f8d7c5cc" status: 200 len: 1570 microversion: 2.1 time: 0.147335 Dec 15 03:10:40.640128 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: [pid: 116156|app: 0|req: 521/1042] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 03:10:40 2021] GET /compute/v2.1/servers/fa7c86bc-c46f-4120-8f3d-d795f8d7c5cc => generated 1570 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 03:10:41.455833 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi [None req-53eea206-7cd9-4fe0-b6ff-96eb40423071 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Calling method '>' {{(pid=116157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:10:41.456762 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.compute.api [None req-53eea206-7cd9-4fe0-b6ff-96eb40423071 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] [instance: b89094ac-aee1-4bd6-a33d-8c4347cebfc7] Fetching instance by UUID {{(pid=116157) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:10:41.462467 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi [None req-ffff3053-9d88-453f-8023-2b7694dbf3f6 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Calling method '>' {{(pid=116156) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:10:41.463078 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.compute.api [None req-ffff3053-9d88-453f-8023-2b7694dbf3f6 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] [instance: bbb8462c-9501-4541-b67e-43ec5c5061a7] Fetching instance by UUID {{(pid=116156) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:10:41.463586 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-53eea206-7cd9-4fe0-b6ff-96eb40423071 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:10:41.464030 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-53eea206-7cd9-4fe0-b6ff-96eb40423071 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:10:41.464804 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-53eea206-7cd9-4fe0-b6ff-96eb40423071 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:10:41.465231 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-53eea206-7cd9-4fe0-b6ff-96eb40423071 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:10:41.469166 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-ffff3053-9d88-453f-8023-2b7694dbf3f6 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:10:41.469617 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-ffff3053-9d88-453f-8023-2b7694dbf3f6 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:10:41.470426 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-ffff3053-9d88-453f-8023-2b7694dbf3f6 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:10:41.470862 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-ffff3053-9d88-453f-8023-2b7694dbf3f6 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:10:41.493963 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: INFO nova.api.openstack.requestlog [None req-53eea206-7cd9-4fe0-b6ff-96eb40423071 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] 10.222.0.18 "GET /compute/v2.1/servers/b89094ac-aee1-4bd6-a33d-8c4347cebfc7/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041965 Dec 15 03:10:41.494566 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: [pid: 116157|app: 0|req: 522/1043] 10.222.0.18 () {60 vars in 1342 bytes} [Wed Dec 15 03:10:41 2021] GET /compute/v2.1/servers/b89094ac-aee1-4bd6-a33d-8c4347cebfc7/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 03:10:41.528474 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.policy [None req-ffff3053-9d88-453f-8023-2b7694dbf3f6 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97bdf19af9e34fc3886ff451cb9d7a27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '494b56bf5eae4d56a5591546f85bc32b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116156) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:10:41.535695 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: INFO nova.api.openstack.requestlog [None req-ffff3053-9d88-453f-8023-2b7694dbf3f6 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] 10.222.0.18 "GET /compute/v2.1/servers/bbb8462c-9501-4541-b67e-43ec5c5061a7" status: 200 len: 1226 microversion: 2.1 time: 0.077426 Dec 15 03:10:41.536258 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: [pid: 116156|app: 0|req: 522/1044] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 03:10:41 2021] GET /compute/v2.1/servers/bbb8462c-9501-4541-b67e-43ec5c5061a7 => generated 1226 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 03:10:41.656193 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi [None req-d8736fbc-0eb9-4ee8-a487-463223b53f6f tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Calling method '>' {{(pid=116157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:10:41.656796 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.compute.api [None req-d8736fbc-0eb9-4ee8-a487-463223b53f6f tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] [instance: fa7c86bc-c46f-4120-8f3d-d795f8d7c5cc] Fetching instance by UUID {{(pid=116157) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:10:41.662725 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-d8736fbc-0eb9-4ee8-a487-463223b53f6f tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:10:41.663175 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-d8736fbc-0eb9-4ee8-a487-463223b53f6f tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:10:41.663950 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-d8736fbc-0eb9-4ee8-a487-463223b53f6f tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:10:41.664386 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-d8736fbc-0eb9-4ee8-a487-463223b53f6f tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:10:41.792081 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.policy [None req-d8736fbc-0eb9-4ee8-a487-463223b53f6f tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c4c0c82448e40ba801c0b52ec44e74a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a093d0bf43046aaa845f3cc115f3f5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116157) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:10:41.799211 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: INFO nova.api.openstack.requestlog [None req-d8736fbc-0eb9-4ee8-a487-463223b53f6f tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] 10.222.0.18 "GET /compute/v2.1/servers/fa7c86bc-c46f-4120-8f3d-d795f8d7c5cc" status: 200 len: 1570 microversion: 2.1 time: 0.146612 Dec 15 03:10:41.799771 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: [pid: 116157|app: 0|req: 523/1045] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 03:10:41 2021] GET /compute/v2.1/servers/fa7c86bc-c46f-4120-8f3d-d795f8d7c5cc => generated 1570 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 03:10:42.505485 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi [None req-06c2ecaf-44de-48ad-a88d-5fd2e7deabc0 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Calling method '>' {{(pid=116156) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:10:42.506339 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.compute.api [None req-06c2ecaf-44de-48ad-a88d-5fd2e7deabc0 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] [instance: b89094ac-aee1-4bd6-a33d-8c4347cebfc7] Fetching instance by UUID {{(pid=116156) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:10:42.512563 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-06c2ecaf-44de-48ad-a88d-5fd2e7deabc0 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:10:42.513016 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-06c2ecaf-44de-48ad-a88d-5fd2e7deabc0 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:10:42.513795 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-06c2ecaf-44de-48ad-a88d-5fd2e7deabc0 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:10:42.514266 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-06c2ecaf-44de-48ad-a88d-5fd2e7deabc0 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:10:42.543017 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: INFO nova.api.openstack.requestlog [None req-06c2ecaf-44de-48ad-a88d-5fd2e7deabc0 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] 10.222.0.18 "GET /compute/v2.1/servers/b89094ac-aee1-4bd6-a33d-8c4347cebfc7/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041377 Dec 15 03:10:42.543563 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: [pid: 116156|app: 0|req: 523/1046] 10.222.0.18 () {60 vars in 1342 bytes} [Wed Dec 15 03:10:42 2021] GET /compute/v2.1/servers/b89094ac-aee1-4bd6-a33d-8c4347cebfc7/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 03:10:42.551666 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi [None req-1679b7be-89ce-472f-a33e-1e85c858a7c2 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Calling method '>' {{(pid=116157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:10:42.552301 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.compute.api [None req-1679b7be-89ce-472f-a33e-1e85c858a7c2 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] [instance: bbb8462c-9501-4541-b67e-43ec5c5061a7] Fetching instance by UUID {{(pid=116157) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:10:42.558455 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-1679b7be-89ce-472f-a33e-1e85c858a7c2 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:10:42.558897 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-1679b7be-89ce-472f-a33e-1e85c858a7c2 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:10:42.559664 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-1679b7be-89ce-472f-a33e-1e85c858a7c2 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:10:42.560097 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-1679b7be-89ce-472f-a33e-1e85c858a7c2 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:10:42.617693 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.policy [None req-1679b7be-89ce-472f-a33e-1e85c858a7c2 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97bdf19af9e34fc3886ff451cb9d7a27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '494b56bf5eae4d56a5591546f85bc32b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116157) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:10:42.624848 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: INFO nova.api.openstack.requestlog [None req-1679b7be-89ce-472f-a33e-1e85c858a7c2 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] 10.222.0.18 "GET /compute/v2.1/servers/bbb8462c-9501-4541-b67e-43ec5c5061a7" status: 200 len: 1226 microversion: 2.1 time: 0.076719 Dec 15 03:10:42.625403 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: [pid: 116157|app: 0|req: 524/1047] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 03:10:42 2021] GET /compute/v2.1/servers/bbb8462c-9501-4541-b67e-43ec5c5061a7 => generated 1226 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 03:10:42.816400 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi [None req-9b27fb4c-0dac-4ad6-92be-d101174aeb4a tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Calling method '>' {{(pid=116156) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:10:42.817009 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.compute.api [None req-9b27fb4c-0dac-4ad6-92be-d101174aeb4a tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] [instance: fa7c86bc-c46f-4120-8f3d-d795f8d7c5cc] Fetching instance by UUID {{(pid=116156) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:10:42.823216 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-9b27fb4c-0dac-4ad6-92be-d101174aeb4a tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:10:42.823663 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-9b27fb4c-0dac-4ad6-92be-d101174aeb4a tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:10:42.824427 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-9b27fb4c-0dac-4ad6-92be-d101174aeb4a tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:10:42.824858 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-9b27fb4c-0dac-4ad6-92be-d101174aeb4a tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:10:42.954973 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.policy [None req-9b27fb4c-0dac-4ad6-92be-d101174aeb4a tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c4c0c82448e40ba801c0b52ec44e74a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a093d0bf43046aaa845f3cc115f3f5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116156) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:10:42.962750 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: INFO nova.api.openstack.requestlog [None req-9b27fb4c-0dac-4ad6-92be-d101174aeb4a tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] 10.222.0.18 "GET /compute/v2.1/servers/fa7c86bc-c46f-4120-8f3d-d795f8d7c5cc" status: 200 len: 1570 microversion: 2.1 time: 0.149954 Dec 15 03:10:42.963315 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: [pid: 116156|app: 0|req: 524/1048] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 03:10:42 2021] GET /compute/v2.1/servers/fa7c86bc-c46f-4120-8f3d-d795f8d7c5cc => generated 1570 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 03:10:43.555244 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi [None req-1160c9a4-9af9-437f-ad04-bbb91b965f7f tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Calling method '>' {{(pid=116157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:10:43.556141 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.compute.api [None req-1160c9a4-9af9-437f-ad04-bbb91b965f7f tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] [instance: b89094ac-aee1-4bd6-a33d-8c4347cebfc7] Fetching instance by UUID {{(pid=116157) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:10:43.562442 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-1160c9a4-9af9-437f-ad04-bbb91b965f7f tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:10:43.562885 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-1160c9a4-9af9-437f-ad04-bbb91b965f7f tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:10:43.563653 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-1160c9a4-9af9-437f-ad04-bbb91b965f7f tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:10:43.564082 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-1160c9a4-9af9-437f-ad04-bbb91b965f7f tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:10:43.592003 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: INFO nova.api.openstack.requestlog [None req-1160c9a4-9af9-437f-ad04-bbb91b965f7f tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] 10.222.0.18 "GET /compute/v2.1/servers/b89094ac-aee1-4bd6-a33d-8c4347cebfc7/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041140 Dec 15 03:10:43.592528 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: [pid: 116157|app: 0|req: 525/1049] 10.222.0.18 () {60 vars in 1342 bytes} [Wed Dec 15 03:10:43 2021] GET /compute/v2.1/servers/b89094ac-aee1-4bd6-a33d-8c4347cebfc7/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 03:10:43.641331 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi [None req-287fba06-6e1e-49a3-af6c-0b2ee06f1209 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Calling method '>' {{(pid=116156) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:10:43.641943 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.compute.api [None req-287fba06-6e1e-49a3-af6c-0b2ee06f1209 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] [instance: bbb8462c-9501-4541-b67e-43ec5c5061a7] Fetching instance by UUID {{(pid=116156) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:10:43.648143 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-287fba06-6e1e-49a3-af6c-0b2ee06f1209 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:10:43.648600 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-287fba06-6e1e-49a3-af6c-0b2ee06f1209 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:10:43.649377 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-287fba06-6e1e-49a3-af6c-0b2ee06f1209 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:10:43.649816 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-287fba06-6e1e-49a3-af6c-0b2ee06f1209 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:10:43.706899 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.policy [None req-287fba06-6e1e-49a3-af6c-0b2ee06f1209 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97bdf19af9e34fc3886ff451cb9d7a27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '494b56bf5eae4d56a5591546f85bc32b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116156) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:10:43.714409 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: INFO nova.api.openstack.requestlog [None req-287fba06-6e1e-49a3-af6c-0b2ee06f1209 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] 10.222.0.18 "GET /compute/v2.1/servers/bbb8462c-9501-4541-b67e-43ec5c5061a7" status: 200 len: 1226 microversion: 2.1 time: 0.076647 Dec 15 03:10:43.714968 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: [pid: 116156|app: 0|req: 525/1050] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 03:10:43 2021] GET /compute/v2.1/servers/bbb8462c-9501-4541-b67e-43ec5c5061a7 => generated 1226 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 03:10:43.980291 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi [None req-a0ab2851-a794-4ba9-a2f9-ad55fb970d6a tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Calling method '>' {{(pid=116157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:10:43.980815 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.compute.api [None req-a0ab2851-a794-4ba9-a2f9-ad55fb970d6a tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] [instance: fa7c86bc-c46f-4120-8f3d-d795f8d7c5cc] Fetching instance by UUID {{(pid=116157) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:10:43.986557 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-a0ab2851-a794-4ba9-a2f9-ad55fb970d6a tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:10:43.987004 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-a0ab2851-a794-4ba9-a2f9-ad55fb970d6a tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:10:43.987782 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-a0ab2851-a794-4ba9-a2f9-ad55fb970d6a tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:10:43.988215 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-a0ab2851-a794-4ba9-a2f9-ad55fb970d6a tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:10:44.117829 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.policy [None req-a0ab2851-a794-4ba9-a2f9-ad55fb970d6a tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c4c0c82448e40ba801c0b52ec44e74a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a093d0bf43046aaa845f3cc115f3f5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116157) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:10:44.125015 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: INFO nova.api.openstack.requestlog [None req-a0ab2851-a794-4ba9-a2f9-ad55fb970d6a tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] 10.222.0.18 "GET /compute/v2.1/servers/fa7c86bc-c46f-4120-8f3d-d795f8d7c5cc" status: 200 len: 1570 microversion: 2.1 time: 0.149078 Dec 15 03:10:44.125573 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: [pid: 116157|app: 0|req: 526/1051] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 03:10:43 2021] GET /compute/v2.1/servers/fa7c86bc-c46f-4120-8f3d-d795f8d7c5cc => generated 1570 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 03:10:44.602823 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi [None req-60a18d98-3920-4f78-a443-6c1dd8fc081e tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Calling method '>' {{(pid=116156) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:10:44.603714 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.compute.api [None req-60a18d98-3920-4f78-a443-6c1dd8fc081e tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] [instance: b89094ac-aee1-4bd6-a33d-8c4347cebfc7] Fetching instance by UUID {{(pid=116156) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:10:44.609547 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-60a18d98-3920-4f78-a443-6c1dd8fc081e tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:10:44.610019 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-60a18d98-3920-4f78-a443-6c1dd8fc081e tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:10:44.610790 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-60a18d98-3920-4f78-a443-6c1dd8fc081e tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:10:44.611220 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-60a18d98-3920-4f78-a443-6c1dd8fc081e tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:10:44.639377 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: INFO nova.api.openstack.requestlog [None req-60a18d98-3920-4f78-a443-6c1dd8fc081e tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] 10.222.0.18 "GET /compute/v2.1/servers/b89094ac-aee1-4bd6-a33d-8c4347cebfc7/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.040330 Dec 15 03:10:44.639907 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: [pid: 116156|app: 0|req: 526/1052] 10.222.0.18 () {60 vars in 1342 bytes} [Wed Dec 15 03:10:44 2021] GET /compute/v2.1/servers/b89094ac-aee1-4bd6-a33d-8c4347cebfc7/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 03:10:44.730981 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi [None req-0f88ffea-6d7b-4a99-bcd6-5994dac10afd tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Calling method '>' {{(pid=116157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:10:44.731593 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.compute.api [None req-0f88ffea-6d7b-4a99-bcd6-5994dac10afd tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] [instance: bbb8462c-9501-4541-b67e-43ec5c5061a7] Fetching instance by UUID {{(pid=116157) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:10:44.737858 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-0f88ffea-6d7b-4a99-bcd6-5994dac10afd tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:10:44.738343 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-0f88ffea-6d7b-4a99-bcd6-5994dac10afd tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:10:44.739122 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-0f88ffea-6d7b-4a99-bcd6-5994dac10afd tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:10:44.739825 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-0f88ffea-6d7b-4a99-bcd6-5994dac10afd tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:10:44.796838 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.policy [None req-0f88ffea-6d7b-4a99-bcd6-5994dac10afd tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97bdf19af9e34fc3886ff451cb9d7a27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '494b56bf5eae4d56a5591546f85bc32b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116157) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:10:44.803902 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: INFO nova.api.openstack.requestlog [None req-0f88ffea-6d7b-4a99-bcd6-5994dac10afd tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] 10.222.0.18 "GET /compute/v2.1/servers/bbb8462c-9501-4541-b67e-43ec5c5061a7" status: 200 len: 1226 microversion: 2.1 time: 0.076529 Dec 15 03:10:44.804465 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: [pid: 116157|app: 0|req: 527/1053] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 03:10:44 2021] GET /compute/v2.1/servers/bbb8462c-9501-4541-b67e-43ec5c5061a7 => generated 1226 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 03:10:45.141611 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi [None req-5179e2a3-fcdd-4cb7-9c0d-ef4c292daebe tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Calling method '>' {{(pid=116156) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:10:45.142243 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.compute.api [None req-5179e2a3-fcdd-4cb7-9c0d-ef4c292daebe tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] [instance: fa7c86bc-c46f-4120-8f3d-d795f8d7c5cc] Fetching instance by UUID {{(pid=116156) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:10:45.148406 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-5179e2a3-fcdd-4cb7-9c0d-ef4c292daebe tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:10:45.148852 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-5179e2a3-fcdd-4cb7-9c0d-ef4c292daebe tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:10:45.149619 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-5179e2a3-fcdd-4cb7-9c0d-ef4c292daebe tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:10:45.150081 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-5179e2a3-fcdd-4cb7-9c0d-ef4c292daebe tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:10:45.279248 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.policy [None req-5179e2a3-fcdd-4cb7-9c0d-ef4c292daebe tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c4c0c82448e40ba801c0b52ec44e74a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a093d0bf43046aaa845f3cc115f3f5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116156) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:10:45.286577 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: INFO nova.api.openstack.requestlog [None req-5179e2a3-fcdd-4cb7-9c0d-ef4c292daebe tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] 10.222.0.18 "GET /compute/v2.1/servers/fa7c86bc-c46f-4120-8f3d-d795f8d7c5cc" status: 200 len: 1570 microversion: 2.1 time: 0.148556 Dec 15 03:10:45.287155 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: [pid: 116156|app: 0|req: 527/1054] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 03:10:45 2021] GET /compute/v2.1/servers/fa7c86bc-c46f-4120-8f3d-d795f8d7c5cc => generated 1570 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 03:10:45.651188 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi [None req-c01fe557-f315-4803-bcd6-c0f3c3fd7007 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Calling method '>' {{(pid=116157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:10:45.652089 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.compute.api [None req-c01fe557-f315-4803-bcd6-c0f3c3fd7007 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] [instance: b89094ac-aee1-4bd6-a33d-8c4347cebfc7] Fetching instance by UUID {{(pid=116157) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:10:45.657903 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-c01fe557-f315-4803-bcd6-c0f3c3fd7007 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:10:45.658386 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-c01fe557-f315-4803-bcd6-c0f3c3fd7007 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:10:45.659157 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-c01fe557-f315-4803-bcd6-c0f3c3fd7007 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:10:45.659593 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-c01fe557-f315-4803-bcd6-c0f3c3fd7007 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:10:45.687889 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: INFO nova.api.openstack.requestlog [None req-c01fe557-f315-4803-bcd6-c0f3c3fd7007 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] 10.222.0.18 "GET /compute/v2.1/servers/b89094ac-aee1-4bd6-a33d-8c4347cebfc7/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.040974 Dec 15 03:10:45.688430 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: [pid: 116157|app: 0|req: 528/1055] 10.222.0.18 () {60 vars in 1342 bytes} [Wed Dec 15 03:10:45 2021] GET /compute/v2.1/servers/b89094ac-aee1-4bd6-a33d-8c4347cebfc7/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 03:10:45.820857 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi [None req-638c430e-2b46-4b02-b4de-4010011da1e6 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Calling method '>' {{(pid=116156) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:10:45.821954 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.compute.api [None req-638c430e-2b46-4b02-b4de-4010011da1e6 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] [instance: bbb8462c-9501-4541-b67e-43ec5c5061a7] Fetching instance by UUID {{(pid=116156) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:10:45.827868 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-638c430e-2b46-4b02-b4de-4010011da1e6 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:10:45.828316 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-638c430e-2b46-4b02-b4de-4010011da1e6 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:10:45.829087 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-638c430e-2b46-4b02-b4de-4010011da1e6 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:10:45.829525 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-638c430e-2b46-4b02-b4de-4010011da1e6 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:10:45.887180 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.policy [None req-638c430e-2b46-4b02-b4de-4010011da1e6 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97bdf19af9e34fc3886ff451cb9d7a27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '494b56bf5eae4d56a5591546f85bc32b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116156) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:10:45.894407 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: INFO nova.api.openstack.requestlog [None req-638c430e-2b46-4b02-b4de-4010011da1e6 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] 10.222.0.18 "GET /compute/v2.1/servers/bbb8462c-9501-4541-b67e-43ec5c5061a7" status: 200 len: 1226 microversion: 2.1 time: 0.077155 Dec 15 03:10:45.894964 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: [pid: 116156|app: 0|req: 528/1056] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 03:10:45 2021] GET /compute/v2.1/servers/bbb8462c-9501-4541-b67e-43ec5c5061a7 => generated 1226 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 03:10:46.304091 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi [None req-876013dc-d463-406e-b8b6-0f92667d7e6a tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Calling method '>' {{(pid=116157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:10:46.304750 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.compute.api [None req-876013dc-d463-406e-b8b6-0f92667d7e6a tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] [instance: fa7c86bc-c46f-4120-8f3d-d795f8d7c5cc] Fetching instance by UUID {{(pid=116157) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:10:46.311616 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-876013dc-d463-406e-b8b6-0f92667d7e6a tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:10:46.312070 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-876013dc-d463-406e-b8b6-0f92667d7e6a tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:10:46.312851 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-876013dc-d463-406e-b8b6-0f92667d7e6a tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:10:46.313293 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-876013dc-d463-406e-b8b6-0f92667d7e6a tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:10:46.439384 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.policy [None req-876013dc-d463-406e-b8b6-0f92667d7e6a tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c4c0c82448e40ba801c0b52ec44e74a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a093d0bf43046aaa845f3cc115f3f5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116157) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:10:46.447287 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: INFO nova.api.openstack.requestlog [None req-876013dc-d463-406e-b8b6-0f92667d7e6a tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] 10.222.0.18 "GET /compute/v2.1/servers/fa7c86bc-c46f-4120-8f3d-d795f8d7c5cc" status: 200 len: 1570 microversion: 2.1 time: 0.146931 Dec 15 03:10:46.447849 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: [pid: 116157|app: 0|req: 529/1057] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 03:10:46 2021] GET /compute/v2.1/servers/fa7c86bc-c46f-4120-8f3d-d795f8d7c5cc => generated 1570 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 03:10:46.699299 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi [None req-e7230d25-16b9-4d23-81e8-c97de22f7998 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Calling method '>' {{(pid=116156) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:10:46.700196 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.compute.api [None req-e7230d25-16b9-4d23-81e8-c97de22f7998 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] [instance: b89094ac-aee1-4bd6-a33d-8c4347cebfc7] Fetching instance by UUID {{(pid=116156) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:10:46.706365 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-e7230d25-16b9-4d23-81e8-c97de22f7998 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:10:46.706813 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-e7230d25-16b9-4d23-81e8-c97de22f7998 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:10:46.707581 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-e7230d25-16b9-4d23-81e8-c97de22f7998 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:10:46.708010 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-e7230d25-16b9-4d23-81e8-c97de22f7998 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:10:46.736386 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: INFO nova.api.openstack.requestlog [None req-e7230d25-16b9-4d23-81e8-c97de22f7998 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] 10.222.0.18 "GET /compute/v2.1/servers/b89094ac-aee1-4bd6-a33d-8c4347cebfc7/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.040938 Dec 15 03:10:46.736932 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: [pid: 116156|app: 0|req: 529/1058] 10.222.0.18 () {60 vars in 1342 bytes} [Wed Dec 15 03:10:46 2021] GET /compute/v2.1/servers/b89094ac-aee1-4bd6-a33d-8c4347cebfc7/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 03:10:46.911359 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi [None req-53a5d4d2-cc44-4905-9c53-976d391a2a0a tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Calling method '>' {{(pid=116157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:10:46.911961 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.compute.api [None req-53a5d4d2-cc44-4905-9c53-976d391a2a0a tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] [instance: bbb8462c-9501-4541-b67e-43ec5c5061a7] Fetching instance by UUID {{(pid=116157) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:10:46.918516 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-53a5d4d2-cc44-4905-9c53-976d391a2a0a tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:10:46.918977 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-53a5d4d2-cc44-4905-9c53-976d391a2a0a tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:10:46.919771 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-53a5d4d2-cc44-4905-9c53-976d391a2a0a tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:10:46.920245 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-53a5d4d2-cc44-4905-9c53-976d391a2a0a tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:10:46.976601 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.policy [None req-53a5d4d2-cc44-4905-9c53-976d391a2a0a tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97bdf19af9e34fc3886ff451cb9d7a27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '494b56bf5eae4d56a5591546f85bc32b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116157) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:10:46.984506 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: INFO nova.api.openstack.requestlog [None req-53a5d4d2-cc44-4905-9c53-976d391a2a0a tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] 10.222.0.18 "GET /compute/v2.1/servers/bbb8462c-9501-4541-b67e-43ec5c5061a7" status: 200 len: 1226 microversion: 2.1 time: 0.076776 Dec 15 03:10:46.985069 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: [pid: 116157|app: 0|req: 530/1059] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 03:10:46 2021] GET /compute/v2.1/servers/bbb8462c-9501-4541-b67e-43ec5c5061a7 => generated 1226 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 03:10:47.464668 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi [None req-47d519ed-bcbd-485d-be7f-93d261546365 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Calling method '>' {{(pid=116156) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:10:47.465308 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.compute.api [None req-47d519ed-bcbd-485d-be7f-93d261546365 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] [instance: fa7c86bc-c46f-4120-8f3d-d795f8d7c5cc] Fetching instance by UUID {{(pid=116156) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:10:47.471156 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-47d519ed-bcbd-485d-be7f-93d261546365 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:10:47.471607 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-47d519ed-bcbd-485d-be7f-93d261546365 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:10:47.472390 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-47d519ed-bcbd-485d-be7f-93d261546365 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:10:47.472828 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-47d519ed-bcbd-485d-be7f-93d261546365 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:10:47.603005 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.policy [None req-47d519ed-bcbd-485d-be7f-93d261546365 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c4c0c82448e40ba801c0b52ec44e74a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a093d0bf43046aaa845f3cc115f3f5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116156) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:10:47.610286 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: INFO nova.api.openstack.requestlog [None req-47d519ed-bcbd-485d-be7f-93d261546365 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] 10.222.0.18 "GET /compute/v2.1/servers/fa7c86bc-c46f-4120-8f3d-d795f8d7c5cc" status: 200 len: 1570 microversion: 2.1 time: 0.149839 Dec 15 03:10:47.610849 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: [pid: 116156|app: 0|req: 530/1060] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 03:10:47 2021] GET /compute/v2.1/servers/fa7c86bc-c46f-4120-8f3d-d795f8d7c5cc => generated 1570 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 03:10:47.748626 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi [None req-5a75674a-7e69-4aa4-89e0-5d8b733ea888 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Calling method '>' {{(pid=116157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:10:47.749461 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.compute.api [None req-5a75674a-7e69-4aa4-89e0-5d8b733ea888 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] [instance: b89094ac-aee1-4bd6-a33d-8c4347cebfc7] Fetching instance by UUID {{(pid=116157) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:10:47.755732 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-5a75674a-7e69-4aa4-89e0-5d8b733ea888 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:10:47.756180 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-5a75674a-7e69-4aa4-89e0-5d8b733ea888 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:10:47.756962 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-5a75674a-7e69-4aa4-89e0-5d8b733ea888 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:10:47.757400 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-5a75674a-7e69-4aa4-89e0-5d8b733ea888 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:10:47.785669 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: INFO nova.api.openstack.requestlog [None req-5a75674a-7e69-4aa4-89e0-5d8b733ea888 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] 10.222.0.18 "GET /compute/v2.1/servers/b89094ac-aee1-4bd6-a33d-8c4347cebfc7/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.040890 Dec 15 03:10:47.786239 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: [pid: 116157|app: 0|req: 531/1061] 10.222.0.18 () {60 vars in 1342 bytes} [Wed Dec 15 03:10:47 2021] GET /compute/v2.1/servers/b89094ac-aee1-4bd6-a33d-8c4347cebfc7/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 03:10:48.001239 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi [None req-0dd94340-6b25-43dd-be95-478c81c4737d tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Calling method '>' {{(pid=116156) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:10:48.001778 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.compute.api [None req-0dd94340-6b25-43dd-be95-478c81c4737d tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] [instance: bbb8462c-9501-4541-b67e-43ec5c5061a7] Fetching instance by UUID {{(pid=116156) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:10:48.007921 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-0dd94340-6b25-43dd-be95-478c81c4737d tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:10:48.008370 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-0dd94340-6b25-43dd-be95-478c81c4737d tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:10:48.009730 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-0dd94340-6b25-43dd-be95-478c81c4737d tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:10:48.010191 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-0dd94340-6b25-43dd-be95-478c81c4737d tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:10:48.068745 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.policy [None req-0dd94340-6b25-43dd-be95-478c81c4737d tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97bdf19af9e34fc3886ff451cb9d7a27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '494b56bf5eae4d56a5591546f85bc32b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116156) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:10:48.076023 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: INFO nova.api.openstack.requestlog [None req-0dd94340-6b25-43dd-be95-478c81c4737d tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] 10.222.0.18 "GET /compute/v2.1/servers/bbb8462c-9501-4541-b67e-43ec5c5061a7" status: 200 len: 1226 microversion: 2.1 time: 0.078442 Dec 15 03:10:48.076576 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: [pid: 116156|app: 0|req: 531/1062] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 03:10:47 2021] GET /compute/v2.1/servers/bbb8462c-9501-4541-b67e-43ec5c5061a7 => generated 1226 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 03:10:48.627294 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi [None req-ca79a5c9-f128-4b02-8a8c-ab3a3800b595 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Calling method '>' {{(pid=116157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:10:48.627901 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.compute.api [None req-ca79a5c9-f128-4b02-8a8c-ab3a3800b595 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] [instance: fa7c86bc-c46f-4120-8f3d-d795f8d7c5cc] Fetching instance by UUID {{(pid=116157) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:10:48.633715 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-ca79a5c9-f128-4b02-8a8c-ab3a3800b595 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:10:48.634207 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-ca79a5c9-f128-4b02-8a8c-ab3a3800b595 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:10:48.634979 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-ca79a5c9-f128-4b02-8a8c-ab3a3800b595 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:10:48.635415 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-ca79a5c9-f128-4b02-8a8c-ab3a3800b595 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:10:48.769023 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.policy [None req-ca79a5c9-f128-4b02-8a8c-ab3a3800b595 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c4c0c82448e40ba801c0b52ec44e74a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a093d0bf43046aaa845f3cc115f3f5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116157) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:10:48.776855 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: INFO nova.api.openstack.requestlog [None req-ca79a5c9-f128-4b02-8a8c-ab3a3800b595 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] 10.222.0.18 "GET /compute/v2.1/servers/fa7c86bc-c46f-4120-8f3d-d795f8d7c5cc" status: 200 len: 1570 microversion: 2.1 time: 0.153176 Dec 15 03:10:48.777417 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: [pid: 116157|app: 0|req: 532/1063] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 03:10:48 2021] GET /compute/v2.1/servers/fa7c86bc-c46f-4120-8f3d-d795f8d7c5cc => generated 1570 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 03:10:48.796672 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi [None req-0904fb39-a06e-4e25-ad2a-18ac709e5ccb tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Calling method '>' {{(pid=116156) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:10:48.797576 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.compute.api [None req-0904fb39-a06e-4e25-ad2a-18ac709e5ccb tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] [instance: b89094ac-aee1-4bd6-a33d-8c4347cebfc7] Fetching instance by UUID {{(pid=116156) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:10:48.803436 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-0904fb39-a06e-4e25-ad2a-18ac709e5ccb tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:10:48.803893 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-0904fb39-a06e-4e25-ad2a-18ac709e5ccb tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:10:48.804675 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-0904fb39-a06e-4e25-ad2a-18ac709e5ccb tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:10:48.805118 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-0904fb39-a06e-4e25-ad2a-18ac709e5ccb tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:10:48.833618 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: INFO nova.api.openstack.requestlog [None req-0904fb39-a06e-4e25-ad2a-18ac709e5ccb tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] 10.222.0.18 "GET /compute/v2.1/servers/b89094ac-aee1-4bd6-a33d-8c4347cebfc7/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.040638 Dec 15 03:10:48.834207 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: [pid: 116156|app: 0|req: 532/1064] 10.222.0.18 () {60 vars in 1342 bytes} [Wed Dec 15 03:10:48 2021] GET /compute/v2.1/servers/b89094ac-aee1-4bd6-a33d-8c4347cebfc7/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 03:10:49.092872 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi [None req-a5135d36-28aa-40cf-afa3-34b59181ae06 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Calling method '>' {{(pid=116157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:10:49.093482 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.compute.api [None req-a5135d36-28aa-40cf-afa3-34b59181ae06 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] [instance: bbb8462c-9501-4541-b67e-43ec5c5061a7] Fetching instance by UUID {{(pid=116157) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:10:49.099315 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-a5135d36-28aa-40cf-afa3-34b59181ae06 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:10:49.099761 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-a5135d36-28aa-40cf-afa3-34b59181ae06 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:10:49.100534 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-a5135d36-28aa-40cf-afa3-34b59181ae06 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:10:49.100974 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-a5135d36-28aa-40cf-afa3-34b59181ae06 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:10:49.158679 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.policy [None req-a5135d36-28aa-40cf-afa3-34b59181ae06 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97bdf19af9e34fc3886ff451cb9d7a27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '494b56bf5eae4d56a5591546f85bc32b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116157) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:10:49.165838 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: INFO nova.api.openstack.requestlog [None req-a5135d36-28aa-40cf-afa3-34b59181ae06 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] 10.222.0.18 "GET /compute/v2.1/servers/bbb8462c-9501-4541-b67e-43ec5c5061a7" status: 200 len: 1226 microversion: 2.1 time: 0.076584 Dec 15 03:10:49.166422 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: [pid: 116157|app: 0|req: 533/1065] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 03:10:49 2021] GET /compute/v2.1/servers/bbb8462c-9501-4541-b67e-43ec5c5061a7 => generated 1226 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 03:10:49.793768 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi [None req-dbd3f534-1b6f-4932-a264-84dc1db3cca2 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Calling method '>' {{(pid=116156) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:10:49.794406 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.compute.api [None req-dbd3f534-1b6f-4932-a264-84dc1db3cca2 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] [instance: fa7c86bc-c46f-4120-8f3d-d795f8d7c5cc] Fetching instance by UUID {{(pid=116156) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:10:49.800608 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-dbd3f534-1b6f-4932-a264-84dc1db3cca2 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:10:49.801060 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-dbd3f534-1b6f-4932-a264-84dc1db3cca2 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:10:49.801835 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-dbd3f534-1b6f-4932-a264-84dc1db3cca2 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:10:49.802298 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-dbd3f534-1b6f-4932-a264-84dc1db3cca2 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:10:49.845731 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi [None req-40600d2a-38db-4ba7-9055-8360a51a6fb1 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Calling method '>' {{(pid=116157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:10:49.846908 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.compute.api [None req-40600d2a-38db-4ba7-9055-8360a51a6fb1 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] [instance: b89094ac-aee1-4bd6-a33d-8c4347cebfc7] Fetching instance by UUID {{(pid=116157) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:10:49.853226 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-40600d2a-38db-4ba7-9055-8360a51a6fb1 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:10:49.853686 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-40600d2a-38db-4ba7-9055-8360a51a6fb1 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:10:49.854575 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-40600d2a-38db-4ba7-9055-8360a51a6fb1 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:10:49.855014 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-40600d2a-38db-4ba7-9055-8360a51a6fb1 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:10:49.884182 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: INFO nova.api.openstack.requestlog [None req-40600d2a-38db-4ba7-9055-8360a51a6fb1 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] 10.222.0.18 "GET /compute/v2.1/servers/b89094ac-aee1-4bd6-a33d-8c4347cebfc7/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041707 Dec 15 03:10:49.884752 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: [pid: 116157|app: 0|req: 534/1066] 10.222.0.18 () {60 vars in 1342 bytes} [Wed Dec 15 03:10:49 2021] GET /compute/v2.1/servers/b89094ac-aee1-4bd6-a33d-8c4347cebfc7/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Dec 15 03:10:49.930674 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.policy [None req-dbd3f534-1b6f-4932-a264-84dc1db3cca2 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c4c0c82448e40ba801c0b52ec44e74a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a093d0bf43046aaa845f3cc115f3f5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116156) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:10:49.937886 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: INFO nova.api.openstack.requestlog [None req-dbd3f534-1b6f-4932-a264-84dc1db3cca2 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] 10.222.0.18 "GET /compute/v2.1/servers/fa7c86bc-c46f-4120-8f3d-d795f8d7c5cc" status: 200 len: 1570 microversion: 2.1 time: 0.147761 Dec 15 03:10:49.938475 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: [pid: 116156|app: 0|req: 533/1067] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 03:10:49 2021] GET /compute/v2.1/servers/fa7c86bc-c46f-4120-8f3d-d795f8d7c5cc => generated 1570 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 03:10:50.182665 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi [None req-f37500db-3225-4acf-9e7f-2144e8cec993 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Calling method '>' {{(pid=116157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:10:50.183278 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.compute.api [None req-f37500db-3225-4acf-9e7f-2144e8cec993 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] [instance: bbb8462c-9501-4541-b67e-43ec5c5061a7] Fetching instance by UUID {{(pid=116157) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:10:50.189205 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-f37500db-3225-4acf-9e7f-2144e8cec993 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:10:50.189660 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-f37500db-3225-4acf-9e7f-2144e8cec993 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:10:50.190473 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-f37500db-3225-4acf-9e7f-2144e8cec993 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:10:50.190938 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-f37500db-3225-4acf-9e7f-2144e8cec993 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:10:50.249072 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.policy [None req-f37500db-3225-4acf-9e7f-2144e8cec993 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97bdf19af9e34fc3886ff451cb9d7a27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '494b56bf5eae4d56a5591546f85bc32b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116157) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:10:50.256249 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: INFO nova.api.openstack.requestlog [None req-f37500db-3225-4acf-9e7f-2144e8cec993 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] 10.222.0.18 "GET /compute/v2.1/servers/bbb8462c-9501-4541-b67e-43ec5c5061a7" status: 200 len: 1226 microversion: 2.1 time: 0.077656 Dec 15 03:10:50.256815 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: [pid: 116157|app: 0|req: 535/1068] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 03:10:50 2021] GET /compute/v2.1/servers/bbb8462c-9501-4541-b67e-43ec5c5061a7 => generated 1226 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 03:10:50.894749 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi [None req-00e9b95b-ed43-4541-9d3f-e5c2b28aac92 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Calling method '>' {{(pid=116156) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:10:50.895652 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.compute.api [None req-00e9b95b-ed43-4541-9d3f-e5c2b28aac92 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] [instance: b89094ac-aee1-4bd6-a33d-8c4347cebfc7] Fetching instance by UUID {{(pid=116156) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:10:50.902448 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-00e9b95b-ed43-4541-9d3f-e5c2b28aac92 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:10:50.902904 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-00e9b95b-ed43-4541-9d3f-e5c2b28aac92 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:10:50.903690 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-00e9b95b-ed43-4541-9d3f-e5c2b28aac92 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:10:50.904130 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-00e9b95b-ed43-4541-9d3f-e5c2b28aac92 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:10:50.932496 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: INFO nova.api.openstack.requestlog [None req-00e9b95b-ed43-4541-9d3f-e5c2b28aac92 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] 10.222.0.18 "GET /compute/v2.1/servers/b89094ac-aee1-4bd6-a33d-8c4347cebfc7/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041521 Dec 15 03:10:50.933037 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: [pid: 116156|app: 0|req: 534/1069] 10.222.0.18 () {60 vars in 1342 bytes} [Wed Dec 15 03:10:50 2021] GET /compute/v2.1/servers/b89094ac-aee1-4bd6-a33d-8c4347cebfc7/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 03:10:50.954255 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi [None req-dc9f1069-e472-4a32-b3c6-85d233b35d56 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Calling method '>' {{(pid=116157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:10:50.954989 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.compute.api [None req-dc9f1069-e472-4a32-b3c6-85d233b35d56 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] [instance: fa7c86bc-c46f-4120-8f3d-d795f8d7c5cc] Fetching instance by UUID {{(pid=116157) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:10:50.961264 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-dc9f1069-e472-4a32-b3c6-85d233b35d56 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:10:50.962243 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-dc9f1069-e472-4a32-b3c6-85d233b35d56 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:10:50.963019 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-dc9f1069-e472-4a32-b3c6-85d233b35d56 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:10:50.963450 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-dc9f1069-e472-4a32-b3c6-85d233b35d56 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:10:51.093198 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.policy [None req-dc9f1069-e472-4a32-b3c6-85d233b35d56 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c4c0c82448e40ba801c0b52ec44e74a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a093d0bf43046aaa845f3cc115f3f5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116157) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:10:51.100424 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: INFO nova.api.openstack.requestlog [None req-dc9f1069-e472-4a32-b3c6-85d233b35d56 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] 10.222.0.18 "GET /compute/v2.1/servers/fa7c86bc-c46f-4120-8f3d-d795f8d7c5cc" status: 200 len: 1570 microversion: 2.1 time: 0.149755 Dec 15 03:10:51.100993 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: [pid: 116157|app: 0|req: 536/1070] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 03:10:50 2021] GET /compute/v2.1/servers/fa7c86bc-c46f-4120-8f3d-d795f8d7c5cc => generated 1570 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 03:10:51.273346 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi [None req-e3bd00dd-3bd6-4f3e-b19f-ec0317a5927f tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Calling method '>' {{(pid=116156) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:10:51.274646 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.compute.api [None req-e3bd00dd-3bd6-4f3e-b19f-ec0317a5927f tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] [instance: bbb8462c-9501-4541-b67e-43ec5c5061a7] Fetching instance by UUID {{(pid=116156) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:10:51.280471 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-e3bd00dd-3bd6-4f3e-b19f-ec0317a5927f tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:10:51.280924 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-e3bd00dd-3bd6-4f3e-b19f-ec0317a5927f tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:10:51.281702 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-e3bd00dd-3bd6-4f3e-b19f-ec0317a5927f tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:10:51.282170 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-e3bd00dd-3bd6-4f3e-b19f-ec0317a5927f tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:10:51.342744 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.policy [None req-e3bd00dd-3bd6-4f3e-b19f-ec0317a5927f tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97bdf19af9e34fc3886ff451cb9d7a27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '494b56bf5eae4d56a5591546f85bc32b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116156) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:10:51.349939 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: INFO nova.api.openstack.requestlog [None req-e3bd00dd-3bd6-4f3e-b19f-ec0317a5927f tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] 10.222.0.18 "GET /compute/v2.1/servers/bbb8462c-9501-4541-b67e-43ec5c5061a7" status: 200 len: 1226 microversion: 2.1 time: 0.080234 Dec 15 03:10:51.350530 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: [pid: 116156|app: 0|req: 535/1071] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 03:10:51 2021] GET /compute/v2.1/servers/bbb8462c-9501-4541-b67e-43ec5c5061a7 => generated 1226 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 03:10:51.943901 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi [None req-fbbde3ea-0732-4d63-aebd-364bd107feec tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Calling method '>' {{(pid=116157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:10:51.944804 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.compute.api [None req-fbbde3ea-0732-4d63-aebd-364bd107feec tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] [instance: b89094ac-aee1-4bd6-a33d-8c4347cebfc7] Fetching instance by UUID {{(pid=116157) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:10:51.950681 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-fbbde3ea-0732-4d63-aebd-364bd107feec tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:10:51.951141 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-fbbde3ea-0732-4d63-aebd-364bd107feec tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:10:51.951915 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-fbbde3ea-0732-4d63-aebd-364bd107feec tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:10:51.952354 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-fbbde3ea-0732-4d63-aebd-364bd107feec tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:10:51.981621 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: INFO nova.api.openstack.requestlog [None req-fbbde3ea-0732-4d63-aebd-364bd107feec tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] 10.222.0.18 "GET /compute/v2.1/servers/b89094ac-aee1-4bd6-a33d-8c4347cebfc7/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041482 Dec 15 03:10:51.982269 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: [pid: 116157|app: 0|req: 537/1072] 10.222.0.18 () {60 vars in 1342 bytes} [Wed Dec 15 03:10:51 2021] GET /compute/v2.1/servers/b89094ac-aee1-4bd6-a33d-8c4347cebfc7/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 03:10:52.117479 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi [None req-62a63070-dd26-4c55-aa82-5e82c6611a7e tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Calling method '>' {{(pid=116156) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:10:52.118719 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.compute.api [None req-62a63070-dd26-4c55-aa82-5e82c6611a7e tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] [instance: fa7c86bc-c46f-4120-8f3d-d795f8d7c5cc] Fetching instance by UUID {{(pid=116156) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:10:52.124894 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-62a63070-dd26-4c55-aa82-5e82c6611a7e tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:10:52.125340 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-62a63070-dd26-4c55-aa82-5e82c6611a7e tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:10:52.126135 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-62a63070-dd26-4c55-aa82-5e82c6611a7e tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:10:52.126568 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-62a63070-dd26-4c55-aa82-5e82c6611a7e tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:10:52.255629 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.policy [None req-62a63070-dd26-4c55-aa82-5e82c6611a7e tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c4c0c82448e40ba801c0b52ec44e74a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a093d0bf43046aaa845f3cc115f3f5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116156) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:10:52.262899 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: INFO nova.api.openstack.requestlog [None req-62a63070-dd26-4c55-aa82-5e82c6611a7e tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] 10.222.0.18 "GET /compute/v2.1/servers/fa7c86bc-c46f-4120-8f3d-d795f8d7c5cc" status: 200 len: 1570 microversion: 2.1 time: 0.149321 Dec 15 03:10:52.263468 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: [pid: 116156|app: 0|req: 536/1073] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 03:10:52 2021] GET /compute/v2.1/servers/fa7c86bc-c46f-4120-8f3d-d795f8d7c5cc => generated 1570 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 03:10:52.366600 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi [None req-ec4fec9a-8df5-4ce7-9857-a7fca1cefd46 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Calling method '>' {{(pid=116157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:10:52.367212 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.compute.api [None req-ec4fec9a-8df5-4ce7-9857-a7fca1cefd46 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] [instance: bbb8462c-9501-4541-b67e-43ec5c5061a7] Fetching instance by UUID {{(pid=116157) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:10:52.372978 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-ec4fec9a-8df5-4ce7-9857-a7fca1cefd46 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:10:52.373424 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-ec4fec9a-8df5-4ce7-9857-a7fca1cefd46 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:10:52.374220 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-ec4fec9a-8df5-4ce7-9857-a7fca1cefd46 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:10:52.374657 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-ec4fec9a-8df5-4ce7-9857-a7fca1cefd46 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:10:52.434189 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.policy [None req-ec4fec9a-8df5-4ce7-9857-a7fca1cefd46 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97bdf19af9e34fc3886ff451cb9d7a27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '494b56bf5eae4d56a5591546f85bc32b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116157) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:10:52.441664 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: INFO nova.api.openstack.requestlog [None req-ec4fec9a-8df5-4ce7-9857-a7fca1cefd46 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] 10.222.0.18 "GET /compute/v2.1/servers/bbb8462c-9501-4541-b67e-43ec5c5061a7" status: 200 len: 1226 microversion: 2.1 time: 0.078956 Dec 15 03:10:52.442274 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: [pid: 116157|app: 0|req: 538/1074] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 03:10:52 2021] GET /compute/v2.1/servers/bbb8462c-9501-4541-b67e-43ec5c5061a7 => generated 1226 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 03:10:52.993815 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi [None req-fd4e05fc-9d73-40d8-b46b-3c7b6f65ca21 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Calling method '>' {{(pid=116156) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:10:52.994709 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.compute.api [None req-fd4e05fc-9d73-40d8-b46b-3c7b6f65ca21 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] [instance: b89094ac-aee1-4bd6-a33d-8c4347cebfc7] Fetching instance by UUID {{(pid=116156) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:10:53.000548 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-fd4e05fc-9d73-40d8-b46b-3c7b6f65ca21 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:10:53.001003 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-fd4e05fc-9d73-40d8-b46b-3c7b6f65ca21 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:10:53.001784 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-fd4e05fc-9d73-40d8-b46b-3c7b6f65ca21 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:10:53.002255 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-fd4e05fc-9d73-40d8-b46b-3c7b6f65ca21 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:10:53.030838 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: INFO nova.api.openstack.requestlog [None req-fd4e05fc-9d73-40d8-b46b-3c7b6f65ca21 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] 10.222.0.18 "GET /compute/v2.1/servers/b89094ac-aee1-4bd6-a33d-8c4347cebfc7/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041686 Dec 15 03:10:53.031380 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: [pid: 116156|app: 0|req: 537/1075] 10.222.0.18 () {60 vars in 1342 bytes} [Wed Dec 15 03:10:52 2021] GET /compute/v2.1/servers/b89094ac-aee1-4bd6-a33d-8c4347cebfc7/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 03:10:53.279753 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi [None req-547fa383-3ae1-473f-a972-60a20cb54ae8 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Calling method '>' {{(pid=116157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:10:53.280346 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.compute.api [None req-547fa383-3ae1-473f-a972-60a20cb54ae8 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] [instance: fa7c86bc-c46f-4120-8f3d-d795f8d7c5cc] Fetching instance by UUID {{(pid=116157) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:10:53.286853 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-547fa383-3ae1-473f-a972-60a20cb54ae8 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:10:53.287308 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-547fa383-3ae1-473f-a972-60a20cb54ae8 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:10:53.288094 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-547fa383-3ae1-473f-a972-60a20cb54ae8 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:10:53.288536 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-547fa383-3ae1-473f-a972-60a20cb54ae8 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:10:53.416296 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.policy [None req-547fa383-3ae1-473f-a972-60a20cb54ae8 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c4c0c82448e40ba801c0b52ec44e74a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a093d0bf43046aaa845f3cc115f3f5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116157) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:10:53.423486 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: INFO nova.api.openstack.requestlog [None req-547fa383-3ae1-473f-a972-60a20cb54ae8 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] 10.222.0.18 "GET /compute/v2.1/servers/fa7c86bc-c46f-4120-8f3d-d795f8d7c5cc" status: 200 len: 1570 microversion: 2.1 time: 0.147448 Dec 15 03:10:53.424053 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: [pid: 116157|app: 0|req: 539/1076] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 03:10:53 2021] GET /compute/v2.1/servers/fa7c86bc-c46f-4120-8f3d-d795f8d7c5cc => generated 1570 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 03:10:53.458018 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi [None req-22645981-5e29-4017-b473-d481c6ac9436 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Calling method '>' {{(pid=116156) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:10:53.458653 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.compute.api [None req-22645981-5e29-4017-b473-d481c6ac9436 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] [instance: bbb8462c-9501-4541-b67e-43ec5c5061a7] Fetching instance by UUID {{(pid=116156) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:10:53.464801 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-22645981-5e29-4017-b473-d481c6ac9436 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:10:53.465258 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-22645981-5e29-4017-b473-d481c6ac9436 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:10:53.466071 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-22645981-5e29-4017-b473-d481c6ac9436 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:10:53.466644 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-22645981-5e29-4017-b473-d481c6ac9436 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:10:53.524338 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.policy [None req-22645981-5e29-4017-b473-d481c6ac9436 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97bdf19af9e34fc3886ff451cb9d7a27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '494b56bf5eae4d56a5591546f85bc32b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116156) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:10:53.531705 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: INFO nova.api.openstack.requestlog [None req-22645981-5e29-4017-b473-d481c6ac9436 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] 10.222.0.18 "GET /compute/v2.1/servers/bbb8462c-9501-4541-b67e-43ec5c5061a7" status: 200 len: 1226 microversion: 2.1 time: 0.077227 Dec 15 03:10:53.532211 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: [pid: 116156|app: 0|req: 538/1077] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 03:10:53 2021] GET /compute/v2.1/servers/bbb8462c-9501-4541-b67e-43ec5c5061a7 => generated 1226 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 03:10:54.043035 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi [None req-30c951b2-2554-44a7-aec0-5425a754cc02 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Calling method '>' {{(pid=116157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:10:54.043936 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.compute.api [None req-30c951b2-2554-44a7-aec0-5425a754cc02 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] [instance: b89094ac-aee1-4bd6-a33d-8c4347cebfc7] Fetching instance by UUID {{(pid=116157) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:10:54.049729 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-30c951b2-2554-44a7-aec0-5425a754cc02 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:10:54.050251 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-30c951b2-2554-44a7-aec0-5425a754cc02 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:10:54.051033 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-30c951b2-2554-44a7-aec0-5425a754cc02 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:10:54.051473 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-30c951b2-2554-44a7-aec0-5425a754cc02 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:10:54.079887 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: INFO nova.api.openstack.requestlog [None req-30c951b2-2554-44a7-aec0-5425a754cc02 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] 10.222.0.18 "GET /compute/v2.1/servers/b89094ac-aee1-4bd6-a33d-8c4347cebfc7/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041382 Dec 15 03:10:54.080433 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: [pid: 116157|app: 0|req: 540/1078] 10.222.0.18 () {60 vars in 1342 bytes} [Wed Dec 15 03:10:54 2021] GET /compute/v2.1/servers/b89094ac-aee1-4bd6-a33d-8c4347cebfc7/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 03:10:54.440405 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi [None req-88dbbce7-1ad5-42a1-ab09-7466619b6b60 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Calling method '>' {{(pid=116156) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:10:54.441049 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.compute.api [None req-88dbbce7-1ad5-42a1-ab09-7466619b6b60 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] [instance: fa7c86bc-c46f-4120-8f3d-d795f8d7c5cc] Fetching instance by UUID {{(pid=116156) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:10:54.447516 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-88dbbce7-1ad5-42a1-ab09-7466619b6b60 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:10:54.447971 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-88dbbce7-1ad5-42a1-ab09-7466619b6b60 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:10:54.448756 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-88dbbce7-1ad5-42a1-ab09-7466619b6b60 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:10:54.449198 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-88dbbce7-1ad5-42a1-ab09-7466619b6b60 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:10:54.548362 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi [None req-5e3f0da0-a809-4510-871e-387b5b19e32b tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Calling method '>' {{(pid=116157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:10:54.548973 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.compute.api [None req-5e3f0da0-a809-4510-871e-387b5b19e32b tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] [instance: bbb8462c-9501-4541-b67e-43ec5c5061a7] Fetching instance by UUID {{(pid=116157) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:10:54.555755 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-5e3f0da0-a809-4510-871e-387b5b19e32b tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:10:54.556207 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-5e3f0da0-a809-4510-871e-387b5b19e32b tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:10:54.556997 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-5e3f0da0-a809-4510-871e-387b5b19e32b tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:10:54.557439 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-5e3f0da0-a809-4510-871e-387b5b19e32b tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:10:54.581346 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.policy [None req-88dbbce7-1ad5-42a1-ab09-7466619b6b60 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c4c0c82448e40ba801c0b52ec44e74a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a093d0bf43046aaa845f3cc115f3f5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116156) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:10:54.588638 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: INFO nova.api.openstack.requestlog [None req-88dbbce7-1ad5-42a1-ab09-7466619b6b60 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] 10.222.0.18 "GET /compute/v2.1/servers/fa7c86bc-c46f-4120-8f3d-d795f8d7c5cc" status: 200 len: 1570 microversion: 2.1 time: 0.151913 Dec 15 03:10:54.589205 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: [pid: 116156|app: 0|req: 539/1079] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 03:10:54 2021] GET /compute/v2.1/servers/fa7c86bc-c46f-4120-8f3d-d795f8d7c5cc => generated 1570 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 03:10:54.615200 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.policy [None req-5e3f0da0-a809-4510-871e-387b5b19e32b tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97bdf19af9e34fc3886ff451cb9d7a27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '494b56bf5eae4d56a5591546f85bc32b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116157) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:10:54.622928 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: INFO nova.api.openstack.requestlog [None req-5e3f0da0-a809-4510-871e-387b5b19e32b tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] 10.222.0.18 "GET /compute/v2.1/servers/bbb8462c-9501-4541-b67e-43ec5c5061a7" status: 200 len: 1226 microversion: 2.1 time: 0.078153 Dec 15 03:10:54.623491 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: [pid: 116157|app: 0|req: 541/1080] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 03:10:54 2021] GET /compute/v2.1/servers/bbb8462c-9501-4541-b67e-43ec5c5061a7 => generated 1226 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 03:10:55.091451 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi [None req-254d6a36-46e2-4d04-a627-c14daa9bdf74 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Calling method '>' {{(pid=116156) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:10:55.092343 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.compute.api [None req-254d6a36-46e2-4d04-a627-c14daa9bdf74 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] [instance: b89094ac-aee1-4bd6-a33d-8c4347cebfc7] Fetching instance by UUID {{(pid=116156) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:10:55.098561 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-254d6a36-46e2-4d04-a627-c14daa9bdf74 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:10:55.099015 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-254d6a36-46e2-4d04-a627-c14daa9bdf74 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:10:55.099882 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-254d6a36-46e2-4d04-a627-c14daa9bdf74 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:10:55.100318 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-254d6a36-46e2-4d04-a627-c14daa9bdf74 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:10:55.131949 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: INFO nova.api.openstack.requestlog [None req-254d6a36-46e2-4d04-a627-c14daa9bdf74 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] 10.222.0.18 "GET /compute/v2.1/servers/b89094ac-aee1-4bd6-a33d-8c4347cebfc7/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044097 Dec 15 03:10:55.132430 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: [pid: 116156|app: 0|req: 540/1081] 10.222.0.18 () {60 vars in 1342 bytes} [Wed Dec 15 03:10:55 2021] GET /compute/v2.1/servers/b89094ac-aee1-4bd6-a33d-8c4347cebfc7/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 03:10:55.639681 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi [None req-b3d150d5-499d-455e-8f84-a01a07ec6be1 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Calling method '>' {{(pid=116156) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:10:55.640497 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.compute.api [None req-b3d150d5-499d-455e-8f84-a01a07ec6be1 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] [instance: bbb8462c-9501-4541-b67e-43ec5c5061a7] Fetching instance by UUID {{(pid=116156) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:10:55.648335 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-b3d150d5-499d-455e-8f84-a01a07ec6be1 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:10:55.649381 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-b3d150d5-499d-455e-8f84-a01a07ec6be1 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:10:55.650284 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-b3d150d5-499d-455e-8f84-a01a07ec6be1 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:10:55.650733 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-b3d150d5-499d-455e-8f84-a01a07ec6be1 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:10:55.711055 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.policy [None req-b3d150d5-499d-455e-8f84-a01a07ec6be1 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97bdf19af9e34fc3886ff451cb9d7a27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '494b56bf5eae4d56a5591546f85bc32b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116156) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:10:55.712665 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi [None req-6ba12819-c958-4ff2-9aa4-29fd8afcfa33 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Calling method '>' {{(pid=116157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:10:55.713275 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.compute.api [None req-6ba12819-c958-4ff2-9aa4-29fd8afcfa33 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] [instance: fa7c86bc-c46f-4120-8f3d-d795f8d7c5cc] Fetching instance by UUID {{(pid=116157) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:10:55.719043 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-6ba12819-c958-4ff2-9aa4-29fd8afcfa33 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:10:55.719494 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-6ba12819-c958-4ff2-9aa4-29fd8afcfa33 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:10:55.719963 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: INFO nova.api.openstack.requestlog [None req-b3d150d5-499d-455e-8f84-a01a07ec6be1 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] 10.222.0.18 "GET /compute/v2.1/servers/bbb8462c-9501-4541-b67e-43ec5c5061a7" status: 200 len: 1226 microversion: 2.1 time: 0.083352 Dec 15 03:10:55.720274 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-6ba12819-c958-4ff2-9aa4-29fd8afcfa33 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:10:55.720536 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: [pid: 116156|app: 0|req: 541/1082] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 03:10:55 2021] GET /compute/v2.1/servers/bbb8462c-9501-4541-b67e-43ec5c5061a7 => generated 1226 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 03:10:55.720700 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-6ba12819-c958-4ff2-9aa4-29fd8afcfa33 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:10:55.855727 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.policy [None req-6ba12819-c958-4ff2-9aa4-29fd8afcfa33 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c4c0c82448e40ba801c0b52ec44e74a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a093d0bf43046aaa845f3cc115f3f5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116157) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:10:55.863549 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: INFO nova.api.openstack.requestlog [None req-6ba12819-c958-4ff2-9aa4-29fd8afcfa33 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] 10.222.0.18 "GET /compute/v2.1/servers/fa7c86bc-c46f-4120-8f3d-d795f8d7c5cc" status: 200 len: 1570 microversion: 2.1 time: 0.261267 Dec 15 03:10:55.864041 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: [pid: 116157|app: 0|req: 542/1083] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 03:10:55 2021] GET /compute/v2.1/servers/fa7c86bc-c46f-4120-8f3d-d795f8d7c5cc => generated 1570 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 03:10:56.143332 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi [None req-25e872d0-4cec-4bea-9cd8-d7cee4f869a7 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Calling method '>' {{(pid=116156) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:10:56.144146 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.compute.api [None req-25e872d0-4cec-4bea-9cd8-d7cee4f869a7 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] [instance: b89094ac-aee1-4bd6-a33d-8c4347cebfc7] Fetching instance by UUID {{(pid=116156) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:10:56.150033 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-25e872d0-4cec-4bea-9cd8-d7cee4f869a7 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:10:56.150478 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-25e872d0-4cec-4bea-9cd8-d7cee4f869a7 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:10:56.151242 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-25e872d0-4cec-4bea-9cd8-d7cee4f869a7 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:10:56.151673 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-25e872d0-4cec-4bea-9cd8-d7cee4f869a7 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:10:56.179890 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: INFO nova.api.openstack.requestlog [None req-25e872d0-4cec-4bea-9cd8-d7cee4f869a7 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] 10.222.0.18 "GET /compute/v2.1/servers/b89094ac-aee1-4bd6-a33d-8c4347cebfc7/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.040393 Dec 15 03:10:56.180916 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: [pid: 116156|app: 0|req: 542/1084] 10.222.0.18 () {60 vars in 1342 bytes} [Wed Dec 15 03:10:56 2021] GET /compute/v2.1/servers/b89094ac-aee1-4bd6-a33d-8c4347cebfc7/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 03:10:56.736424 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi [None req-d172b4f2-4633-4729-bcff-00227c55b886 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Calling method '>' {{(pid=116157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:10:56.737043 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.compute.api [None req-d172b4f2-4633-4729-bcff-00227c55b886 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] [instance: bbb8462c-9501-4541-b67e-43ec5c5061a7] Fetching instance by UUID {{(pid=116157) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:10:56.744095 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-d172b4f2-4633-4729-bcff-00227c55b886 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:10:56.744550 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-d172b4f2-4633-4729-bcff-00227c55b886 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:10:56.745330 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-d172b4f2-4633-4729-bcff-00227c55b886 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:10:56.745767 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-d172b4f2-4633-4729-bcff-00227c55b886 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:10:56.810013 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.policy [None req-d172b4f2-4633-4729-bcff-00227c55b886 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97bdf19af9e34fc3886ff451cb9d7a27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '494b56bf5eae4d56a5591546f85bc32b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116157) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:10:56.820141 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: INFO nova.api.openstack.requestlog [None req-d172b4f2-4633-4729-bcff-00227c55b886 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] 10.222.0.18 "GET /compute/v2.1/servers/bbb8462c-9501-4541-b67e-43ec5c5061a7" status: 200 len: 1226 microversion: 2.1 time: 0.087387 Dec 15 03:10:56.821239 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: [pid: 116157|app: 0|req: 543/1085] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 03:10:56 2021] GET /compute/v2.1/servers/bbb8462c-9501-4541-b67e-43ec5c5061a7 => generated 1226 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 03:10:56.881617 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi [None req-21e31f1d-dc16-4b9f-ac93-3d69aab420a8 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Calling method '>' {{(pid=116156) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:10:56.882289 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.compute.api [None req-21e31f1d-dc16-4b9f-ac93-3d69aab420a8 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] [instance: fa7c86bc-c46f-4120-8f3d-d795f8d7c5cc] Fetching instance by UUID {{(pid=116156) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:10:56.889100 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-21e31f1d-dc16-4b9f-ac93-3d69aab420a8 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:10:56.889581 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-21e31f1d-dc16-4b9f-ac93-3d69aab420a8 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:10:56.890385 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-21e31f1d-dc16-4b9f-ac93-3d69aab420a8 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:10:56.890825 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-21e31f1d-dc16-4b9f-ac93-3d69aab420a8 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:10:57.018785 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.policy [None req-21e31f1d-dc16-4b9f-ac93-3d69aab420a8 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c4c0c82448e40ba801c0b52ec44e74a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a093d0bf43046aaa845f3cc115f3f5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116156) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:10:57.026086 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: INFO nova.api.openstack.requestlog [None req-21e31f1d-dc16-4b9f-ac93-3d69aab420a8 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] 10.222.0.18 "GET /compute/v2.1/servers/fa7c86bc-c46f-4120-8f3d-d795f8d7c5cc" status: 200 len: 1570 microversion: 2.1 time: 0.148035 Dec 15 03:10:57.026658 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: [pid: 116156|app: 0|req: 543/1086] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 03:10:56 2021] GET /compute/v2.1/servers/fa7c86bc-c46f-4120-8f3d-d795f8d7c5cc => generated 1570 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 03:10:57.192194 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi [None req-7d9ad846-1955-4713-ae82-083300e7a8d2 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Calling method '>' {{(pid=116157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:10:57.193339 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.compute.api [None req-7d9ad846-1955-4713-ae82-083300e7a8d2 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] [instance: b89094ac-aee1-4bd6-a33d-8c4347cebfc7] Fetching instance by UUID {{(pid=116157) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:10:57.199174 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-7d9ad846-1955-4713-ae82-083300e7a8d2 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:10:57.199627 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-7d9ad846-1955-4713-ae82-083300e7a8d2 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:10:57.200418 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-7d9ad846-1955-4713-ae82-083300e7a8d2 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:10:57.200868 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-7d9ad846-1955-4713-ae82-083300e7a8d2 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:10:57.230017 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: INFO nova.api.openstack.requestlog [None req-7d9ad846-1955-4713-ae82-083300e7a8d2 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] 10.222.0.18 "GET /compute/v2.1/servers/b89094ac-aee1-4bd6-a33d-8c4347cebfc7/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041987 Dec 15 03:10:57.230572 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: [pid: 116157|app: 0|req: 544/1087] 10.222.0.18 () {60 vars in 1342 bytes} [Wed Dec 15 03:10:57 2021] GET /compute/v2.1/servers/b89094ac-aee1-4bd6-a33d-8c4347cebfc7/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 03:10:57.837886 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi [None req-eb244f2c-30f7-4f41-b97a-6716a3b1fbcf tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Calling method '>' {{(pid=116156) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:10:57.838545 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.compute.api [None req-eb244f2c-30f7-4f41-b97a-6716a3b1fbcf tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] [instance: bbb8462c-9501-4541-b67e-43ec5c5061a7] Fetching instance by UUID {{(pid=116156) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:10:57.844359 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-eb244f2c-30f7-4f41-b97a-6716a3b1fbcf tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:10:57.844805 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-eb244f2c-30f7-4f41-b97a-6716a3b1fbcf tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:10:57.845570 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-eb244f2c-30f7-4f41-b97a-6716a3b1fbcf tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:10:57.846025 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-eb244f2c-30f7-4f41-b97a-6716a3b1fbcf tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:10:57.903638 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.policy [None req-eb244f2c-30f7-4f41-b97a-6716a3b1fbcf tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97bdf19af9e34fc3886ff451cb9d7a27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '494b56bf5eae4d56a5591546f85bc32b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116156) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:10:57.910826 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: INFO nova.api.openstack.requestlog [None req-eb244f2c-30f7-4f41-b97a-6716a3b1fbcf tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] 10.222.0.18 "GET /compute/v2.1/servers/bbb8462c-9501-4541-b67e-43ec5c5061a7" status: 200 len: 1226 microversion: 2.1 time: 0.077255 Dec 15 03:10:57.911378 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: [pid: 116156|app: 0|req: 544/1088] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 03:10:57 2021] GET /compute/v2.1/servers/bbb8462c-9501-4541-b67e-43ec5c5061a7 => generated 1226 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 03:10:58.042992 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi [None req-f38862d2-df80-4385-988a-a844bedf394e tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Calling method '>' {{(pid=116157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:10:58.043698 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.compute.api [None req-f38862d2-df80-4385-988a-a844bedf394e tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] [instance: fa7c86bc-c46f-4120-8f3d-d795f8d7c5cc] Fetching instance by UUID {{(pid=116157) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:10:58.049786 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-f38862d2-df80-4385-988a-a844bedf394e tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:10:58.050270 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-f38862d2-df80-4385-988a-a844bedf394e tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:10:58.051069 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-f38862d2-df80-4385-988a-a844bedf394e tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:10:58.051500 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-f38862d2-df80-4385-988a-a844bedf394e tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:10:58.181496 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.policy [None req-f38862d2-df80-4385-988a-a844bedf394e tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c4c0c82448e40ba801c0b52ec44e74a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a093d0bf43046aaa845f3cc115f3f5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116157) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:10:58.189519 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: INFO nova.api.openstack.requestlog [None req-f38862d2-df80-4385-988a-a844bedf394e tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] 10.222.0.18 "GET /compute/v2.1/servers/fa7c86bc-c46f-4120-8f3d-d795f8d7c5cc" status: 200 len: 1570 microversion: 2.1 time: 0.150084 Dec 15 03:10:58.190601 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: [pid: 116157|app: 0|req: 545/1089] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 03:10:58 2021] GET /compute/v2.1/servers/fa7c86bc-c46f-4120-8f3d-d795f8d7c5cc => generated 1570 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 03:10:58.240787 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi [None req-3ec88560-a8f9-4dd2-a74d-2f0cae522ded tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Calling method '>' {{(pid=116156) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:10:58.241711 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.compute.api [None req-3ec88560-a8f9-4dd2-a74d-2f0cae522ded tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] [instance: b89094ac-aee1-4bd6-a33d-8c4347cebfc7] Fetching instance by UUID {{(pid=116156) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:10:58.248004 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-3ec88560-a8f9-4dd2-a74d-2f0cae522ded tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:10:58.248448 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-3ec88560-a8f9-4dd2-a74d-2f0cae522ded tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:10:58.249212 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-3ec88560-a8f9-4dd2-a74d-2f0cae522ded tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:10:58.249642 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-3ec88560-a8f9-4dd2-a74d-2f0cae522ded tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:10:58.278605 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: INFO nova.api.openstack.requestlog [None req-3ec88560-a8f9-4dd2-a74d-2f0cae522ded tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] 10.222.0.18 "GET /compute/v2.1/servers/b89094ac-aee1-4bd6-a33d-8c4347cebfc7/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041749 Dec 15 03:10:58.279159 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: [pid: 116156|app: 0|req: 545/1090] 10.222.0.18 () {60 vars in 1342 bytes} [Wed Dec 15 03:10:58 2021] GET /compute/v2.1/servers/b89094ac-aee1-4bd6-a33d-8c4347cebfc7/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 03:10:58.926484 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi [None req-64538144-3964-4762-86e9-afd3870fc3bf tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Calling method '>' {{(pid=116157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:10:58.927093 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.compute.api [None req-64538144-3964-4762-86e9-afd3870fc3bf tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] [instance: bbb8462c-9501-4541-b67e-43ec5c5061a7] Fetching instance by UUID {{(pid=116157) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:10:58.932948 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-64538144-3964-4762-86e9-afd3870fc3bf tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:10:58.933396 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-64538144-3964-4762-86e9-afd3870fc3bf tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:10:58.934231 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-64538144-3964-4762-86e9-afd3870fc3bf tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:10:58.934670 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-64538144-3964-4762-86e9-afd3870fc3bf tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:10:58.996208 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.policy [None req-64538144-3964-4762-86e9-afd3870fc3bf tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97bdf19af9e34fc3886ff451cb9d7a27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '494b56bf5eae4d56a5591546f85bc32b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116157) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:10:59.003474 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: INFO nova.api.openstack.requestlog [None req-64538144-3964-4762-86e9-afd3870fc3bf tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] 10.222.0.18 "GET /compute/v2.1/servers/bbb8462c-9501-4541-b67e-43ec5c5061a7" status: 200 len: 1226 microversion: 2.1 time: 0.080626 Dec 15 03:10:59.004036 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: [pid: 116157|app: 0|req: 546/1091] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 03:10:58 2021] GET /compute/v2.1/servers/bbb8462c-9501-4541-b67e-43ec5c5061a7 => generated 1226 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 03:10:59.207547 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi [None req-ad765f01-42f4-438a-af77-6cd4b96544ca tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Calling method '>' {{(pid=116156) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:10:59.208558 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.compute.api [None req-ad765f01-42f4-438a-af77-6cd4b96544ca tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] [instance: fa7c86bc-c46f-4120-8f3d-d795f8d7c5cc] Fetching instance by UUID {{(pid=116156) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:10:59.214836 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-ad765f01-42f4-438a-af77-6cd4b96544ca tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:10:59.215291 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-ad765f01-42f4-438a-af77-6cd4b96544ca tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:10:59.216079 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-ad765f01-42f4-438a-af77-6cd4b96544ca tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:10:59.216516 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-ad765f01-42f4-438a-af77-6cd4b96544ca tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:10:59.291524 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi [None req-45ef1788-5951-43c9-b225-5305e34f58ca tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Calling method '>' {{(pid=116157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:10:59.292422 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.compute.api [None req-45ef1788-5951-43c9-b225-5305e34f58ca tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] [instance: b89094ac-aee1-4bd6-a33d-8c4347cebfc7] Fetching instance by UUID {{(pid=116157) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:10:59.298148 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-45ef1788-5951-43c9-b225-5305e34f58ca tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:10:59.298602 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-45ef1788-5951-43c9-b225-5305e34f58ca tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:10:59.299382 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-45ef1788-5951-43c9-b225-5305e34f58ca tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:10:59.299816 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-45ef1788-5951-43c9-b225-5305e34f58ca tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:10:59.328845 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: INFO nova.api.openstack.requestlog [None req-45ef1788-5951-43c9-b225-5305e34f58ca tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] 10.222.0.18 "GET /compute/v2.1/servers/b89094ac-aee1-4bd6-a33d-8c4347cebfc7/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042359 Dec 15 03:10:59.329404 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: [pid: 116157|app: 0|req: 547/1092] 10.222.0.18 () {60 vars in 1342 bytes} [Wed Dec 15 03:10:59 2021] GET /compute/v2.1/servers/b89094ac-aee1-4bd6-a33d-8c4347cebfc7/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Dec 15 03:10:59.347970 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.policy [None req-ad765f01-42f4-438a-af77-6cd4b96544ca tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c4c0c82448e40ba801c0b52ec44e74a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a093d0bf43046aaa845f3cc115f3f5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116156) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:10:59.355312 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: INFO nova.api.openstack.requestlog [None req-ad765f01-42f4-438a-af77-6cd4b96544ca tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] 10.222.0.18 "GET /compute/v2.1/servers/fa7c86bc-c46f-4120-8f3d-d795f8d7c5cc" status: 200 len: 1570 microversion: 2.1 time: 0.151396 Dec 15 03:10:59.355871 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: [pid: 116156|app: 0|req: 546/1093] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 03:10:59 2021] GET /compute/v2.1/servers/fa7c86bc-c46f-4120-8f3d-d795f8d7c5cc => generated 1570 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 03:11:00.019376 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi [None req-c8aeae78-5162-476b-ad43-d1b4d637a26e tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Calling method '>' {{(pid=116157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:11:00.020019 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.compute.api [None req-c8aeae78-5162-476b-ad43-d1b4d637a26e tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] [instance: bbb8462c-9501-4541-b67e-43ec5c5061a7] Fetching instance by UUID {{(pid=116157) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:11:00.025809 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-c8aeae78-5162-476b-ad43-d1b4d637a26e tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:11:00.026288 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-c8aeae78-5162-476b-ad43-d1b4d637a26e tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:11:00.027068 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-c8aeae78-5162-476b-ad43-d1b4d637a26e tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:11:00.027507 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-c8aeae78-5162-476b-ad43-d1b4d637a26e tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:11:00.085168 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.policy [None req-c8aeae78-5162-476b-ad43-d1b4d637a26e tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97bdf19af9e34fc3886ff451cb9d7a27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '494b56bf5eae4d56a5591546f85bc32b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116157) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:11:00.092281 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: INFO nova.api.openstack.requestlog [None req-c8aeae78-5162-476b-ad43-d1b4d637a26e tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] 10.222.0.18 "GET /compute/v2.1/servers/bbb8462c-9501-4541-b67e-43ec5c5061a7" status: 200 len: 1226 microversion: 2.1 time: 0.076519 Dec 15 03:11:00.092840 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: [pid: 116157|app: 0|req: 548/1094] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 03:11:00 2021] GET /compute/v2.1/servers/bbb8462c-9501-4541-b67e-43ec5c5061a7 => generated 1226 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 03:11:00.340400 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi [None req-036c55b8-21d5-4119-b79a-2295bfb55e60 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Calling method '>' {{(pid=116156) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:11:00.341231 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.compute.api [None req-036c55b8-21d5-4119-b79a-2295bfb55e60 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] [instance: b89094ac-aee1-4bd6-a33d-8c4347cebfc7] Fetching instance by UUID {{(pid=116156) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:11:00.347395 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-036c55b8-21d5-4119-b79a-2295bfb55e60 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:11:00.347843 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-036c55b8-21d5-4119-b79a-2295bfb55e60 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:11:00.348608 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-036c55b8-21d5-4119-b79a-2295bfb55e60 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:11:00.349040 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-036c55b8-21d5-4119-b79a-2295bfb55e60 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:11:00.372765 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi [None req-a05f2e4c-52d6-48e6-863f-2c49d9baf579 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Calling method '>' {{(pid=116157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:11:00.373462 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.compute.api [None req-a05f2e4c-52d6-48e6-863f-2c49d9baf579 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] [instance: fa7c86bc-c46f-4120-8f3d-d795f8d7c5cc] Fetching instance by UUID {{(pid=116157) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:11:00.379115 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-a05f2e4c-52d6-48e6-863f-2c49d9baf579 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:11:00.379568 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-a05f2e4c-52d6-48e6-863f-2c49d9baf579 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:11:00.379770 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: INFO nova.api.openstack.requestlog [None req-036c55b8-21d5-4119-b79a-2295bfb55e60 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] 10.222.0.18 "GET /compute/v2.1/servers/b89094ac-aee1-4bd6-a33d-8c4347cebfc7/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043198 Dec 15 03:11:00.380321 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: [pid: 116156|app: 0|req: 547/1095] 10.222.0.18 () {60 vars in 1342 bytes} [Wed Dec 15 03:11:00 2021] GET /compute/v2.1/servers/b89094ac-aee1-4bd6-a33d-8c4347cebfc7/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 03:11:00.380432 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-a05f2e4c-52d6-48e6-863f-2c49d9baf579 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:11:00.380769 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-a05f2e4c-52d6-48e6-863f-2c49d9baf579 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:11:00.509387 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.policy [None req-a05f2e4c-52d6-48e6-863f-2c49d9baf579 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c4c0c82448e40ba801c0b52ec44e74a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a093d0bf43046aaa845f3cc115f3f5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116157) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:11:00.516470 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: INFO nova.api.openstack.requestlog [None req-a05f2e4c-52d6-48e6-863f-2c49d9baf579 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] 10.222.0.18 "GET /compute/v2.1/servers/fa7c86bc-c46f-4120-8f3d-d795f8d7c5cc" status: 200 len: 1570 microversion: 2.1 time: 0.147309 Dec 15 03:11:00.517028 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: [pid: 116157|app: 0|req: 549/1096] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 03:11:00 2021] GET /compute/v2.1/servers/fa7c86bc-c46f-4120-8f3d-d795f8d7c5cc => generated 1570 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 03:11:01.108444 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi [None req-b0324877-46b4-4304-b387-a36c1701434a tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Calling method '>' {{(pid=116156) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:11:01.109050 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.compute.api [None req-b0324877-46b4-4304-b387-a36c1701434a tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] [instance: bbb8462c-9501-4541-b67e-43ec5c5061a7] Fetching instance by UUID {{(pid=116156) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:11:01.115167 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-b0324877-46b4-4304-b387-a36c1701434a tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:11:01.115611 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-b0324877-46b4-4304-b387-a36c1701434a tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:11:01.116379 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-b0324877-46b4-4304-b387-a36c1701434a tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:11:01.116809 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-b0324877-46b4-4304-b387-a36c1701434a tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:11:01.174754 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.policy [None req-b0324877-46b4-4304-b387-a36c1701434a tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97bdf19af9e34fc3886ff451cb9d7a27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '494b56bf5eae4d56a5591546f85bc32b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116156) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:11:01.181829 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: INFO nova.api.openstack.requestlog [None req-b0324877-46b4-4304-b387-a36c1701434a tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] 10.222.0.18 "GET /compute/v2.1/servers/bbb8462c-9501-4541-b67e-43ec5c5061a7" status: 200 len: 1226 microversion: 2.1 time: 0.076971 Dec 15 03:11:01.182412 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: [pid: 116156|app: 0|req: 548/1097] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 03:11:01 2021] GET /compute/v2.1/servers/bbb8462c-9501-4541-b67e-43ec5c5061a7 => generated 1226 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 03:11:01.391240 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi [None req-df621a7d-3a52-4ca4-96a3-e3a281c54864 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Calling method '>' {{(pid=116157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:11:01.392071 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.compute.api [None req-df621a7d-3a52-4ca4-96a3-e3a281c54864 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] [instance: b89094ac-aee1-4bd6-a33d-8c4347cebfc7] Fetching instance by UUID {{(pid=116157) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:11:01.398280 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-df621a7d-3a52-4ca4-96a3-e3a281c54864 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:11:01.399217 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-df621a7d-3a52-4ca4-96a3-e3a281c54864 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:11:01.399981 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-df621a7d-3a52-4ca4-96a3-e3a281c54864 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:11:01.400409 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-df621a7d-3a52-4ca4-96a3-e3a281c54864 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:11:01.428522 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: INFO nova.api.openstack.requestlog [None req-df621a7d-3a52-4ca4-96a3-e3a281c54864 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] 10.222.0.18 "GET /compute/v2.1/servers/b89094ac-aee1-4bd6-a33d-8c4347cebfc7/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041152 Dec 15 03:11:01.429054 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: [pid: 116157|app: 0|req: 550/1098] 10.222.0.18 () {60 vars in 1342 bytes} [Wed Dec 15 03:11:01 2021] GET /compute/v2.1/servers/b89094ac-aee1-4bd6-a33d-8c4347cebfc7/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 03:11:01.533722 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi [None req-eda7a091-4de6-4e31-a6cc-90784d6cf786 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Calling method '>' {{(pid=116156) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:11:01.534369 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.compute.api [None req-eda7a091-4de6-4e31-a6cc-90784d6cf786 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] [instance: fa7c86bc-c46f-4120-8f3d-d795f8d7c5cc] Fetching instance by UUID {{(pid=116156) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:11:01.541156 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-eda7a091-4de6-4e31-a6cc-90784d6cf786 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:11:01.541598 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-eda7a091-4de6-4e31-a6cc-90784d6cf786 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:11:01.542395 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-eda7a091-4de6-4e31-a6cc-90784d6cf786 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:11:01.542847 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-eda7a091-4de6-4e31-a6cc-90784d6cf786 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:11:01.669306 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.policy [None req-eda7a091-4de6-4e31-a6cc-90784d6cf786 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c4c0c82448e40ba801c0b52ec44e74a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a093d0bf43046aaa845f3cc115f3f5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116156) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:11:01.676496 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: INFO nova.api.openstack.requestlog [None req-eda7a091-4de6-4e31-a6cc-90784d6cf786 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] 10.222.0.18 "GET /compute/v2.1/servers/fa7c86bc-c46f-4120-8f3d-d795f8d7c5cc" status: 200 len: 1570 microversion: 2.1 time: 0.146358 Dec 15 03:11:01.677060 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: [pid: 116156|app: 0|req: 549/1099] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 03:11:01 2021] GET /compute/v2.1/servers/fa7c86bc-c46f-4120-8f3d-d795f8d7c5cc => generated 1570 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 03:11:02.198949 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi [None req-8b7e3b6c-da66-4b0d-99ef-6f38db628784 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Calling method '>' {{(pid=116157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:11:02.199561 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.compute.api [None req-8b7e3b6c-da66-4b0d-99ef-6f38db628784 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] [instance: bbb8462c-9501-4541-b67e-43ec5c5061a7] Fetching instance by UUID {{(pid=116157) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:11:02.206282 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-8b7e3b6c-da66-4b0d-99ef-6f38db628784 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:11:02.206769 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-8b7e3b6c-da66-4b0d-99ef-6f38db628784 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:11:02.207984 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-8b7e3b6c-da66-4b0d-99ef-6f38db628784 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:11:02.208128 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-8b7e3b6c-da66-4b0d-99ef-6f38db628784 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:11:02.265820 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.policy [None req-8b7e3b6c-da66-4b0d-99ef-6f38db628784 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97bdf19af9e34fc3886ff451cb9d7a27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '494b56bf5eae4d56a5591546f85bc32b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116157) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:11:02.273402 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: INFO nova.api.openstack.requestlog [None req-8b7e3b6c-da66-4b0d-99ef-6f38db628784 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] 10.222.0.18 "GET /compute/v2.1/servers/bbb8462c-9501-4541-b67e-43ec5c5061a7" status: 200 len: 1226 microversion: 2.1 time: 0.078706 Dec 15 03:11:02.273964 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: [pid: 116157|app: 0|req: 551/1100] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 03:11:02 2021] GET /compute/v2.1/servers/bbb8462c-9501-4541-b67e-43ec5c5061a7 => generated 1226 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 03:11:02.440506 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi [None req-8ffbb18a-1b0f-4271-9e4a-e8f71913f852 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Calling method '>' {{(pid=116156) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:11:02.441394 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.compute.api [None req-8ffbb18a-1b0f-4271-9e4a-e8f71913f852 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] [instance: b89094ac-aee1-4bd6-a33d-8c4347cebfc7] Fetching instance by UUID {{(pid=116156) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:11:02.447104 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-8ffbb18a-1b0f-4271-9e4a-e8f71913f852 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:11:02.447548 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-8ffbb18a-1b0f-4271-9e4a-e8f71913f852 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:11:02.448309 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-8ffbb18a-1b0f-4271-9e4a-e8f71913f852 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:11:02.448737 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-8ffbb18a-1b0f-4271-9e4a-e8f71913f852 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:11:02.476264 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: INFO nova.api.openstack.requestlog [None req-8ffbb18a-1b0f-4271-9e4a-e8f71913f852 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] 10.222.0.18 "GET /compute/v2.1/servers/b89094ac-aee1-4bd6-a33d-8c4347cebfc7/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.039573 Dec 15 03:11:02.477230 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: [pid: 116156|app: 0|req: 550/1101] 10.222.0.18 () {60 vars in 1342 bytes} [Wed Dec 15 03:11:02 2021] GET /compute/v2.1/servers/b89094ac-aee1-4bd6-a33d-8c4347cebfc7/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Dec 15 03:11:02.693148 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi [None req-cf537113-6885-427f-9791-5606c0730756 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Calling method '>' {{(pid=116157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:11:02.693753 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.compute.api [None req-cf537113-6885-427f-9791-5606c0730756 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] [instance: fa7c86bc-c46f-4120-8f3d-d795f8d7c5cc] Fetching instance by UUID {{(pid=116157) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:11:02.700025 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-cf537113-6885-427f-9791-5606c0730756 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:11:02.700476 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-cf537113-6885-427f-9791-5606c0730756 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:11:02.701249 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-cf537113-6885-427f-9791-5606c0730756 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:11:02.701686 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-cf537113-6885-427f-9791-5606c0730756 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:11:02.830571 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.policy [None req-cf537113-6885-427f-9791-5606c0730756 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c4c0c82448e40ba801c0b52ec44e74a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a093d0bf43046aaa845f3cc115f3f5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116157) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:11:02.838183 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: INFO nova.api.openstack.requestlog [None req-cf537113-6885-427f-9791-5606c0730756 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] 10.222.0.18 "GET /compute/v2.1/servers/fa7c86bc-c46f-4120-8f3d-d795f8d7c5cc" status: 200 len: 1570 microversion: 2.1 time: 0.148595 Dec 15 03:11:02.838747 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: [pid: 116157|app: 0|req: 552/1102] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 03:11:02 2021] GET /compute/v2.1/servers/fa7c86bc-c46f-4120-8f3d-d795f8d7c5cc => generated 1570 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 03:11:03.289928 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi [None req-170def97-bf01-49db-867e-eaa56291ede8 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Calling method '>' {{(pid=116156) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:11:03.290572 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.compute.api [None req-170def97-bf01-49db-867e-eaa56291ede8 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] [instance: bbb8462c-9501-4541-b67e-43ec5c5061a7] Fetching instance by UUID {{(pid=116156) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:11:03.296648 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-170def97-bf01-49db-867e-eaa56291ede8 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:11:03.297089 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-170def97-bf01-49db-867e-eaa56291ede8 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:11:03.297850 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-170def97-bf01-49db-867e-eaa56291ede8 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:11:03.298323 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-170def97-bf01-49db-867e-eaa56291ede8 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:11:03.359719 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.policy [None req-170def97-bf01-49db-867e-eaa56291ede8 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97bdf19af9e34fc3886ff451cb9d7a27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '494b56bf5eae4d56a5591546f85bc32b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116156) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:11:03.367393 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: INFO nova.api.openstack.requestlog [None req-170def97-bf01-49db-867e-eaa56291ede8 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] 10.222.0.18 "GET /compute/v2.1/servers/bbb8462c-9501-4541-b67e-43ec5c5061a7" status: 200 len: 1226 microversion: 2.1 time: 0.081085 Dec 15 03:11:03.367949 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: [pid: 116156|app: 0|req: 551/1103] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 03:11:03 2021] GET /compute/v2.1/servers/bbb8462c-9501-4541-b67e-43ec5c5061a7 => generated 1226 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 03:11:03.487885 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi [None req-f750e806-f9b6-449e-ae40-cd10dab1612e tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Calling method '>' {{(pid=116157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:11:03.488702 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.compute.api [None req-f750e806-f9b6-449e-ae40-cd10dab1612e tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] [instance: b89094ac-aee1-4bd6-a33d-8c4347cebfc7] Fetching instance by UUID {{(pid=116157) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:11:03.495269 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-f750e806-f9b6-449e-ae40-cd10dab1612e tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:11:03.495713 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-f750e806-f9b6-449e-ae40-cd10dab1612e tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:11:03.496496 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-f750e806-f9b6-449e-ae40-cd10dab1612e tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:11:03.496914 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-f750e806-f9b6-449e-ae40-cd10dab1612e tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:11:03.525563 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: INFO nova.api.openstack.requestlog [None req-f750e806-f9b6-449e-ae40-cd10dab1612e tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] 10.222.0.18 "GET /compute/v2.1/servers/b89094ac-aee1-4bd6-a33d-8c4347cebfc7/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041506 Dec 15 03:11:03.526125 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: [pid: 116157|app: 0|req: 553/1104] 10.222.0.18 () {60 vars in 1342 bytes} [Wed Dec 15 03:11:03 2021] GET /compute/v2.1/servers/b89094ac-aee1-4bd6-a33d-8c4347cebfc7/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Dec 15 03:11:03.855499 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi [None req-fbe56db4-d887-4e75-9bc6-c014dc895e85 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Calling method '>' {{(pid=116156) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:11:03.856108 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.compute.api [None req-fbe56db4-d887-4e75-9bc6-c014dc895e85 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] [instance: fa7c86bc-c46f-4120-8f3d-d795f8d7c5cc] Fetching instance by UUID {{(pid=116156) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:11:03.868227 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-fbe56db4-d887-4e75-9bc6-c014dc895e85 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:11:03.868673 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-fbe56db4-d887-4e75-9bc6-c014dc895e85 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:11:03.869484 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-fbe56db4-d887-4e75-9bc6-c014dc895e85 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:11:03.869918 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-fbe56db4-d887-4e75-9bc6-c014dc895e85 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:11:03.997714 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.policy [None req-fbe56db4-d887-4e75-9bc6-c014dc895e85 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c4c0c82448e40ba801c0b52ec44e74a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a093d0bf43046aaa845f3cc115f3f5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116156) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:11:04.004929 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: INFO nova.api.openstack.requestlog [None req-fbe56db4-d887-4e75-9bc6-c014dc895e85 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] 10.222.0.18 "GET /compute/v2.1/servers/fa7c86bc-c46f-4120-8f3d-d795f8d7c5cc" status: 200 len: 1570 microversion: 2.1 time: 0.153622 Dec 15 03:11:04.005487 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: [pid: 116156|app: 0|req: 552/1105] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 03:11:03 2021] GET /compute/v2.1/servers/fa7c86bc-c46f-4120-8f3d-d795f8d7c5cc => generated 1570 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 03:11:04.383801 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi [None req-13f143da-da57-46cf-914e-a02ccd1b4e31 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Calling method '>' {{(pid=116157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:11:04.384405 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.compute.api [None req-13f143da-da57-46cf-914e-a02ccd1b4e31 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] [instance: bbb8462c-9501-4541-b67e-43ec5c5061a7] Fetching instance by UUID {{(pid=116157) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:11:04.390586 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-13f143da-da57-46cf-914e-a02ccd1b4e31 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:11:04.391041 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-13f143da-da57-46cf-914e-a02ccd1b4e31 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:11:04.391805 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-13f143da-da57-46cf-914e-a02ccd1b4e31 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:11:04.392234 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-13f143da-da57-46cf-914e-a02ccd1b4e31 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:11:04.449613 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.policy [None req-13f143da-da57-46cf-914e-a02ccd1b4e31 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97bdf19af9e34fc3886ff451cb9d7a27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '494b56bf5eae4d56a5591546f85bc32b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116157) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:11:04.456791 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: INFO nova.api.openstack.requestlog [None req-13f143da-da57-46cf-914e-a02ccd1b4e31 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] 10.222.0.18 "GET /compute/v2.1/servers/bbb8462c-9501-4541-b67e-43ec5c5061a7" status: 200 len: 1226 microversion: 2.1 time: 0.076587 Dec 15 03:11:04.457285 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: [pid: 116157|app: 0|req: 554/1106] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 03:11:04 2021] GET /compute/v2.1/servers/bbb8462c-9501-4541-b67e-43ec5c5061a7 => generated 1226 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 03:11:04.536722 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi [None req-d208aa80-0c9f-4e0e-991c-332b6c6ff14f tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Calling method '>' {{(pid=116156) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:11:04.537656 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.compute.api [None req-d208aa80-0c9f-4e0e-991c-332b6c6ff14f tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] [instance: b89094ac-aee1-4bd6-a33d-8c4347cebfc7] Fetching instance by UUID {{(pid=116156) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:11:04.544506 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-d208aa80-0c9f-4e0e-991c-332b6c6ff14f tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:11:04.544950 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-d208aa80-0c9f-4e0e-991c-332b6c6ff14f tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:11:04.545717 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-d208aa80-0c9f-4e0e-991c-332b6c6ff14f tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:11:04.546174 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-d208aa80-0c9f-4e0e-991c-332b6c6ff14f tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:11:04.573888 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: INFO nova.api.openstack.requestlog [None req-d208aa80-0c9f-4e0e-991c-332b6c6ff14f tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] 10.222.0.18 "GET /compute/v2.1/servers/b89094ac-aee1-4bd6-a33d-8c4347cebfc7/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.040884 Dec 15 03:11:04.574619 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: [pid: 116156|app: 0|req: 553/1107] 10.222.0.18 () {60 vars in 1342 bytes} [Wed Dec 15 03:11:04 2021] GET /compute/v2.1/servers/b89094ac-aee1-4bd6-a33d-8c4347cebfc7/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 03:11:05.022320 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi [None req-0d7a2de5-2da0-4e7d-a068-7840431ddaa4 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Calling method '>' {{(pid=116157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:11:05.022940 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.compute.api [None req-0d7a2de5-2da0-4e7d-a068-7840431ddaa4 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] [instance: fa7c86bc-c46f-4120-8f3d-d795f8d7c5cc] Fetching instance by UUID {{(pid=116157) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:11:05.028817 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-0d7a2de5-2da0-4e7d-a068-7840431ddaa4 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:11:05.029269 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-0d7a2de5-2da0-4e7d-a068-7840431ddaa4 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:11:05.030073 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-0d7a2de5-2da0-4e7d-a068-7840431ddaa4 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:11:05.030511 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-0d7a2de5-2da0-4e7d-a068-7840431ddaa4 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:11:05.157444 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.policy [None req-0d7a2de5-2da0-4e7d-a068-7840431ddaa4 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c4c0c82448e40ba801c0b52ec44e74a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a093d0bf43046aaa845f3cc115f3f5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116157) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:11:05.164655 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: INFO nova.api.openstack.requestlog [None req-0d7a2de5-2da0-4e7d-a068-7840431ddaa4 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] 10.222.0.18 "GET /compute/v2.1/servers/fa7c86bc-c46f-4120-8f3d-d795f8d7c5cc" status: 200 len: 1570 microversion: 2.1 time: 0.146060 Dec 15 03:11:05.165217 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: [pid: 116157|app: 0|req: 555/1108] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 03:11:05 2021] GET /compute/v2.1/servers/fa7c86bc-c46f-4120-8f3d-d795f8d7c5cc => generated 1570 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 03:11:05.473886 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi [None req-928c2d37-f614-4f8d-a01f-34e5d1bbae0b tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Calling method '>' {{(pid=116156) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:11:05.474517 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.compute.api [None req-928c2d37-f614-4f8d-a01f-34e5d1bbae0b tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] [instance: bbb8462c-9501-4541-b67e-43ec5c5061a7] Fetching instance by UUID {{(pid=116156) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:11:05.480732 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-928c2d37-f614-4f8d-a01f-34e5d1bbae0b tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:11:05.481172 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-928c2d37-f614-4f8d-a01f-34e5d1bbae0b tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:11:05.481935 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-928c2d37-f614-4f8d-a01f-34e5d1bbae0b tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:11:05.482396 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-928c2d37-f614-4f8d-a01f-34e5d1bbae0b tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:11:05.539534 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.policy [None req-928c2d37-f614-4f8d-a01f-34e5d1bbae0b tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97bdf19af9e34fc3886ff451cb9d7a27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '494b56bf5eae4d56a5591546f85bc32b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116156) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:11:05.547057 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: INFO nova.api.openstack.requestlog [None req-928c2d37-f614-4f8d-a01f-34e5d1bbae0b tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] 10.222.0.18 "GET /compute/v2.1/servers/bbb8462c-9501-4541-b67e-43ec5c5061a7" status: 200 len: 1226 microversion: 2.1 time: 0.076818 Dec 15 03:11:05.547610 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: [pid: 116156|app: 0|req: 554/1109] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 03:11:05 2021] GET /compute/v2.1/servers/bbb8462c-9501-4541-b67e-43ec5c5061a7 => generated 1226 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 03:11:05.584438 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi [None req-89b14f1c-c58a-4d9e-9cf0-f30bd8a7cc82 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Calling method '>' {{(pid=116157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:11:05.585342 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.compute.api [None req-89b14f1c-c58a-4d9e-9cf0-f30bd8a7cc82 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] [instance: b89094ac-aee1-4bd6-a33d-8c4347cebfc7] Fetching instance by UUID {{(pid=116157) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:11:05.591551 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-89b14f1c-c58a-4d9e-9cf0-f30bd8a7cc82 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:11:05.592001 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-89b14f1c-c58a-4d9e-9cf0-f30bd8a7cc82 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:11:05.592775 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-89b14f1c-c58a-4d9e-9cf0-f30bd8a7cc82 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:11:05.593212 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-89b14f1c-c58a-4d9e-9cf0-f30bd8a7cc82 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:11:05.622750 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: INFO nova.api.openstack.requestlog [None req-89b14f1c-c58a-4d9e-9cf0-f30bd8a7cc82 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] 10.222.0.18 "GET /compute/v2.1/servers/b89094ac-aee1-4bd6-a33d-8c4347cebfc7/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042028 Dec 15 03:11:05.623306 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: [pid: 116157|app: 0|req: 556/1110] 10.222.0.18 () {60 vars in 1342 bytes} [Wed Dec 15 03:11:05 2021] GET /compute/v2.1/servers/b89094ac-aee1-4bd6-a33d-8c4347cebfc7/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 03:11:06.181701 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi [None req-2636820e-0b90-49c7-9403-1f2a00ea3038 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Calling method '>' {{(pid=116156) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:11:06.182515 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.compute.api [None req-2636820e-0b90-49c7-9403-1f2a00ea3038 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] [instance: fa7c86bc-c46f-4120-8f3d-d795f8d7c5cc] Fetching instance by UUID {{(pid=116156) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:11:06.188834 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-2636820e-0b90-49c7-9403-1f2a00ea3038 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:11:06.189293 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-2636820e-0b90-49c7-9403-1f2a00ea3038 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:11:06.190106 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-2636820e-0b90-49c7-9403-1f2a00ea3038 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:11:06.190577 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-2636820e-0b90-49c7-9403-1f2a00ea3038 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:11:06.321024 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.policy [None req-2636820e-0b90-49c7-9403-1f2a00ea3038 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c4c0c82448e40ba801c0b52ec44e74a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a093d0bf43046aaa845f3cc115f3f5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116156) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:11:06.328227 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: INFO nova.api.openstack.requestlog [None req-2636820e-0b90-49c7-9403-1f2a00ea3038 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] 10.222.0.18 "GET /compute/v2.1/servers/fa7c86bc-c46f-4120-8f3d-d795f8d7c5cc" status: 200 len: 1570 microversion: 2.1 time: 0.150369 Dec 15 03:11:06.328788 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: [pid: 116156|app: 0|req: 555/1111] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 03:11:06 2021] GET /compute/v2.1/servers/fa7c86bc-c46f-4120-8f3d-d795f8d7c5cc => generated 1570 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 03:11:06.564176 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi [None req-92d0453e-8a95-418b-97e4-a8f81d5707c8 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Calling method '>' {{(pid=116157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:11:06.564790 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.compute.api [None req-92d0453e-8a95-418b-97e4-a8f81d5707c8 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] [instance: bbb8462c-9501-4541-b67e-43ec5c5061a7] Fetching instance by UUID {{(pid=116157) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:11:06.571203 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-92d0453e-8a95-418b-97e4-a8f81d5707c8 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:11:06.571651 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-92d0453e-8a95-418b-97e4-a8f81d5707c8 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:11:06.572427 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-92d0453e-8a95-418b-97e4-a8f81d5707c8 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:11:06.572869 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-92d0453e-8a95-418b-97e4-a8f81d5707c8 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:11:06.634840 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi [None req-f7ef3da6-1840-43c0-86bb-667f19126bdc tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Calling method '>' {{(pid=116156) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:11:06.635272 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.policy [None req-92d0453e-8a95-418b-97e4-a8f81d5707c8 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97bdf19af9e34fc3886ff451cb9d7a27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '494b56bf5eae4d56a5591546f85bc32b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116157) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:11:06.635894 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.compute.api [None req-f7ef3da6-1840-43c0-86bb-667f19126bdc tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] [instance: b89094ac-aee1-4bd6-a33d-8c4347cebfc7] Fetching instance by UUID {{(pid=116156) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:11:06.642182 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-f7ef3da6-1840-43c0-86bb-667f19126bdc tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:11:06.642327 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: INFO nova.api.openstack.requestlog [None req-92d0453e-8a95-418b-97e4-a8f81d5707c8 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] 10.222.0.18 "GET /compute/v2.1/servers/bbb8462c-9501-4541-b67e-43ec5c5061a7" status: 200 len: 1226 microversion: 2.1 time: 0.081593 Dec 15 03:11:06.642633 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-f7ef3da6-1840-43c0-86bb-667f19126bdc tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:11:06.642765 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: [pid: 116157|app: 0|req: 557/1112] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 03:11:06 2021] GET /compute/v2.1/servers/bbb8462c-9501-4541-b67e-43ec5c5061a7 => generated 1226 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 03:11:06.643419 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-f7ef3da6-1840-43c0-86bb-667f19126bdc tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:11:06.643855 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-f7ef3da6-1840-43c0-86bb-667f19126bdc tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:11:06.671723 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: INFO nova.api.openstack.requestlog [None req-f7ef3da6-1840-43c0-86bb-667f19126bdc tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] 10.222.0.18 "GET /compute/v2.1/servers/b89094ac-aee1-4bd6-a33d-8c4347cebfc7/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041311 Dec 15 03:11:06.672264 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: [pid: 116156|app: 0|req: 556/1113] 10.222.0.18 () {60 vars in 1342 bytes} [Wed Dec 15 03:11:06 2021] GET /compute/v2.1/servers/b89094ac-aee1-4bd6-a33d-8c4347cebfc7/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Dec 15 03:11:07.349642 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi [None req-bb412790-5952-460b-9719-b722806bc774 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Calling method '>' {{(pid=116157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:11:07.350297 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.compute.api [None req-bb412790-5952-460b-9719-b722806bc774 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] [instance: fa7c86bc-c46f-4120-8f3d-d795f8d7c5cc] Fetching instance by UUID {{(pid=116157) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:11:07.356767 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-bb412790-5952-460b-9719-b722806bc774 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:11:07.357216 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-bb412790-5952-460b-9719-b722806bc774 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:11:07.358019 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-bb412790-5952-460b-9719-b722806bc774 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:11:07.358465 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-bb412790-5952-460b-9719-b722806bc774 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:11:07.490695 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.policy [None req-bb412790-5952-460b-9719-b722806bc774 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c4c0c82448e40ba801c0b52ec44e74a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a093d0bf43046aaa845f3cc115f3f5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116157) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:11:07.497822 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: INFO nova.api.openstack.requestlog [None req-bb412790-5952-460b-9719-b722806bc774 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] 10.222.0.18 "GET /compute/v2.1/servers/fa7c86bc-c46f-4120-8f3d-d795f8d7c5cc" status: 200 len: 1570 microversion: 2.1 time: 0.151802 Dec 15 03:11:07.498419 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: [pid: 116157|app: 0|req: 558/1114] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 03:11:07 2021] GET /compute/v2.1/servers/fa7c86bc-c46f-4120-8f3d-d795f8d7c5cc => generated 1570 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 03:11:07.658537 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi [None req-0bcf53f0-6c7b-4238-8b0b-622955742c47 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Calling method '>' {{(pid=116156) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:11:07.659170 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.compute.api [None req-0bcf53f0-6c7b-4238-8b0b-622955742c47 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] [instance: bbb8462c-9501-4541-b67e-43ec5c5061a7] Fetching instance by UUID {{(pid=116156) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:11:07.665296 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-0bcf53f0-6c7b-4238-8b0b-622955742c47 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:11:07.665746 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-0bcf53f0-6c7b-4238-8b0b-622955742c47 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:11:07.666540 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-0bcf53f0-6c7b-4238-8b0b-622955742c47 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:11:07.666973 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-0bcf53f0-6c7b-4238-8b0b-622955742c47 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:11:07.682714 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi [None req-8a024ca3-2afb-4ce1-a802-06ef4cc42c7f tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Calling method '>' {{(pid=116157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:11:07.683619 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.compute.api [None req-8a024ca3-2afb-4ce1-a802-06ef4cc42c7f tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] [instance: b89094ac-aee1-4bd6-a33d-8c4347cebfc7] Fetching instance by UUID {{(pid=116157) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:11:07.689820 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-8a024ca3-2afb-4ce1-a802-06ef4cc42c7f tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:11:07.690250 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-8a024ca3-2afb-4ce1-a802-06ef4cc42c7f tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:11:07.691035 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-8a024ca3-2afb-4ce1-a802-06ef4cc42c7f tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:11:07.691475 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-8a024ca3-2afb-4ce1-a802-06ef4cc42c7f tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:11:07.721493 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: INFO nova.api.openstack.requestlog [None req-8a024ca3-2afb-4ce1-a802-06ef4cc42c7f tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] 10.222.0.18 "GET /compute/v2.1/servers/b89094ac-aee1-4bd6-a33d-8c4347cebfc7/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042541 Dec 15 03:11:07.722453 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: [pid: 116157|app: 0|req: 559/1115] 10.222.0.18 () {60 vars in 1342 bytes} [Wed Dec 15 03:11:07 2021] GET /compute/v2.1/servers/b89094ac-aee1-4bd6-a33d-8c4347cebfc7/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Dec 15 03:11:07.724768 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.policy [None req-0bcf53f0-6c7b-4238-8b0b-622955742c47 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97bdf19af9e34fc3886ff451cb9d7a27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '494b56bf5eae4d56a5591546f85bc32b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116156) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:11:07.732133 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: INFO nova.api.openstack.requestlog [None req-0bcf53f0-6c7b-4238-8b0b-622955742c47 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] 10.222.0.18 "GET /compute/v2.1/servers/bbb8462c-9501-4541-b67e-43ec5c5061a7" status: 200 len: 1226 microversion: 2.1 time: 0.077127 Dec 15 03:11:07.732695 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: [pid: 116156|app: 0|req: 557/1116] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 03:11:07 2021] GET /compute/v2.1/servers/bbb8462c-9501-4541-b67e-43ec5c5061a7 => generated 1226 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 03:11:08.514452 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi [None req-1645d75a-d76a-4fa0-b624-1fd28fd72bef tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Calling method '>' {{(pid=116157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:11:08.514983 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.compute.api [None req-1645d75a-d76a-4fa0-b624-1fd28fd72bef tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] [instance: fa7c86bc-c46f-4120-8f3d-d795f8d7c5cc] Fetching instance by UUID {{(pid=116157) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:11:08.520778 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-1645d75a-d76a-4fa0-b624-1fd28fd72bef tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:11:08.521259 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-1645d75a-d76a-4fa0-b624-1fd28fd72bef tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:11:08.522055 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-1645d75a-d76a-4fa0-b624-1fd28fd72bef tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:11:08.522492 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-1645d75a-d76a-4fa0-b624-1fd28fd72bef tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:11:08.649720 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.policy [None req-1645d75a-d76a-4fa0-b624-1fd28fd72bef tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c4c0c82448e40ba801c0b52ec44e74a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a093d0bf43046aaa845f3cc115f3f5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116157) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:11:08.656910 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: INFO nova.api.openstack.requestlog [None req-1645d75a-d76a-4fa0-b624-1fd28fd72bef tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] 10.222.0.18 "GET /compute/v2.1/servers/fa7c86bc-c46f-4120-8f3d-d795f8d7c5cc" status: 200 len: 1570 microversion: 2.1 time: 0.146113 Dec 15 03:11:08.657468 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: [pid: 116157|app: 0|req: 560/1117] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 03:11:08 2021] GET /compute/v2.1/servers/fa7c86bc-c46f-4120-8f3d-d795f8d7c5cc => generated 1570 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 03:11:08.732876 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi [None req-01627ea2-08d5-43a8-bfb1-9f13a902be7f tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Calling method '>' {{(pid=116156) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:11:08.733788 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.compute.api [None req-01627ea2-08d5-43a8-bfb1-9f13a902be7f tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] [instance: b89094ac-aee1-4bd6-a33d-8c4347cebfc7] Fetching instance by UUID {{(pid=116156) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:11:08.740419 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-01627ea2-08d5-43a8-bfb1-9f13a902be7f tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:11:08.740890 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-01627ea2-08d5-43a8-bfb1-9f13a902be7f tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:11:08.741650 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-01627ea2-08d5-43a8-bfb1-9f13a902be7f tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:11:08.742609 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-01627ea2-08d5-43a8-bfb1-9f13a902be7f tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:11:08.748631 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi [None req-599166ea-21db-4ad1-a549-d64f962fcca7 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Calling method '>' {{(pid=116157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:11:08.749226 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.compute.api [None req-599166ea-21db-4ad1-a549-d64f962fcca7 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] [instance: bbb8462c-9501-4541-b67e-43ec5c5061a7] Fetching instance by UUID {{(pid=116157) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:11:08.755363 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-599166ea-21db-4ad1-a549-d64f962fcca7 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:11:08.755807 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-599166ea-21db-4ad1-a549-d64f962fcca7 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:11:08.756579 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-599166ea-21db-4ad1-a549-d64f962fcca7 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:11:08.757012 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-599166ea-21db-4ad1-a549-d64f962fcca7 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:11:08.771562 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: INFO nova.api.openstack.requestlog [None req-01627ea2-08d5-43a8-bfb1-9f13a902be7f tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] 10.222.0.18 "GET /compute/v2.1/servers/b89094ac-aee1-4bd6-a33d-8c4347cebfc7/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042732 Dec 15 03:11:08.772255 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: [pid: 116156|app: 0|req: 558/1118] 10.222.0.18 () {60 vars in 1342 bytes} [Wed Dec 15 03:11:08 2021] GET /compute/v2.1/servers/b89094ac-aee1-4bd6-a33d-8c4347cebfc7/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 03:11:08.819347 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.policy [None req-599166ea-21db-4ad1-a549-d64f962fcca7 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97bdf19af9e34fc3886ff451cb9d7a27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '494b56bf5eae4d56a5591546f85bc32b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116157) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:11:08.827187 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: INFO nova.api.openstack.requestlog [None req-599166ea-21db-4ad1-a549-d64f962fcca7 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] 10.222.0.18 "GET /compute/v2.1/servers/bbb8462c-9501-4541-b67e-43ec5c5061a7" status: 200 len: 1226 microversion: 2.1 time: 0.082104 Dec 15 03:11:08.827747 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: [pid: 116157|app: 0|req: 561/1119] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 03:11:08 2021] GET /compute/v2.1/servers/bbb8462c-9501-4541-b67e-43ec5c5061a7 => generated 1226 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 03:11:09.674246 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi [None req-58571285-bdaf-46f9-ac3f-7ef9aa395c4b tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Calling method '>' {{(pid=116156) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:11:09.674860 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.compute.api [None req-58571285-bdaf-46f9-ac3f-7ef9aa395c4b tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] [instance: fa7c86bc-c46f-4120-8f3d-d795f8d7c5cc] Fetching instance by UUID {{(pid=116156) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:11:09.680773 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-58571285-bdaf-46f9-ac3f-7ef9aa395c4b tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:11:09.681226 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-58571285-bdaf-46f9-ac3f-7ef9aa395c4b tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:11:09.682037 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-58571285-bdaf-46f9-ac3f-7ef9aa395c4b tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:11:09.682484 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-58571285-bdaf-46f9-ac3f-7ef9aa395c4b tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:11:09.783020 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi [None req-f30480c2-0bca-44d8-8d18-f844e31a4d60 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Calling method '>' {{(pid=116157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:11:09.783924 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.compute.api [None req-f30480c2-0bca-44d8-8d18-f844e31a4d60 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] [instance: b89094ac-aee1-4bd6-a33d-8c4347cebfc7] Fetching instance by UUID {{(pid=116157) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:11:09.790633 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-f30480c2-0bca-44d8-8d18-f844e31a4d60 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:11:09.791087 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-f30480c2-0bca-44d8-8d18-f844e31a4d60 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:11:09.791875 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-f30480c2-0bca-44d8-8d18-f844e31a4d60 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:11:09.792310 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-f30480c2-0bca-44d8-8d18-f844e31a4d60 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:11:09.812475 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.policy [None req-58571285-bdaf-46f9-ac3f-7ef9aa395c4b tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c4c0c82448e40ba801c0b52ec44e74a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a093d0bf43046aaa845f3cc115f3f5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116156) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:11:09.819685 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: INFO nova.api.openstack.requestlog [None req-58571285-bdaf-46f9-ac3f-7ef9aa395c4b tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] 10.222.0.18 "GET /compute/v2.1/servers/fa7c86bc-c46f-4120-8f3d-d795f8d7c5cc" status: 200 len: 1570 microversion: 2.1 time: 0.149122 Dec 15 03:11:09.820735 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: [pid: 116156|app: 0|req: 559/1120] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 03:11:09 2021] GET /compute/v2.1/servers/fa7c86bc-c46f-4120-8f3d-d795f8d7c5cc => generated 1570 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 03:11:09.821222 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: INFO nova.api.openstack.requestlog [None req-f30480c2-0bca-44d8-8d18-f844e31a4d60 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] 10.222.0.18 "GET /compute/v2.1/servers/b89094ac-aee1-4bd6-a33d-8c4347cebfc7/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041945 Dec 15 03:11:09.821777 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: [pid: 116157|app: 0|req: 562/1121] 10.222.0.18 () {60 vars in 1342 bytes} [Wed Dec 15 03:11:09 2021] GET /compute/v2.1/servers/b89094ac-aee1-4bd6-a33d-8c4347cebfc7/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Dec 15 03:11:09.843302 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi [None req-c3d66696-32be-4570-99e5-2db41a9050df tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Calling method '>' {{(pid=116156) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:11:09.843902 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.compute.api [None req-c3d66696-32be-4570-99e5-2db41a9050df tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] [instance: bbb8462c-9501-4541-b67e-43ec5c5061a7] Fetching instance by UUID {{(pid=116156) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:11:09.849521 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-c3d66696-32be-4570-99e5-2db41a9050df tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:11:09.849965 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-c3d66696-32be-4570-99e5-2db41a9050df tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:11:09.850757 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-c3d66696-32be-4570-99e5-2db41a9050df tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:11:09.851187 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-c3d66696-32be-4570-99e5-2db41a9050df tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:11:09.909912 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.policy [None req-c3d66696-32be-4570-99e5-2db41a9050df tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97bdf19af9e34fc3886ff451cb9d7a27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '494b56bf5eae4d56a5591546f85bc32b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116156) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:11:09.917125 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: INFO nova.api.openstack.requestlog [None req-c3d66696-32be-4570-99e5-2db41a9050df tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] 10.222.0.18 "GET /compute/v2.1/servers/bbb8462c-9501-4541-b67e-43ec5c5061a7" status: 200 len: 1226 microversion: 2.1 time: 0.077226 Dec 15 03:11:09.917687 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: [pid: 116156|app: 0|req: 560/1122] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 03:11:09 2021] GET /compute/v2.1/servers/bbb8462c-9501-4541-b67e-43ec5c5061a7 => generated 1226 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 03:11:10.833460 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi [None req-7ef039c0-4b3b-4f35-8219-f6be4795af26 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Calling method '>' {{(pid=116157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:11:10.834484 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.compute.api [None req-7ef039c0-4b3b-4f35-8219-f6be4795af26 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] [instance: b89094ac-aee1-4bd6-a33d-8c4347cebfc7] Fetching instance by UUID {{(pid=116157) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:11:10.836179 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi [None req-eb043a67-673f-435f-9d26-3628ae956fda tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Calling method '>' {{(pid=116156) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:11:10.836788 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.compute.api [None req-eb043a67-673f-435f-9d26-3628ae956fda tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] [instance: fa7c86bc-c46f-4120-8f3d-d795f8d7c5cc] Fetching instance by UUID {{(pid=116156) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:11:10.841033 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-7ef039c0-4b3b-4f35-8219-f6be4795af26 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:11:10.841493 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-7ef039c0-4b3b-4f35-8219-f6be4795af26 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:11:10.842305 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-7ef039c0-4b3b-4f35-8219-f6be4795af26 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:11:10.842425 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-eb043a67-673f-435f-9d26-3628ae956fda tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:11:10.842748 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-7ef039c0-4b3b-4f35-8219-f6be4795af26 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:11:10.842893 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-eb043a67-673f-435f-9d26-3628ae956fda tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:11:10.843632 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-eb043a67-673f-435f-9d26-3628ae956fda tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:11:10.844061 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-eb043a67-673f-435f-9d26-3628ae956fda tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:11:10.872320 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: INFO nova.api.openstack.requestlog [None req-7ef039c0-4b3b-4f35-8219-f6be4795af26 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] 10.222.0.18 "GET /compute/v2.1/servers/b89094ac-aee1-4bd6-a33d-8c4347cebfc7/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043232 Dec 15 03:11:10.872886 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: [pid: 116157|app: 0|req: 563/1123] 10.222.0.18 () {60 vars in 1342 bytes} [Wed Dec 15 03:11:10 2021] GET /compute/v2.1/servers/b89094ac-aee1-4bd6-a33d-8c4347cebfc7/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 03:11:10.933645 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi [None req-efb910b9-dccd-4aa7-a248-d7e952a2aa85 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Calling method '>' {{(pid=116157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:11:10.934284 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.compute.api [None req-efb910b9-dccd-4aa7-a248-d7e952a2aa85 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] [instance: bbb8462c-9501-4541-b67e-43ec5c5061a7] Fetching instance by UUID {{(pid=116157) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:11:10.940291 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-efb910b9-dccd-4aa7-a248-d7e952a2aa85 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:11:10.940853 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-efb910b9-dccd-4aa7-a248-d7e952a2aa85 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:11:10.941638 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-efb910b9-dccd-4aa7-a248-d7e952a2aa85 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:11:10.942139 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-efb910b9-dccd-4aa7-a248-d7e952a2aa85 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:11:10.975764 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.policy [None req-eb043a67-673f-435f-9d26-3628ae956fda tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c4c0c82448e40ba801c0b52ec44e74a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a093d0bf43046aaa845f3cc115f3f5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116156) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:11:10.983510 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: INFO nova.api.openstack.requestlog [None req-eb043a67-673f-435f-9d26-3628ae956fda tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] 10.222.0.18 "GET /compute/v2.1/servers/fa7c86bc-c46f-4120-8f3d-d795f8d7c5cc" status: 200 len: 1570 microversion: 2.1 time: 0.151041 Dec 15 03:11:10.984075 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: [pid: 116156|app: 0|req: 561/1124] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 03:11:10 2021] GET /compute/v2.1/servers/fa7c86bc-c46f-4120-8f3d-d795f8d7c5cc => generated 1570 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 03:11:11.000359 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.policy [None req-efb910b9-dccd-4aa7-a248-d7e952a2aa85 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97bdf19af9e34fc3886ff451cb9d7a27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '494b56bf5eae4d56a5591546f85bc32b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116157) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:11:11.007537 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: INFO nova.api.openstack.requestlog [None req-efb910b9-dccd-4aa7-a248-d7e952a2aa85 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] 10.222.0.18 "GET /compute/v2.1/servers/bbb8462c-9501-4541-b67e-43ec5c5061a7" status: 200 len: 1226 microversion: 2.1 time: 0.077438 Dec 15 03:11:11.008089 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: [pid: 116157|app: 0|req: 564/1125] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 03:11:10 2021] GET /compute/v2.1/servers/bbb8462c-9501-4541-b67e-43ec5c5061a7 => generated 1226 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 03:11:11.884769 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi [None req-0d7a3f00-b2bc-4274-9916-9b608a08b62c tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Calling method '>' {{(pid=116156) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:11:11.885669 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.compute.api [None req-0d7a3f00-b2bc-4274-9916-9b608a08b62c tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] [instance: b89094ac-aee1-4bd6-a33d-8c4347cebfc7] Fetching instance by UUID {{(pid=116156) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:11:11.891892 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-0d7a3f00-b2bc-4274-9916-9b608a08b62c tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:11:11.892339 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-0d7a3f00-b2bc-4274-9916-9b608a08b62c tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:11:11.893142 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-0d7a3f00-b2bc-4274-9916-9b608a08b62c tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:11:11.893577 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-0d7a3f00-b2bc-4274-9916-9b608a08b62c tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:11:11.921451 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: INFO nova.api.openstack.requestlog [None req-0d7a3f00-b2bc-4274-9916-9b608a08b62c tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] 10.222.0.18 "GET /compute/v2.1/servers/b89094ac-aee1-4bd6-a33d-8c4347cebfc7/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041228 Dec 15 03:11:11.922001 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: [pid: 116156|app: 0|req: 562/1126] 10.222.0.18 () {60 vars in 1342 bytes} [Wed Dec 15 03:11:11 2021] GET /compute/v2.1/servers/b89094ac-aee1-4bd6-a33d-8c4347cebfc7/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 03:11:12.000221 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi [None req-4fee5f3d-ccbf-4ff9-a51b-6e9fba8700ac tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Calling method '>' {{(pid=116157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:11:12.000854 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.compute.api [None req-4fee5f3d-ccbf-4ff9-a51b-6e9fba8700ac tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] [instance: fa7c86bc-c46f-4120-8f3d-d795f8d7c5cc] Fetching instance by UUID {{(pid=116157) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:11:12.007103 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-4fee5f3d-ccbf-4ff9-a51b-6e9fba8700ac tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:11:12.008155 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-4fee5f3d-ccbf-4ff9-a51b-6e9fba8700ac tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:11:12.008946 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-4fee5f3d-ccbf-4ff9-a51b-6e9fba8700ac tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:11:12.009385 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-4fee5f3d-ccbf-4ff9-a51b-6e9fba8700ac tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:11:12.023771 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi [None req-cc069794-762e-4126-a998-0b1d42e93887 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Calling method '>' {{(pid=116156) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:11:12.024508 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.compute.api [None req-cc069794-762e-4126-a998-0b1d42e93887 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] [instance: bbb8462c-9501-4541-b67e-43ec5c5061a7] Fetching instance by UUID {{(pid=116156) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:11:12.030185 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-cc069794-762e-4126-a998-0b1d42e93887 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:11:12.030638 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-cc069794-762e-4126-a998-0b1d42e93887 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:11:12.031418 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-cc069794-762e-4126-a998-0b1d42e93887 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:11:12.031856 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-cc069794-762e-4126-a998-0b1d42e93887 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:11:12.090254 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.policy [None req-cc069794-762e-4126-a998-0b1d42e93887 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97bdf19af9e34fc3886ff451cb9d7a27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '494b56bf5eae4d56a5591546f85bc32b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116156) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:11:12.097755 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: INFO nova.api.openstack.requestlog [None req-cc069794-762e-4126-a998-0b1d42e93887 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] 10.222.0.18 "GET /compute/v2.1/servers/bbb8462c-9501-4541-b67e-43ec5c5061a7" status: 200 len: 1226 microversion: 2.1 time: 0.077548 Dec 15 03:11:12.098358 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: [pid: 116156|app: 0|req: 563/1127] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 03:11:12 2021] GET /compute/v2.1/servers/bbb8462c-9501-4541-b67e-43ec5c5061a7 => generated 1226 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 03:11:12.137955 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.policy [None req-4fee5f3d-ccbf-4ff9-a51b-6e9fba8700ac tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c4c0c82448e40ba801c0b52ec44e74a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a093d0bf43046aaa845f3cc115f3f5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116157) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:11:12.145168 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: INFO nova.api.openstack.requestlog [None req-4fee5f3d-ccbf-4ff9-a51b-6e9fba8700ac tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] 10.222.0.18 "GET /compute/v2.1/servers/fa7c86bc-c46f-4120-8f3d-d795f8d7c5cc" status: 200 len: 1570 microversion: 2.1 time: 0.148552 Dec 15 03:11:12.145727 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: [pid: 116157|app: 0|req: 565/1128] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 03:11:11 2021] GET /compute/v2.1/servers/fa7c86bc-c46f-4120-8f3d-d795f8d7c5cc => generated 1570 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 03:11:12.932919 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi [None req-f8257061-8f0b-4535-8cbc-be489d96ec24 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Calling method '>' {{(pid=116156) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:11:12.933831 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.compute.api [None req-f8257061-8f0b-4535-8cbc-be489d96ec24 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] [instance: b89094ac-aee1-4bd6-a33d-8c4347cebfc7] Fetching instance by UUID {{(pid=116156) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:11:12.940129 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-f8257061-8f0b-4535-8cbc-be489d96ec24 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:11:12.940584 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-f8257061-8f0b-4535-8cbc-be489d96ec24 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:11:12.941363 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-f8257061-8f0b-4535-8cbc-be489d96ec24 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:11:12.941801 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-f8257061-8f0b-4535-8cbc-be489d96ec24 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:11:12.970805 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: INFO nova.api.openstack.requestlog [None req-f8257061-8f0b-4535-8cbc-be489d96ec24 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] 10.222.0.18 "GET /compute/v2.1/servers/b89094ac-aee1-4bd6-a33d-8c4347cebfc7/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041687 Dec 15 03:11:12.971343 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: [pid: 116156|app: 0|req: 564/1129] 10.222.0.18 () {60 vars in 1342 bytes} [Wed Dec 15 03:11:12 2021] GET /compute/v2.1/servers/b89094ac-aee1-4bd6-a33d-8c4347cebfc7/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 03:11:13.115535 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi [None req-1b235f68-b5cb-4619-8132-562cbd0c0bce tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Calling method '>' {{(pid=116157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:11:13.116142 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.compute.api [None req-1b235f68-b5cb-4619-8132-562cbd0c0bce tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] [instance: bbb8462c-9501-4541-b67e-43ec5c5061a7] Fetching instance by UUID {{(pid=116157) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:11:13.122389 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-1b235f68-b5cb-4619-8132-562cbd0c0bce tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:11:13.122841 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-1b235f68-b5cb-4619-8132-562cbd0c0bce tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:11:13.123619 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-1b235f68-b5cb-4619-8132-562cbd0c0bce tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:11:13.124054 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-1b235f68-b5cb-4619-8132-562cbd0c0bce tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:11:13.162388 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi [None req-4ab3b298-4e2f-40c6-a3f7-b9086b5b21d9 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Calling method '>' {{(pid=116156) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:11:13.162992 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.compute.api [None req-4ab3b298-4e2f-40c6-a3f7-b9086b5b21d9 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] [instance: fa7c86bc-c46f-4120-8f3d-d795f8d7c5cc] Fetching instance by UUID {{(pid=116156) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:11:13.168758 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-4ab3b298-4e2f-40c6-a3f7-b9086b5b21d9 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:11:13.169206 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-4ab3b298-4e2f-40c6-a3f7-b9086b5b21d9 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:11:13.170002 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-4ab3b298-4e2f-40c6-a3f7-b9086b5b21d9 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:11:13.170446 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-4ab3b298-4e2f-40c6-a3f7-b9086b5b21d9 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:11:13.183500 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.policy [None req-1b235f68-b5cb-4619-8132-562cbd0c0bce tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97bdf19af9e34fc3886ff451cb9d7a27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '494b56bf5eae4d56a5591546f85bc32b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116157) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:11:13.190966 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: INFO nova.api.openstack.requestlog [None req-1b235f68-b5cb-4619-8132-562cbd0c0bce tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] 10.222.0.18 "GET /compute/v2.1/servers/bbb8462c-9501-4541-b67e-43ec5c5061a7" status: 200 len: 1226 microversion: 2.1 time: 0.079333 Dec 15 03:11:13.191527 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: [pid: 116157|app: 0|req: 566/1130] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 03:11:13 2021] GET /compute/v2.1/servers/bbb8462c-9501-4541-b67e-43ec5c5061a7 => generated 1226 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 03:11:13.298353 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.policy [None req-4ab3b298-4e2f-40c6-a3f7-b9086b5b21d9 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c4c0c82448e40ba801c0b52ec44e74a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a093d0bf43046aaa845f3cc115f3f5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116156) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:11:13.306127 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: INFO nova.api.openstack.requestlog [None req-4ab3b298-4e2f-40c6-a3f7-b9086b5b21d9 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] 10.222.0.18 "GET /compute/v2.1/servers/fa7c86bc-c46f-4120-8f3d-d795f8d7c5cc" status: 200 len: 1570 microversion: 2.1 time: 0.147263 Dec 15 03:11:13.306681 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: [pid: 116156|app: 0|req: 565/1131] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 03:11:13 2021] GET /compute/v2.1/servers/fa7c86bc-c46f-4120-8f3d-d795f8d7c5cc => generated 1570 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 03:11:13.982831 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi [None req-648ce52a-769d-4733-bddd-9275784fbf01 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Calling method '>' {{(pid=116157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:11:13.983723 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.compute.api [None req-648ce52a-769d-4733-bddd-9275784fbf01 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] [instance: b89094ac-aee1-4bd6-a33d-8c4347cebfc7] Fetching instance by UUID {{(pid=116157) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:11:13.989754 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-648ce52a-769d-4733-bddd-9275784fbf01 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:11:13.990228 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-648ce52a-769d-4733-bddd-9275784fbf01 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:11:13.990995 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-648ce52a-769d-4733-bddd-9275784fbf01 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:11:13.991425 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-648ce52a-769d-4733-bddd-9275784fbf01 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:11:14.018682 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: INFO nova.api.openstack.requestlog [None req-648ce52a-769d-4733-bddd-9275784fbf01 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] 10.222.0.18 "GET /compute/v2.1/servers/b89094ac-aee1-4bd6-a33d-8c4347cebfc7/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.039612 Dec 15 03:11:14.019214 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: [pid: 116157|app: 0|req: 567/1132] 10.222.0.18 () {60 vars in 1342 bytes} [Wed Dec 15 03:11:13 2021] GET /compute/v2.1/servers/b89094ac-aee1-4bd6-a33d-8c4347cebfc7/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 03:11:14.208293 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi [None req-e4bfc335-3937-4c73-b683-e64977cad1af tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Calling method '>' {{(pid=116156) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:11:14.208906 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.compute.api [None req-e4bfc335-3937-4c73-b683-e64977cad1af tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] [instance: bbb8462c-9501-4541-b67e-43ec5c5061a7] Fetching instance by UUID {{(pid=116156) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:11:14.215711 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-e4bfc335-3937-4c73-b683-e64977cad1af tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:11:14.216159 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-e4bfc335-3937-4c73-b683-e64977cad1af tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:11:14.216946 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-e4bfc335-3937-4c73-b683-e64977cad1af tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:11:14.217384 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-e4bfc335-3937-4c73-b683-e64977cad1af tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:11:14.278156 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.policy [None req-e4bfc335-3937-4c73-b683-e64977cad1af tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97bdf19af9e34fc3886ff451cb9d7a27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '494b56bf5eae4d56a5591546f85bc32b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116156) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:11:14.285352 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: INFO nova.api.openstack.requestlog [None req-e4bfc335-3937-4c73-b683-e64977cad1af tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] 10.222.0.18 "GET /compute/v2.1/servers/bbb8462c-9501-4541-b67e-43ec5c5061a7" status: 200 len: 1226 microversion: 2.1 time: 0.080783 Dec 15 03:11:14.285912 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: [pid: 116156|app: 0|req: 566/1133] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 03:11:14 2021] GET /compute/v2.1/servers/bbb8462c-9501-4541-b67e-43ec5c5061a7 => generated 1226 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 03:11:14.323186 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi [None req-d5da0e3e-f495-4e43-9515-044c21e50eb2 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Calling method '>' {{(pid=116157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:11:14.323797 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.compute.api [None req-d5da0e3e-f495-4e43-9515-044c21e50eb2 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] [instance: fa7c86bc-c46f-4120-8f3d-d795f8d7c5cc] Fetching instance by UUID {{(pid=116157) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:11:14.329950 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-d5da0e3e-f495-4e43-9515-044c21e50eb2 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:11:14.330440 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-d5da0e3e-f495-4e43-9515-044c21e50eb2 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:11:14.331218 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-d5da0e3e-f495-4e43-9515-044c21e50eb2 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:11:14.331656 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-d5da0e3e-f495-4e43-9515-044c21e50eb2 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:11:14.462661 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.policy [None req-d5da0e3e-f495-4e43-9515-044c21e50eb2 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c4c0c82448e40ba801c0b52ec44e74a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a093d0bf43046aaa845f3cc115f3f5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116157) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:11:14.469995 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: INFO nova.api.openstack.requestlog [None req-d5da0e3e-f495-4e43-9515-044c21e50eb2 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] 10.222.0.18 "GET /compute/v2.1/servers/fa7c86bc-c46f-4120-8f3d-d795f8d7c5cc" status: 200 len: 1570 microversion: 2.1 time: 0.150891 Dec 15 03:11:14.470592 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: [pid: 116157|app: 0|req: 568/1134] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 03:11:14 2021] GET /compute/v2.1/servers/fa7c86bc-c46f-4120-8f3d-d795f8d7c5cc => generated 1570 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 03:11:15.029969 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi [None req-d025eef6-db5a-454d-8d1e-e35502450666 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Calling method '>' {{(pid=116156) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:11:15.030893 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.compute.api [None req-d025eef6-db5a-454d-8d1e-e35502450666 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] [instance: b89094ac-aee1-4bd6-a33d-8c4347cebfc7] Fetching instance by UUID {{(pid=116156) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:11:15.036748 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-d025eef6-db5a-454d-8d1e-e35502450666 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:11:15.037199 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-d025eef6-db5a-454d-8d1e-e35502450666 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:11:15.038048 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-d025eef6-db5a-454d-8d1e-e35502450666 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:11:15.038442 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-d025eef6-db5a-454d-8d1e-e35502450666 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:11:15.067159 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: INFO nova.api.openstack.requestlog [None req-d025eef6-db5a-454d-8d1e-e35502450666 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] 10.222.0.18 "GET /compute/v2.1/servers/b89094ac-aee1-4bd6-a33d-8c4347cebfc7/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.040996 Dec 15 03:11:15.067701 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: [pid: 116156|app: 0|req: 567/1135] 10.222.0.18 () {60 vars in 1342 bytes} [Wed Dec 15 03:11:15 2021] GET /compute/v2.1/servers/b89094ac-aee1-4bd6-a33d-8c4347cebfc7/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 03:11:15.302780 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi [None req-1a7b9d56-d6ab-4a06-8113-bc72b35d61bf tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Calling method '>' {{(pid=116157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:11:15.303393 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.compute.api [None req-1a7b9d56-d6ab-4a06-8113-bc72b35d61bf tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] [instance: bbb8462c-9501-4541-b67e-43ec5c5061a7] Fetching instance by UUID {{(pid=116157) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:11:15.309704 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-1a7b9d56-d6ab-4a06-8113-bc72b35d61bf tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:11:15.310189 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-1a7b9d56-d6ab-4a06-8113-bc72b35d61bf tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:11:15.310973 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-1a7b9d56-d6ab-4a06-8113-bc72b35d61bf tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:11:15.311408 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-1a7b9d56-d6ab-4a06-8113-bc72b35d61bf tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:11:15.369224 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.policy [None req-1a7b9d56-d6ab-4a06-8113-bc72b35d61bf tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97bdf19af9e34fc3886ff451cb9d7a27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '494b56bf5eae4d56a5591546f85bc32b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116157) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:11:15.376330 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: INFO nova.api.openstack.requestlog [None req-1a7b9d56-d6ab-4a06-8113-bc72b35d61bf tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] 10.222.0.18 "GET /compute/v2.1/servers/bbb8462c-9501-4541-b67e-43ec5c5061a7" status: 200 len: 1226 microversion: 2.1 time: 0.077384 Dec 15 03:11:15.376891 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: [pid: 116157|app: 0|req: 569/1136] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 03:11:15 2021] GET /compute/v2.1/servers/bbb8462c-9501-4541-b67e-43ec5c5061a7 => generated 1226 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 03:11:15.486521 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi [None req-b963c778-c328-442a-9e07-211f114a6d0b tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Calling method '>' {{(pid=116156) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:11:15.487130 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.compute.api [None req-b963c778-c328-442a-9e07-211f114a6d0b tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] [instance: fa7c86bc-c46f-4120-8f3d-d795f8d7c5cc] Fetching instance by UUID {{(pid=116156) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:11:15.493574 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-b963c778-c328-442a-9e07-211f114a6d0b tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:11:15.494084 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-b963c778-c328-442a-9e07-211f114a6d0b tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:11:15.494862 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-b963c778-c328-442a-9e07-211f114a6d0b tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:11:15.495302 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-b963c778-c328-442a-9e07-211f114a6d0b tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:11:15.830391 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.policy [None req-b963c778-c328-442a-9e07-211f114a6d0b tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c4c0c82448e40ba801c0b52ec44e74a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a093d0bf43046aaa845f3cc115f3f5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116156) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:11:15.838253 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: INFO nova.api.openstack.requestlog [None req-b963c778-c328-442a-9e07-211f114a6d0b tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] 10.222.0.18 "GET /compute/v2.1/servers/fa7c86bc-c46f-4120-8f3d-d795f8d7c5cc" status: 200 len: 1570 microversion: 2.1 time: 0.355293 Dec 15 03:11:15.838815 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: [pid: 116156|app: 0|req: 568/1137] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 03:11:15 2021] GET /compute/v2.1/servers/fa7c86bc-c46f-4120-8f3d-d795f8d7c5cc => generated 1570 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 03:11:16.077920 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi [None req-1b6710cf-93cc-4884-9349-383211bd18fc tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Calling method '>' {{(pid=116157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:11:16.078858 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.compute.api [None req-1b6710cf-93cc-4884-9349-383211bd18fc tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] [instance: b89094ac-aee1-4bd6-a33d-8c4347cebfc7] Fetching instance by UUID {{(pid=116157) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:11:16.084715 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-1b6710cf-93cc-4884-9349-383211bd18fc tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:11:16.085164 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-1b6710cf-93cc-4884-9349-383211bd18fc tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:11:16.086531 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-1b6710cf-93cc-4884-9349-383211bd18fc tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:11:16.086966 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-1b6710cf-93cc-4884-9349-383211bd18fc tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:11:16.114790 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: INFO nova.api.openstack.requestlog [None req-1b6710cf-93cc-4884-9349-383211bd18fc tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] 10.222.0.18 "GET /compute/v2.1/servers/b89094ac-aee1-4bd6-a33d-8c4347cebfc7/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.040643 Dec 15 03:11:16.115332 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: [pid: 116157|app: 0|req: 570/1138] 10.222.0.18 () {60 vars in 1342 bytes} [Wed Dec 15 03:11:16 2021] GET /compute/v2.1/servers/b89094ac-aee1-4bd6-a33d-8c4347cebfc7/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 03:11:16.392718 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi [None req-061c12c7-3f85-43e5-8b35-f643ceac0c79 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Calling method '>' {{(pid=116156) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:11:16.393288 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.compute.api [None req-061c12c7-3f85-43e5-8b35-f643ceac0c79 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] [instance: bbb8462c-9501-4541-b67e-43ec5c5061a7] Fetching instance by UUID {{(pid=116156) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:11:16.399064 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-061c12c7-3f85-43e5-8b35-f643ceac0c79 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:11:16.399508 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-061c12c7-3f85-43e5-8b35-f643ceac0c79 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:11:16.400272 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-061c12c7-3f85-43e5-8b35-f643ceac0c79 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:11:16.400734 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-061c12c7-3f85-43e5-8b35-f643ceac0c79 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:11:16.458078 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.policy [None req-061c12c7-3f85-43e5-8b35-f643ceac0c79 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97bdf19af9e34fc3886ff451cb9d7a27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '494b56bf5eae4d56a5591546f85bc32b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116156) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:11:16.465191 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: INFO nova.api.openstack.requestlog [None req-061c12c7-3f85-43e5-8b35-f643ceac0c79 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] 10.222.0.18 "GET /compute/v2.1/servers/bbb8462c-9501-4541-b67e-43ec5c5061a7" status: 200 len: 1226 microversion: 2.1 time: 0.076131 Dec 15 03:11:16.465744 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: [pid: 116156|app: 0|req: 569/1139] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 03:11:16 2021] GET /compute/v2.1/servers/bbb8462c-9501-4541-b67e-43ec5c5061a7 => generated 1226 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 03:11:16.855392 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi [None req-c3e75c4f-ecb5-42ba-9c2e-a6de4ce60c9b tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Calling method '>' {{(pid=116157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:11:16.855998 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.compute.api [None req-c3e75c4f-ecb5-42ba-9c2e-a6de4ce60c9b tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] [instance: fa7c86bc-c46f-4120-8f3d-d795f8d7c5cc] Fetching instance by UUID {{(pid=116157) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:11:16.862204 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-c3e75c4f-ecb5-42ba-9c2e-a6de4ce60c9b tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:11:16.862656 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-c3e75c4f-ecb5-42ba-9c2e-a6de4ce60c9b tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:11:16.863425 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-c3e75c4f-ecb5-42ba-9c2e-a6de4ce60c9b tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:11:16.864110 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-c3e75c4f-ecb5-42ba-9c2e-a6de4ce60c9b tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:11:16.992209 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.policy [None req-c3e75c4f-ecb5-42ba-9c2e-a6de4ce60c9b tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c4c0c82448e40ba801c0b52ec44e74a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a093d0bf43046aaa845f3cc115f3f5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116157) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:11:16.999431 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: INFO nova.api.openstack.requestlog [None req-c3e75c4f-ecb5-42ba-9c2e-a6de4ce60c9b tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] 10.222.0.18 "GET /compute/v2.1/servers/fa7c86bc-c46f-4120-8f3d-d795f8d7c5cc" status: 200 len: 1570 microversion: 2.1 time: 0.148145 Dec 15 03:11:16.999994 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: [pid: 116157|app: 0|req: 571/1140] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 03:11:16 2021] GET /compute/v2.1/servers/fa7c86bc-c46f-4120-8f3d-d795f8d7c5cc => generated 1570 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 03:11:17.126216 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi [None req-7cbad4c1-8da8-4df3-9c95-66faa238b7a0 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Calling method '>' {{(pid=116156) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:11:17.127050 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.compute.api [None req-7cbad4c1-8da8-4df3-9c95-66faa238b7a0 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] [instance: b89094ac-aee1-4bd6-a33d-8c4347cebfc7] Fetching instance by UUID {{(pid=116156) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:11:17.133290 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-7cbad4c1-8da8-4df3-9c95-66faa238b7a0 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:11:17.133736 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-7cbad4c1-8da8-4df3-9c95-66faa238b7a0 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:11:17.134534 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-7cbad4c1-8da8-4df3-9c95-66faa238b7a0 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:11:17.134966 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-7cbad4c1-8da8-4df3-9c95-66faa238b7a0 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:11:17.164348 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: INFO nova.api.openstack.requestlog [None req-7cbad4c1-8da8-4df3-9c95-66faa238b7a0 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] 10.222.0.18 "GET /compute/v2.1/servers/b89094ac-aee1-4bd6-a33d-8c4347cebfc7/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041388 Dec 15 03:11:17.164886 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: [pid: 116156|app: 0|req: 570/1141] 10.222.0.18 () {60 vars in 1342 bytes} [Wed Dec 15 03:11:17 2021] GET /compute/v2.1/servers/b89094ac-aee1-4bd6-a33d-8c4347cebfc7/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 03:11:17.481698 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi [None req-1db5ab54-5573-4290-8ecb-e2f018c79e89 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Calling method '>' {{(pid=116157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:11:17.482256 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.compute.api [None req-1db5ab54-5573-4290-8ecb-e2f018c79e89 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] [instance: bbb8462c-9501-4541-b67e-43ec5c5061a7] Fetching instance by UUID {{(pid=116157) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:11:17.488047 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-1db5ab54-5573-4290-8ecb-e2f018c79e89 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:11:17.488496 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-1db5ab54-5573-4290-8ecb-e2f018c79e89 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:11:17.489535 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-1db5ab54-5573-4290-8ecb-e2f018c79e89 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:11:17.489956 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-1db5ab54-5573-4290-8ecb-e2f018c79e89 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:11:17.552023 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.policy [None req-1db5ab54-5573-4290-8ecb-e2f018c79e89 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97bdf19af9e34fc3886ff451cb9d7a27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '494b56bf5eae4d56a5591546f85bc32b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116157) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:11:17.559263 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: INFO nova.api.openstack.requestlog [None req-1db5ab54-5573-4290-8ecb-e2f018c79e89 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] 10.222.0.18 "GET /compute/v2.1/servers/bbb8462c-9501-4541-b67e-43ec5c5061a7" status: 200 len: 1226 microversion: 2.1 time: 0.081269 Dec 15 03:11:17.559832 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: [pid: 116157|app: 0|req: 572/1142] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 03:11:17 2021] GET /compute/v2.1/servers/bbb8462c-9501-4541-b67e-43ec5c5061a7 => generated 1226 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 03:11:18.016368 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi [None req-8de42b7d-ce62-4295-a482-0f4d7d2899e3 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Calling method '>' {{(pid=116156) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:11:18.017072 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.compute.api [None req-8de42b7d-ce62-4295-a482-0f4d7d2899e3 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] [instance: fa7c86bc-c46f-4120-8f3d-d795f8d7c5cc] Fetching instance by UUID {{(pid=116156) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:11:18.023192 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-8de42b7d-ce62-4295-a482-0f4d7d2899e3 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:11:18.023646 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-8de42b7d-ce62-4295-a482-0f4d7d2899e3 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:11:18.024420 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-8de42b7d-ce62-4295-a482-0f4d7d2899e3 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:11:18.024859 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-8de42b7d-ce62-4295-a482-0f4d7d2899e3 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:11:18.156532 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.policy [None req-8de42b7d-ce62-4295-a482-0f4d7d2899e3 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c4c0c82448e40ba801c0b52ec44e74a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a093d0bf43046aaa845f3cc115f3f5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116156) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:11:18.164200 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: INFO nova.api.openstack.requestlog [None req-8de42b7d-ce62-4295-a482-0f4d7d2899e3 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] 10.222.0.18 "GET /compute/v2.1/servers/fa7c86bc-c46f-4120-8f3d-d795f8d7c5cc" status: 200 len: 1570 microversion: 2.1 time: 0.151206 Dec 15 03:11:18.164763 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: [pid: 116156|app: 0|req: 571/1143] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 03:11:18 2021] GET /compute/v2.1/servers/fa7c86bc-c46f-4120-8f3d-d795f8d7c5cc => generated 1570 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 03:11:18.176086 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi [None req-cb87f7d9-a895-4a80-b8a4-c7774f7e0780 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Calling method '>' {{(pid=116157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:11:18.177069 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.compute.api [None req-cb87f7d9-a895-4a80-b8a4-c7774f7e0780 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] [instance: b89094ac-aee1-4bd6-a33d-8c4347cebfc7] Fetching instance by UUID {{(pid=116157) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:11:18.183883 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-cb87f7d9-a895-4a80-b8a4-c7774f7e0780 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:11:18.184334 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-cb87f7d9-a895-4a80-b8a4-c7774f7e0780 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:11:18.185110 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-cb87f7d9-a895-4a80-b8a4-c7774f7e0780 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:11:18.185550 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-cb87f7d9-a895-4a80-b8a4-c7774f7e0780 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:11:18.214223 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: INFO nova.api.openstack.requestlog [None req-cb87f7d9-a895-4a80-b8a4-c7774f7e0780 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] 10.222.0.18 "GET /compute/v2.1/servers/b89094ac-aee1-4bd6-a33d-8c4347cebfc7/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041881 Dec 15 03:11:18.214788 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: [pid: 116157|app: 0|req: 573/1144] 10.222.0.18 () {60 vars in 1342 bytes} [Wed Dec 15 03:11:18 2021] GET /compute/v2.1/servers/b89094ac-aee1-4bd6-a33d-8c4347cebfc7/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 03:11:18.575788 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi [None req-36633a2e-cb6d-4132-8445-7f641257d564 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Calling method '>' {{(pid=116156) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:11:18.576396 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.compute.api [None req-36633a2e-cb6d-4132-8445-7f641257d564 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] [instance: bbb8462c-9501-4541-b67e-43ec5c5061a7] Fetching instance by UUID {{(pid=116156) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:11:18.582405 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-36633a2e-cb6d-4132-8445-7f641257d564 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:11:18.582855 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-36633a2e-cb6d-4132-8445-7f641257d564 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:11:18.583627 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-36633a2e-cb6d-4132-8445-7f641257d564 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:11:18.584057 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-36633a2e-cb6d-4132-8445-7f641257d564 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:11:18.641362 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.policy [None req-36633a2e-cb6d-4132-8445-7f641257d564 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97bdf19af9e34fc3886ff451cb9d7a27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '494b56bf5eae4d56a5591546f85bc32b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116156) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:11:18.649006 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: INFO nova.api.openstack.requestlog [None req-36633a2e-cb6d-4132-8445-7f641257d564 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] 10.222.0.18 "GET /compute/v2.1/servers/bbb8462c-9501-4541-b67e-43ec5c5061a7" status: 200 len: 1226 microversion: 2.1 time: 0.076917 Dec 15 03:11:18.649558 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: [pid: 116156|app: 0|req: 572/1145] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 03:11:18 2021] GET /compute/v2.1/servers/bbb8462c-9501-4541-b67e-43ec5c5061a7 => generated 1226 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 03:11:19.181083 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi [None req-491395ae-f0d8-4d6b-ad82-44997ced8d06 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Calling method '>' {{(pid=116157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:11:19.181688 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.compute.api [None req-491395ae-f0d8-4d6b-ad82-44997ced8d06 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] [instance: fa7c86bc-c46f-4120-8f3d-d795f8d7c5cc] Fetching instance by UUID {{(pid=116157) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:11:19.187989 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-491395ae-f0d8-4d6b-ad82-44997ced8d06 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:11:19.188427 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-491395ae-f0d8-4d6b-ad82-44997ced8d06 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:11:19.189202 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-491395ae-f0d8-4d6b-ad82-44997ced8d06 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:11:19.189634 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-491395ae-f0d8-4d6b-ad82-44997ced8d06 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:11:19.224530 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi [None req-4669b974-26e8-4541-9490-71e466e43828 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Calling method '>' {{(pid=116156) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:11:19.225536 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.compute.api [None req-4669b974-26e8-4541-9490-71e466e43828 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] [instance: b89094ac-aee1-4bd6-a33d-8c4347cebfc7] Fetching instance by UUID {{(pid=116156) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:11:19.232522 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-4669b974-26e8-4541-9490-71e466e43828 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:11:19.233044 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-4669b974-26e8-4541-9490-71e466e43828 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:11:19.233904 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-4669b974-26e8-4541-9490-71e466e43828 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:11:19.234432 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-4669b974-26e8-4541-9490-71e466e43828 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:11:19.262951 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: INFO nova.api.openstack.requestlog [None req-4669b974-26e8-4541-9490-71e466e43828 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] 10.222.0.18 "GET /compute/v2.1/servers/b89094ac-aee1-4bd6-a33d-8c4347cebfc7/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042011 Dec 15 03:11:19.263510 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: [pid: 116156|app: 0|req: 573/1146] 10.222.0.18 () {60 vars in 1342 bytes} [Wed Dec 15 03:11:19 2021] GET /compute/v2.1/servers/b89094ac-aee1-4bd6-a33d-8c4347cebfc7/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Dec 15 03:11:19.321383 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.policy [None req-491395ae-f0d8-4d6b-ad82-44997ced8d06 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c4c0c82448e40ba801c0b52ec44e74a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a093d0bf43046aaa845f3cc115f3f5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116157) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:11:19.328624 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: INFO nova.api.openstack.requestlog [None req-491395ae-f0d8-4d6b-ad82-44997ced8d06 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] 10.222.0.18 "GET /compute/v2.1/servers/fa7c86bc-c46f-4120-8f3d-d795f8d7c5cc" status: 200 len: 1570 microversion: 2.1 time: 0.151192 Dec 15 03:11:19.329179 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: [pid: 116157|app: 0|req: 574/1147] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 03:11:19 2021] GET /compute/v2.1/servers/fa7c86bc-c46f-4120-8f3d-d795f8d7c5cc => generated 1570 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 03:11:19.665464 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi [None req-c935b257-79af-472c-b433-13bab1bd8e5d tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Calling method '>' {{(pid=116156) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:11:19.666128 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.compute.api [None req-c935b257-79af-472c-b433-13bab1bd8e5d tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] [instance: bbb8462c-9501-4541-b67e-43ec5c5061a7] Fetching instance by UUID {{(pid=116156) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:11:19.671938 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-c935b257-79af-472c-b433-13bab1bd8e5d tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:11:19.672386 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-c935b257-79af-472c-b433-13bab1bd8e5d tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:11:19.673157 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-c935b257-79af-472c-b433-13bab1bd8e5d tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:11:19.673589 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-c935b257-79af-472c-b433-13bab1bd8e5d tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:11:19.731032 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.policy [None req-c935b257-79af-472c-b433-13bab1bd8e5d tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97bdf19af9e34fc3886ff451cb9d7a27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '494b56bf5eae4d56a5591546f85bc32b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116156) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:11:19.738196 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: INFO nova.api.openstack.requestlog [None req-c935b257-79af-472c-b433-13bab1bd8e5d tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] 10.222.0.18 "GET /compute/v2.1/servers/bbb8462c-9501-4541-b67e-43ec5c5061a7" status: 200 len: 1226 microversion: 2.1 time: 0.076290 Dec 15 03:11:19.738760 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: [pid: 116156|app: 0|req: 574/1148] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 03:11:19 2021] GET /compute/v2.1/servers/bbb8462c-9501-4541-b67e-43ec5c5061a7 => generated 1226 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 03:11:20.274895 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi [None req-2dfc6390-a6ad-424b-91d6-52d3b495f7e9 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Calling method '>' {{(pid=116157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:11:20.275807 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.compute.api [None req-2dfc6390-a6ad-424b-91d6-52d3b495f7e9 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] [instance: b89094ac-aee1-4bd6-a33d-8c4347cebfc7] Fetching instance by UUID {{(pid=116157) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:11:20.282104 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-2dfc6390-a6ad-424b-91d6-52d3b495f7e9 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:11:20.282563 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-2dfc6390-a6ad-424b-91d6-52d3b495f7e9 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:11:20.283345 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-2dfc6390-a6ad-424b-91d6-52d3b495f7e9 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:11:20.283785 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-2dfc6390-a6ad-424b-91d6-52d3b495f7e9 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:11:20.312104 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: INFO nova.api.openstack.requestlog [None req-2dfc6390-a6ad-424b-91d6-52d3b495f7e9 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] 10.222.0.18 "GET /compute/v2.1/servers/b89094ac-aee1-4bd6-a33d-8c4347cebfc7/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041500 Dec 15 03:11:20.312650 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: [pid: 116157|app: 0|req: 575/1149] 10.222.0.18 () {60 vars in 1342 bytes} [Wed Dec 15 03:11:20 2021] GET /compute/v2.1/servers/b89094ac-aee1-4bd6-a33d-8c4347cebfc7/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 03:11:20.345686 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi [None req-5a9888f2-31ea-4142-b59d-93d72c109832 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Calling method '>' {{(pid=116156) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:11:20.346338 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.compute.api [None req-5a9888f2-31ea-4142-b59d-93d72c109832 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] [instance: fa7c86bc-c46f-4120-8f3d-d795f8d7c5cc] Fetching instance by UUID {{(pid=116156) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:11:20.352487 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-5a9888f2-31ea-4142-b59d-93d72c109832 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:11:20.352943 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-5a9888f2-31ea-4142-b59d-93d72c109832 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:11:20.353723 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-5a9888f2-31ea-4142-b59d-93d72c109832 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:11:20.354198 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-5a9888f2-31ea-4142-b59d-93d72c109832 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:11:20.480551 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.policy [None req-5a9888f2-31ea-4142-b59d-93d72c109832 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c4c0c82448e40ba801c0b52ec44e74a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a093d0bf43046aaa845f3cc115f3f5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116156) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:11:20.487657 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: INFO nova.api.openstack.requestlog [None req-5a9888f2-31ea-4142-b59d-93d72c109832 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] 10.222.0.18 "GET /compute/v2.1/servers/fa7c86bc-c46f-4120-8f3d-d795f8d7c5cc" status: 200 len: 1570 microversion: 2.1 time: 0.145562 Dec 15 03:11:20.488217 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: [pid: 116156|app: 0|req: 575/1150] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 03:11:20 2021] GET /compute/v2.1/servers/fa7c86bc-c46f-4120-8f3d-d795f8d7c5cc => generated 1570 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 03:11:20.755023 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi [None req-6e9e487a-65ab-4108-a9e1-01eb635286ce tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Calling method '>' {{(pid=116157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:11:20.755560 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.compute.api [None req-6e9e487a-65ab-4108-a9e1-01eb635286ce tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] [instance: bbb8462c-9501-4541-b67e-43ec5c5061a7] Fetching instance by UUID {{(pid=116157) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:11:20.762152 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-6e9e487a-65ab-4108-a9e1-01eb635286ce tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:11:20.762600 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-6e9e487a-65ab-4108-a9e1-01eb635286ce tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:11:20.763369 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-6e9e487a-65ab-4108-a9e1-01eb635286ce tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:11:20.763800 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-6e9e487a-65ab-4108-a9e1-01eb635286ce tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:11:20.822247 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.policy [None req-6e9e487a-65ab-4108-a9e1-01eb635286ce tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97bdf19af9e34fc3886ff451cb9d7a27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '494b56bf5eae4d56a5591546f85bc32b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116157) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:11:20.830092 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: INFO nova.api.openstack.requestlog [None req-6e9e487a-65ab-4108-a9e1-01eb635286ce tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] 10.222.0.18 "GET /compute/v2.1/servers/bbb8462c-9501-4541-b67e-43ec5c5061a7" status: 200 len: 1226 microversion: 2.1 time: 0.078682 Dec 15 03:11:20.830652 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: [pid: 116157|app: 0|req: 576/1151] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 03:11:20 2021] GET /compute/v2.1/servers/bbb8462c-9501-4541-b67e-43ec5c5061a7 => generated 1226 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 03:11:21.323423 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi [None req-050a7318-d740-443f-8d33-3fc8a678f788 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Calling method '>' {{(pid=116156) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:11:21.324344 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.compute.api [None req-050a7318-d740-443f-8d33-3fc8a678f788 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] [instance: b89094ac-aee1-4bd6-a33d-8c4347cebfc7] Fetching instance by UUID {{(pid=116156) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:11:21.330157 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-050a7318-d740-443f-8d33-3fc8a678f788 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:11:21.330611 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-050a7318-d740-443f-8d33-3fc8a678f788 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:11:21.331379 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-050a7318-d740-443f-8d33-3fc8a678f788 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:11:21.331807 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-050a7318-d740-443f-8d33-3fc8a678f788 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:11:21.360139 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: INFO nova.api.openstack.requestlog [None req-050a7318-d740-443f-8d33-3fc8a678f788 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] 10.222.0.18 "GET /compute/v2.1/servers/b89094ac-aee1-4bd6-a33d-8c4347cebfc7/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.040531 Dec 15 03:11:21.360728 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: [pid: 116156|app: 0|req: 576/1152] 10.222.0.18 () {60 vars in 1342 bytes} [Wed Dec 15 03:11:21 2021] GET /compute/v2.1/servers/b89094ac-aee1-4bd6-a33d-8c4347cebfc7/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 03:11:21.504465 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi [None req-0b4c386a-1da8-4b67-8b2f-ff13133e473d tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Calling method '>' {{(pid=116157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:11:21.505002 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.compute.api [None req-0b4c386a-1da8-4b67-8b2f-ff13133e473d tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] [instance: fa7c86bc-c46f-4120-8f3d-d795f8d7c5cc] Fetching instance by UUID {{(pid=116157) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:11:21.511206 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-0b4c386a-1da8-4b67-8b2f-ff13133e473d tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:11:21.511654 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-0b4c386a-1da8-4b67-8b2f-ff13133e473d tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:11:21.512427 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-0b4c386a-1da8-4b67-8b2f-ff13133e473d tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:11:21.512858 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-0b4c386a-1da8-4b67-8b2f-ff13133e473d tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:11:21.643357 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.policy [None req-0b4c386a-1da8-4b67-8b2f-ff13133e473d tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c4c0c82448e40ba801c0b52ec44e74a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a093d0bf43046aaa845f3cc115f3f5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116157) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:11:21.651159 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: INFO nova.api.openstack.requestlog [None req-0b4c386a-1da8-4b67-8b2f-ff13133e473d tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] 10.222.0.18 "GET /compute/v2.1/servers/fa7c86bc-c46f-4120-8f3d-d795f8d7c5cc" status: 200 len: 1570 microversion: 2.1 time: 0.150321 Dec 15 03:11:21.651735 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: [pid: 116157|app: 0|req: 577/1153] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 03:11:21 2021] GET /compute/v2.1/servers/fa7c86bc-c46f-4120-8f3d-d795f8d7c5cc => generated 1570 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 03:11:21.845873 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi [None req-f997c0c4-d871-4f93-8e4e-cf2b30db4c5e tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Calling method '>' {{(pid=116156) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:11:21.846525 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.compute.api [None req-f997c0c4-d871-4f93-8e4e-cf2b30db4c5e tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] [instance: bbb8462c-9501-4541-b67e-43ec5c5061a7] Fetching instance by UUID {{(pid=116156) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:11:21.852369 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-f997c0c4-d871-4f93-8e4e-cf2b30db4c5e tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:11:21.852816 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-f997c0c4-d871-4f93-8e4e-cf2b30db4c5e tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:11:21.853593 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-f997c0c4-d871-4f93-8e4e-cf2b30db4c5e tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:11:21.854041 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-f997c0c4-d871-4f93-8e4e-cf2b30db4c5e tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:11:21.921175 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.policy [None req-f997c0c4-d871-4f93-8e4e-cf2b30db4c5e tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97bdf19af9e34fc3886ff451cb9d7a27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '494b56bf5eae4d56a5591546f85bc32b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116156) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:11:21.928485 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: INFO nova.api.openstack.requestlog [None req-f997c0c4-d871-4f93-8e4e-cf2b30db4c5e tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] 10.222.0.18 "GET /compute/v2.1/servers/bbb8462c-9501-4541-b67e-43ec5c5061a7" status: 200 len: 1226 microversion: 2.1 time: 0.086269 Dec 15 03:11:21.929049 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: [pid: 116156|app: 0|req: 577/1154] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 03:11:21 2021] GET /compute/v2.1/servers/bbb8462c-9501-4541-b67e-43ec5c5061a7 => generated 1226 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 03:11:22.372261 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi [None req-c1e80282-ceb8-4822-b7e6-d0097bfaf6c0 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Calling method '>' {{(pid=116157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:11:22.373186 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.compute.api [None req-c1e80282-ceb8-4822-b7e6-d0097bfaf6c0 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] [instance: b89094ac-aee1-4bd6-a33d-8c4347cebfc7] Fetching instance by UUID {{(pid=116157) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:11:22.379050 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-c1e80282-ceb8-4822-b7e6-d0097bfaf6c0 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:11:22.379503 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-c1e80282-ceb8-4822-b7e6-d0097bfaf6c0 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:11:22.380337 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-c1e80282-ceb8-4822-b7e6-d0097bfaf6c0 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:11:22.380773 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-c1e80282-ceb8-4822-b7e6-d0097bfaf6c0 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:11:22.410140 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: INFO nova.api.openstack.requestlog [None req-c1e80282-ceb8-4822-b7e6-d0097bfaf6c0 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] 10.222.0.18 "GET /compute/v2.1/servers/b89094ac-aee1-4bd6-a33d-8c4347cebfc7/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041550 Dec 15 03:11:22.410690 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: [pid: 116157|app: 0|req: 578/1155] 10.222.0.18 () {60 vars in 1342 bytes} [Wed Dec 15 03:11:22 2021] GET /compute/v2.1/servers/b89094ac-aee1-4bd6-a33d-8c4347cebfc7/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 03:11:22.668390 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi [None req-39a0c1a2-07c9-4563-b7ef-afd78b51fd05 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Calling method '>' {{(pid=116156) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:11:22.669031 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.compute.api [None req-39a0c1a2-07c9-4563-b7ef-afd78b51fd05 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] [instance: fa7c86bc-c46f-4120-8f3d-d795f8d7c5cc] Fetching instance by UUID {{(pid=116156) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:11:22.675309 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-39a0c1a2-07c9-4563-b7ef-afd78b51fd05 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:11:22.675768 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-39a0c1a2-07c9-4563-b7ef-afd78b51fd05 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:11:22.676549 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-39a0c1a2-07c9-4563-b7ef-afd78b51fd05 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:11:22.676991 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-39a0c1a2-07c9-4563-b7ef-afd78b51fd05 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:11:22.803762 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.policy [None req-39a0c1a2-07c9-4563-b7ef-afd78b51fd05 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c4c0c82448e40ba801c0b52ec44e74a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a093d0bf43046aaa845f3cc115f3f5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116156) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:11:22.811811 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: INFO nova.api.openstack.requestlog [None req-39a0c1a2-07c9-4563-b7ef-afd78b51fd05 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] 10.222.0.18 "GET /compute/v2.1/servers/fa7c86bc-c46f-4120-8f3d-d795f8d7c5cc" status: 200 len: 1570 microversion: 2.1 time: 0.147098 Dec 15 03:11:22.812373 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: [pid: 116156|app: 0|req: 578/1156] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 03:11:22 2021] GET /compute/v2.1/servers/fa7c86bc-c46f-4120-8f3d-d795f8d7c5cc => generated 1570 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 03:11:22.944514 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi [None req-0391bab4-6fa6-4791-9da1-68179c020e4c tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Calling method '>' {{(pid=116157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:11:22.945077 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.compute.api [None req-0391bab4-6fa6-4791-9da1-68179c020e4c tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] [instance: bbb8462c-9501-4541-b67e-43ec5c5061a7] Fetching instance by UUID {{(pid=116157) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:11:22.951252 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-0391bab4-6fa6-4791-9da1-68179c020e4c tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:11:22.951704 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-0391bab4-6fa6-4791-9da1-68179c020e4c tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:11:22.952479 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-0391bab4-6fa6-4791-9da1-68179c020e4c tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:11:22.953019 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-0391bab4-6fa6-4791-9da1-68179c020e4c tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:11:23.011599 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.policy [None req-0391bab4-6fa6-4791-9da1-68179c020e4c tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97bdf19af9e34fc3886ff451cb9d7a27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '494b56bf5eae4d56a5591546f85bc32b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116157) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:11:23.018998 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: INFO nova.api.openstack.requestlog [None req-0391bab4-6fa6-4791-9da1-68179c020e4c tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] 10.222.0.18 "GET /compute/v2.1/servers/bbb8462c-9501-4541-b67e-43ec5c5061a7" status: 200 len: 1226 microversion: 2.1 time: 0.078340 Dec 15 03:11:23.019566 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: [pid: 116157|app: 0|req: 579/1157] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 03:11:22 2021] GET /compute/v2.1/servers/bbb8462c-9501-4541-b67e-43ec5c5061a7 => generated 1226 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 03:11:23.420663 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi [None req-da4fedf8-ccb6-41dc-b3a6-43d770990b77 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Calling method '>' {{(pid=116156) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:11:23.421872 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.compute.api [None req-da4fedf8-ccb6-41dc-b3a6-43d770990b77 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] [instance: b89094ac-aee1-4bd6-a33d-8c4347cebfc7] Fetching instance by UUID {{(pid=116156) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:11:23.427521 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-da4fedf8-ccb6-41dc-b3a6-43d770990b77 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:11:23.427980 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-da4fedf8-ccb6-41dc-b3a6-43d770990b77 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:11:23.428761 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-da4fedf8-ccb6-41dc-b3a6-43d770990b77 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:11:23.429295 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-da4fedf8-ccb6-41dc-b3a6-43d770990b77 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:11:23.458346 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: INFO nova.api.openstack.requestlog [None req-da4fedf8-ccb6-41dc-b3a6-43d770990b77 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] 10.222.0.18 "GET /compute/v2.1/servers/b89094ac-aee1-4bd6-a33d-8c4347cebfc7/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041271 Dec 15 03:11:23.458842 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: [pid: 116156|app: 0|req: 579/1158] 10.222.0.18 () {60 vars in 1342 bytes} [Wed Dec 15 03:11:23 2021] GET /compute/v2.1/servers/b89094ac-aee1-4bd6-a33d-8c4347cebfc7/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 03:11:23.828845 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi [None req-ae8393ed-c55a-4313-b407-0dbf18e32786 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Calling method '>' {{(pid=116157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:11:23.829482 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.compute.api [None req-ae8393ed-c55a-4313-b407-0dbf18e32786 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] [instance: fa7c86bc-c46f-4120-8f3d-d795f8d7c5cc] Fetching instance by UUID {{(pid=116157) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:11:23.836162 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-ae8393ed-c55a-4313-b407-0dbf18e32786 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:11:23.836606 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-ae8393ed-c55a-4313-b407-0dbf18e32786 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:11:23.837384 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-ae8393ed-c55a-4313-b407-0dbf18e32786 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:11:23.837818 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-ae8393ed-c55a-4313-b407-0dbf18e32786 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:11:23.972039 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.policy [None req-ae8393ed-c55a-4313-b407-0dbf18e32786 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c4c0c82448e40ba801c0b52ec44e74a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a093d0bf43046aaa845f3cc115f3f5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116157) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:11:23.979378 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: INFO nova.api.openstack.requestlog [None req-ae8393ed-c55a-4313-b407-0dbf18e32786 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] 10.222.0.18 "GET /compute/v2.1/servers/fa7c86bc-c46f-4120-8f3d-d795f8d7c5cc" status: 200 len: 1570 microversion: 2.1 time: 0.154313 Dec 15 03:11:23.979949 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: [pid: 116157|app: 0|req: 580/1159] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 03:11:23 2021] GET /compute/v2.1/servers/fa7c86bc-c46f-4120-8f3d-d795f8d7c5cc => generated 1570 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 03:11:24.035774 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi [None req-83031345-adf9-4a7d-abe0-0f7efadf775a tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Calling method '>' {{(pid=116156) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:11:24.036517 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.compute.api [None req-83031345-adf9-4a7d-abe0-0f7efadf775a tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] [instance: bbb8462c-9501-4541-b67e-43ec5c5061a7] Fetching instance by UUID {{(pid=116156) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:11:24.043487 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-83031345-adf9-4a7d-abe0-0f7efadf775a tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:11:24.043940 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-83031345-adf9-4a7d-abe0-0f7efadf775a tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:11:24.044716 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-83031345-adf9-4a7d-abe0-0f7efadf775a tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:11:24.045148 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-83031345-adf9-4a7d-abe0-0f7efadf775a tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:11:24.105107 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.policy [None req-83031345-adf9-4a7d-abe0-0f7efadf775a tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97bdf19af9e34fc3886ff451cb9d7a27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '494b56bf5eae4d56a5591546f85bc32b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116156) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:11:24.112390 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: INFO nova.api.openstack.requestlog [None req-83031345-adf9-4a7d-abe0-0f7efadf775a tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] 10.222.0.18 "GET /compute/v2.1/servers/bbb8462c-9501-4541-b67e-43ec5c5061a7" status: 200 len: 1226 microversion: 2.1 time: 0.080229 Dec 15 03:11:24.112936 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: [pid: 116156|app: 0|req: 580/1160] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 03:11:24 2021] GET /compute/v2.1/servers/bbb8462c-9501-4541-b67e-43ec5c5061a7 => generated 1226 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 03:11:24.470292 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi [None req-34052faa-d9d4-4ade-b3f1-7a6b7ad53feb tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Calling method '>' {{(pid=116157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:11:24.471128 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.compute.api [None req-34052faa-d9d4-4ade-b3f1-7a6b7ad53feb tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] [instance: b89094ac-aee1-4bd6-a33d-8c4347cebfc7] Fetching instance by UUID {{(pid=116157) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:11:24.477635 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-34052faa-d9d4-4ade-b3f1-7a6b7ad53feb tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:11:24.478128 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-34052faa-d9d4-4ade-b3f1-7a6b7ad53feb tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:11:24.478914 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-34052faa-d9d4-4ade-b3f1-7a6b7ad53feb tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:11:24.479362 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-34052faa-d9d4-4ade-b3f1-7a6b7ad53feb tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:11:24.507395 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: INFO nova.api.openstack.requestlog [None req-34052faa-d9d4-4ade-b3f1-7a6b7ad53feb tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] 10.222.0.18 "GET /compute/v2.1/servers/b89094ac-aee1-4bd6-a33d-8c4347cebfc7/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.040973 Dec 15 03:11:24.507934 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: [pid: 116157|app: 0|req: 581/1161] 10.222.0.18 () {60 vars in 1342 bytes} [Wed Dec 15 03:11:24 2021] GET /compute/v2.1/servers/b89094ac-aee1-4bd6-a33d-8c4347cebfc7/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 03:11:24.996212 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi [None req-b8991917-e822-4b22-ac0f-9f58d87269ab tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Calling method '>' {{(pid=116156) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:11:24.996819 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.compute.api [None req-b8991917-e822-4b22-ac0f-9f58d87269ab tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] [instance: fa7c86bc-c46f-4120-8f3d-d795f8d7c5cc] Fetching instance by UUID {{(pid=116156) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:11:25.002726 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-b8991917-e822-4b22-ac0f-9f58d87269ab tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:11:25.003193 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-b8991917-e822-4b22-ac0f-9f58d87269ab tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:11:25.003993 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-b8991917-e822-4b22-ac0f-9f58d87269ab tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:11:25.004424 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-b8991917-e822-4b22-ac0f-9f58d87269ab tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:11:25.129802 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi [None req-f04e362d-fe22-4001-906c-bd9cc3640720 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Calling method '>' {{(pid=116157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:11:25.130436 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.compute.api [None req-f04e362d-fe22-4001-906c-bd9cc3640720 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] [instance: bbb8462c-9501-4541-b67e-43ec5c5061a7] Fetching instance by UUID {{(pid=116157) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:11:25.136720 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-f04e362d-fe22-4001-906c-bd9cc3640720 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:11:25.137171 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-f04e362d-fe22-4001-906c-bd9cc3640720 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:11:25.137957 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-f04e362d-fe22-4001-906c-bd9cc3640720 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:11:25.138419 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-f04e362d-fe22-4001-906c-bd9cc3640720 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:11:25.138616 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.policy [None req-b8991917-e822-4b22-ac0f-9f58d87269ab tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c4c0c82448e40ba801c0b52ec44e74a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a093d0bf43046aaa845f3cc115f3f5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116156) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:11:25.146067 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: INFO nova.api.openstack.requestlog [None req-b8991917-e822-4b22-ac0f-9f58d87269ab tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] 10.222.0.18 "GET /compute/v2.1/servers/fa7c86bc-c46f-4120-8f3d-d795f8d7c5cc" status: 200 len: 1570 microversion: 2.1 time: 0.153396 Dec 15 03:11:25.146638 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: [pid: 116156|app: 0|req: 581/1162] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 03:11:24 2021] GET /compute/v2.1/servers/fa7c86bc-c46f-4120-8f3d-d795f8d7c5cc => generated 1570 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 03:11:25.197037 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.policy [None req-f04e362d-fe22-4001-906c-bd9cc3640720 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97bdf19af9e34fc3886ff451cb9d7a27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '494b56bf5eae4d56a5591546f85bc32b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116157) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:11:25.204299 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: INFO nova.api.openstack.requestlog [None req-f04e362d-fe22-4001-906c-bd9cc3640720 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] 10.222.0.18 "GET /compute/v2.1/servers/bbb8462c-9501-4541-b67e-43ec5c5061a7" status: 200 len: 1226 microversion: 2.1 time: 0.078073 Dec 15 03:11:25.205195 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: [pid: 116157|app: 0|req: 582/1163] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 03:11:25 2021] GET /compute/v2.1/servers/bbb8462c-9501-4541-b67e-43ec5c5061a7 => generated 1226 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 03:11:25.518846 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi [None req-64912199-84a0-4708-8995-ad70e1b7f226 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Calling method '>' {{(pid=116156) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:11:25.519662 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.compute.api [None req-64912199-84a0-4708-8995-ad70e1b7f226 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] [instance: b89094ac-aee1-4bd6-a33d-8c4347cebfc7] Fetching instance by UUID {{(pid=116156) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:11:25.525950 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-64912199-84a0-4708-8995-ad70e1b7f226 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:11:25.526429 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-64912199-84a0-4708-8995-ad70e1b7f226 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:11:25.527199 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-64912199-84a0-4708-8995-ad70e1b7f226 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:11:25.527630 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-64912199-84a0-4708-8995-ad70e1b7f226 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:11:25.555772 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: INFO nova.api.openstack.requestlog [None req-64912199-84a0-4708-8995-ad70e1b7f226 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] 10.222.0.18 "GET /compute/v2.1/servers/b89094ac-aee1-4bd6-a33d-8c4347cebfc7/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.040764 Dec 15 03:11:25.556305 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: [pid: 116156|app: 0|req: 582/1164] 10.222.0.18 () {60 vars in 1342 bytes} [Wed Dec 15 03:11:25 2021] GET /compute/v2.1/servers/b89094ac-aee1-4bd6-a33d-8c4347cebfc7/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 03:11:26.163304 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi [None req-b451fc62-282d-480f-8bed-f1f5818b18b5 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Calling method '>' {{(pid=116157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:11:26.163914 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.compute.api [None req-b451fc62-282d-480f-8bed-f1f5818b18b5 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] [instance: fa7c86bc-c46f-4120-8f3d-d795f8d7c5cc] Fetching instance by UUID {{(pid=116157) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:11:26.170250 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-b451fc62-282d-480f-8bed-f1f5818b18b5 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:11:26.170719 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-b451fc62-282d-480f-8bed-f1f5818b18b5 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:11:26.171479 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-b451fc62-282d-480f-8bed-f1f5818b18b5 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:11:26.171909 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-b451fc62-282d-480f-8bed-f1f5818b18b5 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:11:26.221350 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi [None req-30aacbc2-d10d-4c67-a6fa-a327bd422403 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Calling method '>' {{(pid=116156) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:11:26.221963 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.compute.api [None req-30aacbc2-d10d-4c67-a6fa-a327bd422403 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] [instance: bbb8462c-9501-4541-b67e-43ec5c5061a7] Fetching instance by UUID {{(pid=116156) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:11:26.228155 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-30aacbc2-d10d-4c67-a6fa-a327bd422403 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:11:26.228625 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-30aacbc2-d10d-4c67-a6fa-a327bd422403 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:11:26.229381 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-30aacbc2-d10d-4c67-a6fa-a327bd422403 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:11:26.229811 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-30aacbc2-d10d-4c67-a6fa-a327bd422403 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:11:26.288726 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.policy [None req-30aacbc2-d10d-4c67-a6fa-a327bd422403 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97bdf19af9e34fc3886ff451cb9d7a27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '494b56bf5eae4d56a5591546f85bc32b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116156) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:11:26.295827 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: INFO nova.api.openstack.requestlog [None req-30aacbc2-d10d-4c67-a6fa-a327bd422403 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] 10.222.0.18 "GET /compute/v2.1/servers/bbb8462c-9501-4541-b67e-43ec5c5061a7" status: 200 len: 1226 microversion: 2.1 time: 0.078012 Dec 15 03:11:26.296588 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: [pid: 116156|app: 0|req: 583/1165] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 03:11:26 2021] GET /compute/v2.1/servers/bbb8462c-9501-4541-b67e-43ec5c5061a7 => generated 1226 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 03:11:26.307797 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.policy [None req-b451fc62-282d-480f-8bed-f1f5818b18b5 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c4c0c82448e40ba801c0b52ec44e74a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a093d0bf43046aaa845f3cc115f3f5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116157) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:11:26.314947 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: INFO nova.api.openstack.requestlog [None req-b451fc62-282d-480f-8bed-f1f5818b18b5 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] 10.222.0.18 "GET /compute/v2.1/servers/fa7c86bc-c46f-4120-8f3d-d795f8d7c5cc" status: 200 len: 1570 microversion: 2.1 time: 0.155266 Dec 15 03:11:26.315498 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: [pid: 116157|app: 0|req: 583/1166] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 03:11:26 2021] GET /compute/v2.1/servers/fa7c86bc-c46f-4120-8f3d-d795f8d7c5cc => generated 1570 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 03:11:26.567012 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi [None req-79f210ff-8120-4d5b-b2e7-48a624813423 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Calling method '>' {{(pid=116156) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:11:26.567900 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.compute.api [None req-79f210ff-8120-4d5b-b2e7-48a624813423 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] [instance: b89094ac-aee1-4bd6-a33d-8c4347cebfc7] Fetching instance by UUID {{(pid=116156) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:11:26.573591 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-79f210ff-8120-4d5b-b2e7-48a624813423 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:11:26.574067 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-79f210ff-8120-4d5b-b2e7-48a624813423 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:11:26.574837 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-79f210ff-8120-4d5b-b2e7-48a624813423 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:11:26.575264 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-79f210ff-8120-4d5b-b2e7-48a624813423 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:11:26.602936 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: INFO nova.api.openstack.requestlog [None req-79f210ff-8120-4d5b-b2e7-48a624813423 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] 10.222.0.18 "GET /compute/v2.1/servers/b89094ac-aee1-4bd6-a33d-8c4347cebfc7/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.039672 Dec 15 03:11:26.603463 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: [pid: 116156|app: 0|req: 584/1167] 10.222.0.18 () {60 vars in 1342 bytes} [Wed Dec 15 03:11:26 2021] GET /compute/v2.1/servers/b89094ac-aee1-4bd6-a33d-8c4347cebfc7/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 03:11:27.331886 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi [None req-3e8c977c-d876-42fa-af64-a58cce8d8ed8 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Calling method '>' {{(pid=116156) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:11:27.332645 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.compute.api [None req-3e8c977c-d876-42fa-af64-a58cce8d8ed8 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] [instance: fa7c86bc-c46f-4120-8f3d-d795f8d7c5cc] Fetching instance by UUID {{(pid=116156) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:11:27.339360 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-3e8c977c-d876-42fa-af64-a58cce8d8ed8 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:11:27.339808 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-3e8c977c-d876-42fa-af64-a58cce8d8ed8 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:11:27.340627 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-3e8c977c-d876-42fa-af64-a58cce8d8ed8 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:11:27.341059 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-3e8c977c-d876-42fa-af64-a58cce8d8ed8 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:11:27.407326 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi [None req-7d8d3199-3ca6-4d78-baef-8debbd30d1fb tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Calling method '>' {{(pid=116157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:11:27.407952 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.compute.api [None req-7d8d3199-3ca6-4d78-baef-8debbd30d1fb tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] [instance: bbb8462c-9501-4541-b67e-43ec5c5061a7] Fetching instance by UUID {{(pid=116157) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:11:27.414404 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-7d8d3199-3ca6-4d78-baef-8debbd30d1fb tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:11:27.414858 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-7d8d3199-3ca6-4d78-baef-8debbd30d1fb tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:11:27.415644 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-7d8d3199-3ca6-4d78-baef-8debbd30d1fb tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:11:27.416088 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-7d8d3199-3ca6-4d78-baef-8debbd30d1fb tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:11:27.471383 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.policy [None req-3e8c977c-d876-42fa-af64-a58cce8d8ed8 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c4c0c82448e40ba801c0b52ec44e74a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a093d0bf43046aaa845f3cc115f3f5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116156) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:11:27.474614 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.policy [None req-7d8d3199-3ca6-4d78-baef-8debbd30d1fb tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97bdf19af9e34fc3886ff451cb9d7a27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '494b56bf5eae4d56a5591546f85bc32b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116157) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:11:27.478905 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: INFO nova.api.openstack.requestlog [None req-3e8c977c-d876-42fa-af64-a58cce8d8ed8 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] 10.222.0.18 "GET /compute/v2.1/servers/fa7c86bc-c46f-4120-8f3d-d795f8d7c5cc" status: 200 len: 1570 microversion: 2.1 time: 0.150521 Dec 15 03:11:27.479566 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: [pid: 116156|app: 0|req: 585/1168] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 03:11:27 2021] GET /compute/v2.1/servers/fa7c86bc-c46f-4120-8f3d-d795f8d7c5cc => generated 1570 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 03:11:27.482019 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: INFO nova.api.openstack.requestlog [None req-7d8d3199-3ca6-4d78-baef-8debbd30d1fb tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] 10.222.0.18 "GET /compute/v2.1/servers/bbb8462c-9501-4541-b67e-43ec5c5061a7" status: 200 len: 1226 microversion: 2.1 time: 0.172918 Dec 15 03:11:27.482567 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: [pid: 116157|app: 0|req: 584/1169] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 03:11:27 2021] GET /compute/v2.1/servers/bbb8462c-9501-4541-b67e-43ec5c5061a7 => generated 1226 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 03:11:27.614485 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi [None req-d5d9c9b7-f4d7-41e9-a58d-4f942a438fb2 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Calling method '>' {{(pid=116156) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:11:27.615375 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.compute.api [None req-d5d9c9b7-f4d7-41e9-a58d-4f942a438fb2 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] [instance: b89094ac-aee1-4bd6-a33d-8c4347cebfc7] Fetching instance by UUID {{(pid=116156) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:11:27.621619 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-d5d9c9b7-f4d7-41e9-a58d-4f942a438fb2 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:11:27.622112 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-d5d9c9b7-f4d7-41e9-a58d-4f942a438fb2 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:11:27.622876 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-d5d9c9b7-f4d7-41e9-a58d-4f942a438fb2 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:11:27.623303 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-d5d9c9b7-f4d7-41e9-a58d-4f942a438fb2 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:11:27.651406 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: INFO nova.api.openstack.requestlog [None req-d5d9c9b7-f4d7-41e9-a58d-4f942a438fb2 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] 10.222.0.18 "GET /compute/v2.1/servers/b89094ac-aee1-4bd6-a33d-8c4347cebfc7/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.040875 Dec 15 03:11:27.651935 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: [pid: 116156|app: 0|req: 586/1170] 10.222.0.18 () {60 vars in 1342 bytes} [Wed Dec 15 03:11:27 2021] GET /compute/v2.1/servers/b89094ac-aee1-4bd6-a33d-8c4347cebfc7/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Dec 15 03:11:28.495975 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi [None req-aa8401a2-39f1-4b43-bfcd-956771ba237d tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Calling method '>' {{(pid=116157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:11:28.496512 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.compute.api [None req-aa8401a2-39f1-4b43-bfcd-956771ba237d tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] [instance: fa7c86bc-c46f-4120-8f3d-d795f8d7c5cc] Fetching instance by UUID {{(pid=116157) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:11:28.499242 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi [None req-e0ff4493-e01c-4a52-9e84-7ab374daadc0 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Calling method '>' {{(pid=116156) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:11:28.499848 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.compute.api [None req-e0ff4493-e01c-4a52-9e84-7ab374daadc0 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] [instance: bbb8462c-9501-4541-b67e-43ec5c5061a7] Fetching instance by UUID {{(pid=116156) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:11:28.502807 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-aa8401a2-39f1-4b43-bfcd-956771ba237d tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:11:28.503263 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-aa8401a2-39f1-4b43-bfcd-956771ba237d tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:11:28.504050 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-aa8401a2-39f1-4b43-bfcd-956771ba237d tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:11:28.504485 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-aa8401a2-39f1-4b43-bfcd-956771ba237d tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:11:28.505886 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-e0ff4493-e01c-4a52-9e84-7ab374daadc0 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:11:28.506371 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-e0ff4493-e01c-4a52-9e84-7ab374daadc0 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:11:28.507139 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-e0ff4493-e01c-4a52-9e84-7ab374daadc0 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:11:28.507585 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-e0ff4493-e01c-4a52-9e84-7ab374daadc0 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:11:28.565341 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.policy [None req-e0ff4493-e01c-4a52-9e84-7ab374daadc0 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97bdf19af9e34fc3886ff451cb9d7a27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '494b56bf5eae4d56a5591546f85bc32b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116156) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:11:28.573178 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: INFO nova.api.openstack.requestlog [None req-e0ff4493-e01c-4a52-9e84-7ab374daadc0 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] 10.222.0.18 "GET /compute/v2.1/servers/bbb8462c-9501-4541-b67e-43ec5c5061a7" status: 200 len: 1226 microversion: 2.1 time: 0.077652 Dec 15 03:11:28.573741 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: [pid: 116156|app: 0|req: 587/1171] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 03:11:28 2021] GET /compute/v2.1/servers/bbb8462c-9501-4541-b67e-43ec5c5061a7 => generated 1226 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 03:11:28.633690 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.policy [None req-aa8401a2-39f1-4b43-bfcd-956771ba237d tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c4c0c82448e40ba801c0b52ec44e74a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a093d0bf43046aaa845f3cc115f3f5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116157) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:11:28.641050 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: INFO nova.api.openstack.requestlog [None req-aa8401a2-39f1-4b43-bfcd-956771ba237d tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] 10.222.0.18 "GET /compute/v2.1/servers/fa7c86bc-c46f-4120-8f3d-d795f8d7c5cc" status: 200 len: 1570 microversion: 2.1 time: 0.148808 Dec 15 03:11:28.641603 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: [pid: 116157|app: 0|req: 585/1172] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 03:11:28 2021] GET /compute/v2.1/servers/fa7c86bc-c46f-4120-8f3d-d795f8d7c5cc => generated 1570 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 03:11:28.662750 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi [None req-27daf3cc-b930-43a8-8871-a5ff754a75cf tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Calling method '>' {{(pid=116156) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:11:28.663650 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.compute.api [None req-27daf3cc-b930-43a8-8871-a5ff754a75cf tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] [instance: b89094ac-aee1-4bd6-a33d-8c4347cebfc7] Fetching instance by UUID {{(pid=116156) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:11:28.669309 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-27daf3cc-b930-43a8-8871-a5ff754a75cf tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:11:28.669751 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-27daf3cc-b930-43a8-8871-a5ff754a75cf tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:11:28.670561 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-27daf3cc-b930-43a8-8871-a5ff754a75cf tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:11:28.670986 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-27daf3cc-b930-43a8-8871-a5ff754a75cf tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:11:28.698591 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: INFO nova.api.openstack.requestlog [None req-27daf3cc-b930-43a8-8871-a5ff754a75cf tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] 10.222.0.18 "GET /compute/v2.1/servers/b89094ac-aee1-4bd6-a33d-8c4347cebfc7/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.039691 Dec 15 03:11:28.699309 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: [pid: 116156|app: 0|req: 588/1173] 10.222.0.18 () {60 vars in 1342 bytes} [Wed Dec 15 03:11:28 2021] GET /compute/v2.1/servers/b89094ac-aee1-4bd6-a33d-8c4347cebfc7/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 03:11:29.589639 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi [None req-dc889d5c-baa9-49c3-b71e-0c12e194fc40 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Calling method '>' {{(pid=116157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:11:29.590307 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.compute.api [None req-dc889d5c-baa9-49c3-b71e-0c12e194fc40 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] [instance: bbb8462c-9501-4541-b67e-43ec5c5061a7] Fetching instance by UUID {{(pid=116157) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:11:29.596533 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-dc889d5c-baa9-49c3-b71e-0c12e194fc40 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:11:29.596987 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-dc889d5c-baa9-49c3-b71e-0c12e194fc40 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:11:29.597829 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-dc889d5c-baa9-49c3-b71e-0c12e194fc40 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:11:29.598315 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-dc889d5c-baa9-49c3-b71e-0c12e194fc40 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:11:29.658863 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi [None req-664ba9c1-ebe1-4e8e-9615-7a08238ad108 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Calling method '>' {{(pid=116156) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:11:29.659250 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.compute.api [None req-664ba9c1-ebe1-4e8e-9615-7a08238ad108 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] [instance: fa7c86bc-c46f-4120-8f3d-d795f8d7c5cc] Fetching instance by UUID {{(pid=116156) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:11:29.661405 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.policy [None req-dc889d5c-baa9-49c3-b71e-0c12e194fc40 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97bdf19af9e34fc3886ff451cb9d7a27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '494b56bf5eae4d56a5591546f85bc32b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116157) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:11:29.666005 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-664ba9c1-ebe1-4e8e-9615-7a08238ad108 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:11:29.666477 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-664ba9c1-ebe1-4e8e-9615-7a08238ad108 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:11:29.667265 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-664ba9c1-ebe1-4e8e-9615-7a08238ad108 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:11:29.667700 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-664ba9c1-ebe1-4e8e-9615-7a08238ad108 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:11:29.669332 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: INFO nova.api.openstack.requestlog [None req-dc889d5c-baa9-49c3-b71e-0c12e194fc40 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] 10.222.0.18 "GET /compute/v2.1/servers/bbb8462c-9501-4541-b67e-43ec5c5061a7" status: 200 len: 1226 microversion: 2.1 time: 0.083284 Dec 15 03:11:29.669904 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: [pid: 116157|app: 0|req: 586/1174] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 03:11:29 2021] GET /compute/v2.1/servers/bbb8462c-9501-4541-b67e-43ec5c5061a7 => generated 1226 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 03:11:29.709954 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi [None req-5bd17cbe-db5f-4a59-b2be-a3abf9a51d5e tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Calling method '>' {{(pid=116157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:11:29.711447 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.compute.api [None req-5bd17cbe-db5f-4a59-b2be-a3abf9a51d5e tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] [instance: b89094ac-aee1-4bd6-a33d-8c4347cebfc7] Fetching instance by UUID {{(pid=116157) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:11:29.717218 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-5bd17cbe-db5f-4a59-b2be-a3abf9a51d5e tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:11:29.717666 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-5bd17cbe-db5f-4a59-b2be-a3abf9a51d5e tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:11:29.718472 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-5bd17cbe-db5f-4a59-b2be-a3abf9a51d5e tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:11:29.718910 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-5bd17cbe-db5f-4a59-b2be-a3abf9a51d5e tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:11:29.748349 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: INFO nova.api.openstack.requestlog [None req-5bd17cbe-db5f-4a59-b2be-a3abf9a51d5e tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] 10.222.0.18 "GET /compute/v2.1/servers/b89094ac-aee1-4bd6-a33d-8c4347cebfc7/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042105 Dec 15 03:11:29.749164 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: [pid: 116157|app: 0|req: 587/1175] 10.222.0.18 () {60 vars in 1342 bytes} [Wed Dec 15 03:11:29 2021] GET /compute/v2.1/servers/b89094ac-aee1-4bd6-a33d-8c4347cebfc7/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Dec 15 03:11:29.801500 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.policy [None req-664ba9c1-ebe1-4e8e-9615-7a08238ad108 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c4c0c82448e40ba801c0b52ec44e74a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a093d0bf43046aaa845f3cc115f3f5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116156) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:11:29.808869 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: INFO nova.api.openstack.requestlog [None req-664ba9c1-ebe1-4e8e-9615-7a08238ad108 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] 10.222.0.18 "GET /compute/v2.1/servers/fa7c86bc-c46f-4120-8f3d-d795f8d7c5cc" status: 200 len: 1570 microversion: 2.1 time: 0.154094 Dec 15 03:11:29.809422 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: [pid: 116156|app: 0|req: 589/1176] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 03:11:29 2021] GET /compute/v2.1/servers/fa7c86bc-c46f-4120-8f3d-d795f8d7c5cc => generated 1570 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 03:11:30.686043 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi [None req-10ec867b-881e-49ce-94c1-3318814f908b tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Calling method '>' {{(pid=116157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:11:30.686652 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.compute.api [None req-10ec867b-881e-49ce-94c1-3318814f908b tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] [instance: bbb8462c-9501-4541-b67e-43ec5c5061a7] Fetching instance by UUID {{(pid=116157) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:11:30.692483 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-10ec867b-881e-49ce-94c1-3318814f908b tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:11:30.692935 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-10ec867b-881e-49ce-94c1-3318814f908b tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:11:30.693709 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-10ec867b-881e-49ce-94c1-3318814f908b tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:11:30.694173 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-10ec867b-881e-49ce-94c1-3318814f908b tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:11:30.751238 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.policy [None req-10ec867b-881e-49ce-94c1-3318814f908b tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97bdf19af9e34fc3886ff451cb9d7a27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '494b56bf5eae4d56a5591546f85bc32b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116157) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:11:30.759204 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: INFO nova.api.openstack.requestlog [None req-10ec867b-881e-49ce-94c1-3318814f908b tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] 10.222.0.18 "GET /compute/v2.1/servers/bbb8462c-9501-4541-b67e-43ec5c5061a7" status: 200 len: 1226 microversion: 2.1 time: 0.076937 Dec 15 03:11:30.759760 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: [pid: 116157|app: 0|req: 588/1177] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 03:11:30 2021] GET /compute/v2.1/servers/bbb8462c-9501-4541-b67e-43ec5c5061a7 => generated 1226 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 03:11:30.760342 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi [None req-64553d34-dd53-451c-8743-e69d274b2c64 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Calling method '>' {{(pid=116156) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:11:30.761295 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.compute.api [None req-64553d34-dd53-451c-8743-e69d274b2c64 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] [instance: b89094ac-aee1-4bd6-a33d-8c4347cebfc7] Fetching instance by UUID {{(pid=116156) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:11:30.767480 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-64553d34-dd53-451c-8743-e69d274b2c64 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:11:30.767926 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-64553d34-dd53-451c-8743-e69d274b2c64 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:11:30.768696 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-64553d34-dd53-451c-8743-e69d274b2c64 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:11:30.769126 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-64553d34-dd53-451c-8743-e69d274b2c64 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:11:30.796977 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: INFO nova.api.openstack.requestlog [None req-64553d34-dd53-451c-8743-e69d274b2c64 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] 10.222.0.18 "GET /compute/v2.1/servers/b89094ac-aee1-4bd6-a33d-8c4347cebfc7/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.040912 Dec 15 03:11:30.797503 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: [pid: 116156|app: 0|req: 590/1178] 10.222.0.18 () {60 vars in 1342 bytes} [Wed Dec 15 03:11:30 2021] GET /compute/v2.1/servers/b89094ac-aee1-4bd6-a33d-8c4347cebfc7/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Dec 15 03:11:30.826591 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi [None req-19fe5228-4e50-4789-bc70-8a8b189b19e7 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Calling method '>' {{(pid=116157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:11:30.827491 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.compute.api [None req-19fe5228-4e50-4789-bc70-8a8b189b19e7 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] [instance: fa7c86bc-c46f-4120-8f3d-d795f8d7c5cc] Fetching instance by UUID {{(pid=116157) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:11:30.834174 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-19fe5228-4e50-4789-bc70-8a8b189b19e7 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:11:30.834837 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-19fe5228-4e50-4789-bc70-8a8b189b19e7 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:11:30.835962 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-19fe5228-4e50-4789-bc70-8a8b189b19e7 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:11:30.836554 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-19fe5228-4e50-4789-bc70-8a8b189b19e7 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:11:30.967161 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.policy [None req-19fe5228-4e50-4789-bc70-8a8b189b19e7 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c4c0c82448e40ba801c0b52ec44e74a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a093d0bf43046aaa845f3cc115f3f5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116157) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:11:30.974291 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: INFO nova.api.openstack.requestlog [None req-19fe5228-4e50-4789-bc70-8a8b189b19e7 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] 10.222.0.18 "GET /compute/v2.1/servers/fa7c86bc-c46f-4120-8f3d-d795f8d7c5cc" status: 200 len: 1570 microversion: 2.1 time: 0.152531 Dec 15 03:11:30.974855 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: [pid: 116157|app: 0|req: 589/1179] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 03:11:30 2021] GET /compute/v2.1/servers/fa7c86bc-c46f-4120-8f3d-d795f8d7c5cc => generated 1570 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 03:11:31.776713 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi [None req-72e0876f-0cb4-4852-aeb8-3b1551bc2f42 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Calling method '>' {{(pid=116156) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:11:31.777315 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.compute.api [None req-72e0876f-0cb4-4852-aeb8-3b1551bc2f42 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] [instance: bbb8462c-9501-4541-b67e-43ec5c5061a7] Fetching instance by UUID {{(pid=116156) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:11:31.783768 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-72e0876f-0cb4-4852-aeb8-3b1551bc2f42 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:11:31.784223 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-72e0876f-0cb4-4852-aeb8-3b1551bc2f42 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:11:31.785000 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-72e0876f-0cb4-4852-aeb8-3b1551bc2f42 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:11:31.785437 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-72e0876f-0cb4-4852-aeb8-3b1551bc2f42 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:11:31.808397 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi [None req-92f20022-c0ee-4141-b225-ea67e10a4a6f tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Calling method '>' {{(pid=116157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:11:31.809350 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.compute.api [None req-92f20022-c0ee-4141-b225-ea67e10a4a6f tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] [instance: b89094ac-aee1-4bd6-a33d-8c4347cebfc7] Fetching instance by UUID {{(pid=116157) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:11:31.815558 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-92f20022-c0ee-4141-b225-ea67e10a4a6f tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:11:31.816011 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-92f20022-c0ee-4141-b225-ea67e10a4a6f tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:11:31.816793 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-92f20022-c0ee-4141-b225-ea67e10a4a6f tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:11:31.817229 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-92f20022-c0ee-4141-b225-ea67e10a4a6f tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:11:31.844891 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.policy [None req-72e0876f-0cb4-4852-aeb8-3b1551bc2f42 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97bdf19af9e34fc3886ff451cb9d7a27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '494b56bf5eae4d56a5591546f85bc32b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116156) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:11:31.846903 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: INFO nova.api.openstack.requestlog [None req-92f20022-c0ee-4141-b225-ea67e10a4a6f tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] 10.222.0.18 "GET /compute/v2.1/servers/b89094ac-aee1-4bd6-a33d-8c4347cebfc7/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042234 Dec 15 03:11:31.847478 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: [pid: 116157|app: 0|req: 590/1180] 10.222.0.18 () {60 vars in 1342 bytes} [Wed Dec 15 03:11:31 2021] GET /compute/v2.1/servers/b89094ac-aee1-4bd6-a33d-8c4347cebfc7/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Dec 15 03:11:31.852161 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: INFO nova.api.openstack.requestlog [None req-72e0876f-0cb4-4852-aeb8-3b1551bc2f42 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] 10.222.0.18 "GET /compute/v2.1/servers/bbb8462c-9501-4541-b67e-43ec5c5061a7" status: 200 len: 1226 microversion: 2.1 time: 0.079614 Dec 15 03:11:31.852704 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: [pid: 116156|app: 0|req: 591/1181] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 03:11:31 2021] GET /compute/v2.1/servers/bbb8462c-9501-4541-b67e-43ec5c5061a7 => generated 1226 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 03:11:31.992027 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi [None req-bb43e58f-c6b0-4477-b37f-6408a28b1b6a tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Calling method '>' {{(pid=116157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:11:31.992634 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.compute.api [None req-bb43e58f-c6b0-4477-b37f-6408a28b1b6a tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] [instance: fa7c86bc-c46f-4120-8f3d-d795f8d7c5cc] Fetching instance by UUID {{(pid=116157) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:11:31.998438 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-bb43e58f-c6b0-4477-b37f-6408a28b1b6a tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:11:31.998888 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-bb43e58f-c6b0-4477-b37f-6408a28b1b6a tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:11:31.999667 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-bb43e58f-c6b0-4477-b37f-6408a28b1b6a tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:11:32.000103 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-bb43e58f-c6b0-4477-b37f-6408a28b1b6a tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:11:32.133549 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.policy [None req-bb43e58f-c6b0-4477-b37f-6408a28b1b6a tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c4c0c82448e40ba801c0b52ec44e74a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a093d0bf43046aaa845f3cc115f3f5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116157) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:11:32.140872 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: INFO nova.api.openstack.requestlog [None req-bb43e58f-c6b0-4477-b37f-6408a28b1b6a tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] 10.222.0.18 "GET /compute/v2.1/servers/fa7c86bc-c46f-4120-8f3d-d795f8d7c5cc" status: 200 len: 1570 microversion: 2.1 time: 0.153203 Dec 15 03:11:32.141430 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: [pid: 116157|app: 0|req: 591/1182] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 03:11:31 2021] GET /compute/v2.1/servers/fa7c86bc-c46f-4120-8f3d-d795f8d7c5cc => generated 1570 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 03:11:32.858103 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi [None req-244c13ce-e8f7-4ddc-b880-48d71e940e94 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Calling method '>' {{(pid=116156) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:11:32.859031 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.compute.api [None req-244c13ce-e8f7-4ddc-b880-48d71e940e94 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] [instance: b89094ac-aee1-4bd6-a33d-8c4347cebfc7] Fetching instance by UUID {{(pid=116156) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:11:32.865628 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-244c13ce-e8f7-4ddc-b880-48d71e940e94 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:11:32.866638 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-244c13ce-e8f7-4ddc-b880-48d71e940e94 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:11:32.867457 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-244c13ce-e8f7-4ddc-b880-48d71e940e94 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:11:32.867885 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-244c13ce-e8f7-4ddc-b880-48d71e940e94 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:11:32.868766 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi [None req-f2b7ad58-5bd1-4e31-b2bf-38b21d8e23d9 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Calling method '>' {{(pid=116157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:11:32.869382 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.compute.api [None req-f2b7ad58-5bd1-4e31-b2bf-38b21d8e23d9 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] [instance: bbb8462c-9501-4541-b67e-43ec5c5061a7] Fetching instance by UUID {{(pid=116157) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:11:32.875551 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-f2b7ad58-5bd1-4e31-b2bf-38b21d8e23d9 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:11:32.876009 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-f2b7ad58-5bd1-4e31-b2bf-38b21d8e23d9 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:11:32.876797 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-f2b7ad58-5bd1-4e31-b2bf-38b21d8e23d9 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:11:32.877243 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-f2b7ad58-5bd1-4e31-b2bf-38b21d8e23d9 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:11:32.896998 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: INFO nova.api.openstack.requestlog [None req-244c13ce-e8f7-4ddc-b880-48d71e940e94 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] 10.222.0.18 "GET /compute/v2.1/servers/b89094ac-aee1-4bd6-a33d-8c4347cebfc7/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042699 Dec 15 03:11:32.897555 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: [pid: 116156|app: 0|req: 592/1183] 10.222.0.18 () {60 vars in 1342 bytes} [Wed Dec 15 03:11:32 2021] GET /compute/v2.1/servers/b89094ac-aee1-4bd6-a33d-8c4347cebfc7/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 03:11:32.934594 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.policy [None req-f2b7ad58-5bd1-4e31-b2bf-38b21d8e23d9 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97bdf19af9e34fc3886ff451cb9d7a27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '494b56bf5eae4d56a5591546f85bc32b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116157) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:11:32.941842 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: INFO nova.api.openstack.requestlog [None req-f2b7ad58-5bd1-4e31-b2bf-38b21d8e23d9 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] 10.222.0.18 "GET /compute/v2.1/servers/bbb8462c-9501-4541-b67e-43ec5c5061a7" status: 200 len: 1226 microversion: 2.1 time: 0.077105 Dec 15 03:11:32.942445 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: [pid: 116157|app: 0|req: 592/1184] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 03:11:32 2021] GET /compute/v2.1/servers/bbb8462c-9501-4541-b67e-43ec5c5061a7 => generated 1226 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 03:11:33.157554 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi [None req-7b204094-9d97-4c02-9098-a8873ed6e60c tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Calling method '>' {{(pid=116156) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:11:33.158120 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.compute.api [None req-7b204094-9d97-4c02-9098-a8873ed6e60c tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] [instance: fa7c86bc-c46f-4120-8f3d-d795f8d7c5cc] Fetching instance by UUID {{(pid=116156) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:11:33.164381 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-7b204094-9d97-4c02-9098-a8873ed6e60c tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:11:33.164828 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-7b204094-9d97-4c02-9098-a8873ed6e60c tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:11:33.165607 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-7b204094-9d97-4c02-9098-a8873ed6e60c tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:11:33.166073 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-7b204094-9d97-4c02-9098-a8873ed6e60c tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:11:33.296186 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.policy [None req-7b204094-9d97-4c02-9098-a8873ed6e60c tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c4c0c82448e40ba801c0b52ec44e74a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a093d0bf43046aaa845f3cc115f3f5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116156) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:11:33.303318 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: INFO nova.api.openstack.requestlog [None req-7b204094-9d97-4c02-9098-a8873ed6e60c tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] 10.222.0.18 "GET /compute/v2.1/servers/fa7c86bc-c46f-4120-8f3d-d795f8d7c5cc" status: 200 len: 1570 microversion: 2.1 time: 0.149476 Dec 15 03:11:33.304535 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: [pid: 116156|app: 0|req: 593/1185] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 03:11:33 2021] GET /compute/v2.1/servers/fa7c86bc-c46f-4120-8f3d-d795f8d7c5cc => generated 1570 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 03:11:33.908668 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi [None req-92cbedb8-8a2a-4e26-8d52-8458a508e429 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Calling method '>' {{(pid=116157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:11:33.909594 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.compute.api [None req-92cbedb8-8a2a-4e26-8d52-8458a508e429 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] [instance: b89094ac-aee1-4bd6-a33d-8c4347cebfc7] Fetching instance by UUID {{(pid=116157) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:11:33.915795 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-92cbedb8-8a2a-4e26-8d52-8458a508e429 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:11:33.916247 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-92cbedb8-8a2a-4e26-8d52-8458a508e429 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:11:33.917019 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-92cbedb8-8a2a-4e26-8d52-8458a508e429 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:11:33.917456 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-92cbedb8-8a2a-4e26-8d52-8458a508e429 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:11:33.945396 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: INFO nova.api.openstack.requestlog [None req-92cbedb8-8a2a-4e26-8d52-8458a508e429 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] 10.222.0.18 "GET /compute/v2.1/servers/b89094ac-aee1-4bd6-a33d-8c4347cebfc7/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.040607 Dec 15 03:11:33.945932 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: [pid: 116157|app: 0|req: 593/1186] 10.222.0.18 () {60 vars in 1342 bytes} [Wed Dec 15 03:11:33 2021] GET /compute/v2.1/servers/b89094ac-aee1-4bd6-a33d-8c4347cebfc7/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 03:11:33.958774 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi [None req-4fc87a5d-9d00-463b-b2af-dfd01e386713 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Calling method '>' {{(pid=116156) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:11:33.959490 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.compute.api [None req-4fc87a5d-9d00-463b-b2af-dfd01e386713 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] [instance: bbb8462c-9501-4541-b67e-43ec5c5061a7] Fetching instance by UUID {{(pid=116156) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:11:33.966499 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-4fc87a5d-9d00-463b-b2af-dfd01e386713 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:11:33.966945 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-4fc87a5d-9d00-463b-b2af-dfd01e386713 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:11:33.967712 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-4fc87a5d-9d00-463b-b2af-dfd01e386713 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:11:33.968143 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-4fc87a5d-9d00-463b-b2af-dfd01e386713 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:11:34.025640 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.policy [None req-4fc87a5d-9d00-463b-b2af-dfd01e386713 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97bdf19af9e34fc3886ff451cb9d7a27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '494b56bf5eae4d56a5591546f85bc32b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116156) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:11:34.032772 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: INFO nova.api.openstack.requestlog [None req-4fc87a5d-9d00-463b-b2af-dfd01e386713 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] 10.222.0.18 "GET /compute/v2.1/servers/bbb8462c-9501-4541-b67e-43ec5c5061a7" status: 200 len: 1226 microversion: 2.1 time: 0.077566 Dec 15 03:11:34.033324 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: [pid: 116156|app: 0|req: 594/1187] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 03:11:33 2021] GET /compute/v2.1/servers/bbb8462c-9501-4541-b67e-43ec5c5061a7 => generated 1226 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 03:11:34.321220 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi [None req-d728a966-8cc3-4eb8-b338-0adc882f6d35 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Calling method '>' {{(pid=116157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:11:34.321826 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.compute.api [None req-d728a966-8cc3-4eb8-b338-0adc882f6d35 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] [instance: fa7c86bc-c46f-4120-8f3d-d795f8d7c5cc] Fetching instance by UUID {{(pid=116157) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:11:34.327629 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-d728a966-8cc3-4eb8-b338-0adc882f6d35 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:11:34.328071 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-d728a966-8cc3-4eb8-b338-0adc882f6d35 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:11:34.328837 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-d728a966-8cc3-4eb8-b338-0adc882f6d35 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:11:34.329265 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-d728a966-8cc3-4eb8-b338-0adc882f6d35 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:11:34.456668 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.policy [None req-d728a966-8cc3-4eb8-b338-0adc882f6d35 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c4c0c82448e40ba801c0b52ec44e74a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a093d0bf43046aaa845f3cc115f3f5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116157) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:11:34.463905 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: INFO nova.api.openstack.requestlog [None req-d728a966-8cc3-4eb8-b338-0adc882f6d35 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] 10.222.0.18 "GET /compute/v2.1/servers/fa7c86bc-c46f-4120-8f3d-d795f8d7c5cc" status: 200 len: 1570 microversion: 2.1 time: 0.146855 Dec 15 03:11:34.464405 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: [pid: 116157|app: 0|req: 594/1188] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 03:11:34 2021] GET /compute/v2.1/servers/fa7c86bc-c46f-4120-8f3d-d795f8d7c5cc => generated 1570 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 03:11:34.956627 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi [None req-c5cef921-e3c4-48f5-983a-295649588490 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Calling method '>' {{(pid=116156) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:11:34.957524 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.compute.api [None req-c5cef921-e3c4-48f5-983a-295649588490 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] [instance: b89094ac-aee1-4bd6-a33d-8c4347cebfc7] Fetching instance by UUID {{(pid=116156) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:11:34.964388 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-c5cef921-e3c4-48f5-983a-295649588490 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:11:34.964950 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-c5cef921-e3c4-48f5-983a-295649588490 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:11:34.965602 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-c5cef921-e3c4-48f5-983a-295649588490 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:11:34.966058 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-c5cef921-e3c4-48f5-983a-295649588490 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:11:34.995004 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: INFO nova.api.openstack.requestlog [None req-c5cef921-e3c4-48f5-983a-295649588490 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] 10.222.0.18 "GET /compute/v2.1/servers/b89094ac-aee1-4bd6-a33d-8c4347cebfc7/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042083 Dec 15 03:11:34.995543 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: [pid: 116156|app: 0|req: 595/1189] 10.222.0.18 () {60 vars in 1342 bytes} [Wed Dec 15 03:11:34 2021] GET /compute/v2.1/servers/b89094ac-aee1-4bd6-a33d-8c4347cebfc7/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 03:11:35.049209 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi [None req-7bcff0e0-f086-4d44-8dd3-8b1fabf5cf0b tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Calling method '>' {{(pid=116157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:11:35.049819 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.compute.api [None req-7bcff0e0-f086-4d44-8dd3-8b1fabf5cf0b tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] [instance: bbb8462c-9501-4541-b67e-43ec5c5061a7] Fetching instance by UUID {{(pid=116157) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:11:35.056162 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-7bcff0e0-f086-4d44-8dd3-8b1fabf5cf0b tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:11:35.056611 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-7bcff0e0-f086-4d44-8dd3-8b1fabf5cf0b tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:11:35.057379 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-7bcff0e0-f086-4d44-8dd3-8b1fabf5cf0b tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:11:35.057809 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-7bcff0e0-f086-4d44-8dd3-8b1fabf5cf0b tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:11:35.116083 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.policy [None req-7bcff0e0-f086-4d44-8dd3-8b1fabf5cf0b tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97bdf19af9e34fc3886ff451cb9d7a27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '494b56bf5eae4d56a5591546f85bc32b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116157) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:11:35.123211 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: INFO nova.api.openstack.requestlog [None req-7bcff0e0-f086-4d44-8dd3-8b1fabf5cf0b tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] 10.222.0.18 "GET /compute/v2.1/servers/bbb8462c-9501-4541-b67e-43ec5c5061a7" status: 200 len: 1226 microversion: 2.1 time: 0.077564 Dec 15 03:11:35.123757 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: [pid: 116157|app: 0|req: 595/1190] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 03:11:35 2021] GET /compute/v2.1/servers/bbb8462c-9501-4541-b67e-43ec5c5061a7 => generated 1226 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 03:11:35.479779 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi [None req-372073fb-f428-482c-8e38-1325398e0860 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Calling method '>' {{(pid=116156) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:11:35.480302 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.compute.api [None req-372073fb-f428-482c-8e38-1325398e0860 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] [instance: fa7c86bc-c46f-4120-8f3d-d795f8d7c5cc] Fetching instance by UUID {{(pid=116156) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:11:35.486073 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-372073fb-f428-482c-8e38-1325398e0860 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:11:35.486521 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-372073fb-f428-482c-8e38-1325398e0860 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:11:35.487286 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-372073fb-f428-482c-8e38-1325398e0860 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:11:35.487722 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-372073fb-f428-482c-8e38-1325398e0860 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:11:35.618088 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.policy [None req-372073fb-f428-482c-8e38-1325398e0860 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c4c0c82448e40ba801c0b52ec44e74a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a093d0bf43046aaa845f3cc115f3f5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116156) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:11:35.625236 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: INFO nova.api.openstack.requestlog [None req-372073fb-f428-482c-8e38-1325398e0860 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] 10.222.0.18 "GET /compute/v2.1/servers/fa7c86bc-c46f-4120-8f3d-d795f8d7c5cc" status: 200 len: 1570 microversion: 2.1 time: 0.149129 Dec 15 03:11:35.625793 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: [pid: 116156|app: 0|req: 596/1191] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 03:11:35 2021] GET /compute/v2.1/servers/fa7c86bc-c46f-4120-8f3d-d795f8d7c5cc => generated 1570 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 03:11:36.006428 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi [None req-ba61bfe5-2040-4c5b-9c8f-62ad9e60edda tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Calling method '>' {{(pid=116157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:11:36.007904 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.compute.api [None req-ba61bfe5-2040-4c5b-9c8f-62ad9e60edda tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] [instance: b89094ac-aee1-4bd6-a33d-8c4347cebfc7] Fetching instance by UUID {{(pid=116157) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:11:36.013657 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-ba61bfe5-2040-4c5b-9c8f-62ad9e60edda tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:11:36.014133 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-ba61bfe5-2040-4c5b-9c8f-62ad9e60edda tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:11:36.014901 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-ba61bfe5-2040-4c5b-9c8f-62ad9e60edda tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:11:36.015334 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-ba61bfe5-2040-4c5b-9c8f-62ad9e60edda tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:11:36.043136 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: INFO nova.api.openstack.requestlog [None req-ba61bfe5-2040-4c5b-9c8f-62ad9e60edda tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] 10.222.0.18 "GET /compute/v2.1/servers/b89094ac-aee1-4bd6-a33d-8c4347cebfc7/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.040453 Dec 15 03:11:36.043676 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: [pid: 116157|app: 0|req: 596/1192] 10.222.0.18 () {60 vars in 1342 bytes} [Wed Dec 15 03:11:36 2021] GET /compute/v2.1/servers/b89094ac-aee1-4bd6-a33d-8c4347cebfc7/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 03:11:36.139610 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi [None req-0fbf2f90-0b7b-48dc-9fff-24ab3738b30c tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Calling method '>' {{(pid=116156) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:11:36.140218 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.compute.api [None req-0fbf2f90-0b7b-48dc-9fff-24ab3738b30c tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] [instance: bbb8462c-9501-4541-b67e-43ec5c5061a7] Fetching instance by UUID {{(pid=116156) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:11:36.146464 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-0fbf2f90-0b7b-48dc-9fff-24ab3738b30c tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:11:36.146921 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-0fbf2f90-0b7b-48dc-9fff-24ab3738b30c tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:11:36.147697 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-0fbf2f90-0b7b-48dc-9fff-24ab3738b30c tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:11:36.148133 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-0fbf2f90-0b7b-48dc-9fff-24ab3738b30c tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:11:36.205508 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.policy [None req-0fbf2f90-0b7b-48dc-9fff-24ab3738b30c tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97bdf19af9e34fc3886ff451cb9d7a27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '494b56bf5eae4d56a5591546f85bc32b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116156) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:11:36.212812 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: INFO nova.api.openstack.requestlog [None req-0fbf2f90-0b7b-48dc-9fff-24ab3738b30c tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] 10.222.0.18 "GET /compute/v2.1/servers/bbb8462c-9501-4541-b67e-43ec5c5061a7" status: 200 len: 1226 microversion: 2.1 time: 0.076767 Dec 15 03:11:36.213377 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: [pid: 116156|app: 0|req: 597/1193] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 03:11:36 2021] GET /compute/v2.1/servers/bbb8462c-9501-4541-b67e-43ec5c5061a7 => generated 1226 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 03:11:36.642704 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi [None req-1040b048-069b-4faf-a5ba-00e1b1f02487 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Calling method '>' {{(pid=116157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:11:36.643316 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.compute.api [None req-1040b048-069b-4faf-a5ba-00e1b1f02487 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] [instance: fa7c86bc-c46f-4120-8f3d-d795f8d7c5cc] Fetching instance by UUID {{(pid=116157) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:11:36.650007 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-1040b048-069b-4faf-a5ba-00e1b1f02487 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:11:36.650489 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-1040b048-069b-4faf-a5ba-00e1b1f02487 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:11:36.651280 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-1040b048-069b-4faf-a5ba-00e1b1f02487 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:11:36.651721 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-1040b048-069b-4faf-a5ba-00e1b1f02487 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:11:36.781854 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.policy [None req-1040b048-069b-4faf-a5ba-00e1b1f02487 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c4c0c82448e40ba801c0b52ec44e74a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a093d0bf43046aaa845f3cc115f3f5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116157) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:11:36.789594 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: INFO nova.api.openstack.requestlog [None req-1040b048-069b-4faf-a5ba-00e1b1f02487 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] 10.222.0.18 "GET /compute/v2.1/servers/fa7c86bc-c46f-4120-8f3d-d795f8d7c5cc" status: 200 len: 1570 microversion: 2.1 time: 0.150579 Dec 15 03:11:36.790170 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: [pid: 116157|app: 0|req: 597/1194] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 03:11:36 2021] GET /compute/v2.1/servers/fa7c86bc-c46f-4120-8f3d-d795f8d7c5cc => generated 1570 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 03:11:37.054600 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi [None req-d5839a19-47ea-4235-ba21-e7819ddfca2b tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Calling method '>' {{(pid=116156) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:11:37.055506 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.compute.api [None req-d5839a19-47ea-4235-ba21-e7819ddfca2b tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] [instance: b89094ac-aee1-4bd6-a33d-8c4347cebfc7] Fetching instance by UUID {{(pid=116156) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:11:37.061342 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-d5839a19-47ea-4235-ba21-e7819ddfca2b tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:11:37.061795 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-d5839a19-47ea-4235-ba21-e7819ddfca2b tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:11:37.062610 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-d5839a19-47ea-4235-ba21-e7819ddfca2b tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:11:37.063052 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-d5839a19-47ea-4235-ba21-e7819ddfca2b tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:11:37.092025 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: INFO nova.api.openstack.requestlog [None req-d5839a19-47ea-4235-ba21-e7819ddfca2b tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] 10.222.0.18 "GET /compute/v2.1/servers/b89094ac-aee1-4bd6-a33d-8c4347cebfc7/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041210 Dec 15 03:11:37.092565 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: [pid: 116156|app: 0|req: 598/1195] 10.222.0.18 () {60 vars in 1342 bytes} [Wed Dec 15 03:11:37 2021] GET /compute/v2.1/servers/b89094ac-aee1-4bd6-a33d-8c4347cebfc7/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 03:11:37.229415 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi [None req-6eaece86-0ed3-444a-9fcd-108cb99135d6 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Calling method '>' {{(pid=116157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:11:37.230045 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.compute.api [None req-6eaece86-0ed3-444a-9fcd-108cb99135d6 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] [instance: bbb8462c-9501-4541-b67e-43ec5c5061a7] Fetching instance by UUID {{(pid=116157) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:11:37.235831 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-6eaece86-0ed3-444a-9fcd-108cb99135d6 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:11:37.236275 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-6eaece86-0ed3-444a-9fcd-108cb99135d6 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:11:37.237041 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-6eaece86-0ed3-444a-9fcd-108cb99135d6 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:11:37.237469 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-6eaece86-0ed3-444a-9fcd-108cb99135d6 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:11:37.295646 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.policy [None req-6eaece86-0ed3-444a-9fcd-108cb99135d6 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97bdf19af9e34fc3886ff451cb9d7a27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '494b56bf5eae4d56a5591546f85bc32b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116157) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:11:37.302855 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: INFO nova.api.openstack.requestlog [None req-6eaece86-0ed3-444a-9fcd-108cb99135d6 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] 10.222.0.18 "GET /compute/v2.1/servers/bbb8462c-9501-4541-b67e-43ec5c5061a7" status: 200 len: 1226 microversion: 2.1 time: 0.077083 Dec 15 03:11:37.303951 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: [pid: 116157|app: 0|req: 598/1196] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 03:11:37 2021] GET /compute/v2.1/servers/bbb8462c-9501-4541-b67e-43ec5c5061a7 => generated 1226 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 03:11:37.806922 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi [None req-61548282-3738-4791-a801-3b5c21374b5d tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Calling method '>' {{(pid=116156) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:11:37.807529 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.compute.api [None req-61548282-3738-4791-a801-3b5c21374b5d tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] [instance: fa7c86bc-c46f-4120-8f3d-d795f8d7c5cc] Fetching instance by UUID {{(pid=116156) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:11:37.813642 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-61548282-3738-4791-a801-3b5c21374b5d tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:11:37.814114 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-61548282-3738-4791-a801-3b5c21374b5d tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:11:37.814906 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-61548282-3738-4791-a801-3b5c21374b5d tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:11:37.815332 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-61548282-3738-4791-a801-3b5c21374b5d tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:11:37.947865 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.policy [None req-61548282-3738-4791-a801-3b5c21374b5d tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c4c0c82448e40ba801c0b52ec44e74a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a093d0bf43046aaa845f3cc115f3f5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116156) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:11:37.955131 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: INFO nova.api.openstack.requestlog [None req-61548282-3738-4791-a801-3b5c21374b5d tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] 10.222.0.18 "GET /compute/v2.1/servers/fa7c86bc-c46f-4120-8f3d-d795f8d7c5cc" status: 200 len: 1570 microversion: 2.1 time: 0.152472 Dec 15 03:11:37.955694 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: [pid: 116156|app: 0|req: 599/1197] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 03:11:37 2021] GET /compute/v2.1/servers/fa7c86bc-c46f-4120-8f3d-d795f8d7c5cc => generated 1570 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 03:11:38.103540 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi [None req-fe726ea8-e040-4d34-a7f8-45889a1b1d7f tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Calling method '>' {{(pid=116157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:11:38.104354 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.compute.api [None req-fe726ea8-e040-4d34-a7f8-45889a1b1d7f tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] [instance: b89094ac-aee1-4bd6-a33d-8c4347cebfc7] Fetching instance by UUID {{(pid=116157) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:11:38.110612 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-fe726ea8-e040-4d34-a7f8-45889a1b1d7f tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:11:38.112033 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-fe726ea8-e040-4d34-a7f8-45889a1b1d7f tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:11:38.112814 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-fe726ea8-e040-4d34-a7f8-45889a1b1d7f tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:11:38.113249 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-fe726ea8-e040-4d34-a7f8-45889a1b1d7f tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:11:38.141553 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: INFO nova.api.openstack.requestlog [None req-fe726ea8-e040-4d34-a7f8-45889a1b1d7f tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] 10.222.0.18 "GET /compute/v2.1/servers/b89094ac-aee1-4bd6-a33d-8c4347cebfc7/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042499 Dec 15 03:11:38.142123 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: [pid: 116157|app: 0|req: 599/1198] 10.222.0.18 () {60 vars in 1342 bytes} [Wed Dec 15 03:11:38 2021] GET /compute/v2.1/servers/b89094ac-aee1-4bd6-a33d-8c4347cebfc7/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 03:11:38.320789 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi [None req-ea5ae98b-601a-4a73-ac36-616dd8795c37 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Calling method '>' {{(pid=116156) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:11:38.321396 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.compute.api [None req-ea5ae98b-601a-4a73-ac36-616dd8795c37 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] [instance: bbb8462c-9501-4541-b67e-43ec5c5061a7] Fetching instance by UUID {{(pid=116156) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:11:38.327151 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-ea5ae98b-601a-4a73-ac36-616dd8795c37 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:11:38.327597 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-ea5ae98b-601a-4a73-ac36-616dd8795c37 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:11:38.328368 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-ea5ae98b-601a-4a73-ac36-616dd8795c37 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:11:38.328799 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-ea5ae98b-601a-4a73-ac36-616dd8795c37 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:11:38.390466 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.policy [None req-ea5ae98b-601a-4a73-ac36-616dd8795c37 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97bdf19af9e34fc3886ff451cb9d7a27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '494b56bf5eae4d56a5591546f85bc32b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116156) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:11:38.397645 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: INFO nova.api.openstack.requestlog [None req-ea5ae98b-601a-4a73-ac36-616dd8795c37 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] 10.222.0.18 "GET /compute/v2.1/servers/bbb8462c-9501-4541-b67e-43ec5c5061a7" status: 200 len: 1226 microversion: 2.1 time: 0.081157 Dec 15 03:11:38.398226 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: [pid: 116156|app: 0|req: 600/1199] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 03:11:38 2021] GET /compute/v2.1/servers/bbb8462c-9501-4541-b67e-43ec5c5061a7 => generated 1226 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 03:11:38.971869 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi [None req-83850cd5-096f-4039-a8fe-d3146ba7d3dc tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Calling method '>' {{(pid=116157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:11:38.972486 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.compute.api [None req-83850cd5-096f-4039-a8fe-d3146ba7d3dc tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] [instance: fa7c86bc-c46f-4120-8f3d-d795f8d7c5cc] Fetching instance by UUID {{(pid=116157) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:11:38.978444 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-83850cd5-096f-4039-a8fe-d3146ba7d3dc tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:11:38.978892 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-83850cd5-096f-4039-a8fe-d3146ba7d3dc tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:11:38.979664 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-83850cd5-096f-4039-a8fe-d3146ba7d3dc tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:11:38.980099 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-83850cd5-096f-4039-a8fe-d3146ba7d3dc tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:11:39.108608 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.policy [None req-83850cd5-096f-4039-a8fe-d3146ba7d3dc tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c4c0c82448e40ba801c0b52ec44e74a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a093d0bf43046aaa845f3cc115f3f5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116157) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:11:39.117177 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: INFO nova.api.openstack.requestlog [None req-83850cd5-096f-4039-a8fe-d3146ba7d3dc tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] 10.222.0.18 "GET /compute/v2.1/servers/fa7c86bc-c46f-4120-8f3d-d795f8d7c5cc" status: 200 len: 1570 microversion: 2.1 time: 0.148924 Dec 15 03:11:39.117887 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: [pid: 116157|app: 0|req: 600/1200] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 03:11:38 2021] GET /compute/v2.1/servers/fa7c86bc-c46f-4120-8f3d-d795f8d7c5cc => generated 1570 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 03:11:39.152772 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi [None req-cd6b5f4d-f98e-4c72-b55f-26c1e7bf01df tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Calling method '>' {{(pid=116156) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:11:39.153662 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.compute.api [None req-cd6b5f4d-f98e-4c72-b55f-26c1e7bf01df tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] [instance: b89094ac-aee1-4bd6-a33d-8c4347cebfc7] Fetching instance by UUID {{(pid=116156) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:11:39.159836 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-cd6b5f4d-f98e-4c72-b55f-26c1e7bf01df tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:11:39.160283 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-cd6b5f4d-f98e-4c72-b55f-26c1e7bf01df tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:11:39.161052 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-cd6b5f4d-f98e-4c72-b55f-26c1e7bf01df tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:11:39.161483 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-cd6b5f4d-f98e-4c72-b55f-26c1e7bf01df tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:11:39.189700 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: INFO nova.api.openstack.requestlog [None req-cd6b5f4d-f98e-4c72-b55f-26c1e7bf01df tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] 10.222.0.18 "GET /compute/v2.1/servers/b89094ac-aee1-4bd6-a33d-8c4347cebfc7/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.040581 Dec 15 03:11:39.190261 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: [pid: 116156|app: 0|req: 601/1201] 10.222.0.18 () {60 vars in 1342 bytes} [Wed Dec 15 03:11:39 2021] GET /compute/v2.1/servers/b89094ac-aee1-4bd6-a33d-8c4347cebfc7/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 03:11:39.415479 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi [None req-37b76a9f-9dfc-4922-b87b-29429fcd6ea8 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Calling method '>' {{(pid=116157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:11:39.416085 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.compute.api [None req-37b76a9f-9dfc-4922-b87b-29429fcd6ea8 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] [instance: bbb8462c-9501-4541-b67e-43ec5c5061a7] Fetching instance by UUID {{(pid=116157) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:11:39.421911 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-37b76a9f-9dfc-4922-b87b-29429fcd6ea8 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:11:39.422544 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-37b76a9f-9dfc-4922-b87b-29429fcd6ea8 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:11:39.423308 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-37b76a9f-9dfc-4922-b87b-29429fcd6ea8 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:11:39.423741 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-37b76a9f-9dfc-4922-b87b-29429fcd6ea8 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:11:39.484897 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.policy [None req-37b76a9f-9dfc-4922-b87b-29429fcd6ea8 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97bdf19af9e34fc3886ff451cb9d7a27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '494b56bf5eae4d56a5591546f85bc32b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116157) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:11:39.492369 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: INFO nova.api.openstack.requestlog [None req-37b76a9f-9dfc-4922-b87b-29429fcd6ea8 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] 10.222.0.18 "GET /compute/v2.1/servers/bbb8462c-9501-4541-b67e-43ec5c5061a7" status: 200 len: 1226 microversion: 2.1 time: 0.081172 Dec 15 03:11:39.492923 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: [pid: 116157|app: 0|req: 601/1202] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 03:11:39 2021] GET /compute/v2.1/servers/bbb8462c-9501-4541-b67e-43ec5c5061a7 => generated 1226 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 03:11:40.134669 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi [None req-847bf883-2ab2-4887-88df-ef268352b62e tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Calling method '>' {{(pid=116156) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:11:40.135276 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.compute.api [None req-847bf883-2ab2-4887-88df-ef268352b62e tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] [instance: fa7c86bc-c46f-4120-8f3d-d795f8d7c5cc] Fetching instance by UUID {{(pid=116156) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:11:40.141010 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-847bf883-2ab2-4887-88df-ef268352b62e tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:11:40.141457 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-847bf883-2ab2-4887-88df-ef268352b62e tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:11:40.142247 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-847bf883-2ab2-4887-88df-ef268352b62e tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:11:40.142680 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-847bf883-2ab2-4887-88df-ef268352b62e tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:11:40.201223 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi [None req-e271ff88-64fb-4751-9bd1-91c15b3d94ad tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Calling method '>' {{(pid=116157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:11:40.202338 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.compute.api [None req-e271ff88-64fb-4751-9bd1-91c15b3d94ad tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] [instance: b89094ac-aee1-4bd6-a33d-8c4347cebfc7] Fetching instance by UUID {{(pid=116157) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:11:40.208652 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-e271ff88-64fb-4751-9bd1-91c15b3d94ad tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:11:40.209096 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-e271ff88-64fb-4751-9bd1-91c15b3d94ad tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:11:40.210041 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-e271ff88-64fb-4751-9bd1-91c15b3d94ad tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:11:40.210477 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-e271ff88-64fb-4751-9bd1-91c15b3d94ad tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:11:40.238956 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: INFO nova.api.openstack.requestlog [None req-e271ff88-64fb-4751-9bd1-91c15b3d94ad tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] 10.222.0.18 "GET /compute/v2.1/servers/b89094ac-aee1-4bd6-a33d-8c4347cebfc7/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041334 Dec 15 03:11:40.239717 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: [pid: 116157|app: 0|req: 602/1203] 10.222.0.18 () {60 vars in 1342 bytes} [Wed Dec 15 03:11:40 2021] GET /compute/v2.1/servers/b89094ac-aee1-4bd6-a33d-8c4347cebfc7/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Dec 15 03:11:40.273821 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.policy [None req-847bf883-2ab2-4887-88df-ef268352b62e tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c4c0c82448e40ba801c0b52ec44e74a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a093d0bf43046aaa845f3cc115f3f5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116156) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:11:40.281248 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: INFO nova.api.openstack.requestlog [None req-847bf883-2ab2-4887-88df-ef268352b62e tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] 10.222.0.18 "GET /compute/v2.1/servers/fa7c86bc-c46f-4120-8f3d-d795f8d7c5cc" status: 200 len: 1570 microversion: 2.1 time: 0.150722 Dec 15 03:11:40.281818 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: [pid: 116156|app: 0|req: 602/1204] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 03:11:40 2021] GET /compute/v2.1/servers/fa7c86bc-c46f-4120-8f3d-d795f8d7c5cc => generated 1570 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 03:11:40.509399 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi [None req-de1e315a-b2d5-4eb3-a42d-416cd588fd44 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Calling method '>' {{(pid=116157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:11:40.509935 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.compute.api [None req-de1e315a-b2d5-4eb3-a42d-416cd588fd44 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] [instance: bbb8462c-9501-4541-b67e-43ec5c5061a7] Fetching instance by UUID {{(pid=116157) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:11:40.515789 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-de1e315a-b2d5-4eb3-a42d-416cd588fd44 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:11:40.516232 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-de1e315a-b2d5-4eb3-a42d-416cd588fd44 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:11:40.516997 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-de1e315a-b2d5-4eb3-a42d-416cd588fd44 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:11:40.517427 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-de1e315a-b2d5-4eb3-a42d-416cd588fd44 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:11:40.574430 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.policy [None req-de1e315a-b2d5-4eb3-a42d-416cd588fd44 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97bdf19af9e34fc3886ff451cb9d7a27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '494b56bf5eae4d56a5591546f85bc32b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116157) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:11:40.581498 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: INFO nova.api.openstack.requestlog [None req-de1e315a-b2d5-4eb3-a42d-416cd588fd44 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] 10.222.0.18 "GET /compute/v2.1/servers/bbb8462c-9501-4541-b67e-43ec5c5061a7" status: 200 len: 1226 microversion: 2.1 time: 0.076405 Dec 15 03:11:40.582069 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: [pid: 116157|app: 0|req: 603/1205] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 03:11:40 2021] GET /compute/v2.1/servers/bbb8462c-9501-4541-b67e-43ec5c5061a7 => generated 1226 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 03:11:41.250890 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi [None req-6d774584-7828-4152-8864-63910bce5b6d tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Calling method '>' {{(pid=116156) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:11:41.251797 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.compute.api [None req-6d774584-7828-4152-8864-63910bce5b6d tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] [instance: b89094ac-aee1-4bd6-a33d-8c4347cebfc7] Fetching instance by UUID {{(pid=116156) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:11:41.257614 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-6d774584-7828-4152-8864-63910bce5b6d tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:11:41.258099 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-6d774584-7828-4152-8864-63910bce5b6d tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:11:41.258881 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-6d774584-7828-4152-8864-63910bce5b6d tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:11:41.259325 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-6d774584-7828-4152-8864-63910bce5b6d tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:11:41.287177 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: INFO nova.api.openstack.requestlog [None req-6d774584-7828-4152-8864-63910bce5b6d tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] 10.222.0.18 "GET /compute/v2.1/servers/b89094ac-aee1-4bd6-a33d-8c4347cebfc7/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.040243 Dec 15 03:11:41.287828 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: [pid: 116156|app: 0|req: 603/1206] 10.222.0.18 () {60 vars in 1342 bytes} [Wed Dec 15 03:11:41 2021] GET /compute/v2.1/servers/b89094ac-aee1-4bd6-a33d-8c4347cebfc7/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 03:11:41.297125 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi [None req-3e68ab08-59d5-42e8-8ce9-7df0ad89ad6d tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Calling method '>' {{(pid=116157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:11:41.297780 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.compute.api [None req-3e68ab08-59d5-42e8-8ce9-7df0ad89ad6d tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] [instance: fa7c86bc-c46f-4120-8f3d-d795f8d7c5cc] Fetching instance by UUID {{(pid=116157) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:11:41.304021 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-3e68ab08-59d5-42e8-8ce9-7df0ad89ad6d tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:11:41.304477 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-3e68ab08-59d5-42e8-8ce9-7df0ad89ad6d tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:11:41.305286 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-3e68ab08-59d5-42e8-8ce9-7df0ad89ad6d tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:11:41.305728 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-3e68ab08-59d5-42e8-8ce9-7df0ad89ad6d tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:11:41.433693 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.policy [None req-3e68ab08-59d5-42e8-8ce9-7df0ad89ad6d tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c4c0c82448e40ba801c0b52ec44e74a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a093d0bf43046aaa845f3cc115f3f5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116157) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:11:41.441163 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: INFO nova.api.openstack.requestlog [None req-3e68ab08-59d5-42e8-8ce9-7df0ad89ad6d tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] 10.222.0.18 "GET /compute/v2.1/servers/fa7c86bc-c46f-4120-8f3d-d795f8d7c5cc" status: 200 len: 1570 microversion: 2.1 time: 0.147591 Dec 15 03:11:41.441728 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: [pid: 116157|app: 0|req: 604/1207] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 03:11:41 2021] GET /compute/v2.1/servers/fa7c86bc-c46f-4120-8f3d-d795f8d7c5cc => generated 1570 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 03:11:41.597914 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi [None req-fed72fe9-c180-47f4-bfc1-7adee582d2af tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Calling method '>' {{(pid=116156) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:11:41.598620 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.compute.api [None req-fed72fe9-c180-47f4-bfc1-7adee582d2af tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] [instance: bbb8462c-9501-4541-b67e-43ec5c5061a7] Fetching instance by UUID {{(pid=116156) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:11:41.604459 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-fed72fe9-c180-47f4-bfc1-7adee582d2af tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:11:41.604918 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-fed72fe9-c180-47f4-bfc1-7adee582d2af tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:11:41.605700 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-fed72fe9-c180-47f4-bfc1-7adee582d2af tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:11:41.606175 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-fed72fe9-c180-47f4-bfc1-7adee582d2af tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:11:41.663886 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.policy [None req-fed72fe9-c180-47f4-bfc1-7adee582d2af tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97bdf19af9e34fc3886ff451cb9d7a27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '494b56bf5eae4d56a5591546f85bc32b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116156) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:11:41.671036 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: INFO nova.api.openstack.requestlog [None req-fed72fe9-c180-47f4-bfc1-7adee582d2af tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] 10.222.0.18 "GET /compute/v2.1/servers/bbb8462c-9501-4541-b67e-43ec5c5061a7" status: 200 len: 1226 microversion: 2.1 time: 0.076705 Dec 15 03:11:41.671600 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: [pid: 116156|app: 0|req: 604/1208] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 03:11:41 2021] GET /compute/v2.1/servers/bbb8462c-9501-4541-b67e-43ec5c5061a7 => generated 1226 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 03:11:42.298583 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi [None req-e04067b6-e6e4-48c0-8282-d51fdafcfed4 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Calling method '>' {{(pid=116157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:11:42.299490 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.compute.api [None req-e04067b6-e6e4-48c0-8282-d51fdafcfed4 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] [instance: b89094ac-aee1-4bd6-a33d-8c4347cebfc7] Fetching instance by UUID {{(pid=116157) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:11:42.306430 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-e04067b6-e6e4-48c0-8282-d51fdafcfed4 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:11:42.306882 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-e04067b6-e6e4-48c0-8282-d51fdafcfed4 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:11:42.307656 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-e04067b6-e6e4-48c0-8282-d51fdafcfed4 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:11:42.308091 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-e04067b6-e6e4-48c0-8282-d51fdafcfed4 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:11:42.335462 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: INFO nova.api.openstack.requestlog [None req-e04067b6-e6e4-48c0-8282-d51fdafcfed4 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] 10.222.0.18 "GET /compute/v2.1/servers/b89094ac-aee1-4bd6-a33d-8c4347cebfc7/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.040658 Dec 15 03:11:42.336002 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: [pid: 116157|app: 0|req: 605/1209] 10.222.0.18 () {60 vars in 1342 bytes} [Wed Dec 15 03:11:42 2021] GET /compute/v2.1/servers/b89094ac-aee1-4bd6-a33d-8c4347cebfc7/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 03:11:42.457888 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi [None req-c89e5656-db4f-4751-ae86-6b49fa07fe89 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Calling method '>' {{(pid=116156) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:11:42.458469 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.compute.api [None req-c89e5656-db4f-4751-ae86-6b49fa07fe89 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] [instance: fa7c86bc-c46f-4120-8f3d-d795f8d7c5cc] Fetching instance by UUID {{(pid=116156) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:11:42.465153 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-c89e5656-db4f-4751-ae86-6b49fa07fe89 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:11:42.465602 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-c89e5656-db4f-4751-ae86-6b49fa07fe89 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:11:42.466416 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-c89e5656-db4f-4751-ae86-6b49fa07fe89 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:11:42.466851 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-c89e5656-db4f-4751-ae86-6b49fa07fe89 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:11:42.596085 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.policy [None req-c89e5656-db4f-4751-ae86-6b49fa07fe89 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c4c0c82448e40ba801c0b52ec44e74a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a093d0bf43046aaa845f3cc115f3f5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116156) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:11:42.603799 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: INFO nova.api.openstack.requestlog [None req-c89e5656-db4f-4751-ae86-6b49fa07fe89 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] 10.222.0.18 "GET /compute/v2.1/servers/fa7c86bc-c46f-4120-8f3d-d795f8d7c5cc" status: 200 len: 1570 microversion: 2.1 time: 0.149538 Dec 15 03:11:42.604364 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: [pid: 116156|app: 0|req: 605/1210] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 03:11:42 2021] GET /compute/v2.1/servers/fa7c86bc-c46f-4120-8f3d-d795f8d7c5cc => generated 1570 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 03:11:42.687852 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi [None req-88819a3e-44a7-41ce-afe4-c0b5336cb341 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Calling method '>' {{(pid=116157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:11:42.688458 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.compute.api [None req-88819a3e-44a7-41ce-afe4-c0b5336cb341 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] [instance: bbb8462c-9501-4541-b67e-43ec5c5061a7] Fetching instance by UUID {{(pid=116157) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:11:42.694222 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-88819a3e-44a7-41ce-afe4-c0b5336cb341 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:11:42.694666 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-88819a3e-44a7-41ce-afe4-c0b5336cb341 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:11:42.695433 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-88819a3e-44a7-41ce-afe4-c0b5336cb341 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:11:42.695865 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-88819a3e-44a7-41ce-afe4-c0b5336cb341 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:11:42.754452 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.policy [None req-88819a3e-44a7-41ce-afe4-c0b5336cb341 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97bdf19af9e34fc3886ff451cb9d7a27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '494b56bf5eae4d56a5591546f85bc32b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116157) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:11:42.761668 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: INFO nova.api.openstack.requestlog [None req-88819a3e-44a7-41ce-afe4-c0b5336cb341 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] 10.222.0.18 "GET /compute/v2.1/servers/bbb8462c-9501-4541-b67e-43ec5c5061a7" status: 200 len: 1226 microversion: 2.1 time: 0.077394 Dec 15 03:11:42.762259 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: [pid: 116157|app: 0|req: 606/1211] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 03:11:42 2021] GET /compute/v2.1/servers/bbb8462c-9501-4541-b67e-43ec5c5061a7 => generated 1226 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 03:11:43.346911 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi [None req-e6d147cb-9ef5-477d-925b-bbd7708b03b3 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Calling method '>' {{(pid=116156) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:11:43.347816 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.compute.api [None req-e6d147cb-9ef5-477d-925b-bbd7708b03b3 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] [instance: b89094ac-aee1-4bd6-a33d-8c4347cebfc7] Fetching instance by UUID {{(pid=116156) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:11:43.353792 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-e6d147cb-9ef5-477d-925b-bbd7708b03b3 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:11:43.354295 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-e6d147cb-9ef5-477d-925b-bbd7708b03b3 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:11:43.355068 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-e6d147cb-9ef5-477d-925b-bbd7708b03b3 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:11:43.355503 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-e6d147cb-9ef5-477d-925b-bbd7708b03b3 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:11:43.384811 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: INFO nova.api.openstack.requestlog [None req-e6d147cb-9ef5-477d-925b-bbd7708b03b3 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] 10.222.0.18 "GET /compute/v2.1/servers/b89094ac-aee1-4bd6-a33d-8c4347cebfc7/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041611 Dec 15 03:11:43.385358 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: [pid: 116156|app: 0|req: 606/1212] 10.222.0.18 () {60 vars in 1342 bytes} [Wed Dec 15 03:11:43 2021] GET /compute/v2.1/servers/b89094ac-aee1-4bd6-a33d-8c4347cebfc7/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 03:11:43.621219 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi [None req-468eb831-6ce0-4dc3-be2a-1bdcdcee722f tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Calling method '>' {{(pid=116157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:11:43.621838 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.compute.api [None req-468eb831-6ce0-4dc3-be2a-1bdcdcee722f tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] [instance: fa7c86bc-c46f-4120-8f3d-d795f8d7c5cc] Fetching instance by UUID {{(pid=116157) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:11:43.628115 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-468eb831-6ce0-4dc3-be2a-1bdcdcee722f tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:11:43.628577 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-468eb831-6ce0-4dc3-be2a-1bdcdcee722f tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:11:43.629359 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-468eb831-6ce0-4dc3-be2a-1bdcdcee722f tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:11:43.629800 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-468eb831-6ce0-4dc3-be2a-1bdcdcee722f tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:11:43.778567 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi [None req-b21ba9e6-62a4-4b16-9f64-e9ab9b29f655 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Calling method '>' {{(pid=116156) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:11:43.779285 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.compute.api [None req-b21ba9e6-62a4-4b16-9f64-e9ab9b29f655 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] [instance: bbb8462c-9501-4541-b67e-43ec5c5061a7] Fetching instance by UUID {{(pid=116156) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:11:43.785651 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-b21ba9e6-62a4-4b16-9f64-e9ab9b29f655 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:11:43.786133 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-b21ba9e6-62a4-4b16-9f64-e9ab9b29f655 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:11:43.786919 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-b21ba9e6-62a4-4b16-9f64-e9ab9b29f655 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:11:43.787353 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-b21ba9e6-62a4-4b16-9f64-e9ab9b29f655 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:11:43.845443 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.policy [None req-b21ba9e6-62a4-4b16-9f64-e9ab9b29f655 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97bdf19af9e34fc3886ff451cb9d7a27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '494b56bf5eae4d56a5591546f85bc32b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116156) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:11:43.853262 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: INFO nova.api.openstack.requestlog [None req-b21ba9e6-62a4-4b16-9f64-e9ab9b29f655 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] 10.222.0.18 "GET /compute/v2.1/servers/bbb8462c-9501-4541-b67e-43ec5c5061a7" status: 200 len: 1226 microversion: 2.1 time: 0.078381 Dec 15 03:11:43.853872 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: [pid: 116156|app: 0|req: 607/1213] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 03:11:43 2021] GET /compute/v2.1/servers/bbb8462c-9501-4541-b67e-43ec5c5061a7 => generated 1226 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 03:11:43.915295 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.policy [None req-468eb831-6ce0-4dc3-be2a-1bdcdcee722f tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c4c0c82448e40ba801c0b52ec44e74a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a093d0bf43046aaa845f3cc115f3f5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116157) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:11:43.922515 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: INFO nova.api.openstack.requestlog [None req-468eb831-6ce0-4dc3-be2a-1bdcdcee722f tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] 10.222.0.18 "GET /compute/v2.1/servers/fa7c86bc-c46f-4120-8f3d-d795f8d7c5cc" status: 200 len: 1570 microversion: 2.1 time: 0.305089 Dec 15 03:11:43.923073 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: [pid: 116157|app: 0|req: 607/1214] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 03:11:43 2021] GET /compute/v2.1/servers/fa7c86bc-c46f-4120-8f3d-d795f8d7c5cc => generated 1570 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 03:11:44.395483 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi [None req-ecb13d3d-9407-4b10-bceb-ad852496fe1c tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Calling method '>' {{(pid=116156) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:11:44.396390 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.compute.api [None req-ecb13d3d-9407-4b10-bceb-ad852496fe1c tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] [instance: b89094ac-aee1-4bd6-a33d-8c4347cebfc7] Fetching instance by UUID {{(pid=116156) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:11:44.402918 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-ecb13d3d-9407-4b10-bceb-ad852496fe1c tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:11:44.403371 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-ecb13d3d-9407-4b10-bceb-ad852496fe1c tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:11:44.404160 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-ecb13d3d-9407-4b10-bceb-ad852496fe1c tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:11:44.404595 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-ecb13d3d-9407-4b10-bceb-ad852496fe1c tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:11:44.432045 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: INFO nova.api.openstack.requestlog [None req-ecb13d3d-9407-4b10-bceb-ad852496fe1c tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] 10.222.0.18 "GET /compute/v2.1/servers/b89094ac-aee1-4bd6-a33d-8c4347cebfc7/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.040354 Dec 15 03:11:44.432583 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: [pid: 116156|app: 0|req: 608/1215] 10.222.0.18 () {60 vars in 1342 bytes} [Wed Dec 15 03:11:44 2021] GET /compute/v2.1/servers/b89094ac-aee1-4bd6-a33d-8c4347cebfc7/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 03:11:44.869919 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi [None req-0b57934e-d536-4104-ac21-d4d028f15881 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Calling method '>' {{(pid=116157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:11:44.870562 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.compute.api [None req-0b57934e-d536-4104-ac21-d4d028f15881 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] [instance: bbb8462c-9501-4541-b67e-43ec5c5061a7] Fetching instance by UUID {{(pid=116157) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:11:44.876868 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-0b57934e-d536-4104-ac21-d4d028f15881 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:11:44.877321 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-0b57934e-d536-4104-ac21-d4d028f15881 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:11:44.878122 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-0b57934e-d536-4104-ac21-d4d028f15881 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:11:44.878559 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-0b57934e-d536-4104-ac21-d4d028f15881 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:11:44.935559 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.policy [None req-0b57934e-d536-4104-ac21-d4d028f15881 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97bdf19af9e34fc3886ff451cb9d7a27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '494b56bf5eae4d56a5591546f85bc32b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116157) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:11:44.939707 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi [None req-3f72d2cc-db46-4660-a9d0-09eb3ddb182c tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Calling method '>' {{(pid=116156) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:11:44.940319 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.compute.api [None req-3f72d2cc-db46-4660-a9d0-09eb3ddb182c tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] [instance: fa7c86bc-c46f-4120-8f3d-d795f8d7c5cc] Fetching instance by UUID {{(pid=116156) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:11:44.942915 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: INFO nova.api.openstack.requestlog [None req-0b57934e-d536-4104-ac21-d4d028f15881 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] 10.222.0.18 "GET /compute/v2.1/servers/bbb8462c-9501-4541-b67e-43ec5c5061a7" status: 200 len: 1226 microversion: 2.1 time: 0.077058 Dec 15 03:11:44.943468 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: [pid: 116157|app: 0|req: 608/1216] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 03:11:44 2021] GET /compute/v2.1/servers/bbb8462c-9501-4541-b67e-43ec5c5061a7 => generated 1226 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 03:11:44.947523 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-3f72d2cc-db46-4660-a9d0-09eb3ddb182c tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:11:44.947974 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-3f72d2cc-db46-4660-a9d0-09eb3ddb182c tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:11:44.948745 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-3f72d2cc-db46-4660-a9d0-09eb3ddb182c tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:11:44.949182 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-3f72d2cc-db46-4660-a9d0-09eb3ddb182c tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:11:45.076455 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.policy [None req-3f72d2cc-db46-4660-a9d0-09eb3ddb182c tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c4c0c82448e40ba801c0b52ec44e74a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a093d0bf43046aaa845f3cc115f3f5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116156) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:11:45.083538 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: INFO nova.api.openstack.requestlog [None req-3f72d2cc-db46-4660-a9d0-09eb3ddb182c tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] 10.222.0.18 "GET /compute/v2.1/servers/fa7c86bc-c46f-4120-8f3d-d795f8d7c5cc" status: 200 len: 1570 microversion: 2.1 time: 0.147432 Dec 15 03:11:45.084093 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: [pid: 116156|app: 0|req: 609/1217] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 03:11:44 2021] GET /compute/v2.1/servers/fa7c86bc-c46f-4120-8f3d-d795f8d7c5cc => generated 1570 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 03:11:45.443589 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi [None req-775ef33d-de1c-439a-a9dd-48238b03d272 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Calling method '>' {{(pid=116157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:11:45.444488 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.compute.api [None req-775ef33d-de1c-439a-a9dd-48238b03d272 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] [instance: b89094ac-aee1-4bd6-a33d-8c4347cebfc7] Fetching instance by UUID {{(pid=116157) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:11:45.450265 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-775ef33d-de1c-439a-a9dd-48238b03d272 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:11:45.450719 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-775ef33d-de1c-439a-a9dd-48238b03d272 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:11:45.451482 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-775ef33d-de1c-439a-a9dd-48238b03d272 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:11:45.451911 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-775ef33d-de1c-439a-a9dd-48238b03d272 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:11:45.479950 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: INFO nova.api.openstack.requestlog [None req-775ef33d-de1c-439a-a9dd-48238b03d272 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] 10.222.0.18 "GET /compute/v2.1/servers/b89094ac-aee1-4bd6-a33d-8c4347cebfc7/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.040247 Dec 15 03:11:45.480418 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: [pid: 116157|app: 0|req: 609/1218] 10.222.0.18 () {60 vars in 1342 bytes} [Wed Dec 15 03:11:45 2021] GET /compute/v2.1/servers/b89094ac-aee1-4bd6-a33d-8c4347cebfc7/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 03:11:45.960461 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi [None req-a2e1124d-76c1-42d5-9931-ead63af1d780 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Calling method '>' {{(pid=116156) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:11:45.961061 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.compute.api [None req-a2e1124d-76c1-42d5-9931-ead63af1d780 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] [instance: bbb8462c-9501-4541-b67e-43ec5c5061a7] Fetching instance by UUID {{(pid=116156) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:11:45.967255 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-a2e1124d-76c1-42d5-9931-ead63af1d780 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:11:45.967700 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-a2e1124d-76c1-42d5-9931-ead63af1d780 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:11:45.968471 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-a2e1124d-76c1-42d5-9931-ead63af1d780 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:11:45.968902 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-a2e1124d-76c1-42d5-9931-ead63af1d780 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:11:46.026969 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.policy [None req-a2e1124d-76c1-42d5-9931-ead63af1d780 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97bdf19af9e34fc3886ff451cb9d7a27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '494b56bf5eae4d56a5591546f85bc32b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116156) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:11:46.034020 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: INFO nova.api.openstack.requestlog [None req-a2e1124d-76c1-42d5-9931-ead63af1d780 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] 10.222.0.18 "GET /compute/v2.1/servers/bbb8462c-9501-4541-b67e-43ec5c5061a7" status: 200 len: 1226 microversion: 2.1 time: 0.077767 Dec 15 03:11:46.034572 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: [pid: 116156|app: 0|req: 610/1219] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 03:11:45 2021] GET /compute/v2.1/servers/bbb8462c-9501-4541-b67e-43ec5c5061a7 => generated 1226 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 03:11:46.100131 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi [None req-aca75870-333f-4b2d-b2d5-1ed44228b8ad tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Calling method '>' {{(pid=116157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:11:46.100720 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.compute.api [None req-aca75870-333f-4b2d-b2d5-1ed44228b8ad tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] [instance: fa7c86bc-c46f-4120-8f3d-d795f8d7c5cc] Fetching instance by UUID {{(pid=116157) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:11:46.106952 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-aca75870-333f-4b2d-b2d5-1ed44228b8ad tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:11:46.107401 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-aca75870-333f-4b2d-b2d5-1ed44228b8ad tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:11:46.108173 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-aca75870-333f-4b2d-b2d5-1ed44228b8ad tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:11:46.108609 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-aca75870-333f-4b2d-b2d5-1ed44228b8ad tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:11:46.237512 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.policy [None req-aca75870-333f-4b2d-b2d5-1ed44228b8ad tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c4c0c82448e40ba801c0b52ec44e74a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a093d0bf43046aaa845f3cc115f3f5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116157) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:11:46.245474 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: INFO nova.api.openstack.requestlog [None req-aca75870-333f-4b2d-b2d5-1ed44228b8ad tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] 10.222.0.18 "GET /compute/v2.1/servers/fa7c86bc-c46f-4120-8f3d-d795f8d7c5cc" status: 200 len: 1570 microversion: 2.1 time: 0.148951 Dec 15 03:11:46.246045 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: [pid: 116157|app: 0|req: 610/1220] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 03:11:46 2021] GET /compute/v2.1/servers/fa7c86bc-c46f-4120-8f3d-d795f8d7c5cc => generated 1570 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 03:11:46.492025 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi [None req-6474a91e-b4ba-41a6-8393-e4621a0a70eb tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Calling method '>' {{(pid=116156) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:11:46.492866 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.compute.api [None req-6474a91e-b4ba-41a6-8393-e4621a0a70eb tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] [instance: b89094ac-aee1-4bd6-a33d-8c4347cebfc7] Fetching instance by UUID {{(pid=116156) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:11:46.498646 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-6474a91e-b4ba-41a6-8393-e4621a0a70eb tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:11:46.499095 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-6474a91e-b4ba-41a6-8393-e4621a0a70eb tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:11:46.499856 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-6474a91e-b4ba-41a6-8393-e4621a0a70eb tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:11:46.500285 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-6474a91e-b4ba-41a6-8393-e4621a0a70eb tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:11:46.529550 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: INFO nova.api.openstack.requestlog [None req-6474a91e-b4ba-41a6-8393-e4621a0a70eb tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] 10.222.0.18 "GET /compute/v2.1/servers/b89094ac-aee1-4bd6-a33d-8c4347cebfc7/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042094 Dec 15 03:11:46.530105 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: [pid: 116156|app: 0|req: 611/1221] 10.222.0.18 () {60 vars in 1342 bytes} [Wed Dec 15 03:11:46 2021] GET /compute/v2.1/servers/b89094ac-aee1-4bd6-a33d-8c4347cebfc7/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 03:11:47.050651 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi [None req-c3dd0c31-0e0e-4d16-a4e6-a323dbdc6690 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Calling method '>' {{(pid=116157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:11:47.051264 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.compute.api [None req-c3dd0c31-0e0e-4d16-a4e6-a323dbdc6690 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] [instance: bbb8462c-9501-4541-b67e-43ec5c5061a7] Fetching instance by UUID {{(pid=116157) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:11:47.057148 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-c3dd0c31-0e0e-4d16-a4e6-a323dbdc6690 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:11:47.057603 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-c3dd0c31-0e0e-4d16-a4e6-a323dbdc6690 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:11:47.058418 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-c3dd0c31-0e0e-4d16-a4e6-a323dbdc6690 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:11:47.058863 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-c3dd0c31-0e0e-4d16-a4e6-a323dbdc6690 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:11:47.120094 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.policy [None req-c3dd0c31-0e0e-4d16-a4e6-a323dbdc6690 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97bdf19af9e34fc3886ff451cb9d7a27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '494b56bf5eae4d56a5591546f85bc32b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116157) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:11:47.127319 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: INFO nova.api.openstack.requestlog [None req-c3dd0c31-0e0e-4d16-a4e6-a323dbdc6690 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] 10.222.0.18 "GET /compute/v2.1/servers/bbb8462c-9501-4541-b67e-43ec5c5061a7" status: 200 len: 1226 microversion: 2.1 time: 0.080349 Dec 15 03:11:47.127872 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: [pid: 116157|app: 0|req: 611/1222] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 03:11:47 2021] GET /compute/v2.1/servers/bbb8462c-9501-4541-b67e-43ec5c5061a7 => generated 1226 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 03:11:47.261941 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi [None req-055c431a-7e67-4702-93ec-5f10752d8ce9 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Calling method '>' {{(pid=116156) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:11:47.262577 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.compute.api [None req-055c431a-7e67-4702-93ec-5f10752d8ce9 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] [instance: fa7c86bc-c46f-4120-8f3d-d795f8d7c5cc] Fetching instance by UUID {{(pid=116156) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:11:47.268776 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-055c431a-7e67-4702-93ec-5f10752d8ce9 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:11:47.269228 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-055c431a-7e67-4702-93ec-5f10752d8ce9 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:11:47.270020 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-055c431a-7e67-4702-93ec-5f10752d8ce9 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:11:47.270458 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-055c431a-7e67-4702-93ec-5f10752d8ce9 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:11:47.403551 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.policy [None req-055c431a-7e67-4702-93ec-5f10752d8ce9 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c4c0c82448e40ba801c0b52ec44e74a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a093d0bf43046aaa845f3cc115f3f5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116156) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:11:47.410702 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: INFO nova.api.openstack.requestlog [None req-055c431a-7e67-4702-93ec-5f10752d8ce9 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] 10.222.0.18 "GET /compute/v2.1/servers/fa7c86bc-c46f-4120-8f3d-d795f8d7c5cc" status: 200 len: 1570 microversion: 2.1 time: 0.152338 Dec 15 03:11:47.411260 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: [pid: 116156|app: 0|req: 612/1223] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 03:11:47 2021] GET /compute/v2.1/servers/fa7c86bc-c46f-4120-8f3d-d795f8d7c5cc => generated 1570 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 03:11:47.540152 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi [None req-e89c3493-2304-4841-bd8e-91fff70e693c tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Calling method '>' {{(pid=116157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:11:47.541072 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.compute.api [None req-e89c3493-2304-4841-bd8e-91fff70e693c tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] [instance: b89094ac-aee1-4bd6-a33d-8c4347cebfc7] Fetching instance by UUID {{(pid=116157) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:11:47.547002 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-e89c3493-2304-4841-bd8e-91fff70e693c tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:11:47.547450 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-e89c3493-2304-4841-bd8e-91fff70e693c tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:11:47.548225 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-e89c3493-2304-4841-bd8e-91fff70e693c tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:11:47.548656 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-e89c3493-2304-4841-bd8e-91fff70e693c tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:11:47.576527 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: INFO nova.api.openstack.requestlog [None req-e89c3493-2304-4841-bd8e-91fff70e693c tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] 10.222.0.18 "GET /compute/v2.1/servers/b89094ac-aee1-4bd6-a33d-8c4347cebfc7/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.040136 Dec 15 03:11:47.577057 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: [pid: 116157|app: 0|req: 612/1224] 10.222.0.18 () {60 vars in 1342 bytes} [Wed Dec 15 03:11:47 2021] GET /compute/v2.1/servers/b89094ac-aee1-4bd6-a33d-8c4347cebfc7/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 03:11:48.143934 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi [None req-716eadf9-35d7-42f9-8c24-0acc9e03438e tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Calling method '>' {{(pid=116156) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:11:48.144550 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.compute.api [None req-716eadf9-35d7-42f9-8c24-0acc9e03438e tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] [instance: bbb8462c-9501-4541-b67e-43ec5c5061a7] Fetching instance by UUID {{(pid=116156) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:11:48.150288 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-716eadf9-35d7-42f9-8c24-0acc9e03438e tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:11:48.150740 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-716eadf9-35d7-42f9-8c24-0acc9e03438e tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:11:48.151517 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-716eadf9-35d7-42f9-8c24-0acc9e03438e tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:11:48.151954 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-716eadf9-35d7-42f9-8c24-0acc9e03438e tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:11:48.209375 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.policy [None req-716eadf9-35d7-42f9-8c24-0acc9e03438e tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97bdf19af9e34fc3886ff451cb9d7a27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '494b56bf5eae4d56a5591546f85bc32b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116156) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:11:48.217203 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: INFO nova.api.openstack.requestlog [None req-716eadf9-35d7-42f9-8c24-0acc9e03438e tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] 10.222.0.18 "GET /compute/v2.1/servers/bbb8462c-9501-4541-b67e-43ec5c5061a7" status: 200 len: 1226 microversion: 2.1 time: 0.076953 Dec 15 03:11:48.217761 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: [pid: 116156|app: 0|req: 613/1225] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 03:11:48 2021] GET /compute/v2.1/servers/bbb8462c-9501-4541-b67e-43ec5c5061a7 => generated 1226 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 03:11:48.427482 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi [None req-4ceb7618-903e-420d-8538-1a2e77ab8e9c tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Calling method '>' {{(pid=116157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:11:48.428115 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.compute.api [None req-4ceb7618-903e-420d-8538-1a2e77ab8e9c tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] [instance: fa7c86bc-c46f-4120-8f3d-d795f8d7c5cc] Fetching instance by UUID {{(pid=116157) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:11:48.434205 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-4ceb7618-903e-420d-8538-1a2e77ab8e9c tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:11:48.434653 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-4ceb7618-903e-420d-8538-1a2e77ab8e9c tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:11:48.435448 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-4ceb7618-903e-420d-8538-1a2e77ab8e9c tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:11:48.435876 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-4ceb7618-903e-420d-8538-1a2e77ab8e9c tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:11:48.562415 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.policy [None req-4ceb7618-903e-420d-8538-1a2e77ab8e9c tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c4c0c82448e40ba801c0b52ec44e74a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a093d0bf43046aaa845f3cc115f3f5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116157) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:11:48.569643 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: INFO nova.api.openstack.requestlog [None req-4ceb7618-903e-420d-8538-1a2e77ab8e9c tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] 10.222.0.18 "GET /compute/v2.1/servers/fa7c86bc-c46f-4120-8f3d-d795f8d7c5cc" status: 200 len: 1570 microversion: 2.1 time: 0.145824 Dec 15 03:11:48.570229 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: [pid: 116157|app: 0|req: 613/1226] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 03:11:48 2021] GET /compute/v2.1/servers/fa7c86bc-c46f-4120-8f3d-d795f8d7c5cc => generated 1570 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 03:11:48.588181 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi [None req-6e6d3464-7c04-4b61-b376-44619213ae83 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Calling method '>' {{(pid=116156) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:11:48.589084 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.compute.api [None req-6e6d3464-7c04-4b61-b376-44619213ae83 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] [instance: b89094ac-aee1-4bd6-a33d-8c4347cebfc7] Fetching instance by UUID {{(pid=116156) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:11:48.595201 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-6e6d3464-7c04-4b61-b376-44619213ae83 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:11:48.595672 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-6e6d3464-7c04-4b61-b376-44619213ae83 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:11:48.596442 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-6e6d3464-7c04-4b61-b376-44619213ae83 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:11:48.596876 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-6e6d3464-7c04-4b61-b376-44619213ae83 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:11:48.625117 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: INFO nova.api.openstack.requestlog [None req-6e6d3464-7c04-4b61-b376-44619213ae83 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] 10.222.0.18 "GET /compute/v2.1/servers/b89094ac-aee1-4bd6-a33d-8c4347cebfc7/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041110 Dec 15 03:11:48.625652 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: [pid: 116156|app: 0|req: 614/1227] 10.222.0.18 () {60 vars in 1342 bytes} [Wed Dec 15 03:11:48 2021] GET /compute/v2.1/servers/b89094ac-aee1-4bd6-a33d-8c4347cebfc7/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 03:11:49.234273 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi [None req-f309da91-391b-4f56-a36b-2762442a984a tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Calling method '>' {{(pid=116157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:11:49.234885 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.compute.api [None req-f309da91-391b-4f56-a36b-2762442a984a tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] [instance: bbb8462c-9501-4541-b67e-43ec5c5061a7] Fetching instance by UUID {{(pid=116157) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:11:49.240948 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-f309da91-391b-4f56-a36b-2762442a984a tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:11:49.241403 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-f309da91-391b-4f56-a36b-2762442a984a tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:11:49.242239 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-f309da91-391b-4f56-a36b-2762442a984a tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:11:49.242679 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-f309da91-391b-4f56-a36b-2762442a984a tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:11:49.301196 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.policy [None req-f309da91-391b-4f56-a36b-2762442a984a tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97bdf19af9e34fc3886ff451cb9d7a27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '494b56bf5eae4d56a5591546f85bc32b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116157) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:11:49.308292 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: INFO nova.api.openstack.requestlog [None req-f309da91-391b-4f56-a36b-2762442a984a tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] 10.222.0.18 "GET /compute/v2.1/servers/bbb8462c-9501-4541-b67e-43ec5c5061a7" status: 200 len: 1226 microversion: 2.1 time: 0.077670 Dec 15 03:11:49.308842 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: [pid: 116157|app: 0|req: 614/1228] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 03:11:49 2021] GET /compute/v2.1/servers/bbb8462c-9501-4541-b67e-43ec5c5061a7 => generated 1226 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 03:11:49.586962 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi [None req-fab432e3-2722-456f-9cb0-ffcb6e62f99b tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Calling method '>' {{(pid=116156) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:11:49.587570 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.compute.api [None req-fab432e3-2722-456f-9cb0-ffcb6e62f99b tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] [instance: fa7c86bc-c46f-4120-8f3d-d795f8d7c5cc] Fetching instance by UUID {{(pid=116156) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:11:49.593661 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-fab432e3-2722-456f-9cb0-ffcb6e62f99b tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:11:49.594263 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-fab432e3-2722-456f-9cb0-ffcb6e62f99b tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:11:49.594888 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-fab432e3-2722-456f-9cb0-ffcb6e62f99b tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:11:49.595314 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-fab432e3-2722-456f-9cb0-ffcb6e62f99b tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:11:49.637248 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi [None req-4e52dfe2-45a5-45e5-a329-f0cafcbbc422 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Calling method '>' {{(pid=116157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:11:49.638211 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.compute.api [None req-4e52dfe2-45a5-45e5-a329-f0cafcbbc422 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] [instance: b89094ac-aee1-4bd6-a33d-8c4347cebfc7] Fetching instance by UUID {{(pid=116157) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:11:49.644457 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-4e52dfe2-45a5-45e5-a329-f0cafcbbc422 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:11:49.644909 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-4e52dfe2-45a5-45e5-a329-f0cafcbbc422 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:11:49.645688 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-4e52dfe2-45a5-45e5-a329-f0cafcbbc422 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:11:49.646164 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-4e52dfe2-45a5-45e5-a329-f0cafcbbc422 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:11:49.675056 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: INFO nova.api.openstack.requestlog [None req-4e52dfe2-45a5-45e5-a329-f0cafcbbc422 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] 10.222.0.18 "GET /compute/v2.1/servers/b89094ac-aee1-4bd6-a33d-8c4347cebfc7/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041512 Dec 15 03:11:49.675617 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: [pid: 116157|app: 0|req: 615/1229] 10.222.0.18 () {60 vars in 1342 bytes} [Wed Dec 15 03:11:49 2021] GET /compute/v2.1/servers/b89094ac-aee1-4bd6-a33d-8c4347cebfc7/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 03:11:49.724192 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.policy [None req-fab432e3-2722-456f-9cb0-ffcb6e62f99b tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c4c0c82448e40ba801c0b52ec44e74a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a093d0bf43046aaa845f3cc115f3f5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116156) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:11:49.731573 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: INFO nova.api.openstack.requestlog [None req-fab432e3-2722-456f-9cb0-ffcb6e62f99b tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] 10.222.0.18 "GET /compute/v2.1/servers/fa7c86bc-c46f-4120-8f3d-d795f8d7c5cc" status: 200 len: 1570 microversion: 2.1 time: 0.148854 Dec 15 03:11:49.732158 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: [pid: 116156|app: 0|req: 615/1230] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 03:11:49 2021] GET /compute/v2.1/servers/fa7c86bc-c46f-4120-8f3d-d795f8d7c5cc => generated 1570 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 03:11:49.847727 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Dec 15 03:11:49.847898 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: Wed Dec 15 03:11:49 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Dec 15 03:11:50.325226 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi [None req-859a6e35-0443-433f-8e2c-2b8e167045db tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Calling method '>' {{(pid=116157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:11:50.325832 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.compute.api [None req-859a6e35-0443-433f-8e2c-2b8e167045db tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] [instance: bbb8462c-9501-4541-b67e-43ec5c5061a7] Fetching instance by UUID {{(pid=116157) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:11:50.331738 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-859a6e35-0443-433f-8e2c-2b8e167045db tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:11:50.332200 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-859a6e35-0443-433f-8e2c-2b8e167045db tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:11:50.332970 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-859a6e35-0443-433f-8e2c-2b8e167045db tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:11:50.333404 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-859a6e35-0443-433f-8e2c-2b8e167045db tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:11:50.390762 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.policy [None req-859a6e35-0443-433f-8e2c-2b8e167045db tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97bdf19af9e34fc3886ff451cb9d7a27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '494b56bf5eae4d56a5591546f85bc32b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116157) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:11:50.397814 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: INFO nova.api.openstack.requestlog [None req-859a6e35-0443-433f-8e2c-2b8e167045db tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] 10.222.0.18 "GET /compute/v2.1/servers/bbb8462c-9501-4541-b67e-43ec5c5061a7" status: 200 len: 1226 microversion: 2.1 time: 0.076257 Dec 15 03:11:50.398395 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: [pid: 116157|app: 0|req: 616/1231] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 03:11:50 2021] GET /compute/v2.1/servers/bbb8462c-9501-4541-b67e-43ec5c5061a7 => generated 1226 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 03:11:50.686421 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi [None req-f243b33e-b38c-47d8-b164-125467da92ae tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Calling method '>' {{(pid=116156) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:11:50.687320 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.compute.api [None req-f243b33e-b38c-47d8-b164-125467da92ae tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] [instance: b89094ac-aee1-4bd6-a33d-8c4347cebfc7] Fetching instance by UUID {{(pid=116156) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:11:50.693483 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-f243b33e-b38c-47d8-b164-125467da92ae tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:11:50.693929 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-f243b33e-b38c-47d8-b164-125467da92ae tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:11:50.694740 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-f243b33e-b38c-47d8-b164-125467da92ae tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:11:50.695174 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-f243b33e-b38c-47d8-b164-125467da92ae tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:11:50.723405 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: INFO nova.api.openstack.requestlog [None req-f243b33e-b38c-47d8-b164-125467da92ae tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] 10.222.0.18 "GET /compute/v2.1/servers/b89094ac-aee1-4bd6-a33d-8c4347cebfc7/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.040777 Dec 15 03:11:50.723929 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: [pid: 116156|app: 0|req: 616/1232] 10.222.0.18 () {60 vars in 1342 bytes} [Wed Dec 15 03:11:50 2021] GET /compute/v2.1/servers/b89094ac-aee1-4bd6-a33d-8c4347cebfc7/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 03:11:50.748179 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi [None req-c1107be4-e4cb-464a-9226-d7e490857cab tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Calling method '>' {{(pid=116157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:11:50.748815 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.compute.api [None req-c1107be4-e4cb-464a-9226-d7e490857cab tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] [instance: fa7c86bc-c46f-4120-8f3d-d795f8d7c5cc] Fetching instance by UUID {{(pid=116157) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:11:50.755055 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-c1107be4-e4cb-464a-9226-d7e490857cab tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:11:50.755507 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-c1107be4-e4cb-464a-9226-d7e490857cab tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:11:50.756308 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-c1107be4-e4cb-464a-9226-d7e490857cab tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:11:50.756742 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-c1107be4-e4cb-464a-9226-d7e490857cab tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:11:50.886721 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.policy [None req-c1107be4-e4cb-464a-9226-d7e490857cab tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c4c0c82448e40ba801c0b52ec44e74a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a093d0bf43046aaa845f3cc115f3f5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116157) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:11:50.893888 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: INFO nova.api.openstack.requestlog [None req-c1107be4-e4cb-464a-9226-d7e490857cab tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] 10.222.0.18 "GET /compute/v2.1/servers/fa7c86bc-c46f-4120-8f3d-d795f8d7c5cc" status: 200 len: 1570 microversion: 2.1 time: 0.149338 Dec 15 03:11:50.894476 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: [pid: 116157|app: 0|req: 617/1233] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 03:11:50 2021] GET /compute/v2.1/servers/fa7c86bc-c46f-4120-8f3d-d795f8d7c5cc => generated 1570 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 03:11:51.414479 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi [None req-479c64ba-d7fb-48ca-8469-b4090cb1bb6e tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Calling method '>' {{(pid=116156) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:11:51.415088 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.compute.api [None req-479c64ba-d7fb-48ca-8469-b4090cb1bb6e tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] [instance: bbb8462c-9501-4541-b67e-43ec5c5061a7] Fetching instance by UUID {{(pid=116156) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:11:51.420904 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-479c64ba-d7fb-48ca-8469-b4090cb1bb6e tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:11:51.421355 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-479c64ba-d7fb-48ca-8469-b4090cb1bb6e tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:11:51.422154 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-479c64ba-d7fb-48ca-8469-b4090cb1bb6e tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:11:51.422593 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-479c64ba-d7fb-48ca-8469-b4090cb1bb6e tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:11:51.484020 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.policy [None req-479c64ba-d7fb-48ca-8469-b4090cb1bb6e tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97bdf19af9e34fc3886ff451cb9d7a27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '494b56bf5eae4d56a5591546f85bc32b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116156) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:11:51.491529 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: INFO nova.api.openstack.requestlog [None req-479c64ba-d7fb-48ca-8469-b4090cb1bb6e tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] 10.222.0.18 "GET /compute/v2.1/servers/bbb8462c-9501-4541-b67e-43ec5c5061a7" status: 200 len: 1226 microversion: 2.1 time: 0.081338 Dec 15 03:11:51.492083 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: [pid: 116156|app: 0|req: 617/1234] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 03:11:51 2021] GET /compute/v2.1/servers/bbb8462c-9501-4541-b67e-43ec5c5061a7 => generated 1226 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 03:11:51.735068 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi [None req-c1869077-8d15-4257-be0d-860cf57ca220 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Calling method '>' {{(pid=116157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:11:51.735918 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.compute.api [None req-c1869077-8d15-4257-be0d-860cf57ca220 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] [instance: b89094ac-aee1-4bd6-a33d-8c4347cebfc7] Fetching instance by UUID {{(pid=116157) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:11:51.742017 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-c1869077-8d15-4257-be0d-860cf57ca220 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:11:51.742476 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-c1869077-8d15-4257-be0d-860cf57ca220 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:11:51.743257 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-c1869077-8d15-4257-be0d-860cf57ca220 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:11:51.743693 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-c1869077-8d15-4257-be0d-860cf57ca220 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:11:51.771322 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: INFO nova.api.openstack.requestlog [None req-c1869077-8d15-4257-be0d-860cf57ca220 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] 10.222.0.18 "GET /compute/v2.1/servers/b89094ac-aee1-4bd6-a33d-8c4347cebfc7/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.040100 Dec 15 03:11:51.772409 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: [pid: 116157|app: 0|req: 618/1235] 10.222.0.18 () {60 vars in 1342 bytes} [Wed Dec 15 03:11:51 2021] GET /compute/v2.1/servers/b89094ac-aee1-4bd6-a33d-8c4347cebfc7/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 03:11:51.911017 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi [None req-3a24f6cd-0679-4751-af0b-8ec32ab50f4b tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Calling method '>' {{(pid=116156) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:11:51.911622 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.compute.api [None req-3a24f6cd-0679-4751-af0b-8ec32ab50f4b tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] [instance: fa7c86bc-c46f-4120-8f3d-d795f8d7c5cc] Fetching instance by UUID {{(pid=116156) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:11:51.917790 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-3a24f6cd-0679-4751-af0b-8ec32ab50f4b tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:11:51.918284 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-3a24f6cd-0679-4751-af0b-8ec32ab50f4b tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:11:51.919056 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-3a24f6cd-0679-4751-af0b-8ec32ab50f4b tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:11:51.919486 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-3a24f6cd-0679-4751-af0b-8ec32ab50f4b tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:11:52.047328 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.policy [None req-3a24f6cd-0679-4751-af0b-8ec32ab50f4b tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c4c0c82448e40ba801c0b52ec44e74a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a093d0bf43046aaa845f3cc115f3f5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116156) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:11:52.054580 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: INFO nova.api.openstack.requestlog [None req-3a24f6cd-0679-4751-af0b-8ec32ab50f4b tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] 10.222.0.18 "GET /compute/v2.1/servers/fa7c86bc-c46f-4120-8f3d-d795f8d7c5cc" status: 200 len: 1570 microversion: 2.1 time: 0.147139 Dec 15 03:11:52.055131 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: [pid: 116156|app: 0|req: 618/1236] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 03:11:51 2021] GET /compute/v2.1/servers/fa7c86bc-c46f-4120-8f3d-d795f8d7c5cc => generated 1570 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 03:11:52.095321 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Dec 15 03:11:52.095480 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: Wed Dec 15 03:11:52 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Dec 15 03:11:52.508716 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi [None req-28bb25ea-a063-4de1-9bdf-25bdb4385d7a tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Calling method '>' {{(pid=116157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:11:52.509403 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.compute.api [None req-28bb25ea-a063-4de1-9bdf-25bdb4385d7a tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] [instance: bbb8462c-9501-4541-b67e-43ec5c5061a7] Fetching instance by UUID {{(pid=116157) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:11:52.515449 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-28bb25ea-a063-4de1-9bdf-25bdb4385d7a tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:11:52.515901 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-28bb25ea-a063-4de1-9bdf-25bdb4385d7a tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:11:52.516677 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-28bb25ea-a063-4de1-9bdf-25bdb4385d7a tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:11:52.517121 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-28bb25ea-a063-4de1-9bdf-25bdb4385d7a tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:11:52.574816 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.policy [None req-28bb25ea-a063-4de1-9bdf-25bdb4385d7a tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97bdf19af9e34fc3886ff451cb9d7a27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '494b56bf5eae4d56a5591546f85bc32b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116157) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:11:52.581932 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: INFO nova.api.openstack.requestlog [None req-28bb25ea-a063-4de1-9bdf-25bdb4385d7a tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] 10.222.0.18 "GET /compute/v2.1/servers/bbb8462c-9501-4541-b67e-43ec5c5061a7" status: 200 len: 1226 microversion: 2.1 time: 0.077578 Dec 15 03:11:52.582501 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: [pid: 116157|app: 0|req: 619/1237] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 03:11:52 2021] GET /compute/v2.1/servers/bbb8462c-9501-4541-b67e-43ec5c5061a7 => generated 1226 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 03:11:52.782858 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi [None req-1d0f34dd-4442-47e3-bee4-ea3293bd5449 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Calling method '>' {{(pid=116156) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:11:52.783691 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.compute.api [None req-1d0f34dd-4442-47e3-bee4-ea3293bd5449 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] [instance: b89094ac-aee1-4bd6-a33d-8c4347cebfc7] Fetching instance by UUID {{(pid=116156) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:11:52.790000 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-1d0f34dd-4442-47e3-bee4-ea3293bd5449 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:11:52.790465 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-1d0f34dd-4442-47e3-bee4-ea3293bd5449 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:11:52.791234 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-1d0f34dd-4442-47e3-bee4-ea3293bd5449 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:11:52.791664 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-1d0f34dd-4442-47e3-bee4-ea3293bd5449 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:11:52.819490 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: INFO nova.api.openstack.requestlog [None req-1d0f34dd-4442-47e3-bee4-ea3293bd5449 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] 10.222.0.18 "GET /compute/v2.1/servers/b89094ac-aee1-4bd6-a33d-8c4347cebfc7/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.040496 Dec 15 03:11:52.820016 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: [pid: 116156|app: 0|req: 619/1238] 10.222.0.18 () {60 vars in 1342 bytes} [Wed Dec 15 03:11:52 2021] GET /compute/v2.1/servers/b89094ac-aee1-4bd6-a33d-8c4347cebfc7/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 03:11:53.070586 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi [None req-8d6db688-c5fb-4b9b-9aa4-0e5cdd4a71ce tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Calling method '>' {{(pid=116157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:11:53.071196 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.compute.api [None req-8d6db688-c5fb-4b9b-9aa4-0e5cdd4a71ce tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] [instance: fa7c86bc-c46f-4120-8f3d-d795f8d7c5cc] Fetching instance by UUID {{(pid=116157) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:11:53.077353 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-8d6db688-c5fb-4b9b-9aa4-0e5cdd4a71ce tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:11:53.077795 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-8d6db688-c5fb-4b9b-9aa4-0e5cdd4a71ce tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:11:53.078622 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-8d6db688-c5fb-4b9b-9aa4-0e5cdd4a71ce tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:11:53.079053 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-8d6db688-c5fb-4b9b-9aa4-0e5cdd4a71ce tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:11:53.207447 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.policy [None req-8d6db688-c5fb-4b9b-9aa4-0e5cdd4a71ce tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c4c0c82448e40ba801c0b52ec44e74a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a093d0bf43046aaa845f3cc115f3f5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116157) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:11:53.215266 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: INFO nova.api.openstack.requestlog [None req-8d6db688-c5fb-4b9b-9aa4-0e5cdd4a71ce tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] 10.222.0.18 "GET /compute/v2.1/servers/fa7c86bc-c46f-4120-8f3d-d795f8d7c5cc" status: 200 len: 1570 microversion: 2.1 time: 0.148258 Dec 15 03:11:53.215810 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: [pid: 116157|app: 0|req: 620/1239] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 03:11:53 2021] GET /compute/v2.1/servers/fa7c86bc-c46f-4120-8f3d-d795f8d7c5cc => generated 1570 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 03:11:53.598342 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi [None req-92253268-29d8-48e8-8a7e-25da6fde97e4 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Calling method '>' {{(pid=116156) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:11:53.598952 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.compute.api [None req-92253268-29d8-48e8-8a7e-25da6fde97e4 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] [instance: bbb8462c-9501-4541-b67e-43ec5c5061a7] Fetching instance by UUID {{(pid=116156) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:11:53.605175 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-92253268-29d8-48e8-8a7e-25da6fde97e4 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:11:53.605624 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-92253268-29d8-48e8-8a7e-25da6fde97e4 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:11:53.606421 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-92253268-29d8-48e8-8a7e-25da6fde97e4 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:11:53.606849 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-92253268-29d8-48e8-8a7e-25da6fde97e4 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:11:53.664497 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.policy [None req-92253268-29d8-48e8-8a7e-25da6fde97e4 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97bdf19af9e34fc3886ff451cb9d7a27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '494b56bf5eae4d56a5591546f85bc32b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116156) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:11:53.671612 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: INFO nova.api.openstack.requestlog [None req-92253268-29d8-48e8-8a7e-25da6fde97e4 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] 10.222.0.18 "GET /compute/v2.1/servers/bbb8462c-9501-4541-b67e-43ec5c5061a7" status: 200 len: 1226 microversion: 2.1 time: 0.076904 Dec 15 03:11:53.672163 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: [pid: 116156|app: 0|req: 620/1240] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 03:11:53 2021] GET /compute/v2.1/servers/bbb8462c-9501-4541-b67e-43ec5c5061a7 => generated 1226 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 03:11:53.830800 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi [None req-a811fac2-68e8-4439-aa8f-779695178f8a tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Calling method '>' {{(pid=116157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:11:53.831701 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.compute.api [None req-a811fac2-68e8-4439-aa8f-779695178f8a tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] [instance: b89094ac-aee1-4bd6-a33d-8c4347cebfc7] Fetching instance by UUID {{(pid=116157) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:11:53.837468 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-a811fac2-68e8-4439-aa8f-779695178f8a tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:11:53.837901 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-a811fac2-68e8-4439-aa8f-779695178f8a tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:11:53.838710 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-a811fac2-68e8-4439-aa8f-779695178f8a tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:11:53.839148 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-a811fac2-68e8-4439-aa8f-779695178f8a tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:11:53.867286 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: INFO nova.api.openstack.requestlog [None req-a811fac2-68e8-4439-aa8f-779695178f8a tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] 10.222.0.18 "GET /compute/v2.1/servers/b89094ac-aee1-4bd6-a33d-8c4347cebfc7/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.040226 Dec 15 03:11:53.867764 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: [pid: 116157|app: 0|req: 621/1241] 10.222.0.18 () {60 vars in 1342 bytes} [Wed Dec 15 03:11:53 2021] GET /compute/v2.1/servers/b89094ac-aee1-4bd6-a33d-8c4347cebfc7/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 03:11:54.231985 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi [None req-052b9b7c-32a1-4c9e-8e90-2883ff6391a3 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Calling method '>' {{(pid=116156) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:11:54.232619 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.compute.api [None req-052b9b7c-32a1-4c9e-8e90-2883ff6391a3 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] [instance: fa7c86bc-c46f-4120-8f3d-d795f8d7c5cc] Fetching instance by UUID {{(pid=116156) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:11:54.238742 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-052b9b7c-32a1-4c9e-8e90-2883ff6391a3 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:11:54.239188 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-052b9b7c-32a1-4c9e-8e90-2883ff6391a3 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:11:54.240300 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-052b9b7c-32a1-4c9e-8e90-2883ff6391a3 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:11:54.241023 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-052b9b7c-32a1-4c9e-8e90-2883ff6391a3 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:11:54.373468 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.policy [None req-052b9b7c-32a1-4c9e-8e90-2883ff6391a3 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c4c0c82448e40ba801c0b52ec44e74a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a093d0bf43046aaa845f3cc115f3f5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116156) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:11:54.380578 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: INFO nova.api.openstack.requestlog [None req-052b9b7c-32a1-4c9e-8e90-2883ff6391a3 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] 10.222.0.18 "GET /compute/v2.1/servers/fa7c86bc-c46f-4120-8f3d-d795f8d7c5cc" status: 200 len: 1570 microversion: 2.1 time: 0.152242 Dec 15 03:11:54.381136 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: [pid: 116156|app: 0|req: 621/1242] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 03:11:54 2021] GET /compute/v2.1/servers/fa7c86bc-c46f-4120-8f3d-d795f8d7c5cc => generated 1570 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 03:11:54.688287 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi [None req-edbe0487-7163-4914-aece-9f0d3e71f104 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Calling method '>' {{(pid=116157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:11:54.688888 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.compute.api [None req-edbe0487-7163-4914-aece-9f0d3e71f104 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] [instance: bbb8462c-9501-4541-b67e-43ec5c5061a7] Fetching instance by UUID {{(pid=116157) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:11:54.695066 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-edbe0487-7163-4914-aece-9f0d3e71f104 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:11:54.695512 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-edbe0487-7163-4914-aece-9f0d3e71f104 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:11:54.696280 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-edbe0487-7163-4914-aece-9f0d3e71f104 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:11:54.696710 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-edbe0487-7163-4914-aece-9f0d3e71f104 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:11:54.757692 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.policy [None req-edbe0487-7163-4914-aece-9f0d3e71f104 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97bdf19af9e34fc3886ff451cb9d7a27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '494b56bf5eae4d56a5591546f85bc32b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116157) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:11:54.764863 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: INFO nova.api.openstack.requestlog [None req-edbe0487-7163-4914-aece-9f0d3e71f104 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] 10.222.0.18 "GET /compute/v2.1/servers/bbb8462c-9501-4541-b67e-43ec5c5061a7" status: 200 len: 1226 microversion: 2.1 time: 0.080235 Dec 15 03:11:54.765400 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: [pid: 116157|app: 0|req: 622/1243] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 03:11:54 2021] GET /compute/v2.1/servers/bbb8462c-9501-4541-b67e-43ec5c5061a7 => generated 1226 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 03:11:54.878634 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi [None req-a13b29e2-70f9-4a16-9cf1-6dac87058e55 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Calling method '>' {{(pid=116156) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:11:54.879530 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.compute.api [None req-a13b29e2-70f9-4a16-9cf1-6dac87058e55 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] [instance: b89094ac-aee1-4bd6-a33d-8c4347cebfc7] Fetching instance by UUID {{(pid=116156) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:11:54.886247 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-a13b29e2-70f9-4a16-9cf1-6dac87058e55 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:11:54.886700 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-a13b29e2-70f9-4a16-9cf1-6dac87058e55 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:11:54.887504 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-a13b29e2-70f9-4a16-9cf1-6dac87058e55 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:11:54.887940 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-a13b29e2-70f9-4a16-9cf1-6dac87058e55 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:11:54.917145 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: INFO nova.api.openstack.requestlog [None req-a13b29e2-70f9-4a16-9cf1-6dac87058e55 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] 10.222.0.18 "GET /compute/v2.1/servers/b89094ac-aee1-4bd6-a33d-8c4347cebfc7/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042404 Dec 15 03:11:54.917683 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: [pid: 116156|app: 0|req: 622/1244] 10.222.0.18 () {60 vars in 1342 bytes} [Wed Dec 15 03:11:54 2021] GET /compute/v2.1/servers/b89094ac-aee1-4bd6-a33d-8c4347cebfc7/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 03:11:55.397582 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi [None req-1f056b3f-6352-4864-8536-76b2aea7ad75 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Calling method '>' {{(pid=116157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:11:55.398227 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.compute.api [None req-1f056b3f-6352-4864-8536-76b2aea7ad75 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] [instance: fa7c86bc-c46f-4120-8f3d-d795f8d7c5cc] Fetching instance by UUID {{(pid=116157) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:11:55.403973 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-1f056b3f-6352-4864-8536-76b2aea7ad75 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:11:55.404423 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-1f056b3f-6352-4864-8536-76b2aea7ad75 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:11:55.405213 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-1f056b3f-6352-4864-8536-76b2aea7ad75 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:11:55.405649 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-1f056b3f-6352-4864-8536-76b2aea7ad75 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:11:55.534572 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.policy [None req-1f056b3f-6352-4864-8536-76b2aea7ad75 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c4c0c82448e40ba801c0b52ec44e74a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a093d0bf43046aaa845f3cc115f3f5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116157) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:11:55.542304 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: INFO nova.api.openstack.requestlog [None req-1f056b3f-6352-4864-8536-76b2aea7ad75 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] 10.222.0.18 "GET /compute/v2.1/servers/fa7c86bc-c46f-4120-8f3d-d795f8d7c5cc" status: 200 len: 1570 microversion: 2.1 time: 0.148336 Dec 15 03:11:55.542862 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: [pid: 116157|app: 0|req: 623/1245] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 03:11:55 2021] GET /compute/v2.1/servers/fa7c86bc-c46f-4120-8f3d-d795f8d7c5cc => generated 1570 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 03:11:55.781630 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi [None req-1438f818-3a34-4e2c-bc92-ddae6dffcdd8 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Calling method '>' {{(pid=116156) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:11:55.782203 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.compute.api [None req-1438f818-3a34-4e2c-bc92-ddae6dffcdd8 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] [instance: bbb8462c-9501-4541-b67e-43ec5c5061a7] Fetching instance by UUID {{(pid=116156) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:11:55.788454 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-1438f818-3a34-4e2c-bc92-ddae6dffcdd8 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:11:55.788907 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-1438f818-3a34-4e2c-bc92-ddae6dffcdd8 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:11:55.789682 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-1438f818-3a34-4e2c-bc92-ddae6dffcdd8 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:11:55.790144 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-1438f818-3a34-4e2c-bc92-ddae6dffcdd8 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:11:55.846833 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.policy [None req-1438f818-3a34-4e2c-bc92-ddae6dffcdd8 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97bdf19af9e34fc3886ff451cb9d7a27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '494b56bf5eae4d56a5591546f85bc32b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116156) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:11:55.854495 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: INFO nova.api.openstack.requestlog [None req-1438f818-3a34-4e2c-bc92-ddae6dffcdd8 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] 10.222.0.18 "GET /compute/v2.1/servers/bbb8462c-9501-4541-b67e-43ec5c5061a7" status: 200 len: 1226 microversion: 2.1 time: 0.076377 Dec 15 03:11:55.855056 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: [pid: 116156|app: 0|req: 623/1246] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 03:11:55 2021] GET /compute/v2.1/servers/bbb8462c-9501-4541-b67e-43ec5c5061a7 => generated 1226 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 03:11:55.928374 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi [None req-b32cc97c-0522-4ac8-bea2-133870c13cba tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Calling method '>' {{(pid=116157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:11:55.929303 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.compute.api [None req-b32cc97c-0522-4ac8-bea2-133870c13cba tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] [instance: b89094ac-aee1-4bd6-a33d-8c4347cebfc7] Fetching instance by UUID {{(pid=116157) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:11:55.935558 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-b32cc97c-0522-4ac8-bea2-133870c13cba tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:11:55.936010 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-b32cc97c-0522-4ac8-bea2-133870c13cba tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:11:55.936784 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-b32cc97c-0522-4ac8-bea2-133870c13cba tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:11:55.937222 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-b32cc97c-0522-4ac8-bea2-133870c13cba tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:11:55.965360 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: INFO nova.api.openstack.requestlog [None req-b32cc97c-0522-4ac8-bea2-133870c13cba tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] 10.222.0.18 "GET /compute/v2.1/servers/b89094ac-aee1-4bd6-a33d-8c4347cebfc7/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.040679 Dec 15 03:11:55.965903 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: [pid: 116157|app: 0|req: 624/1247] 10.222.0.18 () {60 vars in 1342 bytes} [Wed Dec 15 03:11:55 2021] GET /compute/v2.1/servers/b89094ac-aee1-4bd6-a33d-8c4347cebfc7/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 03:11:56.559171 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi [None req-102f93fe-15d8-4ef4-ba12-90ae68418dcb tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Calling method '>' {{(pid=116156) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:11:56.559779 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.compute.api [None req-102f93fe-15d8-4ef4-ba12-90ae68418dcb tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] [instance: fa7c86bc-c46f-4120-8f3d-d795f8d7c5cc] Fetching instance by UUID {{(pid=116156) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:11:56.565928 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-102f93fe-15d8-4ef4-ba12-90ae68418dcb tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:11:56.566419 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-102f93fe-15d8-4ef4-ba12-90ae68418dcb tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:11:56.567194 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-102f93fe-15d8-4ef4-ba12-90ae68418dcb tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:11:56.567624 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-102f93fe-15d8-4ef4-ba12-90ae68418dcb tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:11:56.696475 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.policy [None req-102f93fe-15d8-4ef4-ba12-90ae68418dcb tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c4c0c82448e40ba801c0b52ec44e74a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a093d0bf43046aaa845f3cc115f3f5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116156) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:11:56.703760 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: INFO nova.api.openstack.requestlog [None req-102f93fe-15d8-4ef4-ba12-90ae68418dcb tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] 10.222.0.18 "GET /compute/v2.1/servers/fa7c86bc-c46f-4120-8f3d-d795f8d7c5cc" status: 200 len: 1570 microversion: 2.1 time: 0.148230 Dec 15 03:11:56.704313 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: [pid: 116156|app: 0|req: 624/1248] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 03:11:56 2021] GET /compute/v2.1/servers/fa7c86bc-c46f-4120-8f3d-d795f8d7c5cc => generated 1570 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 03:11:56.871065 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi [None req-82b0e814-f5f5-41b3-a497-8dc8307cf89c tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Calling method '>' {{(pid=116157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:11:56.871603 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.compute.api [None req-82b0e814-f5f5-41b3-a497-8dc8307cf89c tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] [instance: bbb8462c-9501-4541-b67e-43ec5c5061a7] Fetching instance by UUID {{(pid=116157) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:11:56.877329 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-82b0e814-f5f5-41b3-a497-8dc8307cf89c tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:11:56.877774 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-82b0e814-f5f5-41b3-a497-8dc8307cf89c tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:11:56.878566 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-82b0e814-f5f5-41b3-a497-8dc8307cf89c tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:11:56.878995 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-82b0e814-f5f5-41b3-a497-8dc8307cf89c tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:11:56.936459 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.policy [None req-82b0e814-f5f5-41b3-a497-8dc8307cf89c tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97bdf19af9e34fc3886ff451cb9d7a27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '494b56bf5eae4d56a5591546f85bc32b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116157) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:11:56.944245 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: INFO nova.api.openstack.requestlog [None req-82b0e814-f5f5-41b3-a497-8dc8307cf89c tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] 10.222.0.18 "GET /compute/v2.1/servers/bbb8462c-9501-4541-b67e-43ec5c5061a7" status: 200 len: 1226 microversion: 2.1 time: 0.076173 Dec 15 03:11:56.944785 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: [pid: 116157|app: 0|req: 625/1249] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 03:11:56 2021] GET /compute/v2.1/servers/bbb8462c-9501-4541-b67e-43ec5c5061a7 => generated 1226 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 03:11:56.976569 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi [None req-193b0650-4f89-454a-8c08-f6020a06742f tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Calling method '>' {{(pid=116156) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:11:56.977471 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.compute.api [None req-193b0650-4f89-454a-8c08-f6020a06742f tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] [instance: b89094ac-aee1-4bd6-a33d-8c4347cebfc7] Fetching instance by UUID {{(pid=116156) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:11:56.983202 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-193b0650-4f89-454a-8c08-f6020a06742f tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:11:56.983657 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-193b0650-4f89-454a-8c08-f6020a06742f tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:11:56.984436 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-193b0650-4f89-454a-8c08-f6020a06742f tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:11:56.984874 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-193b0650-4f89-454a-8c08-f6020a06742f tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:11:57.013950 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: INFO nova.api.openstack.requestlog [None req-193b0650-4f89-454a-8c08-f6020a06742f tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] 10.222.0.18 "GET /compute/v2.1/servers/b89094ac-aee1-4bd6-a33d-8c4347cebfc7/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041113 Dec 15 03:11:57.014516 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: [pid: 116156|app: 0|req: 625/1250] 10.222.0.18 () {60 vars in 1342 bytes} [Wed Dec 15 03:11:56 2021] GET /compute/v2.1/servers/b89094ac-aee1-4bd6-a33d-8c4347cebfc7/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 03:11:57.720298 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi [None req-238fdcf9-b27e-45e5-af40-8a8bdc784e28 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Calling method '>' {{(pid=116157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:11:57.720907 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.compute.api [None req-238fdcf9-b27e-45e5-af40-8a8bdc784e28 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] [instance: fa7c86bc-c46f-4120-8f3d-d795f8d7c5cc] Fetching instance by UUID {{(pid=116157) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:11:57.727328 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-238fdcf9-b27e-45e5-af40-8a8bdc784e28 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:11:57.727774 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-238fdcf9-b27e-45e5-af40-8a8bdc784e28 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:11:57.728540 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-238fdcf9-b27e-45e5-af40-8a8bdc784e28 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:11:57.728968 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-238fdcf9-b27e-45e5-af40-8a8bdc784e28 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:11:57.858839 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.policy [None req-238fdcf9-b27e-45e5-af40-8a8bdc784e28 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c4c0c82448e40ba801c0b52ec44e74a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a093d0bf43046aaa845f3cc115f3f5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116157) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:11:57.866816 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: INFO nova.api.openstack.requestlog [None req-238fdcf9-b27e-45e5-af40-8a8bdc784e28 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] 10.222.0.18 "GET /compute/v2.1/servers/fa7c86bc-c46f-4120-8f3d-d795f8d7c5cc" status: 200 len: 1570 microversion: 2.1 time: 0.150156 Dec 15 03:11:57.867365 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: [pid: 116157|app: 0|req: 626/1251] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 03:11:57 2021] GET /compute/v2.1/servers/fa7c86bc-c46f-4120-8f3d-d795f8d7c5cc => generated 1570 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 03:11:57.960511 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi [None req-9720d651-98c9-461b-8d6b-71e266ea4cbe tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Calling method '>' {{(pid=116156) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:11:57.961121 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.compute.api [None req-9720d651-98c9-461b-8d6b-71e266ea4cbe tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] [instance: bbb8462c-9501-4541-b67e-43ec5c5061a7] Fetching instance by UUID {{(pid=116156) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:11:57.967346 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-9720d651-98c9-461b-8d6b-71e266ea4cbe tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:11:57.967797 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-9720d651-98c9-461b-8d6b-71e266ea4cbe tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:11:57.968569 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-9720d651-98c9-461b-8d6b-71e266ea4cbe tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:11:57.969003 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-9720d651-98c9-461b-8d6b-71e266ea4cbe tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:11:58.025065 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi [None req-9dd09533-8cac-462c-8577-8fe6d9903793 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Calling method '>' {{(pid=116157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:11:58.025996 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.compute.api [None req-9dd09533-8cac-462c-8577-8fe6d9903793 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] [instance: b89094ac-aee1-4bd6-a33d-8c4347cebfc7] Fetching instance by UUID {{(pid=116157) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:11:58.026659 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.policy [None req-9720d651-98c9-461b-8d6b-71e266ea4cbe tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97bdf19af9e34fc3886ff451cb9d7a27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '494b56bf5eae4d56a5591546f85bc32b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116156) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:11:58.032235 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-9dd09533-8cac-462c-8577-8fe6d9903793 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:11:58.032689 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-9dd09533-8cac-462c-8577-8fe6d9903793 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:11:58.033473 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-9dd09533-8cac-462c-8577-8fe6d9903793 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:11:58.033911 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-9dd09533-8cac-462c-8577-8fe6d9903793 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:11:58.034080 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: INFO nova.api.openstack.requestlog [None req-9720d651-98c9-461b-8d6b-71e266ea4cbe tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] 10.222.0.18 "GET /compute/v2.1/servers/bbb8462c-9501-4541-b67e-43ec5c5061a7" status: 200 len: 1226 microversion: 2.1 time: 0.077002 Dec 15 03:11:58.034510 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: [pid: 116156|app: 0|req: 626/1252] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 03:11:57 2021] GET /compute/v2.1/servers/bbb8462c-9501-4541-b67e-43ec5c5061a7 => generated 1226 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 03:11:58.064762 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: INFO nova.api.openstack.requestlog [None req-9dd09533-8cac-462c-8577-8fe6d9903793 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] 10.222.0.18 "GET /compute/v2.1/servers/b89094ac-aee1-4bd6-a33d-8c4347cebfc7/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043849 Dec 15 03:11:58.065305 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: [pid: 116157|app: 0|req: 627/1253] 10.222.0.18 () {60 vars in 1342 bytes} [Wed Dec 15 03:11:58 2021] GET /compute/v2.1/servers/b89094ac-aee1-4bd6-a33d-8c4347cebfc7/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Dec 15 03:11:58.883876 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi [None req-140a5871-feb0-4900-9cb2-06e52d29f539 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Calling method '>' {{(pid=116156) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:11:58.884480 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.compute.api [None req-140a5871-feb0-4900-9cb2-06e52d29f539 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] [instance: fa7c86bc-c46f-4120-8f3d-d795f8d7c5cc] Fetching instance by UUID {{(pid=116156) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:11:58.890245 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-140a5871-feb0-4900-9cb2-06e52d29f539 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:11:58.890697 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-140a5871-feb0-4900-9cb2-06e52d29f539 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:11:58.891477 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-140a5871-feb0-4900-9cb2-06e52d29f539 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:11:58.891918 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-140a5871-feb0-4900-9cb2-06e52d29f539 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:11:59.022150 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.policy [None req-140a5871-feb0-4900-9cb2-06e52d29f539 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c4c0c82448e40ba801c0b52ec44e74a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a093d0bf43046aaa845f3cc115f3f5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116156) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:11:59.029340 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: INFO nova.api.openstack.requestlog [None req-140a5871-feb0-4900-9cb2-06e52d29f539 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] 10.222.0.18 "GET /compute/v2.1/servers/fa7c86bc-c46f-4120-8f3d-d795f8d7c5cc" status: 200 len: 1570 microversion: 2.1 time: 0.149253 Dec 15 03:11:59.029899 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: [pid: 116156|app: 0|req: 627/1254] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 03:11:58 2021] GET /compute/v2.1/servers/fa7c86bc-c46f-4120-8f3d-d795f8d7c5cc => generated 1570 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 03:11:59.050593 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi [None req-7acffb66-482e-416c-b723-764717100f3e tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Calling method '>' {{(pid=116157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:11:59.051197 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.compute.api [None req-7acffb66-482e-416c-b723-764717100f3e tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] [instance: bbb8462c-9501-4541-b67e-43ec5c5061a7] Fetching instance by UUID {{(pid=116157) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:11:59.057363 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-7acffb66-482e-416c-b723-764717100f3e tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:11:59.057815 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-7acffb66-482e-416c-b723-764717100f3e tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:11:59.058627 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-7acffb66-482e-416c-b723-764717100f3e tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:11:59.059060 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-7acffb66-482e-416c-b723-764717100f3e tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:11:59.075943 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi [None req-2ba12098-72da-4e77-a3a5-03e897a90180 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Calling method '>' {{(pid=116156) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:11:59.076864 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.compute.api [None req-2ba12098-72da-4e77-a3a5-03e897a90180 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] [instance: b89094ac-aee1-4bd6-a33d-8c4347cebfc7] Fetching instance by UUID {{(pid=116156) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:11:59.082525 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-2ba12098-72da-4e77-a3a5-03e897a90180 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:11:59.082970 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-2ba12098-72da-4e77-a3a5-03e897a90180 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:11:59.083738 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-2ba12098-72da-4e77-a3a5-03e897a90180 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:11:59.084794 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-2ba12098-72da-4e77-a3a5-03e897a90180 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:11:59.113839 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: INFO nova.api.openstack.requestlog [None req-2ba12098-72da-4e77-a3a5-03e897a90180 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] 10.222.0.18 "GET /compute/v2.1/servers/b89094ac-aee1-4bd6-a33d-8c4347cebfc7/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041545 Dec 15 03:11:59.114609 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: [pid: 116156|app: 0|req: 628/1255] 10.222.0.18 () {60 vars in 1342 bytes} [Wed Dec 15 03:11:59 2021] GET /compute/v2.1/servers/b89094ac-aee1-4bd6-a33d-8c4347cebfc7/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Dec 15 03:11:59.117035 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.policy [None req-7acffb66-482e-416c-b723-764717100f3e tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97bdf19af9e34fc3886ff451cb9d7a27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '494b56bf5eae4d56a5591546f85bc32b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116157) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:11:59.124196 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: INFO nova.api.openstack.requestlog [None req-7acffb66-482e-416c-b723-764717100f3e tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] 10.222.0.18 "GET /compute/v2.1/servers/bbb8462c-9501-4541-b67e-43ec5c5061a7" status: 200 len: 1226 microversion: 2.1 time: 0.077201 Dec 15 03:11:59.124735 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: [pid: 116157|app: 0|req: 628/1256] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 03:11:59 2021] GET /compute/v2.1/servers/bbb8462c-9501-4541-b67e-43ec5c5061a7 => generated 1226 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 03:12:00.046448 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi [None req-57c400b5-38c1-4539-8ffa-56c29595a519 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Calling method '>' {{(pid=116156) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:12:00.047073 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.compute.api [None req-57c400b5-38c1-4539-8ffa-56c29595a519 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] [instance: fa7c86bc-c46f-4120-8f3d-d795f8d7c5cc] Fetching instance by UUID {{(pid=116156) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:12:00.053802 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-57c400b5-38c1-4539-8ffa-56c29595a519 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:12:00.054271 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-57c400b5-38c1-4539-8ffa-56c29595a519 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:12:00.055042 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-57c400b5-38c1-4539-8ffa-56c29595a519 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:12:00.055472 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-57c400b5-38c1-4539-8ffa-56c29595a519 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:12:00.124610 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi [None req-6d01bca5-be64-4746-b89d-5f9162b24f23 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Calling method '>' {{(pid=116157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:12:00.125418 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.compute.api [None req-6d01bca5-be64-4746-b89d-5f9162b24f23 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] [instance: b89094ac-aee1-4bd6-a33d-8c4347cebfc7] Fetching instance by UUID {{(pid=116157) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:12:00.131333 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-6d01bca5-be64-4746-b89d-5f9162b24f23 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:12:00.131792 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-6d01bca5-be64-4746-b89d-5f9162b24f23 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:12:00.132564 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-6d01bca5-be64-4746-b89d-5f9162b24f23 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:12:00.132995 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-6d01bca5-be64-4746-b89d-5f9162b24f23 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:12:00.161848 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: INFO nova.api.openstack.requestlog [None req-6d01bca5-be64-4746-b89d-5f9162b24f23 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] 10.222.0.18 "GET /compute/v2.1/servers/b89094ac-aee1-4bd6-a33d-8c4347cebfc7/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041004 Dec 15 03:12:00.162934 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: [pid: 116157|app: 0|req: 629/1257] 10.222.0.18 () {60 vars in 1342 bytes} [Wed Dec 15 03:12:00 2021] GET /compute/v2.1/servers/b89094ac-aee1-4bd6-a33d-8c4347cebfc7/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Dec 15 03:12:00.167072 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi [None req-44c306bc-d76a-4cd7-9272-2b401603c441 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Calling method '>' {{(pid=116157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:12:00.167682 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.compute.api [None req-44c306bc-d76a-4cd7-9272-2b401603c441 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] [instance: bbb8462c-9501-4541-b67e-43ec5c5061a7] Fetching instance by UUID {{(pid=116157) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:12:00.173056 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-44c306bc-d76a-4cd7-9272-2b401603c441 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:12:00.173511 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-44c306bc-d76a-4cd7-9272-2b401603c441 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:12:00.174319 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-44c306bc-d76a-4cd7-9272-2b401603c441 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:12:00.174758 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-44c306bc-d76a-4cd7-9272-2b401603c441 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:12:00.184415 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.policy [None req-57c400b5-38c1-4539-8ffa-56c29595a519 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c4c0c82448e40ba801c0b52ec44e74a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a093d0bf43046aaa845f3cc115f3f5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116156) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:12:00.191681 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: INFO nova.api.openstack.requestlog [None req-57c400b5-38c1-4539-8ffa-56c29595a519 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] 10.222.0.18 "GET /compute/v2.1/servers/fa7c86bc-c46f-4120-8f3d-d795f8d7c5cc" status: 200 len: 1570 microversion: 2.1 time: 0.149001 Dec 15 03:12:00.192232 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: [pid: 116156|app: 0|req: 629/1258] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 03:12:00 2021] GET /compute/v2.1/servers/fa7c86bc-c46f-4120-8f3d-d795f8d7c5cc => generated 1570 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 03:12:00.235482 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.policy [None req-44c306bc-d76a-4cd7-9272-2b401603c441 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97bdf19af9e34fc3886ff451cb9d7a27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '494b56bf5eae4d56a5591546f85bc32b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116157) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:12:00.243638 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: INFO nova.api.openstack.requestlog [None req-44c306bc-d76a-4cd7-9272-2b401603c441 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] 10.222.0.18 "GET /compute/v2.1/servers/bbb8462c-9501-4541-b67e-43ec5c5061a7" status: 200 len: 1226 microversion: 2.1 time: 0.079774 Dec 15 03:12:00.244204 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: [pid: 116157|app: 0|req: 630/1259] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 03:12:00 2021] GET /compute/v2.1/servers/bbb8462c-9501-4541-b67e-43ec5c5061a7 => generated 1226 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 03:12:01.173714 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi [None req-75961679-0ec5-45c0-9cfa-3c12e75bc177 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Calling method '>' {{(pid=116156) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:12:01.174644 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.compute.api [None req-75961679-0ec5-45c0-9cfa-3c12e75bc177 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] [instance: b89094ac-aee1-4bd6-a33d-8c4347cebfc7] Fetching instance by UUID {{(pid=116156) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:12:01.180843 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-75961679-0ec5-45c0-9cfa-3c12e75bc177 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:12:01.181289 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-75961679-0ec5-45c0-9cfa-3c12e75bc177 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:12:01.182085 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-75961679-0ec5-45c0-9cfa-3c12e75bc177 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:12:01.182518 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-75961679-0ec5-45c0-9cfa-3c12e75bc177 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:12:01.208612 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi [None req-96b5b46e-048f-483e-a7e6-c0d82d778f97 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Calling method '>' {{(pid=116157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:12:01.210034 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.compute.api [None req-96b5b46e-048f-483e-a7e6-c0d82d778f97 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] [instance: fa7c86bc-c46f-4120-8f3d-d795f8d7c5cc] Fetching instance by UUID {{(pid=116157) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:12:01.211151 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: INFO nova.api.openstack.requestlog [None req-75961679-0ec5-45c0-9cfa-3c12e75bc177 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] 10.222.0.18 "GET /compute/v2.1/servers/b89094ac-aee1-4bd6-a33d-8c4347cebfc7/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041154 Dec 15 03:12:01.211713 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: [pid: 116156|app: 0|req: 630/1260] 10.222.0.18 () {60 vars in 1342 bytes} [Wed Dec 15 03:12:01 2021] GET /compute/v2.1/servers/b89094ac-aee1-4bd6-a33d-8c4347cebfc7/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 03:12:01.216479 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-96b5b46e-048f-483e-a7e6-c0d82d778f97 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:12:01.216933 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-96b5b46e-048f-483e-a7e6-c0d82d778f97 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:12:01.217718 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-96b5b46e-048f-483e-a7e6-c0d82d778f97 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:12:01.218169 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-96b5b46e-048f-483e-a7e6-c0d82d778f97 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:12:01.260099 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi [None req-4cc3c1ee-0ff3-460f-94e3-061cf51d3090 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Calling method '>' {{(pid=116156) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:12:01.260712 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.compute.api [None req-4cc3c1ee-0ff3-460f-94e3-061cf51d3090 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] [instance: bbb8462c-9501-4541-b67e-43ec5c5061a7] Fetching instance by UUID {{(pid=116156) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:12:01.266369 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-4cc3c1ee-0ff3-460f-94e3-061cf51d3090 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:12:01.266818 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-4cc3c1ee-0ff3-460f-94e3-061cf51d3090 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:12:01.267600 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-4cc3c1ee-0ff3-460f-94e3-061cf51d3090 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:12:01.268039 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-4cc3c1ee-0ff3-460f-94e3-061cf51d3090 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:12:01.326689 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.policy [None req-4cc3c1ee-0ff3-460f-94e3-061cf51d3090 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97bdf19af9e34fc3886ff451cb9d7a27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '494b56bf5eae4d56a5591546f85bc32b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116156) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:12:01.334162 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: INFO nova.api.openstack.requestlog [None req-4cc3c1ee-0ff3-460f-94e3-061cf51d3090 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] 10.222.0.18 "GET /compute/v2.1/servers/bbb8462c-9501-4541-b67e-43ec5c5061a7" status: 200 len: 1226 microversion: 2.1 time: 0.077499 Dec 15 03:12:01.334736 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: [pid: 116156|app: 0|req: 631/1261] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 03:12:01 2021] GET /compute/v2.1/servers/bbb8462c-9501-4541-b67e-43ec5c5061a7 => generated 1226 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 03:12:01.348358 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.policy [None req-96b5b46e-048f-483e-a7e6-c0d82d778f97 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c4c0c82448e40ba801c0b52ec44e74a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a093d0bf43046aaa845f3cc115f3f5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116157) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:12:01.355516 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: INFO nova.api.openstack.requestlog [None req-96b5b46e-048f-483e-a7e6-c0d82d778f97 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] 10.222.0.18 "GET /compute/v2.1/servers/fa7c86bc-c46f-4120-8f3d-d795f8d7c5cc" status: 200 len: 1570 microversion: 2.1 time: 0.150706 Dec 15 03:12:01.356060 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: [pid: 116157|app: 0|req: 631/1262] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 03:12:01 2021] GET /compute/v2.1/servers/fa7c86bc-c46f-4120-8f3d-d795f8d7c5cc => generated 1570 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 03:12:02.223009 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi [None req-9bbcc697-217c-4c44-aea5-8241560af011 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Calling method '>' {{(pid=116156) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:12:02.223912 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.compute.api [None req-9bbcc697-217c-4c44-aea5-8241560af011 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] [instance: b89094ac-aee1-4bd6-a33d-8c4347cebfc7] Fetching instance by UUID {{(pid=116156) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:12:02.230236 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-9bbcc697-217c-4c44-aea5-8241560af011 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:12:02.230683 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-9bbcc697-217c-4c44-aea5-8241560af011 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:12:02.231455 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-9bbcc697-217c-4c44-aea5-8241560af011 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:12:02.231890 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-9bbcc697-217c-4c44-aea5-8241560af011 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:12:02.260704 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: INFO nova.api.openstack.requestlog [None req-9bbcc697-217c-4c44-aea5-8241560af011 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] 10.222.0.18 "GET /compute/v2.1/servers/b89094ac-aee1-4bd6-a33d-8c4347cebfc7/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041481 Dec 15 03:12:02.261238 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: [pid: 116156|app: 0|req: 632/1263] 10.222.0.18 () {60 vars in 1342 bytes} [Wed Dec 15 03:12:02 2021] GET /compute/v2.1/servers/b89094ac-aee1-4bd6-a33d-8c4347cebfc7/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Dec 15 03:12:02.351191 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi [None req-7e9a8932-10ff-44d7-bca6-84b78778d8e5 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Calling method '>' {{(pid=116157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:12:02.351792 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.compute.api [None req-7e9a8932-10ff-44d7-bca6-84b78778d8e5 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] [instance: bbb8462c-9501-4541-b67e-43ec5c5061a7] Fetching instance by UUID {{(pid=116157) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:12:02.357909 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-7e9a8932-10ff-44d7-bca6-84b78778d8e5 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:12:02.358386 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-7e9a8932-10ff-44d7-bca6-84b78778d8e5 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:12:02.359161 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-7e9a8932-10ff-44d7-bca6-84b78778d8e5 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:12:02.359590 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-7e9a8932-10ff-44d7-bca6-84b78778d8e5 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:12:02.373243 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi [None req-54b7c9bc-063c-4078-a2fd-312952bb524e tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Calling method '>' {{(pid=116156) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:12:02.373854 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.compute.api [None req-54b7c9bc-063c-4078-a2fd-312952bb524e tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] [instance: fa7c86bc-c46f-4120-8f3d-d795f8d7c5cc] Fetching instance by UUID {{(pid=116156) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:12:02.379691 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-54b7c9bc-063c-4078-a2fd-312952bb524e tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:12:02.380169 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-54b7c9bc-063c-4078-a2fd-312952bb524e tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:12:02.380979 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-54b7c9bc-063c-4078-a2fd-312952bb524e tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:12:02.381415 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-54b7c9bc-063c-4078-a2fd-312952bb524e tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:12:02.417403 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.policy [None req-7e9a8932-10ff-44d7-bca6-84b78778d8e5 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97bdf19af9e34fc3886ff451cb9d7a27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '494b56bf5eae4d56a5591546f85bc32b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116157) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:12:02.424852 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: INFO nova.api.openstack.requestlog [None req-7e9a8932-10ff-44d7-bca6-84b78778d8e5 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] 10.222.0.18 "GET /compute/v2.1/servers/bbb8462c-9501-4541-b67e-43ec5c5061a7" status: 200 len: 1226 microversion: 2.1 time: 0.077829 Dec 15 03:12:02.425423 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: [pid: 116157|app: 0|req: 632/1264] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 03:12:02 2021] GET /compute/v2.1/servers/bbb8462c-9501-4541-b67e-43ec5c5061a7 => generated 1226 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 03:12:02.513392 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.policy [None req-54b7c9bc-063c-4078-a2fd-312952bb524e tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c4c0c82448e40ba801c0b52ec44e74a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a093d0bf43046aaa845f3cc115f3f5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116156) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:12:02.520603 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: INFO nova.api.openstack.requestlog [None req-54b7c9bc-063c-4078-a2fd-312952bb524e tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] 10.222.0.18 "GET /compute/v2.1/servers/fa7c86bc-c46f-4120-8f3d-d795f8d7c5cc" status: 200 len: 1570 microversion: 2.1 time: 0.150944 Dec 15 03:12:02.521166 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: [pid: 116156|app: 0|req: 633/1265] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 03:12:02 2021] GET /compute/v2.1/servers/fa7c86bc-c46f-4120-8f3d-d795f8d7c5cc => generated 1570 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 03:12:03.272109 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi [None req-20efe1e1-8dfb-4b63-b767-e31c53f579ba tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Calling method '>' {{(pid=116157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:12:03.273018 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.compute.api [None req-20efe1e1-8dfb-4b63-b767-e31c53f579ba tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] [instance: b89094ac-aee1-4bd6-a33d-8c4347cebfc7] Fetching instance by UUID {{(pid=116157) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:12:03.278872 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-20efe1e1-8dfb-4b63-b767-e31c53f579ba tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:12:03.279329 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-20efe1e1-8dfb-4b63-b767-e31c53f579ba tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:12:03.280106 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-20efe1e1-8dfb-4b63-b767-e31c53f579ba tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:12:03.280540 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-20efe1e1-8dfb-4b63-b767-e31c53f579ba tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:12:03.310289 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: INFO nova.api.openstack.requestlog [None req-20efe1e1-8dfb-4b63-b767-e31c53f579ba tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] 10.222.0.18 "GET /compute/v2.1/servers/b89094ac-aee1-4bd6-a33d-8c4347cebfc7/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041973 Dec 15 03:12:03.310826 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: [pid: 116157|app: 0|req: 633/1266] 10.222.0.18 () {60 vars in 1342 bytes} [Wed Dec 15 03:12:03 2021] GET /compute/v2.1/servers/b89094ac-aee1-4bd6-a33d-8c4347cebfc7/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 03:12:03.442103 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi [None req-42e5e4d3-eac9-43b9-ae9e-6e00a9eb672e tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Calling method '>' {{(pid=116156) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:12:03.442717 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.compute.api [None req-42e5e4d3-eac9-43b9-ae9e-6e00a9eb672e tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] [instance: bbb8462c-9501-4541-b67e-43ec5c5061a7] Fetching instance by UUID {{(pid=116156) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:12:03.449603 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-42e5e4d3-eac9-43b9-ae9e-6e00a9eb672e tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:12:03.450078 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-42e5e4d3-eac9-43b9-ae9e-6e00a9eb672e tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:12:03.450854 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-42e5e4d3-eac9-43b9-ae9e-6e00a9eb672e tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:12:03.451285 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-42e5e4d3-eac9-43b9-ae9e-6e00a9eb672e tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:12:03.509805 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.policy [None req-42e5e4d3-eac9-43b9-ae9e-6e00a9eb672e tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97bdf19af9e34fc3886ff451cb9d7a27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '494b56bf5eae4d56a5591546f85bc32b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116156) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:12:03.517008 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: INFO nova.api.openstack.requestlog [None req-42e5e4d3-eac9-43b9-ae9e-6e00a9eb672e tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] 10.222.0.18 "GET /compute/v2.1/servers/bbb8462c-9501-4541-b67e-43ec5c5061a7" status: 200 len: 1226 microversion: 2.1 time: 0.078530 Dec 15 03:12:03.517565 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: [pid: 116156|app: 0|req: 634/1267] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 03:12:03 2021] GET /compute/v2.1/servers/bbb8462c-9501-4541-b67e-43ec5c5061a7 => generated 1226 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 03:12:03.537112 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi [None req-4e3abdc0-4481-4460-9e8d-1702b398b14e tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Calling method '>' {{(pid=116157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:12:03.537724 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.compute.api [None req-4e3abdc0-4481-4460-9e8d-1702b398b14e tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] [instance: fa7c86bc-c46f-4120-8f3d-d795f8d7c5cc] Fetching instance by UUID {{(pid=116157) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:12:03.543902 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-4e3abdc0-4481-4460-9e8d-1702b398b14e tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:12:03.544348 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-4e3abdc0-4481-4460-9e8d-1702b398b14e tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:12:03.545120 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-4e3abdc0-4481-4460-9e8d-1702b398b14e tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:12:03.545557 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-4e3abdc0-4481-4460-9e8d-1702b398b14e tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:12:03.675307 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.policy [None req-4e3abdc0-4481-4460-9e8d-1702b398b14e tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c4c0c82448e40ba801c0b52ec44e74a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a093d0bf43046aaa845f3cc115f3f5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116157) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:12:03.682963 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: INFO nova.api.openstack.requestlog [None req-4e3abdc0-4481-4460-9e8d-1702b398b14e tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] 10.222.0.18 "GET /compute/v2.1/servers/fa7c86bc-c46f-4120-8f3d-d795f8d7c5cc" status: 200 len: 1570 microversion: 2.1 time: 0.149401 Dec 15 03:12:03.683523 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: [pid: 116157|app: 0|req: 634/1268] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 03:12:03 2021] GET /compute/v2.1/servers/fa7c86bc-c46f-4120-8f3d-d795f8d7c5cc => generated 1570 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 03:12:04.323271 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi [None req-24fd373b-5e13-4401-aa91-679cd8d75247 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Calling method '>' {{(pid=116156) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:12:04.324196 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.compute.api [None req-24fd373b-5e13-4401-aa91-679cd8d75247 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] [instance: b89094ac-aee1-4bd6-a33d-8c4347cebfc7] Fetching instance by UUID {{(pid=116156) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:12:04.330085 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-24fd373b-5e13-4401-aa91-679cd8d75247 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:12:04.330542 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-24fd373b-5e13-4401-aa91-679cd8d75247 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:12:04.331316 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-24fd373b-5e13-4401-aa91-679cd8d75247 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:12:04.331751 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-24fd373b-5e13-4401-aa91-679cd8d75247 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:12:04.359187 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: INFO nova.api.openstack.requestlog [None req-24fd373b-5e13-4401-aa91-679cd8d75247 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] 10.222.0.18 "GET /compute/v2.1/servers/b89094ac-aee1-4bd6-a33d-8c4347cebfc7/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041333 Dec 15 03:12:04.359719 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: [pid: 116156|app: 0|req: 635/1269] 10.222.0.18 () {60 vars in 1342 bytes} [Wed Dec 15 03:12:04 2021] GET /compute/v2.1/servers/b89094ac-aee1-4bd6-a33d-8c4347cebfc7/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 03:12:04.533451 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi [None req-943249a8-70cc-4f89-8285-06a809967797 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Calling method '>' {{(pid=116157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:12:04.534002 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.compute.api [None req-943249a8-70cc-4f89-8285-06a809967797 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] [instance: bbb8462c-9501-4541-b67e-43ec5c5061a7] Fetching instance by UUID {{(pid=116157) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:12:04.540292 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-943249a8-70cc-4f89-8285-06a809967797 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:12:04.540858 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-943249a8-70cc-4f89-8285-06a809967797 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:12:04.541499 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-943249a8-70cc-4f89-8285-06a809967797 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:12:04.541937 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-943249a8-70cc-4f89-8285-06a809967797 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:12:04.598811 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.policy [None req-943249a8-70cc-4f89-8285-06a809967797 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97bdf19af9e34fc3886ff451cb9d7a27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '494b56bf5eae4d56a5591546f85bc32b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116157) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:12:04.606342 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: INFO nova.api.openstack.requestlog [None req-943249a8-70cc-4f89-8285-06a809967797 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] 10.222.0.18 "GET /compute/v2.1/servers/bbb8462c-9501-4541-b67e-43ec5c5061a7" status: 200 len: 1226 microversion: 2.1 time: 0.076491 Dec 15 03:12:04.606896 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: [pid: 116157|app: 0|req: 635/1270] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 03:12:04 2021] GET /compute/v2.1/servers/bbb8462c-9501-4541-b67e-43ec5c5061a7 => generated 1226 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 03:12:04.699908 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi [None req-9e471ce9-1bc7-4c48-beb6-0aabc9eb31ca tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Calling method '>' {{(pid=116156) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:12:04.700514 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.compute.api [None req-9e471ce9-1bc7-4c48-beb6-0aabc9eb31ca tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] [instance: fa7c86bc-c46f-4120-8f3d-d795f8d7c5cc] Fetching instance by UUID {{(pid=116156) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:12:04.706707 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-9e471ce9-1bc7-4c48-beb6-0aabc9eb31ca tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:12:04.707165 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-9e471ce9-1bc7-4c48-beb6-0aabc9eb31ca tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:12:04.707931 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-9e471ce9-1bc7-4c48-beb6-0aabc9eb31ca tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:12:04.708361 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-9e471ce9-1bc7-4c48-beb6-0aabc9eb31ca tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:12:04.836591 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.policy [None req-9e471ce9-1bc7-4c48-beb6-0aabc9eb31ca tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c4c0c82448e40ba801c0b52ec44e74a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a093d0bf43046aaa845f3cc115f3f5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116156) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:12:04.843963 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: INFO nova.api.openstack.requestlog [None req-9e471ce9-1bc7-4c48-beb6-0aabc9eb31ca tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] 10.222.0.18 "GET /compute/v2.1/servers/fa7c86bc-c46f-4120-8f3d-d795f8d7c5cc" status: 200 len: 1570 microversion: 2.1 time: 0.147646 Dec 15 03:12:04.844529 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: [pid: 116156|app: 0|req: 636/1271] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 03:12:04 2021] GET /compute/v2.1/servers/fa7c86bc-c46f-4120-8f3d-d795f8d7c5cc => generated 1570 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 03:12:05.371560 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi [None req-220203c5-1998-40b9-b418-221ddc469cd8 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Calling method '>' {{(pid=116157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:12:05.372472 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.compute.api [None req-220203c5-1998-40b9-b418-221ddc469cd8 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] [instance: b89094ac-aee1-4bd6-a33d-8c4347cebfc7] Fetching instance by UUID {{(pid=116157) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:12:05.378376 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-220203c5-1998-40b9-b418-221ddc469cd8 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:12:05.378833 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-220203c5-1998-40b9-b418-221ddc469cd8 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:12:05.379618 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-220203c5-1998-40b9-b418-221ddc469cd8 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:12:05.380061 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-220203c5-1998-40b9-b418-221ddc469cd8 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:12:05.407802 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: INFO nova.api.openstack.requestlog [None req-220203c5-1998-40b9-b418-221ddc469cd8 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] 10.222.0.18 "GET /compute/v2.1/servers/b89094ac-aee1-4bd6-a33d-8c4347cebfc7/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.040099 Dec 15 03:12:05.408329 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: [pid: 116157|app: 0|req: 636/1272] 10.222.0.18 () {60 vars in 1342 bytes} [Wed Dec 15 03:12:05 2021] GET /compute/v2.1/servers/b89094ac-aee1-4bd6-a33d-8c4347cebfc7/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 03:12:05.623715 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi [None req-0ef0b631-45f7-4478-9e0e-66d514b83de8 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Calling method '>' {{(pid=116156) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:12:05.624324 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.compute.api [None req-0ef0b631-45f7-4478-9e0e-66d514b83de8 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] [instance: bbb8462c-9501-4541-b67e-43ec5c5061a7] Fetching instance by UUID {{(pid=116156) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:12:05.630138 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-0ef0b631-45f7-4478-9e0e-66d514b83de8 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:12:05.630590 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-0ef0b631-45f7-4478-9e0e-66d514b83de8 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:12:05.631365 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-0ef0b631-45f7-4478-9e0e-66d514b83de8 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:12:05.631802 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-0ef0b631-45f7-4478-9e0e-66d514b83de8 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:12:05.692479 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.policy [None req-0ef0b631-45f7-4478-9e0e-66d514b83de8 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97bdf19af9e34fc3886ff451cb9d7a27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '494b56bf5eae4d56a5591546f85bc32b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116156) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:12:05.699708 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: INFO nova.api.openstack.requestlog [None req-0ef0b631-45f7-4478-9e0e-66d514b83de8 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] 10.222.0.18 "GET /compute/v2.1/servers/bbb8462c-9501-4541-b67e-43ec5c5061a7" status: 200 len: 1226 microversion: 2.1 time: 0.079604 Dec 15 03:12:05.700262 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: [pid: 116156|app: 0|req: 637/1273] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 03:12:05 2021] GET /compute/v2.1/servers/bbb8462c-9501-4541-b67e-43ec5c5061a7 => generated 1226 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 03:12:05.860213 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi [None req-db6eed53-ad2d-479f-8e6c-1fca5a6dbc53 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Calling method '>' {{(pid=116157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:12:05.860844 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.compute.api [None req-db6eed53-ad2d-479f-8e6c-1fca5a6dbc53 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] [instance: fa7c86bc-c46f-4120-8f3d-d795f8d7c5cc] Fetching instance by UUID {{(pid=116157) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:12:05.867283 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-db6eed53-ad2d-479f-8e6c-1fca5a6dbc53 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:12:05.867733 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-db6eed53-ad2d-479f-8e6c-1fca5a6dbc53 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:12:05.868509 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-db6eed53-ad2d-479f-8e6c-1fca5a6dbc53 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:12:05.868946 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-db6eed53-ad2d-479f-8e6c-1fca5a6dbc53 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:12:05.995281 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.policy [None req-db6eed53-ad2d-479f-8e6c-1fca5a6dbc53 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c4c0c82448e40ba801c0b52ec44e74a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a093d0bf43046aaa845f3cc115f3f5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116157) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:12:06.002453 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: INFO nova.api.openstack.requestlog [None req-db6eed53-ad2d-479f-8e6c-1fca5a6dbc53 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] 10.222.0.18 "GET /compute/v2.1/servers/fa7c86bc-c46f-4120-8f3d-d795f8d7c5cc" status: 200 len: 1570 microversion: 2.1 time: 0.145851 Dec 15 03:12:06.003012 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: [pid: 116157|app: 0|req: 637/1274] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 03:12:05 2021] GET /compute/v2.1/servers/fa7c86bc-c46f-4120-8f3d-d795f8d7c5cc => generated 1570 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 03:12:06.419292 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi [None req-0f3cbb93-9ece-4b64-8159-b1ccac3dcd39 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Calling method '>' {{(pid=116156) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:12:06.420196 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.compute.api [None req-0f3cbb93-9ece-4b64-8159-b1ccac3dcd39 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] [instance: b89094ac-aee1-4bd6-a33d-8c4347cebfc7] Fetching instance by UUID {{(pid=116156) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:12:06.426507 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-0f3cbb93-9ece-4b64-8159-b1ccac3dcd39 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:12:06.426959 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-0f3cbb93-9ece-4b64-8159-b1ccac3dcd39 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:12:06.427733 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-0f3cbb93-9ece-4b64-8159-b1ccac3dcd39 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:12:06.428170 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-0f3cbb93-9ece-4b64-8159-b1ccac3dcd39 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:12:06.455781 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: INFO nova.api.openstack.requestlog [None req-0f3cbb93-9ece-4b64-8159-b1ccac3dcd39 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] 10.222.0.18 "GET /compute/v2.1/servers/b89094ac-aee1-4bd6-a33d-8c4347cebfc7/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.040311 Dec 15 03:12:06.456327 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: [pid: 116156|app: 0|req: 638/1275] 10.222.0.18 () {60 vars in 1342 bytes} [Wed Dec 15 03:12:06 2021] GET /compute/v2.1/servers/b89094ac-aee1-4bd6-a33d-8c4347cebfc7/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 03:12:06.716531 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi [None req-25e23be4-245c-4e08-ab98-5adc34a05f4f tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Calling method '>' {{(pid=116157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:12:06.717144 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.compute.api [None req-25e23be4-245c-4e08-ab98-5adc34a05f4f tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] [instance: bbb8462c-9501-4541-b67e-43ec5c5061a7] Fetching instance by UUID {{(pid=116157) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:12:06.723042 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-25e23be4-245c-4e08-ab98-5adc34a05f4f tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:12:06.723501 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-25e23be4-245c-4e08-ab98-5adc34a05f4f tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:12:06.724278 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-25e23be4-245c-4e08-ab98-5adc34a05f4f tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:12:06.724712 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-25e23be4-245c-4e08-ab98-5adc34a05f4f tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:12:06.785563 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.policy [None req-25e23be4-245c-4e08-ab98-5adc34a05f4f tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97bdf19af9e34fc3886ff451cb9d7a27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '494b56bf5eae4d56a5591546f85bc32b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116157) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:12:06.793286 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: INFO nova.api.openstack.requestlog [None req-25e23be4-245c-4e08-ab98-5adc34a05f4f tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] 10.222.0.18 "GET /compute/v2.1/servers/bbb8462c-9501-4541-b67e-43ec5c5061a7" status: 200 len: 1226 microversion: 2.1 time: 0.080376 Dec 15 03:12:06.793836 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: [pid: 116157|app: 0|req: 638/1276] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 03:12:06 2021] GET /compute/v2.1/servers/bbb8462c-9501-4541-b67e-43ec5c5061a7 => generated 1226 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 03:12:07.019599 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi [None req-5abb9652-f8e8-4729-bdca-c104aed833f4 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Calling method '>' {{(pid=116156) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:12:07.020147 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.compute.api [None req-5abb9652-f8e8-4729-bdca-c104aed833f4 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] [instance: fa7c86bc-c46f-4120-8f3d-d795f8d7c5cc] Fetching instance by UUID {{(pid=116156) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:12:07.026609 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-5abb9652-f8e8-4729-bdca-c104aed833f4 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:12:07.027061 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-5abb9652-f8e8-4729-bdca-c104aed833f4 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:12:07.027843 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-5abb9652-f8e8-4729-bdca-c104aed833f4 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:12:07.028281 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-5abb9652-f8e8-4729-bdca-c104aed833f4 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:12:07.155528 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.policy [None req-5abb9652-f8e8-4729-bdca-c104aed833f4 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c4c0c82448e40ba801c0b52ec44e74a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a093d0bf43046aaa845f3cc115f3f5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116156) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:12:07.163340 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: INFO nova.api.openstack.requestlog [None req-5abb9652-f8e8-4729-bdca-c104aed833f4 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] 10.222.0.18 "GET /compute/v2.1/servers/fa7c86bc-c46f-4120-8f3d-d795f8d7c5cc" status: 200 len: 1570 microversion: 2.1 time: 0.147358 Dec 15 03:12:07.163894 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: [pid: 116156|app: 0|req: 639/1277] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 03:12:07 2021] GET /compute/v2.1/servers/fa7c86bc-c46f-4120-8f3d-d795f8d7c5cc => generated 1570 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 03:12:07.467704 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi [None req-04801464-1946-484a-a1e8-32f3e89706c8 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Calling method '>' {{(pid=116157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:12:07.468608 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.compute.api [None req-04801464-1946-484a-a1e8-32f3e89706c8 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] [instance: b89094ac-aee1-4bd6-a33d-8c4347cebfc7] Fetching instance by UUID {{(pid=116157) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:12:07.474824 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-04801464-1946-484a-a1e8-32f3e89706c8 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:12:07.475271 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-04801464-1946-484a-a1e8-32f3e89706c8 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:12:07.476047 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-04801464-1946-484a-a1e8-32f3e89706c8 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:12:07.476484 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-04801464-1946-484a-a1e8-32f3e89706c8 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:12:07.504744 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: INFO nova.api.openstack.requestlog [None req-04801464-1946-484a-a1e8-32f3e89706c8 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] 10.222.0.18 "GET /compute/v2.1/servers/b89094ac-aee1-4bd6-a33d-8c4347cebfc7/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.040840 Dec 15 03:12:07.505274 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: [pid: 116157|app: 0|req: 639/1278] 10.222.0.18 () {60 vars in 1342 bytes} [Wed Dec 15 03:12:07 2021] GET /compute/v2.1/servers/b89094ac-aee1-4bd6-a33d-8c4347cebfc7/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 03:12:07.809686 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi [None req-df7abd1b-da9d-4476-8ad5-9475bb5f239a tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Calling method '>' {{(pid=116156) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:12:07.810332 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.compute.api [None req-df7abd1b-da9d-4476-8ad5-9475bb5f239a tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] [instance: bbb8462c-9501-4541-b67e-43ec5c5061a7] Fetching instance by UUID {{(pid=116156) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:12:07.816589 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-df7abd1b-da9d-4476-8ad5-9475bb5f239a tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:12:07.817036 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-df7abd1b-da9d-4476-8ad5-9475bb5f239a tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:12:07.817806 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-df7abd1b-da9d-4476-8ad5-9475bb5f239a tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:12:07.818762 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-df7abd1b-da9d-4476-8ad5-9475bb5f239a tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:12:07.875596 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.policy [None req-df7abd1b-da9d-4476-8ad5-9475bb5f239a tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97bdf19af9e34fc3886ff451cb9d7a27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '494b56bf5eae4d56a5591546f85bc32b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116156) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:12:07.883208 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: INFO nova.api.openstack.requestlog [None req-df7abd1b-da9d-4476-8ad5-9475bb5f239a tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] 10.222.0.18 "GET /compute/v2.1/servers/bbb8462c-9501-4541-b67e-43ec5c5061a7" status: 200 len: 1226 microversion: 2.1 time: 0.077140 Dec 15 03:12:07.883755 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: [pid: 116156|app: 0|req: 640/1279] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 03:12:07 2021] GET /compute/v2.1/servers/bbb8462c-9501-4541-b67e-43ec5c5061a7 => generated 1226 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 03:12:08.180122 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi [None req-2e24640c-2137-4fff-99d6-72501b69aeb8 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Calling method '>' {{(pid=116157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:12:08.180675 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.compute.api [None req-2e24640c-2137-4fff-99d6-72501b69aeb8 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] [instance: fa7c86bc-c46f-4120-8f3d-d795f8d7c5cc] Fetching instance by UUID {{(pid=116157) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:12:08.186421 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-2e24640c-2137-4fff-99d6-72501b69aeb8 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:12:08.186869 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-2e24640c-2137-4fff-99d6-72501b69aeb8 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:12:08.187644 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-2e24640c-2137-4fff-99d6-72501b69aeb8 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:12:08.188081 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-2e24640c-2137-4fff-99d6-72501b69aeb8 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:12:08.314715 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.policy [None req-2e24640c-2137-4fff-99d6-72501b69aeb8 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c4c0c82448e40ba801c0b52ec44e74a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a093d0bf43046aaa845f3cc115f3f5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116157) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:12:08.322603 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: INFO nova.api.openstack.requestlog [None req-2e24640c-2137-4fff-99d6-72501b69aeb8 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] 10.222.0.18 "GET /compute/v2.1/servers/fa7c86bc-c46f-4120-8f3d-d795f8d7c5cc" status: 200 len: 1570 microversion: 2.1 time: 0.146218 Dec 15 03:12:08.323184 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: [pid: 116157|app: 0|req: 640/1280] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 03:12:08 2021] GET /compute/v2.1/servers/fa7c86bc-c46f-4120-8f3d-d795f8d7c5cc => generated 1570 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 03:12:08.516482 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi [None req-711baab3-0334-4dd3-8f45-c55ec1e1f89a tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Calling method '>' {{(pid=116156) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:12:08.517292 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.compute.api [None req-711baab3-0334-4dd3-8f45-c55ec1e1f89a tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] [instance: b89094ac-aee1-4bd6-a33d-8c4347cebfc7] Fetching instance by UUID {{(pid=116156) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:12:08.523898 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-711baab3-0334-4dd3-8f45-c55ec1e1f89a tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:12:08.524343 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-711baab3-0334-4dd3-8f45-c55ec1e1f89a tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:12:08.525188 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-711baab3-0334-4dd3-8f45-c55ec1e1f89a tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:12:08.525619 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-711baab3-0334-4dd3-8f45-c55ec1e1f89a tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:12:08.553054 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: INFO nova.api.openstack.requestlog [None req-711baab3-0334-4dd3-8f45-c55ec1e1f89a tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] 10.222.0.18 "GET /compute/v2.1/servers/b89094ac-aee1-4bd6-a33d-8c4347cebfc7/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.040344 Dec 15 03:12:08.553585 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: [pid: 116156|app: 0|req: 641/1281] 10.222.0.18 () {60 vars in 1342 bytes} [Wed Dec 15 03:12:08 2021] GET /compute/v2.1/servers/b89094ac-aee1-4bd6-a33d-8c4347cebfc7/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 03:12:08.900127 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi [None req-18e8ab02-c134-4fbb-860a-037e005d885d tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Calling method '>' {{(pid=116157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:12:08.900741 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.compute.api [None req-18e8ab02-c134-4fbb-860a-037e005d885d tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] [instance: bbb8462c-9501-4541-b67e-43ec5c5061a7] Fetching instance by UUID {{(pid=116157) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:12:08.907093 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-18e8ab02-c134-4fbb-860a-037e005d885d tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:12:08.907527 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-18e8ab02-c134-4fbb-860a-037e005d885d tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:12:08.908308 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-18e8ab02-c134-4fbb-860a-037e005d885d tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:12:08.908743 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-18e8ab02-c134-4fbb-860a-037e005d885d tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:12:08.965469 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.policy [None req-18e8ab02-c134-4fbb-860a-037e005d885d tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97bdf19af9e34fc3886ff451cb9d7a27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '494b56bf5eae4d56a5591546f85bc32b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116157) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:12:08.972615 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: INFO nova.api.openstack.requestlog [None req-18e8ab02-c134-4fbb-860a-037e005d885d tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] 10.222.0.18 "GET /compute/v2.1/servers/bbb8462c-9501-4541-b67e-43ec5c5061a7" status: 200 len: 1226 microversion: 2.1 time: 0.076180 Dec 15 03:12:08.973167 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: [pid: 116157|app: 0|req: 641/1282] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 03:12:08 2021] GET /compute/v2.1/servers/bbb8462c-9501-4541-b67e-43ec5c5061a7 => generated 1226 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 03:12:09.339889 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi [None req-7d9c8522-6aa2-4245-b156-3cf49a2c1286 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Calling method '>' {{(pid=116156) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:12:09.340493 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.compute.api [None req-7d9c8522-6aa2-4245-b156-3cf49a2c1286 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] [instance: fa7c86bc-c46f-4120-8f3d-d795f8d7c5cc] Fetching instance by UUID {{(pid=116156) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:12:09.346774 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-7d9c8522-6aa2-4245-b156-3cf49a2c1286 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:12:09.347215 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-7d9c8522-6aa2-4245-b156-3cf49a2c1286 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:12:09.347983 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-7d9c8522-6aa2-4245-b156-3cf49a2c1286 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:12:09.348419 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-7d9c8522-6aa2-4245-b156-3cf49a2c1286 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:12:09.478269 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.policy [None req-7d9c8522-6aa2-4245-b156-3cf49a2c1286 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c4c0c82448e40ba801c0b52ec44e74a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a093d0bf43046aaa845f3cc115f3f5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116156) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:12:09.485474 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: INFO nova.api.openstack.requestlog [None req-7d9c8522-6aa2-4245-b156-3cf49a2c1286 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] 10.222.0.18 "GET /compute/v2.1/servers/fa7c86bc-c46f-4120-8f3d-d795f8d7c5cc" status: 200 len: 1570 microversion: 2.1 time: 0.149220 Dec 15 03:12:09.486039 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: [pid: 116156|app: 0|req: 642/1283] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 03:12:09 2021] GET /compute/v2.1/servers/fa7c86bc-c46f-4120-8f3d-d795f8d7c5cc => generated 1570 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 03:12:09.564356 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi [None req-399b56af-2a3e-4a51-91a9-8326e719f807 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Calling method '>' {{(pid=116157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:12:09.565262 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.compute.api [None req-399b56af-2a3e-4a51-91a9-8326e719f807 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] [instance: b89094ac-aee1-4bd6-a33d-8c4347cebfc7] Fetching instance by UUID {{(pid=116157) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:12:09.571681 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-399b56af-2a3e-4a51-91a9-8326e719f807 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:12:09.572161 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-399b56af-2a3e-4a51-91a9-8326e719f807 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:12:09.572935 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-399b56af-2a3e-4a51-91a9-8326e719f807 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:12:09.573372 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-399b56af-2a3e-4a51-91a9-8326e719f807 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:12:09.602577 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: INFO nova.api.openstack.requestlog [None req-399b56af-2a3e-4a51-91a9-8326e719f807 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] 10.222.0.18 "GET /compute/v2.1/servers/b89094ac-aee1-4bd6-a33d-8c4347cebfc7/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041991 Dec 15 03:12:09.603123 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: [pid: 116157|app: 0|req: 642/1284] 10.222.0.18 () {60 vars in 1342 bytes} [Wed Dec 15 03:12:09 2021] GET /compute/v2.1/servers/b89094ac-aee1-4bd6-a33d-8c4347cebfc7/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 03:12:09.989479 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi [None req-6ce3cff1-f38a-44a6-98d4-9dba005720cc tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Calling method '>' {{(pid=116156) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:12:09.990728 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.compute.api [None req-6ce3cff1-f38a-44a6-98d4-9dba005720cc tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] [instance: bbb8462c-9501-4541-b67e-43ec5c5061a7] Fetching instance by UUID {{(pid=116156) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:12:09.996579 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-6ce3cff1-f38a-44a6-98d4-9dba005720cc tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:12:09.997035 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-6ce3cff1-f38a-44a6-98d4-9dba005720cc tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:12:09.997818 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-6ce3cff1-f38a-44a6-98d4-9dba005720cc tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:12:09.998286 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-6ce3cff1-f38a-44a6-98d4-9dba005720cc tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:12:10.055597 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.policy [None req-6ce3cff1-f38a-44a6-98d4-9dba005720cc tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97bdf19af9e34fc3886ff451cb9d7a27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '494b56bf5eae4d56a5591546f85bc32b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116156) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:12:10.062724 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: INFO nova.api.openstack.requestlog [None req-6ce3cff1-f38a-44a6-98d4-9dba005720cc tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] 10.222.0.18 "GET /compute/v2.1/servers/bbb8462c-9501-4541-b67e-43ec5c5061a7" status: 200 len: 1226 microversion: 2.1 time: 0.077255 Dec 15 03:12:10.063283 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: [pid: 116156|app: 0|req: 643/1285] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 03:12:09 2021] GET /compute/v2.1/servers/bbb8462c-9501-4541-b67e-43ec5c5061a7 => generated 1226 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 03:12:10.502867 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi [None req-c916ea5a-e2f1-4f6a-9cd1-79ddeb11d4af tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Calling method '>' {{(pid=116157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:12:10.503471 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.compute.api [None req-c916ea5a-e2f1-4f6a-9cd1-79ddeb11d4af tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] [instance: fa7c86bc-c46f-4120-8f3d-d795f8d7c5cc] Fetching instance by UUID {{(pid=116157) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:12:10.510298 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-c916ea5a-e2f1-4f6a-9cd1-79ddeb11d4af tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:12:10.510744 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-c916ea5a-e2f1-4f6a-9cd1-79ddeb11d4af tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:12:10.511513 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-c916ea5a-e2f1-4f6a-9cd1-79ddeb11d4af tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:12:10.511944 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-c916ea5a-e2f1-4f6a-9cd1-79ddeb11d4af tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:12:10.614282 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi [None req-58cb4286-bb72-444d-8331-d198508a65a1 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Calling method '>' {{(pid=116156) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:12:10.615748 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.compute.api [None req-58cb4286-bb72-444d-8331-d198508a65a1 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] [instance: b89094ac-aee1-4bd6-a33d-8c4347cebfc7] Fetching instance by UUID {{(pid=116156) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:12:10.621634 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-58cb4286-bb72-444d-8331-d198508a65a1 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:12:10.622196 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-58cb4286-bb72-444d-8331-d198508a65a1 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:12:10.622979 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-58cb4286-bb72-444d-8331-d198508a65a1 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:12:10.623418 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-58cb4286-bb72-444d-8331-d198508a65a1 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:12:10.644814 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.policy [None req-c916ea5a-e2f1-4f6a-9cd1-79ddeb11d4af tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c4c0c82448e40ba801c0b52ec44e74a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a093d0bf43046aaa845f3cc115f3f5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116157) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:12:10.651591 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: INFO nova.api.openstack.requestlog [None req-58cb4286-bb72-444d-8331-d198508a65a1 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] 10.222.0.18 "GET /compute/v2.1/servers/b89094ac-aee1-4bd6-a33d-8c4347cebfc7/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041338 Dec 15 03:12:10.652064 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: INFO nova.api.openstack.requestlog [None req-c916ea5a-e2f1-4f6a-9cd1-79ddeb11d4af tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] 10.222.0.18 "GET /compute/v2.1/servers/fa7c86bc-c46f-4120-8f3d-d795f8d7c5cc" status: 200 len: 1570 microversion: 2.1 time: 0.152820 Dec 15 03:12:10.652175 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: [pid: 116156|app: 0|req: 644/1286] 10.222.0.18 () {60 vars in 1342 bytes} [Wed Dec 15 03:12:10 2021] GET /compute/v2.1/servers/b89094ac-aee1-4bd6-a33d-8c4347cebfc7/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Dec 15 03:12:10.652618 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: [pid: 116157|app: 0|req: 643/1287] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 03:12:10 2021] GET /compute/v2.1/servers/fa7c86bc-c46f-4120-8f3d-d795f8d7c5cc => generated 1570 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 03:12:11.079084 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi [None req-963f312e-1af5-4b24-95cc-e2946cdffed1 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Calling method '>' {{(pid=116156) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:12:11.079723 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.compute.api [None req-963f312e-1af5-4b24-95cc-e2946cdffed1 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] [instance: bbb8462c-9501-4541-b67e-43ec5c5061a7] Fetching instance by UUID {{(pid=116156) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:12:11.085530 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-963f312e-1af5-4b24-95cc-e2946cdffed1 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:12:11.086011 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-963f312e-1af5-4b24-95cc-e2946cdffed1 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:12:11.086788 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-963f312e-1af5-4b24-95cc-e2946cdffed1 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:12:11.087229 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-963f312e-1af5-4b24-95cc-e2946cdffed1 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:12:11.144937 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.policy [None req-963f312e-1af5-4b24-95cc-e2946cdffed1 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97bdf19af9e34fc3886ff451cb9d7a27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '494b56bf5eae4d56a5591546f85bc32b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116156) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:12:11.152152 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: INFO nova.api.openstack.requestlog [None req-963f312e-1af5-4b24-95cc-e2946cdffed1 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] 10.222.0.18 "GET /compute/v2.1/servers/bbb8462c-9501-4541-b67e-43ec5c5061a7" status: 200 len: 1226 microversion: 2.1 time: 0.076642 Dec 15 03:12:11.152706 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: [pid: 116156|app: 0|req: 645/1288] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 03:12:11 2021] GET /compute/v2.1/servers/bbb8462c-9501-4541-b67e-43ec5c5061a7 => generated 1226 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 03:12:11.664815 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi [None req-29d16a44-341f-4022-b935-7fd0cece5f55 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Calling method '>' {{(pid=116157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:12:11.665730 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.compute.api [None req-29d16a44-341f-4022-b935-7fd0cece5f55 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] [instance: b89094ac-aee1-4bd6-a33d-8c4347cebfc7] Fetching instance by UUID {{(pid=116157) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:12:11.668556 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi [None req-5b1ed9a0-3b9c-440c-aad9-a61854c87380 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Calling method '>' {{(pid=116156) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:12:11.669164 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.compute.api [None req-5b1ed9a0-3b9c-440c-aad9-a61854c87380 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] [instance: fa7c86bc-c46f-4120-8f3d-d795f8d7c5cc] Fetching instance by UUID {{(pid=116156) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:12:11.672132 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-29d16a44-341f-4022-b935-7fd0cece5f55 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:12:11.672727 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-29d16a44-341f-4022-b935-7fd0cece5f55 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:12:11.673600 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-29d16a44-341f-4022-b935-7fd0cece5f55 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:12:11.673960 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-29d16a44-341f-4022-b935-7fd0cece5f55 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:12:11.675065 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-5b1ed9a0-3b9c-440c-aad9-a61854c87380 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:12:11.675511 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-5b1ed9a0-3b9c-440c-aad9-a61854c87380 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:12:11.676282 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-5b1ed9a0-3b9c-440c-aad9-a61854c87380 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:12:11.676706 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-5b1ed9a0-3b9c-440c-aad9-a61854c87380 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:12:11.703224 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: INFO nova.api.openstack.requestlog [None req-29d16a44-341f-4022-b935-7fd0cece5f55 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] 10.222.0.18 "GET /compute/v2.1/servers/b89094ac-aee1-4bd6-a33d-8c4347cebfc7/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044082 Dec 15 03:12:11.703776 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: [pid: 116157|app: 0|req: 644/1289] 10.222.0.18 () {60 vars in 1342 bytes} [Wed Dec 15 03:12:11 2021] GET /compute/v2.1/servers/b89094ac-aee1-4bd6-a33d-8c4347cebfc7/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 03:12:11.809797 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.policy [None req-5b1ed9a0-3b9c-440c-aad9-a61854c87380 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c4c0c82448e40ba801c0b52ec44e74a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a093d0bf43046aaa845f3cc115f3f5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116156) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:12:11.816979 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: INFO nova.api.openstack.requestlog [None req-5b1ed9a0-3b9c-440c-aad9-a61854c87380 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] 10.222.0.18 "GET /compute/v2.1/servers/fa7c86bc-c46f-4120-8f3d-d795f8d7c5cc" status: 200 len: 1570 microversion: 2.1 time: 0.152027 Dec 15 03:12:11.817543 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: [pid: 116156|app: 0|req: 646/1290] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 03:12:11 2021] GET /compute/v2.1/servers/fa7c86bc-c46f-4120-8f3d-d795f8d7c5cc => generated 1570 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 03:12:12.168274 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi [None req-447064aa-18f6-40dc-8a89-dbf4f7ea0767 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Calling method '>' {{(pid=116157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:12:12.168885 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.compute.api [None req-447064aa-18f6-40dc-8a89-dbf4f7ea0767 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] [instance: bbb8462c-9501-4541-b67e-43ec5c5061a7] Fetching instance by UUID {{(pid=116157) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:12:12.174738 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-447064aa-18f6-40dc-8a89-dbf4f7ea0767 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:12:12.175192 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-447064aa-18f6-40dc-8a89-dbf4f7ea0767 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:12:12.175960 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-447064aa-18f6-40dc-8a89-dbf4f7ea0767 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:12:12.176396 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-447064aa-18f6-40dc-8a89-dbf4f7ea0767 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:12:12.234216 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.policy [None req-447064aa-18f6-40dc-8a89-dbf4f7ea0767 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97bdf19af9e34fc3886ff451cb9d7a27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '494b56bf5eae4d56a5591546f85bc32b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116157) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:12:12.241691 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: INFO nova.api.openstack.requestlog [None req-447064aa-18f6-40dc-8a89-dbf4f7ea0767 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] 10.222.0.18 "GET /compute/v2.1/servers/bbb8462c-9501-4541-b67e-43ec5c5061a7" status: 200 len: 1226 microversion: 2.1 time: 0.077018 Dec 15 03:12:12.242283 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: [pid: 116157|app: 0|req: 645/1291] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 03:12:12 2021] GET /compute/v2.1/servers/bbb8462c-9501-4541-b67e-43ec5c5061a7 => generated 1226 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 03:12:12.714785 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi [None req-b60cfe9e-bbdb-425c-a9ed-2e59eccc7a11 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Calling method '>' {{(pid=116156) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:12:12.715717 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.compute.api [None req-b60cfe9e-bbdb-425c-a9ed-2e59eccc7a11 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] [instance: b89094ac-aee1-4bd6-a33d-8c4347cebfc7] Fetching instance by UUID {{(pid=116156) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:12:12.721919 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-b60cfe9e-bbdb-425c-a9ed-2e59eccc7a11 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:12:12.722403 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-b60cfe9e-bbdb-425c-a9ed-2e59eccc7a11 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:12:12.723178 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-b60cfe9e-bbdb-425c-a9ed-2e59eccc7a11 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:12:12.723612 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-b60cfe9e-bbdb-425c-a9ed-2e59eccc7a11 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:12:12.752197 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: INFO nova.api.openstack.requestlog [None req-b60cfe9e-bbdb-425c-a9ed-2e59eccc7a11 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] 10.222.0.18 "GET /compute/v2.1/servers/b89094ac-aee1-4bd6-a33d-8c4347cebfc7/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041171 Dec 15 03:12:12.752739 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: [pid: 116156|app: 0|req: 647/1292] 10.222.0.18 () {60 vars in 1342 bytes} [Wed Dec 15 03:12:12 2021] GET /compute/v2.1/servers/b89094ac-aee1-4bd6-a33d-8c4347cebfc7/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 03:12:12.834211 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi [None req-3624d8f2-fd90-4743-b1c3-93bbce111a2d tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Calling method '>' {{(pid=116157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:12:12.834841 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.compute.api [None req-3624d8f2-fd90-4743-b1c3-93bbce111a2d tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] [instance: fa7c86bc-c46f-4120-8f3d-d795f8d7c5cc] Fetching instance by UUID {{(pid=116157) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:12:12.840989 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-3624d8f2-fd90-4743-b1c3-93bbce111a2d tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:12:12.841442 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-3624d8f2-fd90-4743-b1c3-93bbce111a2d tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:12:12.842254 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-3624d8f2-fd90-4743-b1c3-93bbce111a2d tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:12:12.842672 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-3624d8f2-fd90-4743-b1c3-93bbce111a2d tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:12:12.969610 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.policy [None req-3624d8f2-fd90-4743-b1c3-93bbce111a2d tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c4c0c82448e40ba801c0b52ec44e74a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a093d0bf43046aaa845f3cc115f3f5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116157) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:12:12.977259 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: INFO nova.api.openstack.requestlog [None req-3624d8f2-fd90-4743-b1c3-93bbce111a2d tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] 10.222.0.18 "GET /compute/v2.1/servers/fa7c86bc-c46f-4120-8f3d-d795f8d7c5cc" status: 200 len: 1570 microversion: 2.1 time: 0.146672 Dec 15 03:12:12.977815 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: [pid: 116157|app: 0|req: 646/1293] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 03:12:12 2021] GET /compute/v2.1/servers/fa7c86bc-c46f-4120-8f3d-d795f8d7c5cc => generated 1570 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 03:12:13.257584 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi [None req-cd43884a-403f-4104-8785-5ffb4ae0467c tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Calling method '>' {{(pid=116156) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:12:13.258315 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.compute.api [None req-cd43884a-403f-4104-8785-5ffb4ae0467c tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] [instance: bbb8462c-9501-4541-b67e-43ec5c5061a7] Fetching instance by UUID {{(pid=116156) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:12:13.264047 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-cd43884a-403f-4104-8785-5ffb4ae0467c tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:12:13.264488 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-cd43884a-403f-4104-8785-5ffb4ae0467c tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:12:13.265279 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-cd43884a-403f-4104-8785-5ffb4ae0467c tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:12:13.265709 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-cd43884a-403f-4104-8785-5ffb4ae0467c tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:12:13.322490 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.policy [None req-cd43884a-403f-4104-8785-5ffb4ae0467c tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97bdf19af9e34fc3886ff451cb9d7a27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '494b56bf5eae4d56a5591546f85bc32b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116156) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:12:13.329662 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: INFO nova.api.openstack.requestlog [None req-cd43884a-403f-4104-8785-5ffb4ae0467c tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] 10.222.0.18 "GET /compute/v2.1/servers/bbb8462c-9501-4541-b67e-43ec5c5061a7" status: 200 len: 1226 microversion: 2.1 time: 0.075489 Dec 15 03:12:13.330252 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: [pid: 116156|app: 0|req: 648/1294] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 03:12:13 2021] GET /compute/v2.1/servers/bbb8462c-9501-4541-b67e-43ec5c5061a7 => generated 1226 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 03:12:13.764524 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi [None req-19900f9f-8fc9-484e-93e6-194b868a199f tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Calling method '>' {{(pid=116157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:12:13.765423 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.compute.api [None req-19900f9f-8fc9-484e-93e6-194b868a199f tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] [instance: b89094ac-aee1-4bd6-a33d-8c4347cebfc7] Fetching instance by UUID {{(pid=116157) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:12:13.771229 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-19900f9f-8fc9-484e-93e6-194b868a199f tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:12:13.771669 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-19900f9f-8fc9-484e-93e6-194b868a199f tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:12:13.772437 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-19900f9f-8fc9-484e-93e6-194b868a199f tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:12:13.772863 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-19900f9f-8fc9-484e-93e6-194b868a199f tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:12:13.800713 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: INFO nova.api.openstack.requestlog [None req-19900f9f-8fc9-484e-93e6-194b868a199f tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] 10.222.0.18 "GET /compute/v2.1/servers/b89094ac-aee1-4bd6-a33d-8c4347cebfc7/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.039969 Dec 15 03:12:13.801243 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: [pid: 116157|app: 0|req: 647/1295] 10.222.0.18 () {60 vars in 1342 bytes} [Wed Dec 15 03:12:13 2021] GET /compute/v2.1/servers/b89094ac-aee1-4bd6-a33d-8c4347cebfc7/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 03:12:13.994662 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi [None req-c2d11c41-3598-46ca-830d-3b2b96246239 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Calling method '>' {{(pid=116156) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:12:13.995275 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.compute.api [None req-c2d11c41-3598-46ca-830d-3b2b96246239 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] [instance: fa7c86bc-c46f-4120-8f3d-d795f8d7c5cc] Fetching instance by UUID {{(pid=116156) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:12:14.001368 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-c2d11c41-3598-46ca-830d-3b2b96246239 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:12:14.001820 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-c2d11c41-3598-46ca-830d-3b2b96246239 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:12:14.002624 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-c2d11c41-3598-46ca-830d-3b2b96246239 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:12:14.003056 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-c2d11c41-3598-46ca-830d-3b2b96246239 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:12:14.133673 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.policy [None req-c2d11c41-3598-46ca-830d-3b2b96246239 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c4c0c82448e40ba801c0b52ec44e74a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a093d0bf43046aaa845f3cc115f3f5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116156) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:12:14.140830 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: INFO nova.api.openstack.requestlog [None req-c2d11c41-3598-46ca-830d-3b2b96246239 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] 10.222.0.18 "GET /compute/v2.1/servers/fa7c86bc-c46f-4120-8f3d-d795f8d7c5cc" status: 200 len: 1570 microversion: 2.1 time: 0.149750 Dec 15 03:12:14.141382 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: [pid: 116156|app: 0|req: 649/1296] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 03:12:13 2021] GET /compute/v2.1/servers/fa7c86bc-c46f-4120-8f3d-d795f8d7c5cc => generated 1570 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 03:12:14.346808 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi [None req-c5e2e006-a3e4-4359-a916-851d52ed245e tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Calling method '>' {{(pid=116157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:12:14.347335 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.compute.api [None req-c5e2e006-a3e4-4359-a916-851d52ed245e tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] [instance: bbb8462c-9501-4541-b67e-43ec5c5061a7] Fetching instance by UUID {{(pid=116157) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:12:14.353583 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-c5e2e006-a3e4-4359-a916-851d52ed245e tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:12:14.354077 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-c5e2e006-a3e4-4359-a916-851d52ed245e tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:12:14.354862 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-c5e2e006-a3e4-4359-a916-851d52ed245e tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:12:14.355305 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-c5e2e006-a3e4-4359-a916-851d52ed245e tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:12:14.413767 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.policy [None req-c5e2e006-a3e4-4359-a916-851d52ed245e tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97bdf19af9e34fc3886ff451cb9d7a27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '494b56bf5eae4d56a5591546f85bc32b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116157) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:12:14.420982 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: INFO nova.api.openstack.requestlog [None req-c5e2e006-a3e4-4359-a916-851d52ed245e tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] 10.222.0.18 "GET /compute/v2.1/servers/bbb8462c-9501-4541-b67e-43ec5c5061a7" status: 200 len: 1226 microversion: 2.1 time: 0.077880 Dec 15 03:12:14.421539 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: [pid: 116157|app: 0|req: 648/1297] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 03:12:14 2021] GET /compute/v2.1/servers/bbb8462c-9501-4541-b67e-43ec5c5061a7 => generated 1226 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 03:12:14.812597 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi [None req-0889f295-c419-49c8-a136-2abde047b041 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Calling method '>' {{(pid=116156) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:12:14.813604 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.compute.api [None req-0889f295-c419-49c8-a136-2abde047b041 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] [instance: b89094ac-aee1-4bd6-a33d-8c4347cebfc7] Fetching instance by UUID {{(pid=116156) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:12:14.820143 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-0889f295-c419-49c8-a136-2abde047b041 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:12:14.820591 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-0889f295-c419-49c8-a136-2abde047b041 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:12:14.821364 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-0889f295-c419-49c8-a136-2abde047b041 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:12:14.821793 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-0889f295-c419-49c8-a136-2abde047b041 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:12:14.849343 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: INFO nova.api.openstack.requestlog [None req-0889f295-c419-49c8-a136-2abde047b041 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] 10.222.0.18 "GET /compute/v2.1/servers/b89094ac-aee1-4bd6-a33d-8c4347cebfc7/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.040465 Dec 15 03:12:14.849875 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: [pid: 116156|app: 0|req: 650/1298] 10.222.0.18 () {60 vars in 1342 bytes} [Wed Dec 15 03:12:14 2021] GET /compute/v2.1/servers/b89094ac-aee1-4bd6-a33d-8c4347cebfc7/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 03:12:15.157134 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi [None req-79730857-18a0-452a-981f-0b42bcd108ed tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Calling method '>' {{(pid=116157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:12:15.157661 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.compute.api [None req-79730857-18a0-452a-981f-0b42bcd108ed tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] [instance: fa7c86bc-c46f-4120-8f3d-d795f8d7c5cc] Fetching instance by UUID {{(pid=116157) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:12:15.163967 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-79730857-18a0-452a-981f-0b42bcd108ed tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:12:15.164409 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-79730857-18a0-452a-981f-0b42bcd108ed tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:12:15.165179 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-79730857-18a0-452a-981f-0b42bcd108ed tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:12:15.165609 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-79730857-18a0-452a-981f-0b42bcd108ed tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:12:15.297263 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.policy [None req-79730857-18a0-452a-981f-0b42bcd108ed tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c4c0c82448e40ba801c0b52ec44e74a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a093d0bf43046aaa845f3cc115f3f5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116157) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:12:15.305068 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: INFO nova.api.openstack.requestlog [None req-79730857-18a0-452a-981f-0b42bcd108ed tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] 10.222.0.18 "GET /compute/v2.1/servers/fa7c86bc-c46f-4120-8f3d-d795f8d7c5cc" status: 200 len: 1570 microversion: 2.1 time: 0.151628 Dec 15 03:12:15.305632 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: [pid: 116157|app: 0|req: 649/1299] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 03:12:15 2021] GET /compute/v2.1/servers/fa7c86bc-c46f-4120-8f3d-d795f8d7c5cc => generated 1570 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 03:12:15.437340 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi [None req-42ab3324-6c24-4f27-ab6f-2d0311b968f9 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Calling method '>' {{(pid=116156) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:12:15.437876 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.compute.api [None req-42ab3324-6c24-4f27-ab6f-2d0311b968f9 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] [instance: bbb8462c-9501-4541-b67e-43ec5c5061a7] Fetching instance by UUID {{(pid=116156) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:12:15.444750 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-42ab3324-6c24-4f27-ab6f-2d0311b968f9 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:12:15.445192 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-42ab3324-6c24-4f27-ab6f-2d0311b968f9 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:12:15.445957 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-42ab3324-6c24-4f27-ab6f-2d0311b968f9 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:12:15.446411 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-42ab3324-6c24-4f27-ab6f-2d0311b968f9 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:12:15.503271 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.policy [None req-42ab3324-6c24-4f27-ab6f-2d0311b968f9 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97bdf19af9e34fc3886ff451cb9d7a27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '494b56bf5eae4d56a5591546f85bc32b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116156) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:12:15.511140 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: INFO nova.api.openstack.requestlog [None req-42ab3324-6c24-4f27-ab6f-2d0311b968f9 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] 10.222.0.18 "GET /compute/v2.1/servers/bbb8462c-9501-4541-b67e-43ec5c5061a7" status: 200 len: 1226 microversion: 2.1 time: 0.077468 Dec 15 03:12:15.511691 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: [pid: 116156|app: 0|req: 651/1300] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 03:12:15 2021] GET /compute/v2.1/servers/bbb8462c-9501-4541-b67e-43ec5c5061a7 => generated 1226 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 03:12:15.860590 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi [None req-038c4f72-f6be-4579-9dc8-dc1f0cb914f6 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Calling method '>' {{(pid=116157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:12:15.861495 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.compute.api [None req-038c4f72-f6be-4579-9dc8-dc1f0cb914f6 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] [instance: b89094ac-aee1-4bd6-a33d-8c4347cebfc7] Fetching instance by UUID {{(pid=116157) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:12:15.868666 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-038c4f72-f6be-4579-9dc8-dc1f0cb914f6 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:12:15.869116 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-038c4f72-f6be-4579-9dc8-dc1f0cb914f6 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:12:15.869893 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-038c4f72-f6be-4579-9dc8-dc1f0cb914f6 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:12:15.870354 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-038c4f72-f6be-4579-9dc8-dc1f0cb914f6 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:12:15.898088 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: INFO nova.api.openstack.requestlog [None req-038c4f72-f6be-4579-9dc8-dc1f0cb914f6 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] 10.222.0.18 "GET /compute/v2.1/servers/b89094ac-aee1-4bd6-a33d-8c4347cebfc7/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041230 Dec 15 03:12:15.898628 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: [pid: 116157|app: 0|req: 650/1301] 10.222.0.18 () {60 vars in 1342 bytes} [Wed Dec 15 03:12:15 2021] GET /compute/v2.1/servers/b89094ac-aee1-4bd6-a33d-8c4347cebfc7/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 03:12:16.321828 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi [None req-7f47f263-af39-488f-830c-80de9f08e473 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Calling method '>' {{(pid=116156) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:12:16.322459 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.compute.api [None req-7f47f263-af39-488f-830c-80de9f08e473 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] [instance: fa7c86bc-c46f-4120-8f3d-d795f8d7c5cc] Fetching instance by UUID {{(pid=116156) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:12:16.328274 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-7f47f263-af39-488f-830c-80de9f08e473 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:12:16.328717 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-7f47f263-af39-488f-830c-80de9f08e473 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:12:16.329482 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-7f47f263-af39-488f-830c-80de9f08e473 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:12:16.329911 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-7f47f263-af39-488f-830c-80de9f08e473 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:12:16.457883 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.policy [None req-7f47f263-af39-488f-830c-80de9f08e473 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c4c0c82448e40ba801c0b52ec44e74a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a093d0bf43046aaa845f3cc115f3f5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116156) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:12:16.465554 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: INFO nova.api.openstack.requestlog [None req-7f47f263-af39-488f-830c-80de9f08e473 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] 10.222.0.18 "GET /compute/v2.1/servers/fa7c86bc-c46f-4120-8f3d-d795f8d7c5cc" status: 200 len: 1570 microversion: 2.1 time: 0.147343 Dec 15 03:12:16.466130 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: [pid: 116156|app: 0|req: 652/1302] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 03:12:16 2021] GET /compute/v2.1/servers/fa7c86bc-c46f-4120-8f3d-d795f8d7c5cc => generated 1570 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 03:12:16.527808 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi [None req-b86db054-fe79-4912-9f9a-f1cca645e5d5 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Calling method '>' {{(pid=116157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:12:16.528416 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.compute.api [None req-b86db054-fe79-4912-9f9a-f1cca645e5d5 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] [instance: bbb8462c-9501-4541-b67e-43ec5c5061a7] Fetching instance by UUID {{(pid=116157) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:12:16.534151 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-b86db054-fe79-4912-9f9a-f1cca645e5d5 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:12:16.534604 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-b86db054-fe79-4912-9f9a-f1cca645e5d5 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:12:16.535390 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-b86db054-fe79-4912-9f9a-f1cca645e5d5 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:12:16.535823 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-b86db054-fe79-4912-9f9a-f1cca645e5d5 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:12:16.593175 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.policy [None req-b86db054-fe79-4912-9f9a-f1cca645e5d5 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97bdf19af9e34fc3886ff451cb9d7a27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '494b56bf5eae4d56a5591546f85bc32b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116157) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:12:16.600314 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: INFO nova.api.openstack.requestlog [None req-b86db054-fe79-4912-9f9a-f1cca645e5d5 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] 10.222.0.18 "GET /compute/v2.1/servers/bbb8462c-9501-4541-b67e-43ec5c5061a7" status: 200 len: 1226 microversion: 2.1 time: 0.076183 Dec 15 03:12:16.600868 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: [pid: 116157|app: 0|req: 651/1303] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 03:12:16 2021] GET /compute/v2.1/servers/bbb8462c-9501-4541-b67e-43ec5c5061a7 => generated 1226 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 03:12:16.909597 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi [None req-7744e805-02f4-4929-88a1-01d0753437b1 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Calling method '>' {{(pid=116156) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:12:16.910539 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.compute.api [None req-7744e805-02f4-4929-88a1-01d0753437b1 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] [instance: b89094ac-aee1-4bd6-a33d-8c4347cebfc7] Fetching instance by UUID {{(pid=116156) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:12:16.916959 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-7744e805-02f4-4929-88a1-01d0753437b1 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:12:16.917410 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-7744e805-02f4-4929-88a1-01d0753437b1 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:12:16.918214 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-7744e805-02f4-4929-88a1-01d0753437b1 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:12:16.918655 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-7744e805-02f4-4929-88a1-01d0753437b1 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:12:16.946169 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: INFO nova.api.openstack.requestlog [None req-7744e805-02f4-4929-88a1-01d0753437b1 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] 10.222.0.18 "GET /compute/v2.1/servers/b89094ac-aee1-4bd6-a33d-8c4347cebfc7/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.040316 Dec 15 03:12:16.946707 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: [pid: 116156|app: 0|req: 653/1304] 10.222.0.18 () {60 vars in 1342 bytes} [Wed Dec 15 03:12:16 2021] GET /compute/v2.1/servers/b89094ac-aee1-4bd6-a33d-8c4347cebfc7/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 03:12:17.482955 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi [None req-65bb12c5-ab6a-4193-8c40-a3f18f702a8f tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Calling method '>' {{(pid=116157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:12:17.483493 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.compute.api [None req-65bb12c5-ab6a-4193-8c40-a3f18f702a8f tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] [instance: fa7c86bc-c46f-4120-8f3d-d795f8d7c5cc] Fetching instance by UUID {{(pid=116157) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:12:17.489993 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-65bb12c5-ab6a-4193-8c40-a3f18f702a8f tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:12:17.490456 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-65bb12c5-ab6a-4193-8c40-a3f18f702a8f tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:12:17.491238 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-65bb12c5-ab6a-4193-8c40-a3f18f702a8f tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:12:17.491675 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-65bb12c5-ab6a-4193-8c40-a3f18f702a8f tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:12:17.617525 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi [None req-19adc499-8104-4165-8e46-43706a3a618a tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Calling method '>' {{(pid=116156) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:12:17.618204 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.compute.api [None req-19adc499-8104-4165-8e46-43706a3a618a tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] [instance: bbb8462c-9501-4541-b67e-43ec5c5061a7] Fetching instance by UUID {{(pid=116156) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:12:17.619277 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.policy [None req-65bb12c5-ab6a-4193-8c40-a3f18f702a8f tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c4c0c82448e40ba801c0b52ec44e74a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a093d0bf43046aaa845f3cc115f3f5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116157) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:12:17.624431 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-19adc499-8104-4165-8e46-43706a3a618a tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:12:17.624891 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-19adc499-8104-4165-8e46-43706a3a618a tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:12:17.625675 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-19adc499-8104-4165-8e46-43706a3a618a tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:12:17.626159 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-19adc499-8104-4165-8e46-43706a3a618a tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:12:17.626944 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: INFO nova.api.openstack.requestlog [None req-65bb12c5-ab6a-4193-8c40-a3f18f702a8f tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] 10.222.0.18 "GET /compute/v2.1/servers/fa7c86bc-c46f-4120-8f3d-d795f8d7c5cc" status: 200 len: 1570 microversion: 2.1 time: 0.147727 Dec 15 03:12:17.627505 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: [pid: 116157|app: 0|req: 652/1305] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 03:12:17 2021] GET /compute/v2.1/servers/fa7c86bc-c46f-4120-8f3d-d795f8d7c5cc => generated 1570 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 03:12:17.688386 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.policy [None req-19adc499-8104-4165-8e46-43706a3a618a tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97bdf19af9e34fc3886ff451cb9d7a27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '494b56bf5eae4d56a5591546f85bc32b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116156) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:12:17.696347 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: INFO nova.api.openstack.requestlog [None req-19adc499-8104-4165-8e46-43706a3a618a tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] 10.222.0.18 "GET /compute/v2.1/servers/bbb8462c-9501-4541-b67e-43ec5c5061a7" status: 200 len: 1226 microversion: 2.1 time: 0.082487 Dec 15 03:12:17.696909 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: [pid: 116156|app: 0|req: 654/1306] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 03:12:17 2021] GET /compute/v2.1/servers/bbb8462c-9501-4541-b67e-43ec5c5061a7 => generated 1226 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 03:12:17.957040 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi [None req-3fa89141-3ca6-4c7e-8a31-e07ecd74c6ae tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Calling method '>' {{(pid=116157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:12:17.957943 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.compute.api [None req-3fa89141-3ca6-4c7e-8a31-e07ecd74c6ae tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] [instance: b89094ac-aee1-4bd6-a33d-8c4347cebfc7] Fetching instance by UUID {{(pid=116157) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:12:17.963792 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-3fa89141-3ca6-4c7e-8a31-e07ecd74c6ae tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:12:17.964239 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-3fa89141-3ca6-4c7e-8a31-e07ecd74c6ae tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:12:17.965026 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-3fa89141-3ca6-4c7e-8a31-e07ecd74c6ae tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:12:17.965466 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-3fa89141-3ca6-4c7e-8a31-e07ecd74c6ae tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:12:17.993617 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: INFO nova.api.openstack.requestlog [None req-3fa89141-3ca6-4c7e-8a31-e07ecd74c6ae tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] 10.222.0.18 "GET /compute/v2.1/servers/b89094ac-aee1-4bd6-a33d-8c4347cebfc7/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.040325 Dec 15 03:12:17.994175 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: [pid: 116157|app: 0|req: 653/1307] 10.222.0.18 () {60 vars in 1342 bytes} [Wed Dec 15 03:12:17 2021] GET /compute/v2.1/servers/b89094ac-aee1-4bd6-a33d-8c4347cebfc7/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 03:12:18.644189 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi [None req-3452090d-20d4-45e8-b276-56f66264a897 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Calling method '>' {{(pid=116156) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:12:18.644832 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.compute.api [None req-3452090d-20d4-45e8-b276-56f66264a897 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] [instance: fa7c86bc-c46f-4120-8f3d-d795f8d7c5cc] Fetching instance by UUID {{(pid=116156) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:12:18.651579 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-3452090d-20d4-45e8-b276-56f66264a897 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:12:18.652033 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-3452090d-20d4-45e8-b276-56f66264a897 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:12:18.652826 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-3452090d-20d4-45e8-b276-56f66264a897 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:12:18.653264 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-3452090d-20d4-45e8-b276-56f66264a897 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:12:18.713730 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi [None req-67aca458-15f8-4d5f-9d8b-feded1dfecbc tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Calling method '>' {{(pid=116157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:12:18.714372 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.compute.api [None req-67aca458-15f8-4d5f-9d8b-feded1dfecbc tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] [instance: bbb8462c-9501-4541-b67e-43ec5c5061a7] Fetching instance by UUID {{(pid=116157) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:12:18.720582 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-67aca458-15f8-4d5f-9d8b-feded1dfecbc tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:12:18.721033 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-67aca458-15f8-4d5f-9d8b-feded1dfecbc tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:12:18.721830 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-67aca458-15f8-4d5f-9d8b-feded1dfecbc tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:12:18.722297 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-67aca458-15f8-4d5f-9d8b-feded1dfecbc tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:12:18.785273 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.policy [None req-3452090d-20d4-45e8-b276-56f66264a897 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c4c0c82448e40ba801c0b52ec44e74a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a093d0bf43046aaa845f3cc115f3f5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116156) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:12:18.785837 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.policy [None req-67aca458-15f8-4d5f-9d8b-feded1dfecbc tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97bdf19af9e34fc3886ff451cb9d7a27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '494b56bf5eae4d56a5591546f85bc32b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116157) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:12:18.792698 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: INFO nova.api.openstack.requestlog [None req-3452090d-20d4-45e8-b276-56f66264a897 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] 10.222.0.18 "GET /compute/v2.1/servers/fa7c86bc-c46f-4120-8f3d-d795f8d7c5cc" status: 200 len: 1570 microversion: 2.1 time: 0.152117 Dec 15 03:12:18.793000 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: INFO nova.api.openstack.requestlog [None req-67aca458-15f8-4d5f-9d8b-feded1dfecbc tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] 10.222.0.18 "GET /compute/v2.1/servers/bbb8462c-9501-4541-b67e-43ec5c5061a7" status: 200 len: 1226 microversion: 2.1 time: 0.083073 Dec 15 03:12:18.793266 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: [pid: 116156|app: 0|req: 655/1308] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 03:12:18 2021] GET /compute/v2.1/servers/fa7c86bc-c46f-4120-8f3d-d795f8d7c5cc => generated 1570 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 03:12:18.793616 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: [pid: 116157|app: 0|req: 654/1309] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 03:12:18 2021] GET /compute/v2.1/servers/bbb8462c-9501-4541-b67e-43ec5c5061a7 => generated 1226 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 03:12:19.004584 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi [None req-c938f9e1-0b94-4759-86db-26569c89cb70 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Calling method '>' {{(pid=116156) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:12:19.005880 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.compute.api [None req-c938f9e1-0b94-4759-86db-26569c89cb70 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] [instance: b89094ac-aee1-4bd6-a33d-8c4347cebfc7] Fetching instance by UUID {{(pid=116156) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:12:19.011749 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-c938f9e1-0b94-4759-86db-26569c89cb70 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:12:19.012199 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-c938f9e1-0b94-4759-86db-26569c89cb70 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:12:19.012970 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-c938f9e1-0b94-4759-86db-26569c89cb70 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:12:19.013396 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-c938f9e1-0b94-4759-86db-26569c89cb70 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:12:19.041059 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: INFO nova.api.openstack.requestlog [None req-c938f9e1-0b94-4759-86db-26569c89cb70 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] 10.222.0.18 "GET /compute/v2.1/servers/b89094ac-aee1-4bd6-a33d-8c4347cebfc7/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.040314 Dec 15 03:12:19.041594 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: [pid: 116156|app: 0|req: 656/1310] 10.222.0.18 () {60 vars in 1342 bytes} [Wed Dec 15 03:12:18 2021] GET /compute/v2.1/servers/b89094ac-aee1-4bd6-a33d-8c4347cebfc7/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 03:12:19.809631 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi [None req-2e1f7eeb-bfe2-4a1b-8ba0-fab00f36ba83 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Calling method '>' {{(pid=116156) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:12:19.810307 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi [None req-4e8b5b32-ab42-4cb4-af8c-ad551be5c9f4 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Calling method '>' {{(pid=116157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:12:19.810668 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.compute.api [None req-2e1f7eeb-bfe2-4a1b-8ba0-fab00f36ba83 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] [instance: fa7c86bc-c46f-4120-8f3d-d795f8d7c5cc] Fetching instance by UUID {{(pid=116156) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:12:19.810791 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.compute.api [None req-4e8b5b32-ab42-4cb4-af8c-ad551be5c9f4 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] [instance: bbb8462c-9501-4541-b67e-43ec5c5061a7] Fetching instance by UUID {{(pid=116157) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:12:19.816685 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-2e1f7eeb-bfe2-4a1b-8ba0-fab00f36ba83 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:12:19.816843 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-4e8b5b32-ab42-4cb4-af8c-ad551be5c9f4 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:12:19.817139 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-2e1f7eeb-bfe2-4a1b-8ba0-fab00f36ba83 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:12:19.817258 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-4e8b5b32-ab42-4cb4-af8c-ad551be5c9f4 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:12:19.817925 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-2e1f7eeb-bfe2-4a1b-8ba0-fab00f36ba83 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:12:19.818059 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-4e8b5b32-ab42-4cb4-af8c-ad551be5c9f4 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:12:19.818388 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-2e1f7eeb-bfe2-4a1b-8ba0-fab00f36ba83 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:12:19.818503 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-4e8b5b32-ab42-4cb4-af8c-ad551be5c9f4 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:12:19.878138 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.policy [None req-4e8b5b32-ab42-4cb4-af8c-ad551be5c9f4 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97bdf19af9e34fc3886ff451cb9d7a27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '494b56bf5eae4d56a5591546f85bc32b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116157) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:12:19.885407 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: INFO nova.api.openstack.requestlog [None req-4e8b5b32-ab42-4cb4-af8c-ad551be5c9f4 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] 10.222.0.18 "GET /compute/v2.1/servers/bbb8462c-9501-4541-b67e-43ec5c5061a7" status: 200 len: 1226 microversion: 2.1 time: 0.079373 Dec 15 03:12:19.885973 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: [pid: 116157|app: 0|req: 655/1311] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 03:12:19 2021] GET /compute/v2.1/servers/bbb8462c-9501-4541-b67e-43ec5c5061a7 => generated 1226 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 03:12:19.947977 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.policy [None req-2e1f7eeb-bfe2-4a1b-8ba0-fab00f36ba83 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c4c0c82448e40ba801c0b52ec44e74a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a093d0bf43046aaa845f3cc115f3f5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116156) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:12:19.955169 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: INFO nova.api.openstack.requestlog [None req-2e1f7eeb-bfe2-4a1b-8ba0-fab00f36ba83 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] 10.222.0.18 "GET /compute/v2.1/servers/fa7c86bc-c46f-4120-8f3d-d795f8d7c5cc" status: 200 len: 1570 microversion: 2.1 time: 0.149132 Dec 15 03:12:19.955730 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: [pid: 116156|app: 0|req: 657/1312] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 03:12:19 2021] GET /compute/v2.1/servers/fa7c86bc-c46f-4120-8f3d-d795f8d7c5cc => generated 1570 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 03:12:20.052510 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi [None req-ae8b064a-9c81-4d81-aa46-13ccf888c620 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Calling method '>' {{(pid=116157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:12:20.053411 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.compute.api [None req-ae8b064a-9c81-4d81-aa46-13ccf888c620 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] [instance: b89094ac-aee1-4bd6-a33d-8c4347cebfc7] Fetching instance by UUID {{(pid=116157) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:12:20.059160 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-ae8b064a-9c81-4d81-aa46-13ccf888c620 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:12:20.059610 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-ae8b064a-9c81-4d81-aa46-13ccf888c620 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:12:20.060439 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-ae8b064a-9c81-4d81-aa46-13ccf888c620 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:12:20.060824 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-ae8b064a-9c81-4d81-aa46-13ccf888c620 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:12:20.089832 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: INFO nova.api.openstack.requestlog [None req-ae8b064a-9c81-4d81-aa46-13ccf888c620 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] 10.222.0.18 "GET /compute/v2.1/servers/b89094ac-aee1-4bd6-a33d-8c4347cebfc7/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041180 Dec 15 03:12:20.090400 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: [pid: 116157|app: 0|req: 656/1313] 10.222.0.18 () {60 vars in 1342 bytes} [Wed Dec 15 03:12:20 2021] GET /compute/v2.1/servers/b89094ac-aee1-4bd6-a33d-8c4347cebfc7/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 03:12:20.902289 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi [None req-f1a61e40-0855-435c-9218-c468537a2a34 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Calling method '>' {{(pid=116156) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:12:20.902888 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.compute.api [None req-f1a61e40-0855-435c-9218-c468537a2a34 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] [instance: bbb8462c-9501-4541-b67e-43ec5c5061a7] Fetching instance by UUID {{(pid=116156) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:12:20.909039 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-f1a61e40-0855-435c-9218-c468537a2a34 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:12:20.909489 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-f1a61e40-0855-435c-9218-c468537a2a34 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:12:20.910284 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-f1a61e40-0855-435c-9218-c468537a2a34 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:12:20.910714 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-f1a61e40-0855-435c-9218-c468537a2a34 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:12:20.972412 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi [None req-0398f1c5-36e6-49e7-80ed-1b2a6303c1e6 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Calling method '>' {{(pid=116157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:12:20.972947 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.policy [None req-f1a61e40-0855-435c-9218-c468537a2a34 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97bdf19af9e34fc3886ff451cb9d7a27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '494b56bf5eae4d56a5591546f85bc32b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116156) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:12:20.973096 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.compute.api [None req-0398f1c5-36e6-49e7-80ed-1b2a6303c1e6 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] [instance: fa7c86bc-c46f-4120-8f3d-d795f8d7c5cc] Fetching instance by UUID {{(pid=116157) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:12:20.979616 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-0398f1c5-36e6-49e7-80ed-1b2a6303c1e6 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:12:20.980058 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-0398f1c5-36e6-49e7-80ed-1b2a6303c1e6 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:12:20.980827 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-0398f1c5-36e6-49e7-80ed-1b2a6303c1e6 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:12:20.980956 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: INFO nova.api.openstack.requestlog [None req-f1a61e40-0855-435c-9218-c468537a2a34 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] 10.222.0.18 "GET /compute/v2.1/servers/bbb8462c-9501-4541-b67e-43ec5c5061a7" status: 200 len: 1226 microversion: 2.1 time: 0.082243 Dec 15 03:12:20.981262 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-0398f1c5-36e6-49e7-80ed-1b2a6303c1e6 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:12:20.981515 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: [pid: 116156|app: 0|req: 658/1314] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 03:12:20 2021] GET /compute/v2.1/servers/bbb8462c-9501-4541-b67e-43ec5c5061a7 => generated 1226 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 03:12:21.100539 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi [None req-8330e0fa-e733-4926-bd99-aedd4dba2812 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Calling method '>' {{(pid=116156) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:12:21.101434 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.compute.api [None req-8330e0fa-e733-4926-bd99-aedd4dba2812 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] [instance: b89094ac-aee1-4bd6-a33d-8c4347cebfc7] Fetching instance by UUID {{(pid=116156) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:12:21.107171 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-8330e0fa-e733-4926-bd99-aedd4dba2812 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:12:21.107560 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-8330e0fa-e733-4926-bd99-aedd4dba2812 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:12:21.108339 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-8330e0fa-e733-4926-bd99-aedd4dba2812 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:12:21.108767 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-8330e0fa-e733-4926-bd99-aedd4dba2812 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:12:21.109399 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.policy [None req-0398f1c5-36e6-49e7-80ed-1b2a6303c1e6 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c4c0c82448e40ba801c0b52ec44e74a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a093d0bf43046aaa845f3cc115f3f5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116157) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:12:21.116848 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: INFO nova.api.openstack.requestlog [None req-0398f1c5-36e6-49e7-80ed-1b2a6303c1e6 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] 10.222.0.18 "GET /compute/v2.1/servers/fa7c86bc-c46f-4120-8f3d-d795f8d7c5cc" status: 200 len: 1570 microversion: 2.1 time: 0.148180 Dec 15 03:12:21.117401 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: [pid: 116157|app: 0|req: 657/1315] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 03:12:20 2021] GET /compute/v2.1/servers/fa7c86bc-c46f-4120-8f3d-d795f8d7c5cc => generated 1570 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 03:12:21.137742 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: INFO nova.api.openstack.requestlog [None req-8330e0fa-e733-4926-bd99-aedd4dba2812 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] 10.222.0.18 "GET /compute/v2.1/servers/b89094ac-aee1-4bd6-a33d-8c4347cebfc7/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.040935 Dec 15 03:12:21.138307 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: [pid: 116156|app: 0|req: 659/1316] 10.222.0.18 () {60 vars in 1342 bytes} [Wed Dec 15 03:12:21 2021] GET /compute/v2.1/servers/b89094ac-aee1-4bd6-a33d-8c4347cebfc7/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Dec 15 03:12:21.997614 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi [None req-910c7dd2-0fbe-4378-8184-4b2581cd69bb tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Calling method '>' {{(pid=116157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:12:21.998241 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.compute.api [None req-910c7dd2-0fbe-4378-8184-4b2581cd69bb tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] [instance: bbb8462c-9501-4541-b67e-43ec5c5061a7] Fetching instance by UUID {{(pid=116157) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:12:22.004428 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-910c7dd2-0fbe-4378-8184-4b2581cd69bb tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:12:22.004876 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-910c7dd2-0fbe-4378-8184-4b2581cd69bb tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:12:22.005645 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-910c7dd2-0fbe-4378-8184-4b2581cd69bb tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:12:22.006110 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-910c7dd2-0fbe-4378-8184-4b2581cd69bb tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:12:22.063400 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.policy [None req-910c7dd2-0fbe-4378-8184-4b2581cd69bb tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97bdf19af9e34fc3886ff451cb9d7a27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '494b56bf5eae4d56a5591546f85bc32b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116157) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:12:22.070441 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: INFO nova.api.openstack.requestlog [None req-910c7dd2-0fbe-4378-8184-4b2581cd69bb tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] 10.222.0.18 "GET /compute/v2.1/servers/bbb8462c-9501-4541-b67e-43ec5c5061a7" status: 200 len: 1226 microversion: 2.1 time: 0.076446 Dec 15 03:12:22.070990 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: [pid: 116157|app: 0|req: 658/1317] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 03:12:21 2021] GET /compute/v2.1/servers/bbb8462c-9501-4541-b67e-43ec5c5061a7 => generated 1226 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 03:12:22.133674 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi [None req-a74a5179-eb5c-4b10-b3bf-58095a5793b5 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Calling method '>' {{(pid=116156) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:12:22.134296 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.compute.api [None req-a74a5179-eb5c-4b10-b3bf-58095a5793b5 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] [instance: fa7c86bc-c46f-4120-8f3d-d795f8d7c5cc] Fetching instance by UUID {{(pid=116156) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:12:22.140366 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-a74a5179-eb5c-4b10-b3bf-58095a5793b5 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:12:22.140815 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-a74a5179-eb5c-4b10-b3bf-58095a5793b5 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:12:22.141580 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-a74a5179-eb5c-4b10-b3bf-58095a5793b5 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:12:22.142040 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-a74a5179-eb5c-4b10-b3bf-58095a5793b5 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:12:22.149142 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi [None req-8887c42c-8254-4159-84a1-5516671ecd75 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Calling method '>' {{(pid=116157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:12:22.150039 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.compute.api [None req-8887c42c-8254-4159-84a1-5516671ecd75 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] [instance: b89094ac-aee1-4bd6-a33d-8c4347cebfc7] Fetching instance by UUID {{(pid=116157) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:12:22.155830 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-8887c42c-8254-4159-84a1-5516671ecd75 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:12:22.156283 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-8887c42c-8254-4159-84a1-5516671ecd75 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:12:22.157058 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-8887c42c-8254-4159-84a1-5516671ecd75 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:12:22.157489 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-8887c42c-8254-4159-84a1-5516671ecd75 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:12:22.186999 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: INFO nova.api.openstack.requestlog [None req-8887c42c-8254-4159-84a1-5516671ecd75 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] 10.222.0.18 "GET /compute/v2.1/servers/b89094ac-aee1-4bd6-a33d-8c4347cebfc7/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042150 Dec 15 03:12:22.187568 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: [pid: 116157|app: 0|req: 659/1318] 10.222.0.18 () {60 vars in 1342 bytes} [Wed Dec 15 03:12:22 2021] GET /compute/v2.1/servers/b89094ac-aee1-4bd6-a33d-8c4347cebfc7/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Dec 15 03:12:22.272197 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.policy [None req-a74a5179-eb5c-4b10-b3bf-58095a5793b5 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c4c0c82448e40ba801c0b52ec44e74a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a093d0bf43046aaa845f3cc115f3f5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116156) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:12:22.279301 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: INFO nova.api.openstack.requestlog [None req-a74a5179-eb5c-4b10-b3bf-58095a5793b5 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] 10.222.0.18 "GET /compute/v2.1/servers/fa7c86bc-c46f-4120-8f3d-d795f8d7c5cc" status: 200 len: 1570 microversion: 2.1 time: 0.149226 Dec 15 03:12:22.279851 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: [pid: 116156|app: 0|req: 660/1319] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 03:12:22 2021] GET /compute/v2.1/servers/fa7c86bc-c46f-4120-8f3d-d795f8d7c5cc => generated 1570 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 03:12:23.087613 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi [None req-6d1cc991-19cc-4e70-9870-30b50528f1ec tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Calling method '>' {{(pid=116157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:12:23.088337 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.compute.api [None req-6d1cc991-19cc-4e70-9870-30b50528f1ec tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] [instance: bbb8462c-9501-4541-b67e-43ec5c5061a7] Fetching instance by UUID {{(pid=116157) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:12:23.094532 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-6d1cc991-19cc-4e70-9870-30b50528f1ec tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:12:23.094981 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-6d1cc991-19cc-4e70-9870-30b50528f1ec tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:12:23.095761 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-6d1cc991-19cc-4e70-9870-30b50528f1ec tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:12:23.096188 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-6d1cc991-19cc-4e70-9870-30b50528f1ec tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:12:23.158282 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.policy [None req-6d1cc991-19cc-4e70-9870-30b50528f1ec tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97bdf19af9e34fc3886ff451cb9d7a27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '494b56bf5eae4d56a5591546f85bc32b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116157) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:12:23.166254 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: INFO nova.api.openstack.requestlog [None req-6d1cc991-19cc-4e70-9870-30b50528f1ec tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] 10.222.0.18 "GET /compute/v2.1/servers/bbb8462c-9501-4541-b67e-43ec5c5061a7" status: 200 len: 1226 microversion: 2.1 time: 0.082587 Dec 15 03:12:23.166757 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: [pid: 116157|app: 0|req: 660/1320] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 03:12:23 2021] GET /compute/v2.1/servers/bbb8462c-9501-4541-b67e-43ec5c5061a7 => generated 1226 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 03:12:23.199188 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi [None req-b928f982-f9ef-4cb3-b57a-009a49c58ba8 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Calling method '>' {{(pid=116156) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:12:23.200672 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.compute.api [None req-b928f982-f9ef-4cb3-b57a-009a49c58ba8 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] [instance: b89094ac-aee1-4bd6-a33d-8c4347cebfc7] Fetching instance by UUID {{(pid=116156) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:12:23.210625 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-b928f982-f9ef-4cb3-b57a-009a49c58ba8 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:12:23.211186 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-b928f982-f9ef-4cb3-b57a-009a49c58ba8 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:12:23.212069 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-b928f982-f9ef-4cb3-b57a-009a49c58ba8 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:12:23.212580 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-b928f982-f9ef-4cb3-b57a-009a49c58ba8 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:12:23.242798 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: INFO nova.api.openstack.requestlog [None req-b928f982-f9ef-4cb3-b57a-009a49c58ba8 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] 10.222.0.18 "GET /compute/v2.1/servers/b89094ac-aee1-4bd6-a33d-8c4347cebfc7/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047901 Dec 15 03:12:23.243351 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: [pid: 116156|app: 0|req: 661/1321] 10.222.0.18 () {60 vars in 1342 bytes} [Wed Dec 15 03:12:23 2021] GET /compute/v2.1/servers/b89094ac-aee1-4bd6-a33d-8c4347cebfc7/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 03:12:23.296364 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi [None req-512b645b-991b-418f-8d5c-0998a0af3e0d tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Calling method '>' {{(pid=116157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:12:23.296971 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.compute.api [None req-512b645b-991b-418f-8d5c-0998a0af3e0d tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] [instance: fa7c86bc-c46f-4120-8f3d-d795f8d7c5cc] Fetching instance by UUID {{(pid=116157) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:12:23.302649 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-512b645b-991b-418f-8d5c-0998a0af3e0d tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:12:23.303100 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-512b645b-991b-418f-8d5c-0998a0af3e0d tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:12:23.303873 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-512b645b-991b-418f-8d5c-0998a0af3e0d tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:12:23.304310 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-512b645b-991b-418f-8d5c-0998a0af3e0d tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:12:23.439199 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.policy [None req-512b645b-991b-418f-8d5c-0998a0af3e0d tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c4c0c82448e40ba801c0b52ec44e74a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a093d0bf43046aaa845f3cc115f3f5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116157) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:12:23.447056 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: INFO nova.api.openstack.requestlog [None req-512b645b-991b-418f-8d5c-0998a0af3e0d tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] 10.222.0.18 "GET /compute/v2.1/servers/fa7c86bc-c46f-4120-8f3d-d795f8d7c5cc" status: 200 len: 1570 microversion: 2.1 time: 0.154300 Dec 15 03:12:23.447611 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: [pid: 116157|app: 0|req: 661/1322] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 03:12:23 2021] GET /compute/v2.1/servers/fa7c86bc-c46f-4120-8f3d-d795f8d7c5cc => generated 1570 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 03:12:24.182603 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi [None req-6c49ba16-86e0-42b1-b0fe-a06642c9b395 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Calling method '>' {{(pid=116156) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:12:24.183210 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.compute.api [None req-6c49ba16-86e0-42b1-b0fe-a06642c9b395 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] [instance: bbb8462c-9501-4541-b67e-43ec5c5061a7] Fetching instance by UUID {{(pid=116156) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:12:24.189004 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-6c49ba16-86e0-42b1-b0fe-a06642c9b395 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:12:24.189459 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-6c49ba16-86e0-42b1-b0fe-a06642c9b395 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:12:24.190269 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-6c49ba16-86e0-42b1-b0fe-a06642c9b395 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:12:24.190703 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-6c49ba16-86e0-42b1-b0fe-a06642c9b395 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:12:24.249528 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.policy [None req-6c49ba16-86e0-42b1-b0fe-a06642c9b395 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97bdf19af9e34fc3886ff451cb9d7a27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '494b56bf5eae4d56a5591546f85bc32b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116156) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:12:24.255059 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi [None req-13d7e49a-1370-43a0-9b17-d57294005a26 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Calling method '>' {{(pid=116157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:12:24.255962 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.compute.api [None req-13d7e49a-1370-43a0-9b17-d57294005a26 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] [instance: b89094ac-aee1-4bd6-a33d-8c4347cebfc7] Fetching instance by UUID {{(pid=116157) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:12:24.256855 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: INFO nova.api.openstack.requestlog [None req-6c49ba16-86e0-42b1-b0fe-a06642c9b395 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] 10.222.0.18 "GET /compute/v2.1/servers/bbb8462c-9501-4541-b67e-43ec5c5061a7" status: 200 len: 1226 microversion: 2.1 time: 0.077897 Dec 15 03:12:24.257448 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: [pid: 116156|app: 0|req: 662/1323] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 03:12:24 2021] GET /compute/v2.1/servers/bbb8462c-9501-4541-b67e-43ec5c5061a7 => generated 1226 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 03:12:24.262228 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-13d7e49a-1370-43a0-9b17-d57294005a26 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:12:24.262675 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-13d7e49a-1370-43a0-9b17-d57294005a26 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:12:24.263450 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-13d7e49a-1370-43a0-9b17-d57294005a26 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:12:24.263880 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-13d7e49a-1370-43a0-9b17-d57294005a26 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:12:24.291924 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: INFO nova.api.openstack.requestlog [None req-13d7e49a-1370-43a0-9b17-d57294005a26 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] 10.222.0.18 "GET /compute/v2.1/servers/b89094ac-aee1-4bd6-a33d-8c4347cebfc7/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.040626 Dec 15 03:12:24.292460 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: [pid: 116157|app: 0|req: 662/1324] 10.222.0.18 () {60 vars in 1342 bytes} [Wed Dec 15 03:12:24 2021] GET /compute/v2.1/servers/b89094ac-aee1-4bd6-a33d-8c4347cebfc7/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 03:12:24.463458 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi [None req-93743a06-f1b8-425b-ad7c-6cf0956d645b tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Calling method '>' {{(pid=116156) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:12:24.463996 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.compute.api [None req-93743a06-f1b8-425b-ad7c-6cf0956d645b tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] [instance: fa7c86bc-c46f-4120-8f3d-d795f8d7c5cc] Fetching instance by UUID {{(pid=116156) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:12:24.469826 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-93743a06-f1b8-425b-ad7c-6cf0956d645b tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:12:24.470309 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-93743a06-f1b8-425b-ad7c-6cf0956d645b tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:12:24.471082 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-93743a06-f1b8-425b-ad7c-6cf0956d645b tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:12:24.471516 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-93743a06-f1b8-425b-ad7c-6cf0956d645b tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:12:24.608343 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.policy [None req-93743a06-f1b8-425b-ad7c-6cf0956d645b tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c4c0c82448e40ba801c0b52ec44e74a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a093d0bf43046aaa845f3cc115f3f5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116156) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:12:24.610611 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: INFO nova.api.openstack.requestlog [None req-93743a06-f1b8-425b-ad7c-6cf0956d645b tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] 10.222.0.18 "GET /compute/v2.1/servers/fa7c86bc-c46f-4120-8f3d-d795f8d7c5cc" status: 200 len: 1570 microversion: 2.1 time: 0.150753 Dec 15 03:12:24.611170 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: [pid: 116156|app: 0|req: 663/1325] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 03:12:24 2021] GET /compute/v2.1/servers/fa7c86bc-c46f-4120-8f3d-d795f8d7c5cc => generated 1570 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 03:12:25.273559 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi [None req-b4576988-3aef-49f2-9a44-32b12912ff45 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Calling method '>' {{(pid=116157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:12:25.274206 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.compute.api [None req-b4576988-3aef-49f2-9a44-32b12912ff45 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] [instance: bbb8462c-9501-4541-b67e-43ec5c5061a7] Fetching instance by UUID {{(pid=116157) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:12:25.280409 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-b4576988-3aef-49f2-9a44-32b12912ff45 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:12:25.280862 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-b4576988-3aef-49f2-9a44-32b12912ff45 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:12:25.281645 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-b4576988-3aef-49f2-9a44-32b12912ff45 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:12:25.282113 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-b4576988-3aef-49f2-9a44-32b12912ff45 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:12:25.303361 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi [None req-6e9b7154-df39-4dbe-aa4f-5907bcfb0326 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Calling method '>' {{(pid=116156) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:12:25.304260 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.compute.api [None req-6e9b7154-df39-4dbe-aa4f-5907bcfb0326 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] [instance: b89094ac-aee1-4bd6-a33d-8c4347cebfc7] Fetching instance by UUID {{(pid=116156) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:12:25.310322 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-6e9b7154-df39-4dbe-aa4f-5907bcfb0326 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:12:25.310774 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-6e9b7154-df39-4dbe-aa4f-5907bcfb0326 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:12:25.311547 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-6e9b7154-df39-4dbe-aa4f-5907bcfb0326 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:12:25.311981 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-6e9b7154-df39-4dbe-aa4f-5907bcfb0326 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:12:25.340603 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.policy [None req-b4576988-3aef-49f2-9a44-32b12912ff45 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97bdf19af9e34fc3886ff451cb9d7a27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '494b56bf5eae4d56a5591546f85bc32b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116157) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:12:25.340937 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: INFO nova.api.openstack.requestlog [None req-6e9b7154-df39-4dbe-aa4f-5907bcfb0326 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] 10.222.0.18 "GET /compute/v2.1/servers/b89094ac-aee1-4bd6-a33d-8c4347cebfc7/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041358 Dec 15 03:12:25.341492 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: [pid: 116156|app: 0|req: 664/1326] 10.222.0.18 () {60 vars in 1342 bytes} [Wed Dec 15 03:12:25 2021] GET /compute/v2.1/servers/b89094ac-aee1-4bd6-a33d-8c4347cebfc7/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Dec 15 03:12:25.348069 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: INFO nova.api.openstack.requestlog [None req-b4576988-3aef-49f2-9a44-32b12912ff45 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] 10.222.0.18 "GET /compute/v2.1/servers/bbb8462c-9501-4541-b67e-43ec5c5061a7" status: 200 len: 1226 microversion: 2.1 time: 0.078607 Dec 15 03:12:25.348621 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: [pid: 116157|app: 0|req: 663/1327] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 03:12:25 2021] GET /compute/v2.1/servers/bbb8462c-9501-4541-b67e-43ec5c5061a7 => generated 1226 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 03:12:25.627541 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi [None req-8e95d91c-6745-4bb8-8a06-d376249c9b2a tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Calling method '>' {{(pid=116156) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:12:25.628146 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.compute.api [None req-8e95d91c-6745-4bb8-8a06-d376249c9b2a tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] [instance: fa7c86bc-c46f-4120-8f3d-d795f8d7c5cc] Fetching instance by UUID {{(pid=116156) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:12:25.634406 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-8e95d91c-6745-4bb8-8a06-d376249c9b2a tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:12:25.634854 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-8e95d91c-6745-4bb8-8a06-d376249c9b2a tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:12:25.635618 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-8e95d91c-6745-4bb8-8a06-d376249c9b2a tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:12:25.636048 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-8e95d91c-6745-4bb8-8a06-d376249c9b2a tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:12:25.767950 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.policy [None req-8e95d91c-6745-4bb8-8a06-d376249c9b2a tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c4c0c82448e40ba801c0b52ec44e74a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a093d0bf43046aaa845f3cc115f3f5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116156) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:12:25.775799 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: INFO nova.api.openstack.requestlog [None req-8e95d91c-6745-4bb8-8a06-d376249c9b2a tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] 10.222.0.18 "GET /compute/v2.1/servers/fa7c86bc-c46f-4120-8f3d-d795f8d7c5cc" status: 200 len: 1570 microversion: 2.1 time: 0.151855 Dec 15 03:12:25.776355 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: [pid: 116156|app: 0|req: 665/1328] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 03:12:25 2021] GET /compute/v2.1/servers/fa7c86bc-c46f-4120-8f3d-d795f8d7c5cc => generated 1570 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 03:12:26.352538 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi [None req-4383ee02-9004-48da-91d2-30c14b0d14c0 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Calling method '>' {{(pid=116157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:12:26.353464 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.compute.api [None req-4383ee02-9004-48da-91d2-30c14b0d14c0 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] [instance: b89094ac-aee1-4bd6-a33d-8c4347cebfc7] Fetching instance by UUID {{(pid=116157) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:12:26.359647 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-4383ee02-9004-48da-91d2-30c14b0d14c0 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:12:26.360092 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-4383ee02-9004-48da-91d2-30c14b0d14c0 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:12:26.360861 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-4383ee02-9004-48da-91d2-30c14b0d14c0 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:12:26.361293 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-4383ee02-9004-48da-91d2-30c14b0d14c0 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:12:26.365044 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi [None req-a420178a-5ca1-4bba-8d5e-ac33ee8506d5 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Calling method '>' {{(pid=116156) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:12:26.365691 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.compute.api [None req-a420178a-5ca1-4bba-8d5e-ac33ee8506d5 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] [instance: bbb8462c-9501-4541-b67e-43ec5c5061a7] Fetching instance by UUID {{(pid=116156) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:12:26.371815 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-a420178a-5ca1-4bba-8d5e-ac33ee8506d5 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:12:26.372265 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-a420178a-5ca1-4bba-8d5e-ac33ee8506d5 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:12:26.373053 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-a420178a-5ca1-4bba-8d5e-ac33ee8506d5 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:12:26.373497 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-a420178a-5ca1-4bba-8d5e-ac33ee8506d5 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:12:26.390341 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: INFO nova.api.openstack.requestlog [None req-4383ee02-9004-48da-91d2-30c14b0d14c0 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] 10.222.0.18 "GET /compute/v2.1/servers/b89094ac-aee1-4bd6-a33d-8c4347cebfc7/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042023 Dec 15 03:12:26.390887 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: [pid: 116157|app: 0|req: 664/1329] 10.222.0.18 () {60 vars in 1342 bytes} [Wed Dec 15 03:12:26 2021] GET /compute/v2.1/servers/b89094ac-aee1-4bd6-a33d-8c4347cebfc7/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 03:12:26.431014 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.policy [None req-a420178a-5ca1-4bba-8d5e-ac33ee8506d5 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97bdf19af9e34fc3886ff451cb9d7a27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '494b56bf5eae4d56a5591546f85bc32b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116156) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:12:26.438059 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: INFO nova.api.openstack.requestlog [None req-a420178a-5ca1-4bba-8d5e-ac33ee8506d5 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] 10.222.0.18 "GET /compute/v2.1/servers/bbb8462c-9501-4541-b67e-43ec5c5061a7" status: 200 len: 1226 microversion: 2.1 time: 0.077465 Dec 15 03:12:26.438617 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: [pid: 116156|app: 0|req: 666/1330] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 03:12:26 2021] GET /compute/v2.1/servers/bbb8462c-9501-4541-b67e-43ec5c5061a7 => generated 1226 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 03:12:26.792412 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi [None req-07f175d5-c724-4e46-a535-96d8cb2e4745 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Calling method '>' {{(pid=116157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:12:26.792966 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.compute.api [None req-07f175d5-c724-4e46-a535-96d8cb2e4745 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] [instance: fa7c86bc-c46f-4120-8f3d-d795f8d7c5cc] Fetching instance by UUID {{(pid=116157) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:12:26.798803 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-07f175d5-c724-4e46-a535-96d8cb2e4745 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:12:26.799254 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-07f175d5-c724-4e46-a535-96d8cb2e4745 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:12:26.800026 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-07f175d5-c724-4e46-a535-96d8cb2e4745 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:12:26.800462 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-07f175d5-c724-4e46-a535-96d8cb2e4745 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:12:26.930243 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.policy [None req-07f175d5-c724-4e46-a535-96d8cb2e4745 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c4c0c82448e40ba801c0b52ec44e74a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a093d0bf43046aaa845f3cc115f3f5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116157) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:12:26.937405 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: INFO nova.api.openstack.requestlog [None req-07f175d5-c724-4e46-a535-96d8cb2e4745 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] 10.222.0.18 "GET /compute/v2.1/servers/fa7c86bc-c46f-4120-8f3d-d795f8d7c5cc" status: 200 len: 1570 microversion: 2.1 time: 0.148740 Dec 15 03:12:26.937960 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: [pid: 116157|app: 0|req: 665/1331] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 03:12:26 2021] GET /compute/v2.1/servers/fa7c86bc-c46f-4120-8f3d-d795f8d7c5cc => generated 1570 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 03:12:27.402467 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi [None req-32735664-5662-4a0a-bfd2-ea90ff60a665 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Calling method '>' {{(pid=116156) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:12:27.403366 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.compute.api [None req-32735664-5662-4a0a-bfd2-ea90ff60a665 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] [instance: b89094ac-aee1-4bd6-a33d-8c4347cebfc7] Fetching instance by UUID {{(pid=116156) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:12:27.409494 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-32735664-5662-4a0a-bfd2-ea90ff60a665 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:12:27.409939 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-32735664-5662-4a0a-bfd2-ea90ff60a665 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:12:27.410743 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-32735664-5662-4a0a-bfd2-ea90ff60a665 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:12:27.411208 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-32735664-5662-4a0a-bfd2-ea90ff60a665 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:12:27.439041 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: INFO nova.api.openstack.requestlog [None req-32735664-5662-4a0a-bfd2-ea90ff60a665 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] 10.222.0.18 "GET /compute/v2.1/servers/b89094ac-aee1-4bd6-a33d-8c4347cebfc7/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.040629 Dec 15 03:12:27.439575 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: [pid: 116156|app: 0|req: 667/1332] 10.222.0.18 () {60 vars in 1342 bytes} [Wed Dec 15 03:12:27 2021] GET /compute/v2.1/servers/b89094ac-aee1-4bd6-a33d-8c4347cebfc7/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 03:12:27.455328 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi [None req-94f66c0f-4cb5-4038-8b0f-391a3e422605 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Calling method '>' {{(pid=116157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:12:27.455870 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.compute.api [None req-94f66c0f-4cb5-4038-8b0f-391a3e422605 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] [instance: bbb8462c-9501-4541-b67e-43ec5c5061a7] Fetching instance by UUID {{(pid=116157) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:12:27.462593 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-94f66c0f-4cb5-4038-8b0f-391a3e422605 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:12:27.463037 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-94f66c0f-4cb5-4038-8b0f-391a3e422605 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:12:27.463834 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-94f66c0f-4cb5-4038-8b0f-391a3e422605 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:12:27.464267 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-94f66c0f-4cb5-4038-8b0f-391a3e422605 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:12:27.521950 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.policy [None req-94f66c0f-4cb5-4038-8b0f-391a3e422605 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97bdf19af9e34fc3886ff451cb9d7a27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '494b56bf5eae4d56a5591546f85bc32b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116157) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:12:27.529041 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: INFO nova.api.openstack.requestlog [None req-94f66c0f-4cb5-4038-8b0f-391a3e422605 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] 10.222.0.18 "GET /compute/v2.1/servers/bbb8462c-9501-4541-b67e-43ec5c5061a7" status: 200 len: 1226 microversion: 2.1 time: 0.077363 Dec 15 03:12:27.529590 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: [pid: 116157|app: 0|req: 666/1333] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 03:12:27 2021] GET /compute/v2.1/servers/bbb8462c-9501-4541-b67e-43ec5c5061a7 => generated 1226 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 03:12:27.953816 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi [None req-de336c5b-2673-4a05-b748-dd58fcc15b13 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Calling method '>' {{(pid=116156) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:12:27.954445 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.compute.api [None req-de336c5b-2673-4a05-b748-dd58fcc15b13 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] [instance: fa7c86bc-c46f-4120-8f3d-d795f8d7c5cc] Fetching instance by UUID {{(pid=116156) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:12:27.960760 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-de336c5b-2673-4a05-b748-dd58fcc15b13 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:12:27.961206 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-de336c5b-2673-4a05-b748-dd58fcc15b13 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:12:27.961966 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-de336c5b-2673-4a05-b748-dd58fcc15b13 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:12:27.962419 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-de336c5b-2673-4a05-b748-dd58fcc15b13 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:12:28.092772 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.policy [None req-de336c5b-2673-4a05-b748-dd58fcc15b13 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c4c0c82448e40ba801c0b52ec44e74a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a093d0bf43046aaa845f3cc115f3f5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116156) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:12:28.100016 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: INFO nova.api.openstack.requestlog [None req-de336c5b-2673-4a05-b748-dd58fcc15b13 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] 10.222.0.18 "GET /compute/v2.1/servers/fa7c86bc-c46f-4120-8f3d-d795f8d7c5cc" status: 200 len: 1570 microversion: 2.1 time: 0.149796 Dec 15 03:12:28.101381 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: [pid: 116156|app: 0|req: 668/1334] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 03:12:27 2021] GET /compute/v2.1/servers/fa7c86bc-c46f-4120-8f3d-d795f8d7c5cc => generated 1570 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 03:12:28.451002 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi [None req-0c8048a5-54d5-4cbd-9076-0f414e7db330 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Calling method '>' {{(pid=116157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:12:28.451902 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.compute.api [None req-0c8048a5-54d5-4cbd-9076-0f414e7db330 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] [instance: b89094ac-aee1-4bd6-a33d-8c4347cebfc7] Fetching instance by UUID {{(pid=116157) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:12:28.457632 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-0c8048a5-54d5-4cbd-9076-0f414e7db330 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:12:28.458413 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-0c8048a5-54d5-4cbd-9076-0f414e7db330 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:12:28.459013 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-0c8048a5-54d5-4cbd-9076-0f414e7db330 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:12:28.459658 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-0c8048a5-54d5-4cbd-9076-0f414e7db330 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:12:28.489751 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: INFO nova.api.openstack.requestlog [None req-0c8048a5-54d5-4cbd-9076-0f414e7db330 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] 10.222.0.18 "GET /compute/v2.1/servers/b89094ac-aee1-4bd6-a33d-8c4347cebfc7/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042168 Dec 15 03:12:28.490332 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: [pid: 116157|app: 0|req: 667/1335] 10.222.0.18 () {60 vars in 1342 bytes} [Wed Dec 15 03:12:28 2021] GET /compute/v2.1/servers/b89094ac-aee1-4bd6-a33d-8c4347cebfc7/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 03:12:28.546026 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi [None req-0b74d8cd-a1c6-4408-9c00-04b6c4c32126 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Calling method '>' {{(pid=116156) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:12:28.546634 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.compute.api [None req-0b74d8cd-a1c6-4408-9c00-04b6c4c32126 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] [instance: bbb8462c-9501-4541-b67e-43ec5c5061a7] Fetching instance by UUID {{(pid=116156) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:12:28.553440 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-0b74d8cd-a1c6-4408-9c00-04b6c4c32126 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:12:28.553886 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-0b74d8cd-a1c6-4408-9c00-04b6c4c32126 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:12:28.554680 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-0b74d8cd-a1c6-4408-9c00-04b6c4c32126 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:12:28.555133 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-0b74d8cd-a1c6-4408-9c00-04b6c4c32126 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:12:28.616927 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.policy [None req-0b74d8cd-a1c6-4408-9c00-04b6c4c32126 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97bdf19af9e34fc3886ff451cb9d7a27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '494b56bf5eae4d56a5591546f85bc32b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116156) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:12:28.624278 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: INFO nova.api.openstack.requestlog [None req-0b74d8cd-a1c6-4408-9c00-04b6c4c32126 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] 10.222.0.18 "GET /compute/v2.1/servers/bbb8462c-9501-4541-b67e-43ec5c5061a7" status: 200 len: 1226 microversion: 2.1 time: 0.081745 Dec 15 03:12:28.624847 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: [pid: 116156|app: 0|req: 669/1336] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 03:12:28 2021] GET /compute/v2.1/servers/bbb8462c-9501-4541-b67e-43ec5c5061a7 => generated 1226 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 03:12:29.117819 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi [None req-d3fa11c7-d008-4fa4-947f-6c0082365935 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Calling method '>' {{(pid=116157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:12:29.118466 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.compute.api [None req-d3fa11c7-d008-4fa4-947f-6c0082365935 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] [instance: fa7c86bc-c46f-4120-8f3d-d795f8d7c5cc] Fetching instance by UUID {{(pid=116157) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:12:29.124304 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-d3fa11c7-d008-4fa4-947f-6c0082365935 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:12:29.124760 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-d3fa11c7-d008-4fa4-947f-6c0082365935 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:12:29.125540 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-d3fa11c7-d008-4fa4-947f-6c0082365935 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:12:29.126001 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-d3fa11c7-d008-4fa4-947f-6c0082365935 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:12:29.256031 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.policy [None req-d3fa11c7-d008-4fa4-947f-6c0082365935 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c4c0c82448e40ba801c0b52ec44e74a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a093d0bf43046aaa845f3cc115f3f5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116157) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:12:29.264068 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: INFO nova.api.openstack.requestlog [None req-d3fa11c7-d008-4fa4-947f-6c0082365935 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] 10.222.0.18 "GET /compute/v2.1/servers/fa7c86bc-c46f-4120-8f3d-d795f8d7c5cc" status: 200 len: 1570 microversion: 2.1 time: 0.149973 Dec 15 03:12:29.264630 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: [pid: 116157|app: 0|req: 668/1337] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 03:12:29 2021] GET /compute/v2.1/servers/fa7c86bc-c46f-4120-8f3d-d795f8d7c5cc => generated 1570 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 03:12:29.501165 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi [None req-94f97709-6d17-4533-b503-5d034cd8e74e tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Calling method '>' {{(pid=116156) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:12:29.501991 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.compute.api [None req-94f97709-6d17-4533-b503-5d034cd8e74e tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] [instance: b89094ac-aee1-4bd6-a33d-8c4347cebfc7] Fetching instance by UUID {{(pid=116156) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:12:29.508245 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-94f97709-6d17-4533-b503-5d034cd8e74e tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:12:29.508698 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-94f97709-6d17-4533-b503-5d034cd8e74e tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:12:29.509471 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-94f97709-6d17-4533-b503-5d034cd8e74e tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:12:29.509906 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-94f97709-6d17-4533-b503-5d034cd8e74e tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:12:29.537880 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: INFO nova.api.openstack.requestlog [None req-94f97709-6d17-4533-b503-5d034cd8e74e tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] 10.222.0.18 "GET /compute/v2.1/servers/b89094ac-aee1-4bd6-a33d-8c4347cebfc7/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.040518 Dec 15 03:12:29.538463 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: [pid: 116156|app: 0|req: 670/1338] 10.222.0.18 () {60 vars in 1342 bytes} [Wed Dec 15 03:12:29 2021] GET /compute/v2.1/servers/b89094ac-aee1-4bd6-a33d-8c4347cebfc7/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 03:12:29.640355 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi [None req-164cab3a-c6de-4d8f-8a0c-961d8768fdf6 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Calling method '>' {{(pid=116157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:12:29.640973 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.compute.api [None req-164cab3a-c6de-4d8f-8a0c-961d8768fdf6 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] [instance: bbb8462c-9501-4541-b67e-43ec5c5061a7] Fetching instance by UUID {{(pid=116157) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:12:29.647221 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-164cab3a-c6de-4d8f-8a0c-961d8768fdf6 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:12:29.647674 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-164cab3a-c6de-4d8f-8a0c-961d8768fdf6 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:12:29.648456 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-164cab3a-c6de-4d8f-8a0c-961d8768fdf6 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:12:29.648895 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-164cab3a-c6de-4d8f-8a0c-961d8768fdf6 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:12:29.706464 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.policy [None req-164cab3a-c6de-4d8f-8a0c-961d8768fdf6 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97bdf19af9e34fc3886ff451cb9d7a27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '494b56bf5eae4d56a5591546f85bc32b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116157) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:12:29.713613 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: INFO nova.api.openstack.requestlog [None req-164cab3a-c6de-4d8f-8a0c-961d8768fdf6 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] 10.222.0.18 "GET /compute/v2.1/servers/bbb8462c-9501-4541-b67e-43ec5c5061a7" status: 200 len: 1226 microversion: 2.1 time: 0.076957 Dec 15 03:12:29.714213 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: [pid: 116157|app: 0|req: 669/1339] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 03:12:29 2021] GET /compute/v2.1/servers/bbb8462c-9501-4541-b67e-43ec5c5061a7 => generated 1226 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 03:12:30.281443 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi [None req-263d424b-8feb-4ae6-86e5-8b4b9480ce47 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Calling method '>' {{(pid=116156) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:12:30.282079 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.compute.api [None req-263d424b-8feb-4ae6-86e5-8b4b9480ce47 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] [instance: fa7c86bc-c46f-4120-8f3d-d795f8d7c5cc] Fetching instance by UUID {{(pid=116156) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:12:30.288864 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-263d424b-8feb-4ae6-86e5-8b4b9480ce47 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:12:30.289313 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-263d424b-8feb-4ae6-86e5-8b4b9480ce47 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:12:30.290111 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-263d424b-8feb-4ae6-86e5-8b4b9480ce47 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:12:30.290549 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-263d424b-8feb-4ae6-86e5-8b4b9480ce47 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:12:30.417723 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.policy [None req-263d424b-8feb-4ae6-86e5-8b4b9480ce47 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c4c0c82448e40ba801c0b52ec44e74a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a093d0bf43046aaa845f3cc115f3f5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116156) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:12:30.425140 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: INFO nova.api.openstack.requestlog [None req-263d424b-8feb-4ae6-86e5-8b4b9480ce47 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] 10.222.0.18 "GET /compute/v2.1/servers/fa7c86bc-c46f-4120-8f3d-d795f8d7c5cc" status: 200 len: 1570 microversion: 2.1 time: 0.147293 Dec 15 03:12:30.425701 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: [pid: 116156|app: 0|req: 671/1340] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 03:12:30 2021] GET /compute/v2.1/servers/fa7c86bc-c46f-4120-8f3d-d795f8d7c5cc => generated 1570 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 03:12:30.549333 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi [None req-b82c416a-8b78-4458-8523-727ef413fcea tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Calling method '>' {{(pid=116157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:12:30.550263 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.compute.api [None req-b82c416a-8b78-4458-8523-727ef413fcea tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] [instance: b89094ac-aee1-4bd6-a33d-8c4347cebfc7] Fetching instance by UUID {{(pid=116157) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:12:30.556043 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-b82c416a-8b78-4458-8523-727ef413fcea tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:12:30.556489 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-b82c416a-8b78-4458-8523-727ef413fcea tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:12:30.557267 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-b82c416a-8b78-4458-8523-727ef413fcea tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:12:30.557705 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-b82c416a-8b78-4458-8523-727ef413fcea tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:12:30.585706 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: INFO nova.api.openstack.requestlog [None req-b82c416a-8b78-4458-8523-727ef413fcea tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] 10.222.0.18 "GET /compute/v2.1/servers/b89094ac-aee1-4bd6-a33d-8c4347cebfc7/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.040320 Dec 15 03:12:30.586507 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: [pid: 116157|app: 0|req: 670/1341] 10.222.0.18 () {60 vars in 1342 bytes} [Wed Dec 15 03:12:30 2021] GET /compute/v2.1/servers/b89094ac-aee1-4bd6-a33d-8c4347cebfc7/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 03:12:30.730650 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi [None req-d8b06fe0-2238-4355-8e2f-bfadb5de8024 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Calling method '>' {{(pid=116156) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:12:30.731237 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.compute.api [None req-d8b06fe0-2238-4355-8e2f-bfadb5de8024 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] [instance: bbb8462c-9501-4541-b67e-43ec5c5061a7] Fetching instance by UUID {{(pid=116156) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:12:30.736986 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-d8b06fe0-2238-4355-8e2f-bfadb5de8024 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:12:30.737690 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-d8b06fe0-2238-4355-8e2f-bfadb5de8024 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:12:30.738480 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-d8b06fe0-2238-4355-8e2f-bfadb5de8024 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:12:30.738916 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-d8b06fe0-2238-4355-8e2f-bfadb5de8024 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:12:30.796149 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.policy [None req-d8b06fe0-2238-4355-8e2f-bfadb5de8024 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97bdf19af9e34fc3886ff451cb9d7a27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '494b56bf5eae4d56a5591546f85bc32b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116156) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:12:30.803319 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: INFO nova.api.openstack.requestlog [None req-d8b06fe0-2238-4355-8e2f-bfadb5de8024 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] 10.222.0.18 "GET /compute/v2.1/servers/bbb8462c-9501-4541-b67e-43ec5c5061a7" status: 200 len: 1226 microversion: 2.1 time: 0.076224 Dec 15 03:12:30.803788 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: [pid: 116156|app: 0|req: 672/1342] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 03:12:30 2021] GET /compute/v2.1/servers/bbb8462c-9501-4541-b67e-43ec5c5061a7 => generated 1226 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 03:12:31.441376 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi [None req-f386c0ce-a0d7-4868-b340-bb993d52b005 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Calling method '>' {{(pid=116157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:12:31.441945 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.compute.api [None req-f386c0ce-a0d7-4868-b340-bb993d52b005 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] [instance: fa7c86bc-c46f-4120-8f3d-d795f8d7c5cc] Fetching instance by UUID {{(pid=116157) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:12:31.448388 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-f386c0ce-a0d7-4868-b340-bb993d52b005 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:12:31.448834 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-f386c0ce-a0d7-4868-b340-bb993d52b005 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:12:31.449604 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-f386c0ce-a0d7-4868-b340-bb993d52b005 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:12:31.450063 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-f386c0ce-a0d7-4868-b340-bb993d52b005 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:12:31.579365 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.policy [None req-f386c0ce-a0d7-4868-b340-bb993d52b005 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c4c0c82448e40ba801c0b52ec44e74a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a093d0bf43046aaa845f3cc115f3f5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116157) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:12:31.586600 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: INFO nova.api.openstack.requestlog [None req-f386c0ce-a0d7-4868-b340-bb993d52b005 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] 10.222.0.18 "GET /compute/v2.1/servers/fa7c86bc-c46f-4120-8f3d-d795f8d7c5cc" status: 200 len: 1570 microversion: 2.1 time: 0.148928 Dec 15 03:12:31.587167 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: [pid: 116157|app: 0|req: 671/1343] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 03:12:31 2021] GET /compute/v2.1/servers/fa7c86bc-c46f-4120-8f3d-d795f8d7c5cc => generated 1570 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 03:12:31.596427 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi [None req-cc9a5d19-ae41-47c7-b56e-b79f0ae9ceb6 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Calling method '>' {{(pid=116156) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:12:31.597365 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.compute.api [None req-cc9a5d19-ae41-47c7-b56e-b79f0ae9ceb6 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] [instance: b89094ac-aee1-4bd6-a33d-8c4347cebfc7] Fetching instance by UUID {{(pid=116156) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:12:31.604092 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-cc9a5d19-ae41-47c7-b56e-b79f0ae9ceb6 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:12:31.604544 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-cc9a5d19-ae41-47c7-b56e-b79f0ae9ceb6 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:12:31.605316 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-cc9a5d19-ae41-47c7-b56e-b79f0ae9ceb6 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:12:31.605751 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-cc9a5d19-ae41-47c7-b56e-b79f0ae9ceb6 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:12:31.634164 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: INFO nova.api.openstack.requestlog [None req-cc9a5d19-ae41-47c7-b56e-b79f0ae9ceb6 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] 10.222.0.18 "GET /compute/v2.1/servers/b89094ac-aee1-4bd6-a33d-8c4347cebfc7/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041441 Dec 15 03:12:31.634700 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: [pid: 116156|app: 0|req: 673/1344] 10.222.0.18 () {60 vars in 1342 bytes} [Wed Dec 15 03:12:31 2021] GET /compute/v2.1/servers/b89094ac-aee1-4bd6-a33d-8c4347cebfc7/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 03:12:31.819671 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi [None req-327e626e-cb6b-488e-8fd1-d87245790bb6 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Calling method '>' {{(pid=116157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:12:31.820276 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.compute.api [None req-327e626e-cb6b-488e-8fd1-d87245790bb6 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] [instance: bbb8462c-9501-4541-b67e-43ec5c5061a7] Fetching instance by UUID {{(pid=116157) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:12:31.826093 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-327e626e-cb6b-488e-8fd1-d87245790bb6 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:12:31.826538 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-327e626e-cb6b-488e-8fd1-d87245790bb6 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:12:31.827313 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-327e626e-cb6b-488e-8fd1-d87245790bb6 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:12:31.827742 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-327e626e-cb6b-488e-8fd1-d87245790bb6 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:12:31.884953 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.policy [None req-327e626e-cb6b-488e-8fd1-d87245790bb6 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97bdf19af9e34fc3886ff451cb9d7a27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '494b56bf5eae4d56a5591546f85bc32b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116157) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:12:31.892052 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: INFO nova.api.openstack.requestlog [None req-327e626e-cb6b-488e-8fd1-d87245790bb6 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] 10.222.0.18 "GET /compute/v2.1/servers/bbb8462c-9501-4541-b67e-43ec5c5061a7" status: 200 len: 1226 microversion: 2.1 time: 0.076066 Dec 15 03:12:31.892599 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: [pid: 116157|app: 0|req: 672/1345] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 03:12:31 2021] GET /compute/v2.1/servers/bbb8462c-9501-4541-b67e-43ec5c5061a7 => generated 1226 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 03:12:32.603009 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi [None req-88fa576d-bbb2-447c-8915-0430ff3570fe tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Calling method '>' {{(pid=116156) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:12:32.603651 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.compute.api [None req-88fa576d-bbb2-447c-8915-0430ff3570fe tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] [instance: fa7c86bc-c46f-4120-8f3d-d795f8d7c5cc] Fetching instance by UUID {{(pid=116156) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:12:32.609873 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-88fa576d-bbb2-447c-8915-0430ff3570fe tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:12:32.610346 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-88fa576d-bbb2-447c-8915-0430ff3570fe tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:12:32.611114 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-88fa576d-bbb2-447c-8915-0430ff3570fe tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:12:32.611548 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-88fa576d-bbb2-447c-8915-0430ff3570fe tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:12:32.645040 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi [None req-a48f6cee-1df4-4b6b-9eef-a4463f3cc9f6 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Calling method '>' {{(pid=116157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:12:32.646011 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.compute.api [None req-a48f6cee-1df4-4b6b-9eef-a4463f3cc9f6 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] [instance: b89094ac-aee1-4bd6-a33d-8c4347cebfc7] Fetching instance by UUID {{(pid=116157) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:12:32.652241 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-a48f6cee-1df4-4b6b-9eef-a4463f3cc9f6 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:12:32.652748 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-a48f6cee-1df4-4b6b-9eef-a4463f3cc9f6 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:12:32.653533 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-a48f6cee-1df4-4b6b-9eef-a4463f3cc9f6 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:12:32.653960 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-a48f6cee-1df4-4b6b-9eef-a4463f3cc9f6 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:12:32.682441 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: INFO nova.api.openstack.requestlog [None req-a48f6cee-1df4-4b6b-9eef-a4463f3cc9f6 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] 10.222.0.18 "GET /compute/v2.1/servers/b89094ac-aee1-4bd6-a33d-8c4347cebfc7/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041043 Dec 15 03:12:32.682998 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: [pid: 116157|app: 0|req: 673/1346] 10.222.0.18 () {60 vars in 1342 bytes} [Wed Dec 15 03:12:32 2021] GET /compute/v2.1/servers/b89094ac-aee1-4bd6-a33d-8c4347cebfc7/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Dec 15 03:12:32.744324 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.policy [None req-88fa576d-bbb2-447c-8915-0430ff3570fe tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c4c0c82448e40ba801c0b52ec44e74a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a093d0bf43046aaa845f3cc115f3f5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116156) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:12:32.751517 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: INFO nova.api.openstack.requestlog [None req-88fa576d-bbb2-447c-8915-0430ff3570fe tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] 10.222.0.18 "GET /compute/v2.1/servers/fa7c86bc-c46f-4120-8f3d-d795f8d7c5cc" status: 200 len: 1570 microversion: 2.1 time: 0.152107 Dec 15 03:12:32.752076 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: [pid: 116156|app: 0|req: 674/1347] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 03:12:32 2021] GET /compute/v2.1/servers/fa7c86bc-c46f-4120-8f3d-d795f8d7c5cc => generated 1570 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 03:12:32.908253 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi [None req-fac6b974-23d1-4016-8dae-a02d49f94693 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Calling method '>' {{(pid=116157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:12:32.908812 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.compute.api [None req-fac6b974-23d1-4016-8dae-a02d49f94693 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] [instance: bbb8462c-9501-4541-b67e-43ec5c5061a7] Fetching instance by UUID {{(pid=116157) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:12:32.914551 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-fac6b974-23d1-4016-8dae-a02d49f94693 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:12:32.915004 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-fac6b974-23d1-4016-8dae-a02d49f94693 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:12:32.915776 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-fac6b974-23d1-4016-8dae-a02d49f94693 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:12:32.916208 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-fac6b974-23d1-4016-8dae-a02d49f94693 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:12:32.973198 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.policy [None req-fac6b974-23d1-4016-8dae-a02d49f94693 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97bdf19af9e34fc3886ff451cb9d7a27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '494b56bf5eae4d56a5591546f85bc32b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116157) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:12:32.980808 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: INFO nova.api.openstack.requestlog [None req-fac6b974-23d1-4016-8dae-a02d49f94693 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] 10.222.0.18 "GET /compute/v2.1/servers/bbb8462c-9501-4541-b67e-43ec5c5061a7" status: 200 len: 1226 microversion: 2.1 time: 0.076250 Dec 15 03:12:32.981360 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: [pid: 116157|app: 0|req: 674/1348] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 03:12:32 2021] GET /compute/v2.1/servers/bbb8462c-9501-4541-b67e-43ec5c5061a7 => generated 1226 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 03:12:33.692836 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi [None req-ef390078-d581-4b08-92de-fbf3308cc6e8 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Calling method '>' {{(pid=116156) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:12:33.693731 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.compute.api [None req-ef390078-d581-4b08-92de-fbf3308cc6e8 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] [instance: b89094ac-aee1-4bd6-a33d-8c4347cebfc7] Fetching instance by UUID {{(pid=116156) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:12:33.699899 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-ef390078-d581-4b08-92de-fbf3308cc6e8 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:12:33.700345 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-ef390078-d581-4b08-92de-fbf3308cc6e8 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:12:33.701112 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-ef390078-d581-4b08-92de-fbf3308cc6e8 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:12:33.701542 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-ef390078-d581-4b08-92de-fbf3308cc6e8 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:12:33.729884 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: INFO nova.api.openstack.requestlog [None req-ef390078-d581-4b08-92de-fbf3308cc6e8 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] 10.222.0.18 "GET /compute/v2.1/servers/b89094ac-aee1-4bd6-a33d-8c4347cebfc7/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.040841 Dec 15 03:12:33.730447 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: [pid: 116156|app: 0|req: 675/1349] 10.222.0.18 () {60 vars in 1342 bytes} [Wed Dec 15 03:12:33 2021] GET /compute/v2.1/servers/b89094ac-aee1-4bd6-a33d-8c4347cebfc7/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 03:12:33.768718 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi [None req-7a4c3f55-9f37-4728-baec-8d650ccdf541 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Calling method '>' {{(pid=116157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:12:33.769329 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.compute.api [None req-7a4c3f55-9f37-4728-baec-8d650ccdf541 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] [instance: fa7c86bc-c46f-4120-8f3d-d795f8d7c5cc] Fetching instance by UUID {{(pid=116157) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:12:33.776213 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-7a4c3f55-9f37-4728-baec-8d650ccdf541 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:12:33.776662 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-7a4c3f55-9f37-4728-baec-8d650ccdf541 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:12:33.777442 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-7a4c3f55-9f37-4728-baec-8d650ccdf541 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:12:33.777882 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-7a4c3f55-9f37-4728-baec-8d650ccdf541 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:12:33.905464 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.policy [None req-7a4c3f55-9f37-4728-baec-8d650ccdf541 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c4c0c82448e40ba801c0b52ec44e74a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a093d0bf43046aaa845f3cc115f3f5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116157) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:12:33.912670 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: INFO nova.api.openstack.requestlog [None req-7a4c3f55-9f37-4728-baec-8d650ccdf541 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] 10.222.0.18 "GET /compute/v2.1/servers/fa7c86bc-c46f-4120-8f3d-d795f8d7c5cc" status: 200 len: 1570 microversion: 2.1 time: 0.147564 Dec 15 03:12:33.913228 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: [pid: 116157|app: 0|req: 675/1350] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 03:12:33 2021] GET /compute/v2.1/servers/fa7c86bc-c46f-4120-8f3d-d795f8d7c5cc => generated 1570 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 03:12:33.997634 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi [None req-a781d3f3-e63e-48ec-8dc0-771547e6c01e tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Calling method '>' {{(pid=116156) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:12:33.998201 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.compute.api [None req-a781d3f3-e63e-48ec-8dc0-771547e6c01e tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] [instance: bbb8462c-9501-4541-b67e-43ec5c5061a7] Fetching instance by UUID {{(pid=116156) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:12:34.003884 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-a781d3f3-e63e-48ec-8dc0-771547e6c01e tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:12:34.004332 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-a781d3f3-e63e-48ec-8dc0-771547e6c01e tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:12:34.005104 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-a781d3f3-e63e-48ec-8dc0-771547e6c01e tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:12:34.005540 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-a781d3f3-e63e-48ec-8dc0-771547e6c01e tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:12:34.063186 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.policy [None req-a781d3f3-e63e-48ec-8dc0-771547e6c01e tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97bdf19af9e34fc3886ff451cb9d7a27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '494b56bf5eae4d56a5591546f85bc32b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116156) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:12:34.070823 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: INFO nova.api.openstack.requestlog [None req-a781d3f3-e63e-48ec-8dc0-771547e6c01e tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] 10.222.0.18 "GET /compute/v2.1/servers/bbb8462c-9501-4541-b67e-43ec5c5061a7" status: 200 len: 1226 microversion: 2.1 time: 0.076888 Dec 15 03:12:34.071375 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: [pid: 116156|app: 0|req: 676/1351] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 03:12:33 2021] GET /compute/v2.1/servers/bbb8462c-9501-4541-b67e-43ec5c5061a7 => generated 1226 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 03:12:34.741549 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi [None req-867f0161-bc59-483b-9fe4-048a9940d3c1 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Calling method '>' {{(pid=116157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:12:34.742484 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.compute.api [None req-867f0161-bc59-483b-9fe4-048a9940d3c1 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] [instance: b89094ac-aee1-4bd6-a33d-8c4347cebfc7] Fetching instance by UUID {{(pid=116157) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:12:34.748288 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-867f0161-bc59-483b-9fe4-048a9940d3c1 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:12:34.748736 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-867f0161-bc59-483b-9fe4-048a9940d3c1 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:12:34.749503 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-867f0161-bc59-483b-9fe4-048a9940d3c1 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:12:34.749932 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-867f0161-bc59-483b-9fe4-048a9940d3c1 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:12:34.780457 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: INFO nova.api.openstack.requestlog [None req-867f0161-bc59-483b-9fe4-048a9940d3c1 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] 10.222.0.18 "GET /compute/v2.1/servers/b89094ac-aee1-4bd6-a33d-8c4347cebfc7/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042956 Dec 15 03:12:34.781101 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: [pid: 116157|app: 0|req: 676/1352] 10.222.0.18 () {60 vars in 1342 bytes} [Wed Dec 15 03:12:34 2021] GET /compute/v2.1/servers/b89094ac-aee1-4bd6-a33d-8c4347cebfc7/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 03:12:34.929187 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi [None req-07564fd6-0c44-4543-a518-bb5549d87bd6 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Calling method '>' {{(pid=116156) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:12:34.929800 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.compute.api [None req-07564fd6-0c44-4543-a518-bb5549d87bd6 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] [instance: fa7c86bc-c46f-4120-8f3d-d795f8d7c5cc] Fetching instance by UUID {{(pid=116156) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:12:34.936035 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-07564fd6-0c44-4543-a518-bb5549d87bd6 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:12:34.936488 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-07564fd6-0c44-4543-a518-bb5549d87bd6 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:12:34.937270 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-07564fd6-0c44-4543-a518-bb5549d87bd6 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:12:34.937706 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-07564fd6-0c44-4543-a518-bb5549d87bd6 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:12:35.064964 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.policy [None req-07564fd6-0c44-4543-a518-bb5549d87bd6 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c4c0c82448e40ba801c0b52ec44e74a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a093d0bf43046aaa845f3cc115f3f5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116156) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:12:35.072848 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: INFO nova.api.openstack.requestlog [None req-07564fd6-0c44-4543-a518-bb5549d87bd6 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] 10.222.0.18 "GET /compute/v2.1/servers/fa7c86bc-c46f-4120-8f3d-d795f8d7c5cc" status: 200 len: 1570 microversion: 2.1 time: 0.147794 Dec 15 03:12:35.073410 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: [pid: 116156|app: 0|req: 677/1353] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 03:12:34 2021] GET /compute/v2.1/servers/fa7c86bc-c46f-4120-8f3d-d795f8d7c5cc => generated 1570 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 03:12:35.087099 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi [None req-8b9e3712-9788-4665-b6d5-e80ec526a1de tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Calling method '>' {{(pid=116157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:12:35.087712 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.compute.api [None req-8b9e3712-9788-4665-b6d5-e80ec526a1de tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] [instance: bbb8462c-9501-4541-b67e-43ec5c5061a7] Fetching instance by UUID {{(pid=116157) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:12:35.093347 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-8b9e3712-9788-4665-b6d5-e80ec526a1de tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:12:35.093795 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-8b9e3712-9788-4665-b6d5-e80ec526a1de tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:12:35.094601 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-8b9e3712-9788-4665-b6d5-e80ec526a1de tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:12:35.095040 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-8b9e3712-9788-4665-b6d5-e80ec526a1de tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:12:35.155898 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.policy [None req-8b9e3712-9788-4665-b6d5-e80ec526a1de tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97bdf19af9e34fc3886ff451cb9d7a27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '494b56bf5eae4d56a5591546f85bc32b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116157) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:12:35.163141 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: INFO nova.api.openstack.requestlog [None req-8b9e3712-9788-4665-b6d5-e80ec526a1de tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] 10.222.0.18 "GET /compute/v2.1/servers/bbb8462c-9501-4541-b67e-43ec5c5061a7" status: 200 len: 1226 microversion: 2.1 time: 0.079674 Dec 15 03:12:35.163697 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: [pid: 116157|app: 0|req: 677/1354] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 03:12:35 2021] GET /compute/v2.1/servers/bbb8462c-9501-4541-b67e-43ec5c5061a7 => generated 1226 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 03:12:35.792532 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi [None req-153d246e-7ab5-4e3a-993e-74ca2d23c5ad tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Calling method '>' {{(pid=116156) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:12:35.793437 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.compute.api [None req-153d246e-7ab5-4e3a-993e-74ca2d23c5ad tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] [instance: b89094ac-aee1-4bd6-a33d-8c4347cebfc7] Fetching instance by UUID {{(pid=116156) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:12:35.799383 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-153d246e-7ab5-4e3a-993e-74ca2d23c5ad tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:12:35.799841 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-153d246e-7ab5-4e3a-993e-74ca2d23c5ad tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:12:35.800619 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-153d246e-7ab5-4e3a-993e-74ca2d23c5ad tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:12:35.801058 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-153d246e-7ab5-4e3a-993e-74ca2d23c5ad tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:12:35.829013 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: INFO nova.api.openstack.requestlog [None req-153d246e-7ab5-4e3a-993e-74ca2d23c5ad tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] 10.222.0.18 "GET /compute/v2.1/servers/b89094ac-aee1-4bd6-a33d-8c4347cebfc7/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.040210 Dec 15 03:12:35.829560 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: [pid: 116156|app: 0|req: 678/1355] 10.222.0.18 () {60 vars in 1342 bytes} [Wed Dec 15 03:12:35 2021] GET /compute/v2.1/servers/b89094ac-aee1-4bd6-a33d-8c4347cebfc7/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 03:12:36.090240 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi [None req-b3d541e0-3022-49ee-827d-b33668cfdf0d tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Calling method '>' {{(pid=116157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:12:36.090848 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.compute.api [None req-b3d541e0-3022-49ee-827d-b33668cfdf0d tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] [instance: fa7c86bc-c46f-4120-8f3d-d795f8d7c5cc] Fetching instance by UUID {{(pid=116157) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:12:36.097054 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-b3d541e0-3022-49ee-827d-b33668cfdf0d tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:12:36.097502 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-b3d541e0-3022-49ee-827d-b33668cfdf0d tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:12:36.098307 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-b3d541e0-3022-49ee-827d-b33668cfdf0d tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:12:36.098738 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-b3d541e0-3022-49ee-827d-b33668cfdf0d tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:12:36.179930 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi [None req-98349073-f1d1-4350-b9d6-d83929ae56ee tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Calling method '>' {{(pid=116156) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:12:36.180538 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.compute.api [None req-98349073-f1d1-4350-b9d6-d83929ae56ee tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] [instance: bbb8462c-9501-4541-b67e-43ec5c5061a7] Fetching instance by UUID {{(pid=116156) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:12:36.186676 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-98349073-f1d1-4350-b9d6-d83929ae56ee tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:12:36.187132 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-98349073-f1d1-4350-b9d6-d83929ae56ee tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:12:36.187902 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-98349073-f1d1-4350-b9d6-d83929ae56ee tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:12:36.188331 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-98349073-f1d1-4350-b9d6-d83929ae56ee tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:12:36.228526 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.policy [None req-b3d541e0-3022-49ee-827d-b33668cfdf0d tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c4c0c82448e40ba801c0b52ec44e74a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a093d0bf43046aaa845f3cc115f3f5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116157) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:12:36.236102 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: INFO nova.api.openstack.requestlog [None req-b3d541e0-3022-49ee-827d-b33668cfdf0d tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] 10.222.0.18 "GET /compute/v2.1/servers/fa7c86bc-c46f-4120-8f3d-d795f8d7c5cc" status: 200 len: 1570 microversion: 2.1 time: 0.149456 Dec 15 03:12:36.236667 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: [pid: 116157|app: 0|req: 678/1356] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 03:12:36 2021] GET /compute/v2.1/servers/fa7c86bc-c46f-4120-8f3d-d795f8d7c5cc => generated 1570 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 03:12:36.250477 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.policy [None req-98349073-f1d1-4350-b9d6-d83929ae56ee tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97bdf19af9e34fc3886ff451cb9d7a27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '494b56bf5eae4d56a5591546f85bc32b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116156) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:12:36.258181 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: INFO nova.api.openstack.requestlog [None req-98349073-f1d1-4350-b9d6-d83929ae56ee tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] 10.222.0.18 "GET /compute/v2.1/servers/bbb8462c-9501-4541-b67e-43ec5c5061a7" status: 200 len: 1226 microversion: 2.1 time: 0.081768 Dec 15 03:12:36.258730 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: [pid: 116156|app: 0|req: 679/1357] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 03:12:36 2021] GET /compute/v2.1/servers/bbb8462c-9501-4541-b67e-43ec5c5061a7 => generated 1226 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 03:12:36.840454 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi [None req-4e8ce4d7-e763-47bb-a65f-c9715cac490e tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Calling method '>' {{(pid=116157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:12:36.841360 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.compute.api [None req-4e8ce4d7-e763-47bb-a65f-c9715cac490e tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] [instance: b89094ac-aee1-4bd6-a33d-8c4347cebfc7] Fetching instance by UUID {{(pid=116157) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:12:36.847216 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-4e8ce4d7-e763-47bb-a65f-c9715cac490e tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:12:36.847669 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-4e8ce4d7-e763-47bb-a65f-c9715cac490e tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:12:36.848444 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-4e8ce4d7-e763-47bb-a65f-c9715cac490e tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:12:36.848880 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-4e8ce4d7-e763-47bb-a65f-c9715cac490e tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:12:36.879049 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: INFO nova.api.openstack.requestlog [None req-4e8ce4d7-e763-47bb-a65f-c9715cac490e tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] 10.222.0.18 "GET /compute/v2.1/servers/b89094ac-aee1-4bd6-a33d-8c4347cebfc7/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042410 Dec 15 03:12:36.879583 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: [pid: 116157|app: 0|req: 679/1358] 10.222.0.18 () {60 vars in 1342 bytes} [Wed Dec 15 03:12:36 2021] GET /compute/v2.1/servers/b89094ac-aee1-4bd6-a33d-8c4347cebfc7/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Dec 15 03:12:37.254225 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi [None req-0944d072-e89f-453d-8114-194e89a9f901 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Calling method '>' {{(pid=116156) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:12:37.254837 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.compute.api [None req-0944d072-e89f-453d-8114-194e89a9f901 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] [instance: fa7c86bc-c46f-4120-8f3d-d795f8d7c5cc] Fetching instance by UUID {{(pid=116156) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:12:37.261063 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-0944d072-e89f-453d-8114-194e89a9f901 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:12:37.261515 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-0944d072-e89f-453d-8114-194e89a9f901 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:12:37.262334 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-0944d072-e89f-453d-8114-194e89a9f901 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:12:37.262770 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-0944d072-e89f-453d-8114-194e89a9f901 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:12:37.275026 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi [None req-8196585f-9246-43f3-ab0a-b600adcbd711 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Calling method '>' {{(pid=116157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:12:37.275634 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.compute.api [None req-8196585f-9246-43f3-ab0a-b600adcbd711 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] [instance: bbb8462c-9501-4541-b67e-43ec5c5061a7] Fetching instance by UUID {{(pid=116157) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:12:37.281738 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-8196585f-9246-43f3-ab0a-b600adcbd711 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:12:37.282238 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-8196585f-9246-43f3-ab0a-b600adcbd711 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:12:37.283025 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-8196585f-9246-43f3-ab0a-b600adcbd711 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:12:37.283706 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-8196585f-9246-43f3-ab0a-b600adcbd711 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:12:37.342306 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.policy [None req-8196585f-9246-43f3-ab0a-b600adcbd711 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97bdf19af9e34fc3886ff451cb9d7a27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '494b56bf5eae4d56a5591546f85bc32b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116157) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:12:37.349474 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: INFO nova.api.openstack.requestlog [None req-8196585f-9246-43f3-ab0a-b600adcbd711 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] 10.222.0.18 "GET /compute/v2.1/servers/bbb8462c-9501-4541-b67e-43ec5c5061a7" status: 200 len: 1226 microversion: 2.1 time: 0.078533 Dec 15 03:12:37.350706 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: [pid: 116157|app: 0|req: 680/1359] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 03:12:37 2021] GET /compute/v2.1/servers/bbb8462c-9501-4541-b67e-43ec5c5061a7 => generated 1226 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 03:12:37.396388 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.policy [None req-0944d072-e89f-453d-8114-194e89a9f901 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c4c0c82448e40ba801c0b52ec44e74a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a093d0bf43046aaa845f3cc115f3f5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116156) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:12:37.404413 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: INFO nova.api.openstack.requestlog [None req-0944d072-e89f-453d-8114-194e89a9f901 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] 10.222.0.18 "GET /compute/v2.1/servers/fa7c86bc-c46f-4120-8f3d-d795f8d7c5cc" status: 200 len: 1570 microversion: 2.1 time: 0.153856 Dec 15 03:12:37.404981 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: [pid: 116156|app: 0|req: 680/1360] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 03:12:37 2021] GET /compute/v2.1/servers/fa7c86bc-c46f-4120-8f3d-d795f8d7c5cc => generated 1570 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 03:12:37.890915 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi [None req-e9aad135-0382-4e33-bcdf-a61b363c4a51 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Calling method '>' {{(pid=116157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:12:37.891805 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.compute.api [None req-e9aad135-0382-4e33-bcdf-a61b363c4a51 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] [instance: b89094ac-aee1-4bd6-a33d-8c4347cebfc7] Fetching instance by UUID {{(pid=116157) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:12:37.897634 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-e9aad135-0382-4e33-bcdf-a61b363c4a51 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:12:37.898107 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-e9aad135-0382-4e33-bcdf-a61b363c4a51 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:12:37.898904 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-e9aad135-0382-4e33-bcdf-a61b363c4a51 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:12:37.899332 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-e9aad135-0382-4e33-bcdf-a61b363c4a51 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:12:37.926625 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: INFO nova.api.openstack.requestlog [None req-e9aad135-0382-4e33-bcdf-a61b363c4a51 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] 10.222.0.18 "GET /compute/v2.1/servers/b89094ac-aee1-4bd6-a33d-8c4347cebfc7/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.039521 Dec 15 03:12:37.927160 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: [pid: 116157|app: 0|req: 681/1361] 10.222.0.18 () {60 vars in 1342 bytes} [Wed Dec 15 03:12:37 2021] GET /compute/v2.1/servers/b89094ac-aee1-4bd6-a33d-8c4347cebfc7/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 03:12:38.367085 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi [None req-8a00a1ae-37f8-4964-af65-cd23268cc838 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Calling method '>' {{(pid=116156) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:12:38.367698 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.compute.api [None req-8a00a1ae-37f8-4964-af65-cd23268cc838 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] [instance: bbb8462c-9501-4541-b67e-43ec5c5061a7] Fetching instance by UUID {{(pid=116156) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:12:38.373868 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-8a00a1ae-37f8-4964-af65-cd23268cc838 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:12:38.374346 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-8a00a1ae-37f8-4964-af65-cd23268cc838 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:12:38.375121 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-8a00a1ae-37f8-4964-af65-cd23268cc838 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:12:38.375551 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-8a00a1ae-37f8-4964-af65-cd23268cc838 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:12:38.421842 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi [None req-5d111d44-782b-470d-9b8e-ecbcf1366a87 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Calling method '>' {{(pid=116157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:12:38.422478 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.compute.api [None req-5d111d44-782b-470d-9b8e-ecbcf1366a87 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] [instance: fa7c86bc-c46f-4120-8f3d-d795f8d7c5cc] Fetching instance by UUID {{(pid=116157) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:12:38.429447 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-5d111d44-782b-470d-9b8e-ecbcf1366a87 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:12:38.429927 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-5d111d44-782b-470d-9b8e-ecbcf1366a87 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:12:38.430725 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-5d111d44-782b-470d-9b8e-ecbcf1366a87 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:12:38.431152 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-5d111d44-782b-470d-9b8e-ecbcf1366a87 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:12:38.435346 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.policy [None req-8a00a1ae-37f8-4964-af65-cd23268cc838 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97bdf19af9e34fc3886ff451cb9d7a27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '494b56bf5eae4d56a5591546f85bc32b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116156) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:12:38.442568 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: INFO nova.api.openstack.requestlog [None req-8a00a1ae-37f8-4964-af65-cd23268cc838 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] 10.222.0.18 "GET /compute/v2.1/servers/bbb8462c-9501-4541-b67e-43ec5c5061a7" status: 200 len: 1226 microversion: 2.1 time: 0.079991 Dec 15 03:12:38.443140 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: [pid: 116156|app: 0|req: 681/1362] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 03:12:38 2021] GET /compute/v2.1/servers/bbb8462c-9501-4541-b67e-43ec5c5061a7 => generated 1226 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 03:12:38.563100 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.policy [None req-5d111d44-782b-470d-9b8e-ecbcf1366a87 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c4c0c82448e40ba801c0b52ec44e74a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a093d0bf43046aaa845f3cc115f3f5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116157) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:12:38.570281 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: INFO nova.api.openstack.requestlog [None req-5d111d44-782b-470d-9b8e-ecbcf1366a87 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] 10.222.0.18 "GET /compute/v2.1/servers/fa7c86bc-c46f-4120-8f3d-d795f8d7c5cc" status: 200 len: 1570 microversion: 2.1 time: 0.152013 Dec 15 03:12:38.570838 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: [pid: 116157|app: 0|req: 682/1363] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 03:12:38 2021] GET /compute/v2.1/servers/fa7c86bc-c46f-4120-8f3d-d795f8d7c5cc => generated 1570 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 03:12:38.938458 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi [None req-154485e3-74bb-4c22-8fdd-d96618aa371e tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Calling method '>' {{(pid=116156) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:12:38.939355 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.compute.api [None req-154485e3-74bb-4c22-8fdd-d96618aa371e tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] [instance: b89094ac-aee1-4bd6-a33d-8c4347cebfc7] Fetching instance by UUID {{(pid=116156) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:12:38.945169 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-154485e3-74bb-4c22-8fdd-d96618aa371e tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:12:38.945621 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-154485e3-74bb-4c22-8fdd-d96618aa371e tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:12:38.946422 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-154485e3-74bb-4c22-8fdd-d96618aa371e tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:12:38.946857 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-154485e3-74bb-4c22-8fdd-d96618aa371e tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:12:38.974760 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: INFO nova.api.openstack.requestlog [None req-154485e3-74bb-4c22-8fdd-d96618aa371e tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] 10.222.0.18 "GET /compute/v2.1/servers/b89094ac-aee1-4bd6-a33d-8c4347cebfc7/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.040094 Dec 15 03:12:38.975872 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: [pid: 116156|app: 0|req: 682/1364] 10.222.0.18 () {60 vars in 1342 bytes} [Wed Dec 15 03:12:38 2021] GET /compute/v2.1/servers/b89094ac-aee1-4bd6-a33d-8c4347cebfc7/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 03:12:39.459922 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi [None req-32d8296c-2e1d-4783-8c24-91b67dc2f829 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Calling method '>' {{(pid=116157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:12:39.460464 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.compute.api [None req-32d8296c-2e1d-4783-8c24-91b67dc2f829 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] [instance: bbb8462c-9501-4541-b67e-43ec5c5061a7] Fetching instance by UUID {{(pid=116157) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:12:39.466672 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-32d8296c-2e1d-4783-8c24-91b67dc2f829 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:12:39.467121 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-32d8296c-2e1d-4783-8c24-91b67dc2f829 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:12:39.467890 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-32d8296c-2e1d-4783-8c24-91b67dc2f829 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:12:39.468316 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-32d8296c-2e1d-4783-8c24-91b67dc2f829 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:12:39.526055 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.policy [None req-32d8296c-2e1d-4783-8c24-91b67dc2f829 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97bdf19af9e34fc3886ff451cb9d7a27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '494b56bf5eae4d56a5591546f85bc32b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116157) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:12:39.533207 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: INFO nova.api.openstack.requestlog [None req-32d8296c-2e1d-4783-8c24-91b67dc2f829 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] 10.222.0.18 "GET /compute/v2.1/servers/bbb8462c-9501-4541-b67e-43ec5c5061a7" status: 200 len: 1226 microversion: 2.1 time: 0.077547 Dec 15 03:12:39.533754 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: [pid: 116157|app: 0|req: 683/1365] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 03:12:39 2021] GET /compute/v2.1/servers/bbb8462c-9501-4541-b67e-43ec5c5061a7 => generated 1226 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 03:12:39.587350 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi [None req-e93c620b-8f46-45cb-be30-1abad78a5d2d tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Calling method '>' {{(pid=116156) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:12:39.587950 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.compute.api [None req-e93c620b-8f46-45cb-be30-1abad78a5d2d tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] [instance: fa7c86bc-c46f-4120-8f3d-d795f8d7c5cc] Fetching instance by UUID {{(pid=116156) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:12:39.594110 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-e93c620b-8f46-45cb-be30-1abad78a5d2d tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:12:39.594558 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-e93c620b-8f46-45cb-be30-1abad78a5d2d tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:12:39.595321 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-e93c620b-8f46-45cb-be30-1abad78a5d2d tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:12:39.595753 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-e93c620b-8f46-45cb-be30-1abad78a5d2d tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:12:39.722532 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.policy [None req-e93c620b-8f46-45cb-be30-1abad78a5d2d tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c4c0c82448e40ba801c0b52ec44e74a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a093d0bf43046aaa845f3cc115f3f5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116156) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:12:39.730183 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: INFO nova.api.openstack.requestlog [None req-e93c620b-8f46-45cb-be30-1abad78a5d2d tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] 10.222.0.18 "GET /compute/v2.1/servers/fa7c86bc-c46f-4120-8f3d-d795f8d7c5cc" status: 200 len: 1570 microversion: 2.1 time: 0.146902 Dec 15 03:12:39.730740 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: [pid: 116156|app: 0|req: 683/1366] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 03:12:39 2021] GET /compute/v2.1/servers/fa7c86bc-c46f-4120-8f3d-d795f8d7c5cc => generated 1570 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 03:12:39.986528 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi [None req-8fd5f2a8-8f12-46c4-8722-68a6771e5fda tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Calling method '>' {{(pid=116157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:12:39.987611 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.compute.api [None req-8fd5f2a8-8f12-46c4-8722-68a6771e5fda tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] [instance: b89094ac-aee1-4bd6-a33d-8c4347cebfc7] Fetching instance by UUID {{(pid=116157) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:12:39.993377 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-8fd5f2a8-8f12-46c4-8722-68a6771e5fda tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:12:39.993823 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-8fd5f2a8-8f12-46c4-8722-68a6771e5fda tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:12:39.994619 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-8fd5f2a8-8f12-46c4-8722-68a6771e5fda tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:12:39.995052 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-8fd5f2a8-8f12-46c4-8722-68a6771e5fda tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:12:40.023529 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: INFO nova.api.openstack.requestlog [None req-8fd5f2a8-8f12-46c4-8722-68a6771e5fda tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] 10.222.0.18 "GET /compute/v2.1/servers/b89094ac-aee1-4bd6-a33d-8c4347cebfc7/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.040828 Dec 15 03:12:40.024062 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: [pid: 116157|app: 0|req: 684/1367] 10.222.0.18 () {60 vars in 1342 bytes} [Wed Dec 15 03:12:39 2021] GET /compute/v2.1/servers/b89094ac-aee1-4bd6-a33d-8c4347cebfc7/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 03:12:40.550454 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi [None req-aadd7978-a343-401f-bec7-40eb0b1309ba tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Calling method '>' {{(pid=116156) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:12:40.551071 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.compute.api [None req-aadd7978-a343-401f-bec7-40eb0b1309ba tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] [instance: bbb8462c-9501-4541-b67e-43ec5c5061a7] Fetching instance by UUID {{(pid=116156) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:12:40.557567 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-aadd7978-a343-401f-bec7-40eb0b1309ba tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:12:40.558048 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-aadd7978-a343-401f-bec7-40eb0b1309ba tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:12:40.558829 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-aadd7978-a343-401f-bec7-40eb0b1309ba tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:12:40.559265 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-aadd7978-a343-401f-bec7-40eb0b1309ba tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:12:40.617889 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.policy [None req-aadd7978-a343-401f-bec7-40eb0b1309ba tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97bdf19af9e34fc3886ff451cb9d7a27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '494b56bf5eae4d56a5591546f85bc32b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116156) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:12:40.625068 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: INFO nova.api.openstack.requestlog [None req-aadd7978-a343-401f-bec7-40eb0b1309ba tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] 10.222.0.18 "GET /compute/v2.1/servers/bbb8462c-9501-4541-b67e-43ec5c5061a7" status: 200 len: 1226 microversion: 2.1 time: 0.078305 Dec 15 03:12:40.625651 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: [pid: 116156|app: 0|req: 684/1368] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 03:12:40 2021] GET /compute/v2.1/servers/bbb8462c-9501-4541-b67e-43ec5c5061a7 => generated 1226 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 03:12:40.747124 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi [None req-6a96d0ec-335f-4b6d-9848-eba6bf374dd7 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Calling method '>' {{(pid=116157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:12:40.747724 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.compute.api [None req-6a96d0ec-335f-4b6d-9848-eba6bf374dd7 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] [instance: fa7c86bc-c46f-4120-8f3d-d795f8d7c5cc] Fetching instance by UUID {{(pid=116157) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:12:40.753884 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-6a96d0ec-335f-4b6d-9848-eba6bf374dd7 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:12:40.754360 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-6a96d0ec-335f-4b6d-9848-eba6bf374dd7 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:12:40.755130 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-6a96d0ec-335f-4b6d-9848-eba6bf374dd7 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:12:40.755563 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-6a96d0ec-335f-4b6d-9848-eba6bf374dd7 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:12:40.882454 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.policy [None req-6a96d0ec-335f-4b6d-9848-eba6bf374dd7 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c4c0c82448e40ba801c0b52ec44e74a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a093d0bf43046aaa845f3cc115f3f5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116157) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:12:40.889605 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: INFO nova.api.openstack.requestlog [None req-6a96d0ec-335f-4b6d-9848-eba6bf374dd7 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] 10.222.0.18 "GET /compute/v2.1/servers/fa7c86bc-c46f-4120-8f3d-d795f8d7c5cc" status: 200 len: 1570 microversion: 2.1 time: 0.146085 Dec 15 03:12:40.890196 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: [pid: 116157|app: 0|req: 685/1369] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 03:12:40 2021] GET /compute/v2.1/servers/fa7c86bc-c46f-4120-8f3d-d795f8d7c5cc => generated 1570 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 03:12:41.034731 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi [None req-43d1c4e6-e129-48ac-b6ea-505a49213562 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Calling method '>' {{(pid=116156) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:12:41.035634 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.compute.api [None req-43d1c4e6-e129-48ac-b6ea-505a49213562 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] [instance: b89094ac-aee1-4bd6-a33d-8c4347cebfc7] Fetching instance by UUID {{(pid=116156) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:12:41.041928 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-43d1c4e6-e129-48ac-b6ea-505a49213562 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:12:41.042422 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-43d1c4e6-e129-48ac-b6ea-505a49213562 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:12:41.043197 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-43d1c4e6-e129-48ac-b6ea-505a49213562 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:12:41.043633 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-43d1c4e6-e129-48ac-b6ea-505a49213562 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:12:41.071008 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: INFO nova.api.openstack.requestlog [None req-43d1c4e6-e129-48ac-b6ea-505a49213562 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] 10.222.0.18 "GET /compute/v2.1/servers/b89094ac-aee1-4bd6-a33d-8c4347cebfc7/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.039996 Dec 15 03:12:41.071539 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: [pid: 116156|app: 0|req: 685/1370] 10.222.0.18 () {60 vars in 1342 bytes} [Wed Dec 15 03:12:41 2021] GET /compute/v2.1/servers/b89094ac-aee1-4bd6-a33d-8c4347cebfc7/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 03:12:41.641531 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi [None req-c4d6aa29-550a-4ce8-916c-a27b531af120 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Calling method '>' {{(pid=116157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:12:41.642176 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.compute.api [None req-c4d6aa29-550a-4ce8-916c-a27b531af120 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] [instance: bbb8462c-9501-4541-b67e-43ec5c5061a7] Fetching instance by UUID {{(pid=116157) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:12:41.648027 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-c4d6aa29-550a-4ce8-916c-a27b531af120 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:12:41.648478 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-c4d6aa29-550a-4ce8-916c-a27b531af120 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:12:41.649263 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-c4d6aa29-550a-4ce8-916c-a27b531af120 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:12:41.649697 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-c4d6aa29-550a-4ce8-916c-a27b531af120 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:12:41.706483 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.policy [None req-c4d6aa29-550a-4ce8-916c-a27b531af120 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97bdf19af9e34fc3886ff451cb9d7a27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '494b56bf5eae4d56a5591546f85bc32b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116157) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:12:41.713513 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: INFO nova.api.openstack.requestlog [None req-c4d6aa29-550a-4ce8-916c-a27b531af120 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] 10.222.0.18 "GET /compute/v2.1/servers/bbb8462c-9501-4541-b67e-43ec5c5061a7" status: 200 len: 1226 microversion: 2.1 time: 0.075608 Dec 15 03:12:41.714094 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: [pid: 116157|app: 0|req: 686/1371] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 03:12:41 2021] GET /compute/v2.1/servers/bbb8462c-9501-4541-b67e-43ec5c5061a7 => generated 1226 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 03:12:41.906841 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi [None req-0d304527-35bf-427b-a669-df4559930076 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Calling method '>' {{(pid=116156) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:12:41.907385 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.compute.api [None req-0d304527-35bf-427b-a669-df4559930076 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] [instance: fa7c86bc-c46f-4120-8f3d-d795f8d7c5cc] Fetching instance by UUID {{(pid=116156) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:12:41.913570 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-0d304527-35bf-427b-a669-df4559930076 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:12:41.914046 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-0d304527-35bf-427b-a669-df4559930076 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:12:41.914821 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-0d304527-35bf-427b-a669-df4559930076 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:12:41.915255 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-0d304527-35bf-427b-a669-df4559930076 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:12:42.047145 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.policy [None req-0d304527-35bf-427b-a669-df4559930076 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c4c0c82448e40ba801c0b52ec44e74a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a093d0bf43046aaa845f3cc115f3f5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116156) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:12:42.054932 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: INFO nova.api.openstack.requestlog [None req-0d304527-35bf-427b-a669-df4559930076 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] 10.222.0.18 "GET /compute/v2.1/servers/fa7c86bc-c46f-4120-8f3d-d795f8d7c5cc" status: 200 len: 1570 microversion: 2.1 time: 0.151755 Dec 15 03:12:42.055489 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: [pid: 116156|app: 0|req: 686/1372] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 03:12:41 2021] GET /compute/v2.1/servers/fa7c86bc-c46f-4120-8f3d-d795f8d7c5cc => generated 1570 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 03:12:42.082233 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi [None req-a307a3c3-0572-44ae-8fba-db2680b6e7ec tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Calling method '>' {{(pid=116157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:12:42.083168 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.compute.api [None req-a307a3c3-0572-44ae-8fba-db2680b6e7ec tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] [instance: b89094ac-aee1-4bd6-a33d-8c4347cebfc7] Fetching instance by UUID {{(pid=116157) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:12:42.089421 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-a307a3c3-0572-44ae-8fba-db2680b6e7ec tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:12:42.089866 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-a307a3c3-0572-44ae-8fba-db2680b6e7ec tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:12:42.090673 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-a307a3c3-0572-44ae-8fba-db2680b6e7ec tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:12:42.091107 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-a307a3c3-0572-44ae-8fba-db2680b6e7ec tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:12:42.119860 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: INFO nova.api.openstack.requestlog [None req-a307a3c3-0572-44ae-8fba-db2680b6e7ec tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] 10.222.0.18 "GET /compute/v2.1/servers/b89094ac-aee1-4bd6-a33d-8c4347cebfc7/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041363 Dec 15 03:12:42.120400 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: [pid: 116157|app: 0|req: 687/1373] 10.222.0.18 () {60 vars in 1342 bytes} [Wed Dec 15 03:12:42 2021] GET /compute/v2.1/servers/b89094ac-aee1-4bd6-a33d-8c4347cebfc7/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 03:12:42.730663 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi [None req-3ec22e25-d268-4051-9a54-27971551c13e tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Calling method '>' {{(pid=116156) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:12:42.731274 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.compute.api [None req-3ec22e25-d268-4051-9a54-27971551c13e tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] [instance: bbb8462c-9501-4541-b67e-43ec5c5061a7] Fetching instance by UUID {{(pid=116156) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:12:42.737366 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-3ec22e25-d268-4051-9a54-27971551c13e tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:12:42.737824 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-3ec22e25-d268-4051-9a54-27971551c13e tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:12:42.738624 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-3ec22e25-d268-4051-9a54-27971551c13e tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:12:42.739063 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-3ec22e25-d268-4051-9a54-27971551c13e tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:12:42.796705 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.policy [None req-3ec22e25-d268-4051-9a54-27971551c13e tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97bdf19af9e34fc3886ff451cb9d7a27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '494b56bf5eae4d56a5591546f85bc32b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116156) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:12:42.803807 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: INFO nova.api.openstack.requestlog [None req-3ec22e25-d268-4051-9a54-27971551c13e tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] 10.222.0.18 "GET /compute/v2.1/servers/bbb8462c-9501-4541-b67e-43ec5c5061a7" status: 200 len: 1226 microversion: 2.1 time: 0.076802 Dec 15 03:12:42.804368 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: [pid: 116156|app: 0|req: 687/1374] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 03:12:42 2021] GET /compute/v2.1/servers/bbb8462c-9501-4541-b67e-43ec5c5061a7 => generated 1226 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 03:12:43.072237 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi [None req-5394fe7e-7746-475d-ad59-5841a9af20a0 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Calling method '>' {{(pid=116157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:12:43.072844 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.compute.api [None req-5394fe7e-7746-475d-ad59-5841a9af20a0 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] [instance: fa7c86bc-c46f-4120-8f3d-d795f8d7c5cc] Fetching instance by UUID {{(pid=116157) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:12:43.078654 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-5394fe7e-7746-475d-ad59-5841a9af20a0 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:12:43.079102 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-5394fe7e-7746-475d-ad59-5841a9af20a0 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:12:43.079873 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-5394fe7e-7746-475d-ad59-5841a9af20a0 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:12:43.080303 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-5394fe7e-7746-475d-ad59-5841a9af20a0 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:12:43.131853 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi [None req-97b124c5-bb33-43b3-817e-ba627d5818c8 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Calling method '>' {{(pid=116156) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:12:43.133026 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.compute.api [None req-97b124c5-bb33-43b3-817e-ba627d5818c8 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] [instance: b89094ac-aee1-4bd6-a33d-8c4347cebfc7] Fetching instance by UUID {{(pid=116156) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:12:43.139202 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-97b124c5-bb33-43b3-817e-ba627d5818c8 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:12:43.139645 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-97b124c5-bb33-43b3-817e-ba627d5818c8 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:12:43.140425 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-97b124c5-bb33-43b3-817e-ba627d5818c8 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:12:43.140853 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-97b124c5-bb33-43b3-817e-ba627d5818c8 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:12:43.169107 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: INFO nova.api.openstack.requestlog [None req-97b124c5-bb33-43b3-817e-ba627d5818c8 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] 10.222.0.18 "GET /compute/v2.1/servers/b89094ac-aee1-4bd6-a33d-8c4347cebfc7/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041511 Dec 15 03:12:43.169665 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: [pid: 116156|app: 0|req: 688/1375] 10.222.0.18 () {60 vars in 1342 bytes} [Wed Dec 15 03:12:43 2021] GET /compute/v2.1/servers/b89094ac-aee1-4bd6-a33d-8c4347cebfc7/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Dec 15 03:12:43.212582 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.policy [None req-5394fe7e-7746-475d-ad59-5841a9af20a0 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c4c0c82448e40ba801c0b52ec44e74a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a093d0bf43046aaa845f3cc115f3f5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116157) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:12:43.219752 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: INFO nova.api.openstack.requestlog [None req-5394fe7e-7746-475d-ad59-5841a9af20a0 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] 10.222.0.18 "GET /compute/v2.1/servers/fa7c86bc-c46f-4120-8f3d-d795f8d7c5cc" status: 200 len: 1570 microversion: 2.1 time: 0.151703 Dec 15 03:12:43.220313 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: [pid: 116157|app: 0|req: 688/1376] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 03:12:43 2021] GET /compute/v2.1/servers/fa7c86bc-c46f-4120-8f3d-d795f8d7c5cc => generated 1570 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 03:12:43.820682 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi [None req-c70cf095-5384-4d94-b5af-bd1aa4504604 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Calling method '>' {{(pid=116156) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:12:43.821345 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.compute.api [None req-c70cf095-5384-4d94-b5af-bd1aa4504604 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] [instance: bbb8462c-9501-4541-b67e-43ec5c5061a7] Fetching instance by UUID {{(pid=116156) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:12:43.827133 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-c70cf095-5384-4d94-b5af-bd1aa4504604 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:12:43.827584 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-c70cf095-5384-4d94-b5af-bd1aa4504604 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:12:43.828853 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-c70cf095-5384-4d94-b5af-bd1aa4504604 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:12:43.829287 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-c70cf095-5384-4d94-b5af-bd1aa4504604 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:12:43.887773 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.policy [None req-c70cf095-5384-4d94-b5af-bd1aa4504604 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97bdf19af9e34fc3886ff451cb9d7a27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '494b56bf5eae4d56a5591546f85bc32b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116156) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:12:43.895065 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: INFO nova.api.openstack.requestlog [None req-c70cf095-5384-4d94-b5af-bd1aa4504604 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] 10.222.0.18 "GET /compute/v2.1/servers/bbb8462c-9501-4541-b67e-43ec5c5061a7" status: 200 len: 1226 microversion: 2.1 time: 0.078465 Dec 15 03:12:43.895631 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: [pid: 116156|app: 0|req: 689/1377] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 03:12:43 2021] GET /compute/v2.1/servers/bbb8462c-9501-4541-b67e-43ec5c5061a7 => generated 1226 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 03:12:44.181113 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi [None req-87ec7c80-2ae7-4a45-9766-97c66b7a9961 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Calling method '>' {{(pid=116157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:12:44.181926 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.compute.api [None req-87ec7c80-2ae7-4a45-9766-97c66b7a9961 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] [instance: b89094ac-aee1-4bd6-a33d-8c4347cebfc7] Fetching instance by UUID {{(pid=116157) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:12:44.188161 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-87ec7c80-2ae7-4a45-9766-97c66b7a9961 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:12:44.188608 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-87ec7c80-2ae7-4a45-9766-97c66b7a9961 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:12:44.189379 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-87ec7c80-2ae7-4a45-9766-97c66b7a9961 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:12:44.189809 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-87ec7c80-2ae7-4a45-9766-97c66b7a9961 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:12:44.218463 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: INFO nova.api.openstack.requestlog [None req-87ec7c80-2ae7-4a45-9766-97c66b7a9961 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] 10.222.0.18 "GET /compute/v2.1/servers/b89094ac-aee1-4bd6-a33d-8c4347cebfc7/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041656 Dec 15 03:12:44.219011 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: [pid: 116157|app: 0|req: 689/1378] 10.222.0.18 () {60 vars in 1342 bytes} [Wed Dec 15 03:12:44 2021] GET /compute/v2.1/servers/b89094ac-aee1-4bd6-a33d-8c4347cebfc7/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 03:12:44.236158 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi [None req-62c8656a-0cfa-4820-8d08-68f29f6c7433 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Calling method '>' {{(pid=116156) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:12:44.236765 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.compute.api [None req-62c8656a-0cfa-4820-8d08-68f29f6c7433 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] [instance: fa7c86bc-c46f-4120-8f3d-d795f8d7c5cc] Fetching instance by UUID {{(pid=116156) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:12:44.244025 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-62c8656a-0cfa-4820-8d08-68f29f6c7433 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:12:44.244477 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-62c8656a-0cfa-4820-8d08-68f29f6c7433 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:12:44.245257 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-62c8656a-0cfa-4820-8d08-68f29f6c7433 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:12:44.245695 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-62c8656a-0cfa-4820-8d08-68f29f6c7433 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:12:44.376322 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.policy [None req-62c8656a-0cfa-4820-8d08-68f29f6c7433 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c4c0c82448e40ba801c0b52ec44e74a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a093d0bf43046aaa845f3cc115f3f5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116156) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:12:44.383511 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: INFO nova.api.openstack.requestlog [None req-62c8656a-0cfa-4820-8d08-68f29f6c7433 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] 10.222.0.18 "GET /compute/v2.1/servers/fa7c86bc-c46f-4120-8f3d-d795f8d7c5cc" status: 200 len: 1570 microversion: 2.1 time: 0.150927 Dec 15 03:12:44.384070 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: [pid: 116156|app: 0|req: 690/1379] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 03:12:44 2021] GET /compute/v2.1/servers/fa7c86bc-c46f-4120-8f3d-d795f8d7c5cc => generated 1570 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 03:12:44.911575 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi [None req-2b39051e-ff0e-405a-991f-774e4117d074 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Calling method '>' {{(pid=116157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:12:44.912797 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.compute.api [None req-2b39051e-ff0e-405a-991f-774e4117d074 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] [instance: bbb8462c-9501-4541-b67e-43ec5c5061a7] Fetching instance by UUID {{(pid=116157) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:12:44.918802 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-2b39051e-ff0e-405a-991f-774e4117d074 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:12:44.919278 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-2b39051e-ff0e-405a-991f-774e4117d074 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:12:44.920043 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-2b39051e-ff0e-405a-991f-774e4117d074 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:12:44.920478 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-2b39051e-ff0e-405a-991f-774e4117d074 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:12:44.984745 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.policy [None req-2b39051e-ff0e-405a-991f-774e4117d074 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97bdf19af9e34fc3886ff451cb9d7a27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '494b56bf5eae4d56a5591546f85bc32b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116157) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:12:44.992210 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: INFO nova.api.openstack.requestlog [None req-2b39051e-ff0e-405a-991f-774e4117d074 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] 10.222.0.18 "GET /compute/v2.1/servers/bbb8462c-9501-4541-b67e-43ec5c5061a7" status: 200 len: 1226 microversion: 2.1 time: 0.084310 Dec 15 03:12:44.992774 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: [pid: 116157|app: 0|req: 690/1380] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 03:12:44 2021] GET /compute/v2.1/servers/bbb8462c-9501-4541-b67e-43ec5c5061a7 => generated 1226 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 03:12:45.229996 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi [None req-2eb74665-f458-4d7e-b818-6145e47e10d0 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Calling method '>' {{(pid=116156) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:12:45.230908 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.compute.api [None req-2eb74665-f458-4d7e-b818-6145e47e10d0 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] [instance: b89094ac-aee1-4bd6-a33d-8c4347cebfc7] Fetching instance by UUID {{(pid=116156) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:12:45.239147 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-2eb74665-f458-4d7e-b818-6145e47e10d0 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:12:45.239664 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-2eb74665-f458-4d7e-b818-6145e47e10d0 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:12:45.240390 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-2eb74665-f458-4d7e-b818-6145e47e10d0 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:12:45.240833 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-2eb74665-f458-4d7e-b818-6145e47e10d0 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:12:45.270348 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: INFO nova.api.openstack.requestlog [None req-2eb74665-f458-4d7e-b818-6145e47e10d0 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] 10.222.0.18 "GET /compute/v2.1/servers/b89094ac-aee1-4bd6-a33d-8c4347cebfc7/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044171 Dec 15 03:12:45.270900 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: [pid: 116156|app: 0|req: 691/1381] 10.222.0.18 () {60 vars in 1342 bytes} [Wed Dec 15 03:12:45 2021] GET /compute/v2.1/servers/b89094ac-aee1-4bd6-a33d-8c4347cebfc7/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 03:12:45.400269 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi [None req-e6da5e4f-a426-44ce-a230-152269c6f0d0 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Calling method '>' {{(pid=116157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:12:45.400992 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.compute.api [None req-e6da5e4f-a426-44ce-a230-152269c6f0d0 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] [instance: fa7c86bc-c46f-4120-8f3d-d795f8d7c5cc] Fetching instance by UUID {{(pid=116157) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:12:45.407246 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-e6da5e4f-a426-44ce-a230-152269c6f0d0 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:12:45.407697 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-e6da5e4f-a426-44ce-a230-152269c6f0d0 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:12:45.408475 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-e6da5e4f-a426-44ce-a230-152269c6f0d0 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:12:45.408908 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-e6da5e4f-a426-44ce-a230-152269c6f0d0 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:12:45.538321 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.policy [None req-e6da5e4f-a426-44ce-a230-152269c6f0d0 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c4c0c82448e40ba801c0b52ec44e74a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a093d0bf43046aaa845f3cc115f3f5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116157) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:12:45.545523 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: INFO nova.api.openstack.requestlog [None req-e6da5e4f-a426-44ce-a230-152269c6f0d0 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] 10.222.0.18 "GET /compute/v2.1/servers/fa7c86bc-c46f-4120-8f3d-d795f8d7c5cc" status: 200 len: 1570 microversion: 2.1 time: 0.149023 Dec 15 03:12:45.546118 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: [pid: 116157|app: 0|req: 691/1382] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 03:12:45 2021] GET /compute/v2.1/servers/fa7c86bc-c46f-4120-8f3d-d795f8d7c5cc => generated 1570 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 03:12:46.008230 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi [None req-57cd72d6-7e53-4185-858e-09bbe10a85c1 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Calling method '>' {{(pid=116156) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:12:46.008882 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.compute.api [None req-57cd72d6-7e53-4185-858e-09bbe10a85c1 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] [instance: bbb8462c-9501-4541-b67e-43ec5c5061a7] Fetching instance by UUID {{(pid=116156) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:12:46.014736 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-57cd72d6-7e53-4185-858e-09bbe10a85c1 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:12:46.015194 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-57cd72d6-7e53-4185-858e-09bbe10a85c1 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:12:46.015970 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-57cd72d6-7e53-4185-858e-09bbe10a85c1 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:12:46.016410 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-57cd72d6-7e53-4185-858e-09bbe10a85c1 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:12:46.073873 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.policy [None req-57cd72d6-7e53-4185-858e-09bbe10a85c1 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97bdf19af9e34fc3886ff451cb9d7a27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '494b56bf5eae4d56a5591546f85bc32b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116156) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:12:46.081149 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: INFO nova.api.openstack.requestlog [None req-57cd72d6-7e53-4185-858e-09bbe10a85c1 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] 10.222.0.18 "GET /compute/v2.1/servers/bbb8462c-9501-4541-b67e-43ec5c5061a7" status: 200 len: 1226 microversion: 2.1 time: 0.076514 Dec 15 03:12:46.081728 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: [pid: 116156|app: 0|req: 692/1383] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 03:12:46 2021] GET /compute/v2.1/servers/bbb8462c-9501-4541-b67e-43ec5c5061a7 => generated 1226 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 03:12:46.283106 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi [None req-c4f37904-6805-4f40-ac2b-d6fc619f37da tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Calling method '>' {{(pid=116157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:12:46.283943 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.compute.api [None req-c4f37904-6805-4f40-ac2b-d6fc619f37da tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] [instance: b89094ac-aee1-4bd6-a33d-8c4347cebfc7] Fetching instance by UUID {{(pid=116157) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:12:46.290289 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-c4f37904-6805-4f40-ac2b-d6fc619f37da tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:12:46.290749 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-c4f37904-6805-4f40-ac2b-d6fc619f37da tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:12:46.291532 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-c4f37904-6805-4f40-ac2b-d6fc619f37da tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:12:46.291974 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-c4f37904-6805-4f40-ac2b-d6fc619f37da tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:12:46.320569 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: INFO nova.api.openstack.requestlog [None req-c4f37904-6805-4f40-ac2b-d6fc619f37da tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] 10.222.0.18 "GET /compute/v2.1/servers/b89094ac-aee1-4bd6-a33d-8c4347cebfc7/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041355 Dec 15 03:12:46.321114 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: [pid: 116157|app: 0|req: 692/1384] 10.222.0.18 () {60 vars in 1342 bytes} [Wed Dec 15 03:12:46 2021] GET /compute/v2.1/servers/b89094ac-aee1-4bd6-a33d-8c4347cebfc7/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 03:12:46.562856 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi [None req-3bef5db9-0a02-4178-b02f-a6e143907dff tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Calling method '>' {{(pid=116156) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:12:46.563470 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.compute.api [None req-3bef5db9-0a02-4178-b02f-a6e143907dff tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] [instance: fa7c86bc-c46f-4120-8f3d-d795f8d7c5cc] Fetching instance by UUID {{(pid=116156) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:12:46.569623 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-3bef5db9-0a02-4178-b02f-a6e143907dff tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:12:46.570096 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-3bef5db9-0a02-4178-b02f-a6e143907dff tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:12:46.570866 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-3bef5db9-0a02-4178-b02f-a6e143907dff tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:12:46.571298 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-3bef5db9-0a02-4178-b02f-a6e143907dff tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:12:46.699460 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.policy [None req-3bef5db9-0a02-4178-b02f-a6e143907dff tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c4c0c82448e40ba801c0b52ec44e74a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a093d0bf43046aaa845f3cc115f3f5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116156) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:12:46.706646 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: INFO nova.api.openstack.requestlog [None req-3bef5db9-0a02-4178-b02f-a6e143907dff tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] 10.222.0.18 "GET /compute/v2.1/servers/fa7c86bc-c46f-4120-8f3d-d795f8d7c5cc" status: 200 len: 1570 microversion: 2.1 time: 0.147412 Dec 15 03:12:46.707200 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: [pid: 116156|app: 0|req: 693/1385] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 03:12:46 2021] GET /compute/v2.1/servers/fa7c86bc-c46f-4120-8f3d-d795f8d7c5cc => generated 1570 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 03:12:47.097618 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi [None req-4e16911f-bc16-4ee4-9196-7f6629f69034 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Calling method '>' {{(pid=116157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:12:47.098266 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.compute.api [None req-4e16911f-bc16-4ee4-9196-7f6629f69034 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] [instance: bbb8462c-9501-4541-b67e-43ec5c5061a7] Fetching instance by UUID {{(pid=116157) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:12:47.106001 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-4e16911f-bc16-4ee4-9196-7f6629f69034 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:12:47.106458 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-4e16911f-bc16-4ee4-9196-7f6629f69034 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:12:47.107225 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-4e16911f-bc16-4ee4-9196-7f6629f69034 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:12:47.107656 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-4e16911f-bc16-4ee4-9196-7f6629f69034 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:12:47.168848 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.policy [None req-4e16911f-bc16-4ee4-9196-7f6629f69034 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97bdf19af9e34fc3886ff451cb9d7a27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '494b56bf5eae4d56a5591546f85bc32b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116157) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:12:47.176301 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: INFO nova.api.openstack.requestlog [None req-4e16911f-bc16-4ee4-9196-7f6629f69034 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] 10.222.0.18 "GET /compute/v2.1/servers/bbb8462c-9501-4541-b67e-43ec5c5061a7" status: 200 len: 1226 microversion: 2.1 time: 0.082294 Dec 15 03:12:47.176850 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: [pid: 116157|app: 0|req: 693/1386] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 03:12:47 2021] GET /compute/v2.1/servers/bbb8462c-9501-4541-b67e-43ec5c5061a7 => generated 1226 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 03:12:47.331994 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi [None req-b2d57e89-6558-4c81-803c-d72e24bbf101 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Calling method '>' {{(pid=116156) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:12:47.332907 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.compute.api [None req-b2d57e89-6558-4c81-803c-d72e24bbf101 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] [instance: b89094ac-aee1-4bd6-a33d-8c4347cebfc7] Fetching instance by UUID {{(pid=116156) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:12:47.339181 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-b2d57e89-6558-4c81-803c-d72e24bbf101 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:12:47.339639 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-b2d57e89-6558-4c81-803c-d72e24bbf101 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:12:47.340416 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-b2d57e89-6558-4c81-803c-d72e24bbf101 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:12:47.340857 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-b2d57e89-6558-4c81-803c-d72e24bbf101 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:12:47.369558 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: INFO nova.api.openstack.requestlog [None req-b2d57e89-6558-4c81-803c-d72e24bbf101 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] 10.222.0.18 "GET /compute/v2.1/servers/b89094ac-aee1-4bd6-a33d-8c4347cebfc7/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041337 Dec 15 03:12:47.370054 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: [pid: 116156|app: 0|req: 694/1387] 10.222.0.18 () {60 vars in 1342 bytes} [Wed Dec 15 03:12:47 2021] GET /compute/v2.1/servers/b89094ac-aee1-4bd6-a33d-8c4347cebfc7/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 03:12:47.723928 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi [None req-6728e1a3-770a-4438-9f66-f14f0e2ae854 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Calling method '>' {{(pid=116157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:12:47.724456 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.compute.api [None req-6728e1a3-770a-4438-9f66-f14f0e2ae854 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] [instance: fa7c86bc-c46f-4120-8f3d-d795f8d7c5cc] Fetching instance by UUID {{(pid=116157) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:12:47.730262 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-6728e1a3-770a-4438-9f66-f14f0e2ae854 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:12:47.730710 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-6728e1a3-770a-4438-9f66-f14f0e2ae854 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:12:47.731478 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-6728e1a3-770a-4438-9f66-f14f0e2ae854 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:12:47.731912 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-6728e1a3-770a-4438-9f66-f14f0e2ae854 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:12:47.861050 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.policy [None req-6728e1a3-770a-4438-9f66-f14f0e2ae854 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c4c0c82448e40ba801c0b52ec44e74a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a093d0bf43046aaa845f3cc115f3f5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116157) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:12:47.868538 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: INFO nova.api.openstack.requestlog [None req-6728e1a3-770a-4438-9f66-f14f0e2ae854 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] 10.222.0.18 "GET /compute/v2.1/servers/fa7c86bc-c46f-4120-8f3d-d795f8d7c5cc" status: 200 len: 1570 microversion: 2.1 time: 0.148364 Dec 15 03:12:47.869083 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: [pid: 116157|app: 0|req: 694/1388] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 03:12:47 2021] GET /compute/v2.1/servers/fa7c86bc-c46f-4120-8f3d-d795f8d7c5cc => generated 1570 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 03:12:48.192631 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi [None req-dbfb4cbc-38b4-4f1f-b2d6-38afa050bffc tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Calling method '>' {{(pid=116156) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:12:48.193271 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.compute.api [None req-dbfb4cbc-38b4-4f1f-b2d6-38afa050bffc tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] [instance: bbb8462c-9501-4541-b67e-43ec5c5061a7] Fetching instance by UUID {{(pid=116156) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:12:48.200169 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-dbfb4cbc-38b4-4f1f-b2d6-38afa050bffc tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:12:48.200631 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-dbfb4cbc-38b4-4f1f-b2d6-38afa050bffc tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:12:48.201411 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-dbfb4cbc-38b4-4f1f-b2d6-38afa050bffc tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:12:48.201851 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-dbfb4cbc-38b4-4f1f-b2d6-38afa050bffc tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:12:48.260745 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.policy [None req-dbfb4cbc-38b4-4f1f-b2d6-38afa050bffc tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97bdf19af9e34fc3886ff451cb9d7a27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '494b56bf5eae4d56a5591546f85bc32b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116156) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:12:48.267946 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: INFO nova.api.openstack.requestlog [None req-dbfb4cbc-38b4-4f1f-b2d6-38afa050bffc tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] 10.222.0.18 "GET /compute/v2.1/servers/bbb8462c-9501-4541-b67e-43ec5c5061a7" status: 200 len: 1226 microversion: 2.1 time: 0.079067 Dec 15 03:12:48.268501 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: [pid: 116156|app: 0|req: 695/1389] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 03:12:48 2021] GET /compute/v2.1/servers/bbb8462c-9501-4541-b67e-43ec5c5061a7 => generated 1226 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 03:12:48.380750 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi [None req-2d348e11-5baf-4390-a99a-e6f7fdeb41c8 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Calling method '>' {{(pid=116157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:12:48.381650 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.compute.api [None req-2d348e11-5baf-4390-a99a-e6f7fdeb41c8 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] [instance: b89094ac-aee1-4bd6-a33d-8c4347cebfc7] Fetching instance by UUID {{(pid=116157) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:12:48.387840 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-2d348e11-5baf-4390-a99a-e6f7fdeb41c8 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:12:48.388285 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-2d348e11-5baf-4390-a99a-e6f7fdeb41c8 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:12:48.389055 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-2d348e11-5baf-4390-a99a-e6f7fdeb41c8 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:12:48.389484 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-2d348e11-5baf-4390-a99a-e6f7fdeb41c8 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:12:48.417840 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: INFO nova.api.openstack.requestlog [None req-2d348e11-5baf-4390-a99a-e6f7fdeb41c8 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] 10.222.0.18 "GET /compute/v2.1/servers/b89094ac-aee1-4bd6-a33d-8c4347cebfc7/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.040755 Dec 15 03:12:48.418424 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: [pid: 116157|app: 0|req: 695/1390] 10.222.0.18 () {60 vars in 1342 bytes} [Wed Dec 15 03:12:48 2021] GET /compute/v2.1/servers/b89094ac-aee1-4bd6-a33d-8c4347cebfc7/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 03:12:48.885478 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi [None req-959a2d57-e528-4a19-aa9a-25d9f0e86fdf tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Calling method '>' {{(pid=116156) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:12:48.886114 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.compute.api [None req-959a2d57-e528-4a19-aa9a-25d9f0e86fdf tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] [instance: fa7c86bc-c46f-4120-8f3d-d795f8d7c5cc] Fetching instance by UUID {{(pid=116156) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:12:48.892012 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-959a2d57-e528-4a19-aa9a-25d9f0e86fdf tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:12:48.892458 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-959a2d57-e528-4a19-aa9a-25d9f0e86fdf tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:12:48.893257 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-959a2d57-e528-4a19-aa9a-25d9f0e86fdf tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:12:48.893687 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-959a2d57-e528-4a19-aa9a-25d9f0e86fdf tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:12:49.025375 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.policy [None req-959a2d57-e528-4a19-aa9a-25d9f0e86fdf tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c4c0c82448e40ba801c0b52ec44e74a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a093d0bf43046aaa845f3cc115f3f5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116156) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:12:49.032608 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: INFO nova.api.openstack.requestlog [None req-959a2d57-e528-4a19-aa9a-25d9f0e86fdf tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] 10.222.0.18 "GET /compute/v2.1/servers/fa7c86bc-c46f-4120-8f3d-d795f8d7c5cc" status: 200 len: 1570 microversion: 2.1 time: 0.151314 Dec 15 03:12:49.033174 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: [pid: 116156|app: 0|req: 696/1391] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 03:12:48 2021] GET /compute/v2.1/servers/fa7c86bc-c46f-4120-8f3d-d795f8d7c5cc => generated 1570 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 03:12:49.284194 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi [None req-4a80d235-47fb-454a-af7b-1984abcd8a4a tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Calling method '>' {{(pid=116157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:12:49.284840 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.compute.api [None req-4a80d235-47fb-454a-af7b-1984abcd8a4a tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] [instance: bbb8462c-9501-4541-b67e-43ec5c5061a7] Fetching instance by UUID {{(pid=116157) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:12:49.291152 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-4a80d235-47fb-454a-af7b-1984abcd8a4a tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:12:49.291624 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-4a80d235-47fb-454a-af7b-1984abcd8a4a tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:12:49.292394 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-4a80d235-47fb-454a-af7b-1984abcd8a4a tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:12:49.292836 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-4a80d235-47fb-454a-af7b-1984abcd8a4a tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:12:49.350059 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.policy [None req-4a80d235-47fb-454a-af7b-1984abcd8a4a tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97bdf19af9e34fc3886ff451cb9d7a27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '494b56bf5eae4d56a5591546f85bc32b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116157) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:12:49.357752 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: INFO nova.api.openstack.requestlog [None req-4a80d235-47fb-454a-af7b-1984abcd8a4a tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] 10.222.0.18 "GET /compute/v2.1/servers/bbb8462c-9501-4541-b67e-43ec5c5061a7" status: 200 len: 1226 microversion: 2.1 time: 0.077245 Dec 15 03:12:49.358348 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: [pid: 116157|app: 0|req: 696/1392] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 03:12:49 2021] GET /compute/v2.1/servers/bbb8462c-9501-4541-b67e-43ec5c5061a7 => generated 1226 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 03:12:49.428974 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi [None req-33f66e44-8de7-42fd-a7e4-73be7ffc4deb tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Calling method '>' {{(pid=116156) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:12:49.430576 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.compute.api [None req-33f66e44-8de7-42fd-a7e4-73be7ffc4deb tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] [instance: b89094ac-aee1-4bd6-a33d-8c4347cebfc7] Fetching instance by UUID {{(pid=116156) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:12:49.436719 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-33f66e44-8de7-42fd-a7e4-73be7ffc4deb tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:12:49.437170 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-33f66e44-8de7-42fd-a7e4-73be7ffc4deb tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:12:49.437944 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-33f66e44-8de7-42fd-a7e4-73be7ffc4deb tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:12:49.438407 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-33f66e44-8de7-42fd-a7e4-73be7ffc4deb tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:12:49.467464 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: INFO nova.api.openstack.requestlog [None req-33f66e44-8de7-42fd-a7e4-73be7ffc4deb tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] 10.222.0.18 "GET /compute/v2.1/servers/b89094ac-aee1-4bd6-a33d-8c4347cebfc7/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042101 Dec 15 03:12:49.467937 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: [pid: 116156|app: 0|req: 697/1393] 10.222.0.18 () {60 vars in 1342 bytes} [Wed Dec 15 03:12:49 2021] GET /compute/v2.1/servers/b89094ac-aee1-4bd6-a33d-8c4347cebfc7/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 03:12:50.049910 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi [None req-5db1057d-bce5-49af-a424-355eaf395508 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Calling method '>' {{(pid=116157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:12:50.050555 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.compute.api [None req-5db1057d-bce5-49af-a424-355eaf395508 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] [instance: fa7c86bc-c46f-4120-8f3d-d795f8d7c5cc] Fetching instance by UUID {{(pid=116157) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:12:50.056833 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-5db1057d-bce5-49af-a424-355eaf395508 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:12:50.057290 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-5db1057d-bce5-49af-a424-355eaf395508 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:12:50.058100 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-5db1057d-bce5-49af-a424-355eaf395508 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:12:50.058545 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-5db1057d-bce5-49af-a424-355eaf395508 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:12:50.190138 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.policy [None req-5db1057d-bce5-49af-a424-355eaf395508 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c4c0c82448e40ba801c0b52ec44e74a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a093d0bf43046aaa845f3cc115f3f5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116157) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:12:50.197509 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: INFO nova.api.openstack.requestlog [None req-5db1057d-bce5-49af-a424-355eaf395508 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] 10.222.0.18 "GET /compute/v2.1/servers/fa7c86bc-c46f-4120-8f3d-d795f8d7c5cc" status: 200 len: 1570 microversion: 2.1 time: 0.151208 Dec 15 03:12:50.198092 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: [pid: 116157|app: 0|req: 697/1394] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 03:12:50 2021] GET /compute/v2.1/servers/fa7c86bc-c46f-4120-8f3d-d795f8d7c5cc => generated 1570 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 03:12:50.373811 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi [None req-6419b104-bf19-4416-a64c-6febecbd7d79 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Calling method '>' {{(pid=116156) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:12:50.374371 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.compute.api [None req-6419b104-bf19-4416-a64c-6febecbd7d79 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] [instance: bbb8462c-9501-4541-b67e-43ec5c5061a7] Fetching instance by UUID {{(pid=116156) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:12:50.380233 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-6419b104-bf19-4416-a64c-6febecbd7d79 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:12:50.380686 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-6419b104-bf19-4416-a64c-6febecbd7d79 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:12:50.381462 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-6419b104-bf19-4416-a64c-6febecbd7d79 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:12:50.381900 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-6419b104-bf19-4416-a64c-6febecbd7d79 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:12:50.439128 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.policy [None req-6419b104-bf19-4416-a64c-6febecbd7d79 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97bdf19af9e34fc3886ff451cb9d7a27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '494b56bf5eae4d56a5591546f85bc32b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116156) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:12:50.446528 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: INFO nova.api.openstack.requestlog [None req-6419b104-bf19-4416-a64c-6febecbd7d79 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] 10.222.0.18 "GET /compute/v2.1/servers/bbb8462c-9501-4541-b67e-43ec5c5061a7" status: 200 len: 1226 microversion: 2.1 time: 0.076439 Dec 15 03:12:50.447115 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: [pid: 116156|app: 0|req: 698/1395] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 03:12:50 2021] GET /compute/v2.1/servers/bbb8462c-9501-4541-b67e-43ec5c5061a7 => generated 1226 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 03:12:50.479421 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi [None req-70ba0afa-4a1c-42b7-b353-143be7d5e4f9 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Calling method '>' {{(pid=116157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:12:50.480371 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.compute.api [None req-70ba0afa-4a1c-42b7-b353-143be7d5e4f9 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] [instance: b89094ac-aee1-4bd6-a33d-8c4347cebfc7] Fetching instance by UUID {{(pid=116157) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:12:50.486172 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-70ba0afa-4a1c-42b7-b353-143be7d5e4f9 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:12:50.486623 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-70ba0afa-4a1c-42b7-b353-143be7d5e4f9 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:12:50.487647 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-70ba0afa-4a1c-42b7-b353-143be7d5e4f9 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:12:50.488077 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-70ba0afa-4a1c-42b7-b353-143be7d5e4f9 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:12:50.515346 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: INFO nova.api.openstack.requestlog [None req-70ba0afa-4a1c-42b7-b353-143be7d5e4f9 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] 10.222.0.18 "GET /compute/v2.1/servers/b89094ac-aee1-4bd6-a33d-8c4347cebfc7/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.040293 Dec 15 03:12:50.515872 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: [pid: 116157|app: 0|req: 698/1396] 10.222.0.18 () {60 vars in 1342 bytes} [Wed Dec 15 03:12:50 2021] GET /compute/v2.1/servers/b89094ac-aee1-4bd6-a33d-8c4347cebfc7/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 03:12:51.213492 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi [None req-e2a8c7e9-d398-4501-a14b-9068c192de85 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Calling method '>' {{(pid=116156) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:12:51.214154 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.compute.api [None req-e2a8c7e9-d398-4501-a14b-9068c192de85 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] [instance: fa7c86bc-c46f-4120-8f3d-d795f8d7c5cc] Fetching instance by UUID {{(pid=116156) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:12:51.219987 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-e2a8c7e9-d398-4501-a14b-9068c192de85 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:12:51.220472 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-e2a8c7e9-d398-4501-a14b-9068c192de85 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:12:51.221252 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-e2a8c7e9-d398-4501-a14b-9068c192de85 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:12:51.221692 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-e2a8c7e9-d398-4501-a14b-9068c192de85 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:12:51.349373 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.policy [None req-e2a8c7e9-d398-4501-a14b-9068c192de85 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c4c0c82448e40ba801c0b52ec44e74a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a093d0bf43046aaa845f3cc115f3f5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116156) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:12:51.357127 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: INFO nova.api.openstack.requestlog [None req-e2a8c7e9-d398-4501-a14b-9068c192de85 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] 10.222.0.18 "GET /compute/v2.1/servers/fa7c86bc-c46f-4120-8f3d-d795f8d7c5cc" status: 200 len: 1570 microversion: 2.1 time: 0.147335 Dec 15 03:12:51.357691 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: [pid: 116156|app: 0|req: 699/1397] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 03:12:51 2021] GET /compute/v2.1/servers/fa7c86bc-c46f-4120-8f3d-d795f8d7c5cc => generated 1570 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 03:12:51.462879 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi [None req-0805594a-97e3-4548-b42e-e5c880551a2f tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Calling method '>' {{(pid=116157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:12:51.463583 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.compute.api [None req-0805594a-97e3-4548-b42e-e5c880551a2f tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] [instance: bbb8462c-9501-4541-b67e-43ec5c5061a7] Fetching instance by UUID {{(pid=116157) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:12:51.469712 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-0805594a-97e3-4548-b42e-e5c880551a2f tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:12:51.470204 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-0805594a-97e3-4548-b42e-e5c880551a2f tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:12:51.470976 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-0805594a-97e3-4548-b42e-e5c880551a2f tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:12:51.471408 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-0805594a-97e3-4548-b42e-e5c880551a2f tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:12:51.525876 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi [None req-b599b4c4-eb26-42d5-9af3-98e94146ab79 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Calling method '>' {{(pid=116156) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:12:51.527061 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.compute.api [None req-b599b4c4-eb26-42d5-9af3-98e94146ab79 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] [instance: b89094ac-aee1-4bd6-a33d-8c4347cebfc7] Fetching instance by UUID {{(pid=116156) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:12:51.529206 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.policy [None req-0805594a-97e3-4548-b42e-e5c880551a2f tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97bdf19af9e34fc3886ff451cb9d7a27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '494b56bf5eae4d56a5591546f85bc32b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116157) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:12:51.533246 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-b599b4c4-eb26-42d5-9af3-98e94146ab79 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:12:51.533700 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-b599b4c4-eb26-42d5-9af3-98e94146ab79 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:12:51.534523 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-b599b4c4-eb26-42d5-9af3-98e94146ab79 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:12:51.534964 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-b599b4c4-eb26-42d5-9af3-98e94146ab79 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:12:51.536358 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: INFO nova.api.openstack.requestlog [None req-0805594a-97e3-4548-b42e-e5c880551a2f tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] 10.222.0.18 "GET /compute/v2.1/servers/bbb8462c-9501-4541-b67e-43ec5c5061a7" status: 200 len: 1226 microversion: 2.1 time: 0.077112 Dec 15 03:12:51.536914 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: [pid: 116157|app: 0|req: 699/1398] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 03:12:51 2021] GET /compute/v2.1/servers/bbb8462c-9501-4541-b67e-43ec5c5061a7 => generated 1226 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 03:12:51.564345 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: INFO nova.api.openstack.requestlog [None req-b599b4c4-eb26-42d5-9af3-98e94146ab79 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] 10.222.0.18 "GET /compute/v2.1/servers/b89094ac-aee1-4bd6-a33d-8c4347cebfc7/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042253 Dec 15 03:12:51.564889 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: [pid: 116156|app: 0|req: 700/1399] 10.222.0.18 () {60 vars in 1342 bytes} [Wed Dec 15 03:12:51 2021] GET /compute/v2.1/servers/b89094ac-aee1-4bd6-a33d-8c4347cebfc7/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Dec 15 03:12:52.373395 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi [None req-32ee451f-0cfd-45a7-9cf9-033d361308ab tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Calling method '>' {{(pid=116157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:12:52.374010 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.compute.api [None req-32ee451f-0cfd-45a7-9cf9-033d361308ab tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] [instance: fa7c86bc-c46f-4120-8f3d-d795f8d7c5cc] Fetching instance by UUID {{(pid=116157) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:12:52.379820 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-32ee451f-0cfd-45a7-9cf9-033d361308ab tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:12:52.380274 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-32ee451f-0cfd-45a7-9cf9-033d361308ab tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:12:52.381042 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-32ee451f-0cfd-45a7-9cf9-033d361308ab tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:12:52.381475 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-32ee451f-0cfd-45a7-9cf9-033d361308ab tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:12:52.514714 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.policy [None req-32ee451f-0cfd-45a7-9cf9-033d361308ab tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c4c0c82448e40ba801c0b52ec44e74a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a093d0bf43046aaa845f3cc115f3f5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116157) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:12:52.521882 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: INFO nova.api.openstack.requestlog [None req-32ee451f-0cfd-45a7-9cf9-033d361308ab tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] 10.222.0.18 "GET /compute/v2.1/servers/fa7c86bc-c46f-4120-8f3d-d795f8d7c5cc" status: 200 len: 1570 microversion: 2.1 time: 0.152119 Dec 15 03:12:52.522469 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: [pid: 116157|app: 0|req: 700/1400] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 03:12:52 2021] GET /compute/v2.1/servers/fa7c86bc-c46f-4120-8f3d-d795f8d7c5cc => generated 1570 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 03:12:52.553146 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi [None req-b6443dd0-386e-4ed1-8ade-3a63646bc766 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Calling method '>' {{(pid=116156) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:12:52.553763 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.compute.api [None req-b6443dd0-386e-4ed1-8ade-3a63646bc766 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] [instance: bbb8462c-9501-4541-b67e-43ec5c5061a7] Fetching instance by UUID {{(pid=116156) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:12:52.560519 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-b6443dd0-386e-4ed1-8ade-3a63646bc766 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:12:52.560987 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-b6443dd0-386e-4ed1-8ade-3a63646bc766 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:12:52.561750 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-b6443dd0-386e-4ed1-8ade-3a63646bc766 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:12:52.562235 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-b6443dd0-386e-4ed1-8ade-3a63646bc766 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:12:52.576198 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi [None req-a7ff223c-7ad1-4fd2-836b-96d8d45b1df2 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Calling method '>' {{(pid=116157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:12:52.577100 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.compute.api [None req-a7ff223c-7ad1-4fd2-836b-96d8d45b1df2 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] [instance: b89094ac-aee1-4bd6-a33d-8c4347cebfc7] Fetching instance by UUID {{(pid=116157) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:12:52.582881 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-a7ff223c-7ad1-4fd2-836b-96d8d45b1df2 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:12:52.583333 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-a7ff223c-7ad1-4fd2-836b-96d8d45b1df2 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:12:52.584111 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-a7ff223c-7ad1-4fd2-836b-96d8d45b1df2 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:12:52.584548 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-a7ff223c-7ad1-4fd2-836b-96d8d45b1df2 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:12:52.613773 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: INFO nova.api.openstack.requestlog [None req-a7ff223c-7ad1-4fd2-836b-96d8d45b1df2 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] 10.222.0.18 "GET /compute/v2.1/servers/b89094ac-aee1-4bd6-a33d-8c4347cebfc7/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041826 Dec 15 03:12:52.614384 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: [pid: 116157|app: 0|req: 701/1401] 10.222.0.18 () {60 vars in 1342 bytes} [Wed Dec 15 03:12:52 2021] GET /compute/v2.1/servers/b89094ac-aee1-4bd6-a33d-8c4347cebfc7/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Dec 15 03:12:52.624077 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.policy [None req-b6443dd0-386e-4ed1-8ade-3a63646bc766 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97bdf19af9e34fc3886ff451cb9d7a27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '494b56bf5eae4d56a5591546f85bc32b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116156) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:12:52.631466 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: INFO nova.api.openstack.requestlog [None req-b6443dd0-386e-4ed1-8ade-3a63646bc766 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] 10.222.0.18 "GET /compute/v2.1/servers/bbb8462c-9501-4541-b67e-43ec5c5061a7" status: 200 len: 1226 microversion: 2.1 time: 0.081906 Dec 15 03:12:52.632016 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: [pid: 116156|app: 0|req: 701/1402] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 03:12:52 2021] GET /compute/v2.1/servers/bbb8462c-9501-4541-b67e-43ec5c5061a7 => generated 1226 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 03:12:53.538749 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi [None req-68b8bdfc-6a34-4322-b5e7-b784ef3b6bf8 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Calling method '>' {{(pid=116157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:12:53.539279 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.compute.api [None req-68b8bdfc-6a34-4322-b5e7-b784ef3b6bf8 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] [instance: fa7c86bc-c46f-4120-8f3d-d795f8d7c5cc] Fetching instance by UUID {{(pid=116157) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:12:53.546100 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-68b8bdfc-6a34-4322-b5e7-b784ef3b6bf8 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:12:53.546543 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-68b8bdfc-6a34-4322-b5e7-b784ef3b6bf8 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:12:53.547313 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-68b8bdfc-6a34-4322-b5e7-b784ef3b6bf8 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:12:53.547748 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-68b8bdfc-6a34-4322-b5e7-b784ef3b6bf8 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:12:53.624722 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi [None req-81504330-8802-4c73-b9c7-1e1e315a0d17 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Calling method '>' {{(pid=116156) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:12:53.625500 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.compute.api [None req-81504330-8802-4c73-b9c7-1e1e315a0d17 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] [instance: b89094ac-aee1-4bd6-a33d-8c4347cebfc7] Fetching instance by UUID {{(pid=116156) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:12:53.631788 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-81504330-8802-4c73-b9c7-1e1e315a0d17 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:12:53.632242 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-81504330-8802-4c73-b9c7-1e1e315a0d17 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:12:53.633021 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-81504330-8802-4c73-b9c7-1e1e315a0d17 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:12:53.633454 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-81504330-8802-4c73-b9c7-1e1e315a0d17 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:12:53.662899 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: INFO nova.api.openstack.requestlog [None req-81504330-8802-4c73-b9c7-1e1e315a0d17 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] 10.222.0.18 "GET /compute/v2.1/servers/b89094ac-aee1-4bd6-a33d-8c4347cebfc7/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041990 Dec 15 03:12:53.663463 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: [pid: 116156|app: 0|req: 702/1403] 10.222.0.18 () {60 vars in 1342 bytes} [Wed Dec 15 03:12:53 2021] GET /compute/v2.1/servers/b89094ac-aee1-4bd6-a33d-8c4347cebfc7/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Dec 15 03:12:53.667637 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi [None req-d68eb6f2-b131-41e0-8354-58be013fe64b tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Calling method '>' {{(pid=116156) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:12:53.668243 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.compute.api [None req-d68eb6f2-b131-41e0-8354-58be013fe64b tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] [instance: bbb8462c-9501-4541-b67e-43ec5c5061a7] Fetching instance by UUID {{(pid=116156) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:12:53.673755 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-d68eb6f2-b131-41e0-8354-58be013fe64b tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:12:53.674238 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-d68eb6f2-b131-41e0-8354-58be013fe64b tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:12:53.675018 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-d68eb6f2-b131-41e0-8354-58be013fe64b tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:12:53.675454 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-d68eb6f2-b131-41e0-8354-58be013fe64b tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:12:53.680023 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.policy [None req-68b8bdfc-6a34-4322-b5e7-b784ef3b6bf8 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c4c0c82448e40ba801c0b52ec44e74a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a093d0bf43046aaa845f3cc115f3f5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116157) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:12:53.687263 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: INFO nova.api.openstack.requestlog [None req-68b8bdfc-6a34-4322-b5e7-b784ef3b6bf8 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] 10.222.0.18 "GET /compute/v2.1/servers/fa7c86bc-c46f-4120-8f3d-d795f8d7c5cc" status: 200 len: 1570 microversion: 2.1 time: 0.152263 Dec 15 03:12:53.687851 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: [pid: 116157|app: 0|req: 702/1404] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 03:12:53 2021] GET /compute/v2.1/servers/fa7c86bc-c46f-4120-8f3d-d795f8d7c5cc => generated 1570 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 03:12:53.733117 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.policy [None req-d68eb6f2-b131-41e0-8354-58be013fe64b tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97bdf19af9e34fc3886ff451cb9d7a27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '494b56bf5eae4d56a5591546f85bc32b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116156) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:12:53.740478 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: INFO nova.api.openstack.requestlog [None req-d68eb6f2-b131-41e0-8354-58be013fe64b tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] 10.222.0.18 "GET /compute/v2.1/servers/bbb8462c-9501-4541-b67e-43ec5c5061a7" status: 200 len: 1226 microversion: 2.1 time: 0.076079 Dec 15 03:12:53.741029 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: [pid: 116156|app: 0|req: 703/1405] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 03:12:53 2021] GET /compute/v2.1/servers/bbb8462c-9501-4541-b67e-43ec5c5061a7 => generated 1226 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 03:12:54.674208 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi [None req-b38e0c2c-d8e3-4c55-bb10-f2920a6c008d tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Calling method '>' {{(pid=116157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:12:54.675176 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.compute.api [None req-b38e0c2c-d8e3-4c55-bb10-f2920a6c008d tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] [instance: b89094ac-aee1-4bd6-a33d-8c4347cebfc7] Fetching instance by UUID {{(pid=116157) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:12:54.681336 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-b38e0c2c-d8e3-4c55-bb10-f2920a6c008d tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:12:54.681783 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-b38e0c2c-d8e3-4c55-bb10-f2920a6c008d tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:12:54.682591 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-b38e0c2c-d8e3-4c55-bb10-f2920a6c008d tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:12:54.683028 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-b38e0c2c-d8e3-4c55-bb10-f2920a6c008d tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:12:54.704769 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi [None req-6ca9dae7-7e00-422c-afee-c64fe4fa16ca tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Calling method '>' {{(pid=116156) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:12:54.705463 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.compute.api [None req-6ca9dae7-7e00-422c-afee-c64fe4fa16ca tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] [instance: fa7c86bc-c46f-4120-8f3d-d795f8d7c5cc] Fetching instance by UUID {{(pid=116156) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:12:54.711650 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-6ca9dae7-7e00-422c-afee-c64fe4fa16ca tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:12:54.711852 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: INFO nova.api.openstack.requestlog [None req-b38e0c2c-d8e3-4c55-bb10-f2920a6c008d tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] 10.222.0.18 "GET /compute/v2.1/servers/b89094ac-aee1-4bd6-a33d-8c4347cebfc7/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041413 Dec 15 03:12:54.712099 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-6ca9dae7-7e00-422c-afee-c64fe4fa16ca tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:12:54.712893 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: [pid: 116157|app: 0|req: 703/1406] 10.222.0.18 () {60 vars in 1342 bytes} [Wed Dec 15 03:12:54 2021] GET /compute/v2.1/servers/b89094ac-aee1-4bd6-a33d-8c4347cebfc7/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 03:12:54.713412 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-6ca9dae7-7e00-422c-afee-c64fe4fa16ca tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:12:54.713844 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-6ca9dae7-7e00-422c-afee-c64fe4fa16ca tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:12:54.756585 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi [None req-2aff7898-7ce0-4c19-8d41-36a93e99411e tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Calling method '>' {{(pid=116157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:12:54.757101 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.compute.api [None req-2aff7898-7ce0-4c19-8d41-36a93e99411e tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] [instance: bbb8462c-9501-4541-b67e-43ec5c5061a7] Fetching instance by UUID {{(pid=116157) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:12:54.762875 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-2aff7898-7ce0-4c19-8d41-36a93e99411e tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:12:54.763325 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-2aff7898-7ce0-4c19-8d41-36a93e99411e tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:12:54.764095 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-2aff7898-7ce0-4c19-8d41-36a93e99411e tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:12:54.764525 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-2aff7898-7ce0-4c19-8d41-36a93e99411e tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:12:54.822957 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.policy [None req-2aff7898-7ce0-4c19-8d41-36a93e99411e tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97bdf19af9e34fc3886ff451cb9d7a27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '494b56bf5eae4d56a5591546f85bc32b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116157) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:12:54.830110 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: INFO nova.api.openstack.requestlog [None req-2aff7898-7ce0-4c19-8d41-36a93e99411e tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] 10.222.0.18 "GET /compute/v2.1/servers/bbb8462c-9501-4541-b67e-43ec5c5061a7" status: 200 len: 1226 microversion: 2.1 time: 0.077457 Dec 15 03:12:54.830670 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: [pid: 116157|app: 0|req: 704/1407] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 03:12:54 2021] GET /compute/v2.1/servers/bbb8462c-9501-4541-b67e-43ec5c5061a7 => generated 1226 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 03:12:54.843790 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.policy [None req-6ca9dae7-7e00-422c-afee-c64fe4fa16ca tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c4c0c82448e40ba801c0b52ec44e74a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a093d0bf43046aaa845f3cc115f3f5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116156) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:12:54.851074 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: INFO nova.api.openstack.requestlog [None req-6ca9dae7-7e00-422c-afee-c64fe4fa16ca tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] 10.222.0.18 "GET /compute/v2.1/servers/fa7c86bc-c46f-4120-8f3d-d795f8d7c5cc" status: 200 len: 1570 microversion: 2.1 time: 0.149908 Dec 15 03:12:54.851622 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: [pid: 116156|app: 0|req: 704/1408] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 03:12:54 2021] GET /compute/v2.1/servers/fa7c86bc-c46f-4120-8f3d-d795f8d7c5cc => generated 1570 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 03:12:55.723848 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi [None req-eed3176e-8106-4b27-9126-d4c9cce1eccb tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Calling method '>' {{(pid=116157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:12:55.724875 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.compute.api [None req-eed3176e-8106-4b27-9126-d4c9cce1eccb tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] [instance: b89094ac-aee1-4bd6-a33d-8c4347cebfc7] Fetching instance by UUID {{(pid=116157) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:12:55.731163 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-eed3176e-8106-4b27-9126-d4c9cce1eccb tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:12:55.731609 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-eed3176e-8106-4b27-9126-d4c9cce1eccb tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:12:55.732409 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-eed3176e-8106-4b27-9126-d4c9cce1eccb tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:12:55.732841 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-eed3176e-8106-4b27-9126-d4c9cce1eccb tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:12:55.761535 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: INFO nova.api.openstack.requestlog [None req-eed3176e-8106-4b27-9126-d4c9cce1eccb tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] 10.222.0.18 "GET /compute/v2.1/servers/b89094ac-aee1-4bd6-a33d-8c4347cebfc7/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041516 Dec 15 03:12:55.762093 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: [pid: 116157|app: 0|req: 705/1409] 10.222.0.18 () {60 vars in 1342 bytes} [Wed Dec 15 03:12:55 2021] GET /compute/v2.1/servers/b89094ac-aee1-4bd6-a33d-8c4347cebfc7/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 03:12:55.846589 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi [None req-b89297ac-97ef-4f95-813e-bd5066127107 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Calling method '>' {{(pid=116156) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:12:55.847198 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.compute.api [None req-b89297ac-97ef-4f95-813e-bd5066127107 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] [instance: bbb8462c-9501-4541-b67e-43ec5c5061a7] Fetching instance by UUID {{(pid=116156) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:12:55.853844 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-b89297ac-97ef-4f95-813e-bd5066127107 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:12:55.854321 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-b89297ac-97ef-4f95-813e-bd5066127107 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:12:55.855096 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-b89297ac-97ef-4f95-813e-bd5066127107 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:12:55.855524 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-b89297ac-97ef-4f95-813e-bd5066127107 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:12:55.868291 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi [None req-81ab9b12-27c6-4cbd-b521-c163562e4e4b tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Calling method '>' {{(pid=116157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:12:55.869635 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.compute.api [None req-81ab9b12-27c6-4cbd-b521-c163562e4e4b tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] [instance: fa7c86bc-c46f-4120-8f3d-d795f8d7c5cc] Fetching instance by UUID {{(pid=116157) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:12:55.875990 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-81ab9b12-27c6-4cbd-b521-c163562e4e4b tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:12:55.876439 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-81ab9b12-27c6-4cbd-b521-c163562e4e4b tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:12:55.877229 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-81ab9b12-27c6-4cbd-b521-c163562e4e4b tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:12:55.877661 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-81ab9b12-27c6-4cbd-b521-c163562e4e4b tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:12:56.016518 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.policy [None req-81ab9b12-27c6-4cbd-b521-c163562e4e4b tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c4c0c82448e40ba801c0b52ec44e74a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a093d0bf43046aaa845f3cc115f3f5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116157) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:12:56.023805 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: INFO nova.api.openstack.requestlog [None req-81ab9b12-27c6-4cbd-b521-c163562e4e4b tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] 10.222.0.18 "GET /compute/v2.1/servers/fa7c86bc-c46f-4120-8f3d-d795f8d7c5cc" status: 200 len: 1570 microversion: 2.1 time: 0.159153 Dec 15 03:12:56.024371 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: [pid: 116157|app: 0|req: 706/1410] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 03:12:55 2021] GET /compute/v2.1/servers/fa7c86bc-c46f-4120-8f3d-d795f8d7c5cc => generated 1570 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 03:12:56.059835 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.policy [None req-b89297ac-97ef-4f95-813e-bd5066127107 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97bdf19af9e34fc3886ff451cb9d7a27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '494b56bf5eae4d56a5591546f85bc32b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116156) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:12:56.067162 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: INFO nova.api.openstack.requestlog [None req-b89297ac-97ef-4f95-813e-bd5066127107 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] 10.222.0.18 "GET /compute/v2.1/servers/bbb8462c-9501-4541-b67e-43ec5c5061a7" status: 200 len: 1226 microversion: 2.1 time: 0.224111 Dec 15 03:12:56.067708 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: [pid: 116156|app: 0|req: 705/1411] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 03:12:55 2021] GET /compute/v2.1/servers/bbb8462c-9501-4541-b67e-43ec5c5061a7 => generated 1226 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 03:12:56.153230 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Dec 15 03:12:56.153439 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: Wed Dec 15 03:12:56 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Dec 15 03:12:56.772599 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi [None req-acc7a7dc-fa6f-4dac-ab15-4243469dff7b tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Calling method '>' {{(pid=116157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:12:56.773497 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.compute.api [None req-acc7a7dc-fa6f-4dac-ab15-4243469dff7b tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] [instance: b89094ac-aee1-4bd6-a33d-8c4347cebfc7] Fetching instance by UUID {{(pid=116157) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:12:56.780326 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-acc7a7dc-fa6f-4dac-ab15-4243469dff7b tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:12:56.780769 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-acc7a7dc-fa6f-4dac-ab15-4243469dff7b tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:12:56.781535 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-acc7a7dc-fa6f-4dac-ab15-4243469dff7b tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:12:56.781964 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-acc7a7dc-fa6f-4dac-ab15-4243469dff7b tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:12:56.809330 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: INFO nova.api.openstack.requestlog [None req-acc7a7dc-fa6f-4dac-ab15-4243469dff7b tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] 10.222.0.18 "GET /compute/v2.1/servers/b89094ac-aee1-4bd6-a33d-8c4347cebfc7/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.040501 Dec 15 03:12:56.809856 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: [pid: 116157|app: 0|req: 707/1412] 10.222.0.18 () {60 vars in 1342 bytes} [Wed Dec 15 03:12:56 2021] GET /compute/v2.1/servers/b89094ac-aee1-4bd6-a33d-8c4347cebfc7/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 03:12:57.040528 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi [None req-9ea4a280-06b3-48a8-aeb2-fd9adc358313 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Calling method '>' {{(pid=116156) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:12:57.041098 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.compute.api [None req-9ea4a280-06b3-48a8-aeb2-fd9adc358313 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] [instance: fa7c86bc-c46f-4120-8f3d-d795f8d7c5cc] Fetching instance by UUID {{(pid=116156) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:12:57.047227 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-9ea4a280-06b3-48a8-aeb2-fd9adc358313 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:12:57.047672 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-9ea4a280-06b3-48a8-aeb2-fd9adc358313 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:12:57.048437 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-9ea4a280-06b3-48a8-aeb2-fd9adc358313 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:12:57.048868 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-9ea4a280-06b3-48a8-aeb2-fd9adc358313 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:12:57.083574 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi [None req-5c52fa74-23bd-4a49-b61c-eac605e9a78e tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Calling method '>' {{(pid=116157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:12:57.084281 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.compute.api [None req-5c52fa74-23bd-4a49-b61c-eac605e9a78e tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] [instance: bbb8462c-9501-4541-b67e-43ec5c5061a7] Fetching instance by UUID {{(pid=116157) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:12:57.090238 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-5c52fa74-23bd-4a49-b61c-eac605e9a78e tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:12:57.090761 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-5c52fa74-23bd-4a49-b61c-eac605e9a78e tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:12:57.091610 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-5c52fa74-23bd-4a49-b61c-eac605e9a78e tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:12:57.092045 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-5c52fa74-23bd-4a49-b61c-eac605e9a78e tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:12:57.150422 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.policy [None req-5c52fa74-23bd-4a49-b61c-eac605e9a78e tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97bdf19af9e34fc3886ff451cb9d7a27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '494b56bf5eae4d56a5591546f85bc32b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116157) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:12:57.157659 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: INFO nova.api.openstack.requestlog [None req-5c52fa74-23bd-4a49-b61c-eac605e9a78e tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] 10.222.0.18 "GET /compute/v2.1/servers/bbb8462c-9501-4541-b67e-43ec5c5061a7" status: 200 len: 1226 microversion: 2.1 time: 0.077631 Dec 15 03:12:57.158514 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: [pid: 116157|app: 0|req: 708/1413] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 03:12:57 2021] GET /compute/v2.1/servers/bbb8462c-9501-4541-b67e-43ec5c5061a7 => generated 1226 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 03:12:57.182535 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.policy [None req-9ea4a280-06b3-48a8-aeb2-fd9adc358313 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c4c0c82448e40ba801c0b52ec44e74a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a093d0bf43046aaa845f3cc115f3f5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116156) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:12:57.189891 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: INFO nova.api.openstack.requestlog [None req-9ea4a280-06b3-48a8-aeb2-fd9adc358313 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] 10.222.0.18 "GET /compute/v2.1/servers/fa7c86bc-c46f-4120-8f3d-d795f8d7c5cc" status: 200 len: 1570 microversion: 2.1 time: 0.153062 Dec 15 03:12:57.190479 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: [pid: 116156|app: 0|req: 706/1414] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 03:12:57 2021] GET /compute/v2.1/servers/fa7c86bc-c46f-4120-8f3d-d795f8d7c5cc => generated 1570 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 03:12:57.820130 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi [None req-60c5f085-7c50-43a2-bab3-f10a40b8f15a tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Calling method '>' {{(pid=116157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:12:57.821027 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.compute.api [None req-60c5f085-7c50-43a2-bab3-f10a40b8f15a tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] [instance: b89094ac-aee1-4bd6-a33d-8c4347cebfc7] Fetching instance by UUID {{(pid=116157) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:12:57.827226 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-60c5f085-7c50-43a2-bab3-f10a40b8f15a tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:12:57.827672 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-60c5f085-7c50-43a2-bab3-f10a40b8f15a tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:12:57.828444 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-60c5f085-7c50-43a2-bab3-f10a40b8f15a tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:12:57.828883 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-60c5f085-7c50-43a2-bab3-f10a40b8f15a tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:12:57.857761 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: INFO nova.api.openstack.requestlog [None req-60c5f085-7c50-43a2-bab3-f10a40b8f15a tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] 10.222.0.18 "GET /compute/v2.1/servers/b89094ac-aee1-4bd6-a33d-8c4347cebfc7/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041389 Dec 15 03:12:57.858331 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: [pid: 116157|app: 0|req: 709/1415] 10.222.0.18 () {60 vars in 1342 bytes} [Wed Dec 15 03:12:57 2021] GET /compute/v2.1/servers/b89094ac-aee1-4bd6-a33d-8c4347cebfc7/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 03:12:58.173607 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi [None req-77267fc6-ae21-40e0-a28d-2337d5aa5b01 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Calling method '>' {{(pid=116156) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:12:58.174237 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.compute.api [None req-77267fc6-ae21-40e0-a28d-2337d5aa5b01 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] [instance: bbb8462c-9501-4541-b67e-43ec5c5061a7] Fetching instance by UUID {{(pid=116156) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:12:58.180466 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-77267fc6-ae21-40e0-a28d-2337d5aa5b01 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:12:58.180918 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-77267fc6-ae21-40e0-a28d-2337d5aa5b01 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:12:58.181696 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-77267fc6-ae21-40e0-a28d-2337d5aa5b01 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:12:58.182163 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-77267fc6-ae21-40e0-a28d-2337d5aa5b01 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:12:58.208529 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi [None req-7f83a792-d5e0-4ce7-819c-d9e4ee44fa6e tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Calling method '>' {{(pid=116157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:12:58.210178 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.compute.api [None req-7f83a792-d5e0-4ce7-819c-d9e4ee44fa6e tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] [instance: fa7c86bc-c46f-4120-8f3d-d795f8d7c5cc] Fetching instance by UUID {{(pid=116157) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:12:58.216661 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-7f83a792-d5e0-4ce7-819c-d9e4ee44fa6e tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:12:58.217110 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-7f83a792-d5e0-4ce7-819c-d9e4ee44fa6e tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:12:58.217888 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-7f83a792-d5e0-4ce7-819c-d9e4ee44fa6e tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:12:58.218351 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-7f83a792-d5e0-4ce7-819c-d9e4ee44fa6e tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:12:58.242692 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.policy [None req-77267fc6-ae21-40e0-a28d-2337d5aa5b01 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97bdf19af9e34fc3886ff451cb9d7a27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '494b56bf5eae4d56a5591546f85bc32b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116156) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:12:58.252159 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: INFO nova.api.openstack.requestlog [None req-77267fc6-ae21-40e0-a28d-2337d5aa5b01 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] 10.222.0.18 "GET /compute/v2.1/servers/bbb8462c-9501-4541-b67e-43ec5c5061a7" status: 200 len: 1226 microversion: 2.1 time: 0.082266 Dec 15 03:12:58.252726 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: [pid: 116156|app: 0|req: 707/1416] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 03:12:58 2021] GET /compute/v2.1/servers/bbb8462c-9501-4541-b67e-43ec5c5061a7 => generated 1226 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 03:12:58.352133 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.policy [None req-7f83a792-d5e0-4ce7-819c-d9e4ee44fa6e tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c4c0c82448e40ba801c0b52ec44e74a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a093d0bf43046aaa845f3cc115f3f5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116157) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:12:58.359504 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: INFO nova.api.openstack.requestlog [None req-7f83a792-d5e0-4ce7-819c-d9e4ee44fa6e tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] 10.222.0.18 "GET /compute/v2.1/servers/fa7c86bc-c46f-4120-8f3d-d795f8d7c5cc" status: 200 len: 1570 microversion: 2.1 time: 0.154708 Dec 15 03:12:58.360056 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: [pid: 116157|app: 0|req: 710/1417] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 03:12:58 2021] GET /compute/v2.1/servers/fa7c86bc-c46f-4120-8f3d-d795f8d7c5cc => generated 1570 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 03:12:58.869246 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi [None req-13bd96f7-654f-4009-8031-63b93ea9f421 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Calling method '>' {{(pid=116156) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:12:58.870218 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.compute.api [None req-13bd96f7-654f-4009-8031-63b93ea9f421 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] [instance: b89094ac-aee1-4bd6-a33d-8c4347cebfc7] Fetching instance by UUID {{(pid=116156) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:12:58.875993 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-13bd96f7-654f-4009-8031-63b93ea9f421 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:12:58.876447 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-13bd96f7-654f-4009-8031-63b93ea9f421 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:12:58.877225 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-13bd96f7-654f-4009-8031-63b93ea9f421 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:12:58.877663 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-13bd96f7-654f-4009-8031-63b93ea9f421 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:12:58.906300 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: INFO nova.api.openstack.requestlog [None req-13bd96f7-654f-4009-8031-63b93ea9f421 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] 10.222.0.18 "GET /compute/v2.1/servers/b89094ac-aee1-4bd6-a33d-8c4347cebfc7/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041425 Dec 15 03:12:58.906838 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: [pid: 116156|app: 0|req: 708/1418] 10.222.0.18 () {60 vars in 1342 bytes} [Wed Dec 15 03:12:58 2021] GET /compute/v2.1/servers/b89094ac-aee1-4bd6-a33d-8c4347cebfc7/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 03:12:59.268377 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi [None req-198bfa99-a573-468f-889a-e6b934fdbb60 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Calling method '>' {{(pid=116157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:12:59.268984 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.compute.api [None req-198bfa99-a573-468f-889a-e6b934fdbb60 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] [instance: bbb8462c-9501-4541-b67e-43ec5c5061a7] Fetching instance by UUID {{(pid=116157) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:12:59.275726 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-198bfa99-a573-468f-889a-e6b934fdbb60 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:12:59.276172 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-198bfa99-a573-468f-889a-e6b934fdbb60 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:12:59.276938 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-198bfa99-a573-468f-889a-e6b934fdbb60 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:12:59.277369 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-198bfa99-a573-468f-889a-e6b934fdbb60 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:12:59.335525 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.policy [None req-198bfa99-a573-468f-889a-e6b934fdbb60 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97bdf19af9e34fc3886ff451cb9d7a27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '494b56bf5eae4d56a5591546f85bc32b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116157) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:12:59.343182 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: INFO nova.api.openstack.requestlog [None req-198bfa99-a573-468f-889a-e6b934fdbb60 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] 10.222.0.18 "GET /compute/v2.1/servers/bbb8462c-9501-4541-b67e-43ec5c5061a7" status: 200 len: 1226 microversion: 2.1 time: 0.078413 Dec 15 03:12:59.343735 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: [pid: 116157|app: 0|req: 711/1419] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 03:12:59 2021] GET /compute/v2.1/servers/bbb8462c-9501-4541-b67e-43ec5c5061a7 => generated 1226 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 03:12:59.376750 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi [None req-743bd53e-0d6e-4998-ad4c-4c3b3f2dde9e tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Calling method '>' {{(pid=116156) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:12:59.377725 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.compute.api [None req-743bd53e-0d6e-4998-ad4c-4c3b3f2dde9e tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] [instance: fa7c86bc-c46f-4120-8f3d-d795f8d7c5cc] Fetching instance by UUID {{(pid=116156) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:12:59.384327 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-743bd53e-0d6e-4998-ad4c-4c3b3f2dde9e tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:12:59.384767 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-743bd53e-0d6e-4998-ad4c-4c3b3f2dde9e tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:12:59.385547 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-743bd53e-0d6e-4998-ad4c-4c3b3f2dde9e tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:12:59.386004 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-743bd53e-0d6e-4998-ad4c-4c3b3f2dde9e tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:12:59.514547 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.policy [None req-743bd53e-0d6e-4998-ad4c-4c3b3f2dde9e tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c4c0c82448e40ba801c0b52ec44e74a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a093d0bf43046aaa845f3cc115f3f5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116156) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:12:59.521723 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: INFO nova.api.openstack.requestlog [None req-743bd53e-0d6e-4998-ad4c-4c3b3f2dde9e tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] 10.222.0.18 "GET /compute/v2.1/servers/fa7c86bc-c46f-4120-8f3d-d795f8d7c5cc" status: 200 len: 1570 microversion: 2.1 time: 0.148608 Dec 15 03:12:59.522305 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: [pid: 116156|app: 0|req: 709/1420] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 03:12:59 2021] GET /compute/v2.1/servers/fa7c86bc-c46f-4120-8f3d-d795f8d7c5cc => generated 1570 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 03:12:59.916849 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi [None req-ccea421a-db6d-41e0-94ff-a49e468554a4 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Calling method '>' {{(pid=116157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:12:59.917750 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.compute.api [None req-ccea421a-db6d-41e0-94ff-a49e468554a4 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] [instance: b89094ac-aee1-4bd6-a33d-8c4347cebfc7] Fetching instance by UUID {{(pid=116157) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:12:59.923550 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-ccea421a-db6d-41e0-94ff-a49e468554a4 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:12:59.924005 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-ccea421a-db6d-41e0-94ff-a49e468554a4 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:12:59.924782 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-ccea421a-db6d-41e0-94ff-a49e468554a4 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:12:59.925219 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-ccea421a-db6d-41e0-94ff-a49e468554a4 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:12:59.953961 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: INFO nova.api.openstack.requestlog [None req-ccea421a-db6d-41e0-94ff-a49e468554a4 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] 10.222.0.18 "GET /compute/v2.1/servers/b89094ac-aee1-4bd6-a33d-8c4347cebfc7/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.040931 Dec 15 03:12:59.954518 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: [pid: 116157|app: 0|req: 712/1421] 10.222.0.18 () {60 vars in 1342 bytes} [Wed Dec 15 03:12:59 2021] GET /compute/v2.1/servers/b89094ac-aee1-4bd6-a33d-8c4347cebfc7/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 03:13:00.359569 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi [None req-163ee180-d324-4656-892b-a8621fa4cfe8 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Calling method '>' {{(pid=116156) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:13:00.360175 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.compute.api [None req-163ee180-d324-4656-892b-a8621fa4cfe8 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] [instance: bbb8462c-9501-4541-b67e-43ec5c5061a7] Fetching instance by UUID {{(pid=116156) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:13:00.366236 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-163ee180-d324-4656-892b-a8621fa4cfe8 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:13:00.366683 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-163ee180-d324-4656-892b-a8621fa4cfe8 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:13:00.367455 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-163ee180-d324-4656-892b-a8621fa4cfe8 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:13:00.367887 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-163ee180-d324-4656-892b-a8621fa4cfe8 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:13:00.424759 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.policy [None req-163ee180-d324-4656-892b-a8621fa4cfe8 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97bdf19af9e34fc3886ff451cb9d7a27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '494b56bf5eae4d56a5591546f85bc32b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116156) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:13:00.432502 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: INFO nova.api.openstack.requestlog [None req-163ee180-d324-4656-892b-a8621fa4cfe8 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] 10.222.0.18 "GET /compute/v2.1/servers/bbb8462c-9501-4541-b67e-43ec5c5061a7" status: 200 len: 1226 microversion: 2.1 time: 0.076538 Dec 15 03:13:00.433044 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: [pid: 116156|app: 0|req: 710/1422] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 03:13:00 2021] GET /compute/v2.1/servers/bbb8462c-9501-4541-b67e-43ec5c5061a7 => generated 1226 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 03:13:00.538447 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi [None req-840db5ee-f6db-46e5-81bb-e072163acadb tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Calling method '>' {{(pid=116157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:13:00.538978 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.compute.api [None req-840db5ee-f6db-46e5-81bb-e072163acadb tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] [instance: fa7c86bc-c46f-4120-8f3d-d795f8d7c5cc] Fetching instance by UUID {{(pid=116157) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:13:00.545259 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-840db5ee-f6db-46e5-81bb-e072163acadb tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:13:00.545704 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-840db5ee-f6db-46e5-81bb-e072163acadb tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:13:00.546501 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-840db5ee-f6db-46e5-81bb-e072163acadb tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:13:00.546932 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-840db5ee-f6db-46e5-81bb-e072163acadb tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:13:00.677273 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.policy [None req-840db5ee-f6db-46e5-81bb-e072163acadb tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c4c0c82448e40ba801c0b52ec44e74a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a093d0bf43046aaa845f3cc115f3f5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116157) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:13:00.684461 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: INFO nova.api.openstack.requestlog [None req-840db5ee-f6db-46e5-81bb-e072163acadb tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] 10.222.0.18 "GET /compute/v2.1/servers/fa7c86bc-c46f-4120-8f3d-d795f8d7c5cc" status: 200 len: 1570 microversion: 2.1 time: 0.149771 Dec 15 03:13:00.685012 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: [pid: 116157|app: 0|req: 713/1423] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 03:13:00 2021] GET /compute/v2.1/servers/fa7c86bc-c46f-4120-8f3d-d795f8d7c5cc => generated 1570 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 03:13:00.965638 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi [None req-72f0c3ae-dcb9-4c71-ae9e-69e6c2e66f3f tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Calling method '>' {{(pid=116156) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:13:00.966562 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.compute.api [None req-72f0c3ae-dcb9-4c71-ae9e-69e6c2e66f3f tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] [instance: b89094ac-aee1-4bd6-a33d-8c4347cebfc7] Fetching instance by UUID {{(pid=116156) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:13:00.972406 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-72f0c3ae-dcb9-4c71-ae9e-69e6c2e66f3f tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:13:00.972859 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-72f0c3ae-dcb9-4c71-ae9e-69e6c2e66f3f tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:13:00.973634 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-72f0c3ae-dcb9-4c71-ae9e-69e6c2e66f3f tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:13:00.974099 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-72f0c3ae-dcb9-4c71-ae9e-69e6c2e66f3f tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:13:01.002246 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: INFO nova.api.openstack.requestlog [None req-72f0c3ae-dcb9-4c71-ae9e-69e6c2e66f3f tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] 10.222.0.18 "GET /compute/v2.1/servers/b89094ac-aee1-4bd6-a33d-8c4347cebfc7/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.040794 Dec 15 03:13:01.002802 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: [pid: 116156|app: 0|req: 711/1424] 10.222.0.18 () {60 vars in 1342 bytes} [Wed Dec 15 03:13:00 2021] GET /compute/v2.1/servers/b89094ac-aee1-4bd6-a33d-8c4347cebfc7/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 03:13:01.448835 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi [None req-1352ad76-eca4-43a1-80c6-8717aa11a0f2 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Calling method '>' {{(pid=116157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:13:01.449440 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.compute.api [None req-1352ad76-eca4-43a1-80c6-8717aa11a0f2 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] [instance: bbb8462c-9501-4541-b67e-43ec5c5061a7] Fetching instance by UUID {{(pid=116157) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:13:01.455305 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-1352ad76-eca4-43a1-80c6-8717aa11a0f2 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:13:01.455749 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-1352ad76-eca4-43a1-80c6-8717aa11a0f2 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:13:01.456521 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-1352ad76-eca4-43a1-80c6-8717aa11a0f2 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:13:01.456955 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-1352ad76-eca4-43a1-80c6-8717aa11a0f2 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:13:01.514275 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.policy [None req-1352ad76-eca4-43a1-80c6-8717aa11a0f2 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97bdf19af9e34fc3886ff451cb9d7a27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '494b56bf5eae4d56a5591546f85bc32b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116157) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:13:01.521297 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: INFO nova.api.openstack.requestlog [None req-1352ad76-eca4-43a1-80c6-8717aa11a0f2 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] 10.222.0.18 "GET /compute/v2.1/servers/bbb8462c-9501-4541-b67e-43ec5c5061a7" status: 200 len: 1226 microversion: 2.1 time: 0.076088 Dec 15 03:13:01.521849 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: [pid: 116157|app: 0|req: 714/1425] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 03:13:01 2021] GET /compute/v2.1/servers/bbb8462c-9501-4541-b67e-43ec5c5061a7 => generated 1226 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 03:13:01.700294 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi [None req-740a8832-c05c-43dc-9a47-a85c351fa2a5 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Calling method '>' {{(pid=116156) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:13:01.700901 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.compute.api [None req-740a8832-c05c-43dc-9a47-a85c351fa2a5 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] [instance: fa7c86bc-c46f-4120-8f3d-d795f8d7c5cc] Fetching instance by UUID {{(pid=116156) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:13:01.707139 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-740a8832-c05c-43dc-9a47-a85c351fa2a5 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:13:01.707594 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-740a8832-c05c-43dc-9a47-a85c351fa2a5 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:13:01.708366 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-740a8832-c05c-43dc-9a47-a85c351fa2a5 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:13:01.708807 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-740a8832-c05c-43dc-9a47-a85c351fa2a5 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:13:01.842090 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.policy [None req-740a8832-c05c-43dc-9a47-a85c351fa2a5 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c4c0c82448e40ba801c0b52ec44e74a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a093d0bf43046aaa845f3cc115f3f5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116156) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:13:01.850110 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: INFO nova.api.openstack.requestlog [None req-740a8832-c05c-43dc-9a47-a85c351fa2a5 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] 10.222.0.18 "GET /compute/v2.1/servers/fa7c86bc-c46f-4120-8f3d-d795f8d7c5cc" status: 200 len: 1570 microversion: 2.1 time: 0.153372 Dec 15 03:13:01.850660 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: [pid: 116156|app: 0|req: 712/1426] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 03:13:01 2021] GET /compute/v2.1/servers/fa7c86bc-c46f-4120-8f3d-d795f8d7c5cc => generated 1570 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 03:13:02.012976 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi [None req-a28c9dc5-fbd2-492e-b42f-e6cb3d10e63e tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Calling method '>' {{(pid=116157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:13:02.013891 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.compute.api [None req-a28c9dc5-fbd2-492e-b42f-e6cb3d10e63e tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] [instance: b89094ac-aee1-4bd6-a33d-8c4347cebfc7] Fetching instance by UUID {{(pid=116157) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:13:02.020189 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-a28c9dc5-fbd2-492e-b42f-e6cb3d10e63e tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:13:02.020643 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-a28c9dc5-fbd2-492e-b42f-e6cb3d10e63e tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:13:02.021436 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-a28c9dc5-fbd2-492e-b42f-e6cb3d10e63e tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:13:02.021879 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-a28c9dc5-fbd2-492e-b42f-e6cb3d10e63e tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:13:02.051661 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: INFO nova.api.openstack.requestlog [None req-a28c9dc5-fbd2-492e-b42f-e6cb3d10e63e tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] 10.222.0.18 "GET /compute/v2.1/servers/b89094ac-aee1-4bd6-a33d-8c4347cebfc7/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042922 Dec 15 03:13:02.052199 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: [pid: 116157|app: 0|req: 715/1427] 10.222.0.18 () {60 vars in 1342 bytes} [Wed Dec 15 03:13:02 2021] GET /compute/v2.1/servers/b89094ac-aee1-4bd6-a33d-8c4347cebfc7/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 03:13:02.538384 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi [None req-9b23f037-adb2-404d-a1ea-3743eb8cd0e4 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Calling method '>' {{(pid=116156) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:13:02.538917 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.compute.api [None req-9b23f037-adb2-404d-a1ea-3743eb8cd0e4 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] [instance: bbb8462c-9501-4541-b67e-43ec5c5061a7] Fetching instance by UUID {{(pid=116156) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:13:02.545238 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-9b23f037-adb2-404d-a1ea-3743eb8cd0e4 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:13:02.545681 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-9b23f037-adb2-404d-a1ea-3743eb8cd0e4 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:13:02.546478 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-9b23f037-adb2-404d-a1ea-3743eb8cd0e4 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:13:02.546912 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-9b23f037-adb2-404d-a1ea-3743eb8cd0e4 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:13:02.604329 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.policy [None req-9b23f037-adb2-404d-a1ea-3743eb8cd0e4 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97bdf19af9e34fc3886ff451cb9d7a27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '494b56bf5eae4d56a5591546f85bc32b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116156) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:13:02.611383 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: INFO nova.api.openstack.requestlog [None req-9b23f037-adb2-404d-a1ea-3743eb8cd0e4 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] 10.222.0.18 "GET /compute/v2.1/servers/bbb8462c-9501-4541-b67e-43ec5c5061a7" status: 200 len: 1226 microversion: 2.1 time: 0.076679 Dec 15 03:13:02.612189 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: [pid: 116156|app: 0|req: 713/1428] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 03:13:02 2021] GET /compute/v2.1/servers/bbb8462c-9501-4541-b67e-43ec5c5061a7 => generated 1226 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 03:13:02.867068 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi [None req-845dd7f6-d7f4-449f-8c30-76d0a4030086 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Calling method '>' {{(pid=116157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:13:02.867675 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.compute.api [None req-845dd7f6-d7f4-449f-8c30-76d0a4030086 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] [instance: fa7c86bc-c46f-4120-8f3d-d795f8d7c5cc] Fetching instance by UUID {{(pid=116157) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:13:02.873379 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-845dd7f6-d7f4-449f-8c30-76d0a4030086 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:13:02.873825 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-845dd7f6-d7f4-449f-8c30-76d0a4030086 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:13:02.874619 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-845dd7f6-d7f4-449f-8c30-76d0a4030086 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:13:02.875051 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-845dd7f6-d7f4-449f-8c30-76d0a4030086 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:13:03.006549 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.policy [None req-845dd7f6-d7f4-449f-8c30-76d0a4030086 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c4c0c82448e40ba801c0b52ec44e74a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a093d0bf43046aaa845f3cc115f3f5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116157) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:13:03.014368 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: INFO nova.api.openstack.requestlog [None req-845dd7f6-d7f4-449f-8c30-76d0a4030086 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] 10.222.0.18 "GET /compute/v2.1/servers/fa7c86bc-c46f-4120-8f3d-d795f8d7c5cc" status: 200 len: 1570 microversion: 2.1 time: 0.150859 Dec 15 03:13:03.014934 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: [pid: 116157|app: 0|req: 716/1429] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 03:13:02 2021] GET /compute/v2.1/servers/fa7c86bc-c46f-4120-8f3d-d795f8d7c5cc => generated 1570 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 03:13:03.063141 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi [None req-c340972d-f55c-4be6-b68d-8d4a6769e888 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Calling method '>' {{(pid=116156) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:13:03.064047 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.compute.api [None req-c340972d-f55c-4be6-b68d-8d4a6769e888 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] [instance: b89094ac-aee1-4bd6-a33d-8c4347cebfc7] Fetching instance by UUID {{(pid=116156) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:13:03.070328 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-c340972d-f55c-4be6-b68d-8d4a6769e888 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:13:03.070782 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-c340972d-f55c-4be6-b68d-8d4a6769e888 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:13:03.072218 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-c340972d-f55c-4be6-b68d-8d4a6769e888 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:13:03.072660 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-c340972d-f55c-4be6-b68d-8d4a6769e888 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:13:03.101206 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: INFO nova.api.openstack.requestlog [None req-c340972d-f55c-4be6-b68d-8d4a6769e888 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] 10.222.0.18 "GET /compute/v2.1/servers/b89094ac-aee1-4bd6-a33d-8c4347cebfc7/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041927 Dec 15 03:13:03.101741 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: [pid: 116156|app: 0|req: 714/1430] 10.222.0.18 () {60 vars in 1342 bytes} [Wed Dec 15 03:13:03 2021] GET /compute/v2.1/servers/b89094ac-aee1-4bd6-a33d-8c4347cebfc7/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 03:13:03.628774 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi [None req-6ef0b2e9-8fb8-467e-afb6-d3d0aaf59624 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Calling method '>' {{(pid=116157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:13:03.629389 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.compute.api [None req-6ef0b2e9-8fb8-467e-afb6-d3d0aaf59624 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] [instance: bbb8462c-9501-4541-b67e-43ec5c5061a7] Fetching instance by UUID {{(pid=116157) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:13:03.635742 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-6ef0b2e9-8fb8-467e-afb6-d3d0aaf59624 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:13:03.636194 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-6ef0b2e9-8fb8-467e-afb6-d3d0aaf59624 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:13:03.637001 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-6ef0b2e9-8fb8-467e-afb6-d3d0aaf59624 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:13:03.637440 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-6ef0b2e9-8fb8-467e-afb6-d3d0aaf59624 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:13:03.695445 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.policy [None req-6ef0b2e9-8fb8-467e-afb6-d3d0aaf59624 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97bdf19af9e34fc3886ff451cb9d7a27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '494b56bf5eae4d56a5591546f85bc32b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116157) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:13:03.702642 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: INFO nova.api.openstack.requestlog [None req-6ef0b2e9-8fb8-467e-afb6-d3d0aaf59624 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] 10.222.0.18 "GET /compute/v2.1/servers/bbb8462c-9501-4541-b67e-43ec5c5061a7" status: 200 len: 1226 microversion: 2.1 time: 0.077533 Dec 15 03:13:03.703202 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: [pid: 116157|app: 0|req: 717/1431] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 03:13:03 2021] GET /compute/v2.1/servers/bbb8462c-9501-4541-b67e-43ec5c5061a7 => generated 1226 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 03:13:04.031183 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi [None req-eda154e3-98ed-4ae6-b450-44f390edccc6 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Calling method '>' {{(pid=116156) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:13:04.031746 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.compute.api [None req-eda154e3-98ed-4ae6-b450-44f390edccc6 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] [instance: fa7c86bc-c46f-4120-8f3d-d795f8d7c5cc] Fetching instance by UUID {{(pid=116156) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:13:04.039273 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-eda154e3-98ed-4ae6-b450-44f390edccc6 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:13:04.040699 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-eda154e3-98ed-4ae6-b450-44f390edccc6 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:13:04.041483 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-eda154e3-98ed-4ae6-b450-44f390edccc6 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:13:04.041921 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-eda154e3-98ed-4ae6-b450-44f390edccc6 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:13:04.112916 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi [None req-1301a986-dd86-47e7-9a8a-7c3a842937ee tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Calling method '>' {{(pid=116157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:13:04.113853 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.compute.api [None req-1301a986-dd86-47e7-9a8a-7c3a842937ee tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] [instance: b89094ac-aee1-4bd6-a33d-8c4347cebfc7] Fetching instance by UUID {{(pid=116157) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:13:04.119549 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-1301a986-dd86-47e7-9a8a-7c3a842937ee tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:13:04.119999 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-1301a986-dd86-47e7-9a8a-7c3a842937ee tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:13:04.120779 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-1301a986-dd86-47e7-9a8a-7c3a842937ee tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:13:04.121217 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-1301a986-dd86-47e7-9a8a-7c3a842937ee tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:13:04.151414 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: INFO nova.api.openstack.requestlog [None req-1301a986-dd86-47e7-9a8a-7c3a842937ee tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] 10.222.0.18 "GET /compute/v2.1/servers/b89094ac-aee1-4bd6-a33d-8c4347cebfc7/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042448 Dec 15 03:13:04.152174 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: [pid: 116157|app: 0|req: 718/1432] 10.222.0.18 () {60 vars in 1342 bytes} [Wed Dec 15 03:13:04 2021] GET /compute/v2.1/servers/b89094ac-aee1-4bd6-a33d-8c4347cebfc7/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Dec 15 03:13:04.172069 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.policy [None req-eda154e3-98ed-4ae6-b450-44f390edccc6 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c4c0c82448e40ba801c0b52ec44e74a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a093d0bf43046aaa845f3cc115f3f5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116156) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:13:04.179408 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: INFO nova.api.openstack.requestlog [None req-eda154e3-98ed-4ae6-b450-44f390edccc6 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] 10.222.0.18 "GET /compute/v2.1/servers/fa7c86bc-c46f-4120-8f3d-d795f8d7c5cc" status: 200 len: 1570 microversion: 2.1 time: 0.151920 Dec 15 03:13:04.179954 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: [pid: 116156|app: 0|req: 715/1433] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 03:13:04 2021] GET /compute/v2.1/servers/fa7c86bc-c46f-4120-8f3d-d795f8d7c5cc => generated 1570 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 03:13:04.720205 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi [None req-5908939d-d690-4291-8acc-126a54b14f41 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Calling method '>' {{(pid=116157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:13:04.720813 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.compute.api [None req-5908939d-d690-4291-8acc-126a54b14f41 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] [instance: bbb8462c-9501-4541-b67e-43ec5c5061a7] Fetching instance by UUID {{(pid=116157) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:13:04.727038 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-5908939d-d690-4291-8acc-126a54b14f41 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:13:04.727530 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-5908939d-d690-4291-8acc-126a54b14f41 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:13:04.728306 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-5908939d-d690-4291-8acc-126a54b14f41 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:13:04.728738 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-5908939d-d690-4291-8acc-126a54b14f41 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:13:04.786412 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.policy [None req-5908939d-d690-4291-8acc-126a54b14f41 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97bdf19af9e34fc3886ff451cb9d7a27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '494b56bf5eae4d56a5591546f85bc32b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116157) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:13:04.794005 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: INFO nova.api.openstack.requestlog [None req-5908939d-d690-4291-8acc-126a54b14f41 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] 10.222.0.18 "GET /compute/v2.1/servers/bbb8462c-9501-4541-b67e-43ec5c5061a7" status: 200 len: 1226 microversion: 2.1 time: 0.077397 Dec 15 03:13:04.794546 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: [pid: 116157|app: 0|req: 719/1434] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 03:13:04 2021] GET /compute/v2.1/servers/bbb8462c-9501-4541-b67e-43ec5c5061a7 => generated 1226 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 03:13:05.162821 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi [None req-80c8907d-2c84-43d2-a823-f762ba9553d8 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Calling method '>' {{(pid=116156) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:13:05.163725 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.compute.api [None req-80c8907d-2c84-43d2-a823-f762ba9553d8 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] [instance: b89094ac-aee1-4bd6-a33d-8c4347cebfc7] Fetching instance by UUID {{(pid=116156) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:13:05.170569 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-80c8907d-2c84-43d2-a823-f762ba9553d8 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:13:05.171023 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-80c8907d-2c84-43d2-a823-f762ba9553d8 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:13:05.171802 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-80c8907d-2c84-43d2-a823-f762ba9553d8 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:13:05.172245 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-80c8907d-2c84-43d2-a823-f762ba9553d8 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:13:05.196335 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi [None req-d964c408-ae87-4724-ab01-df6a7a460584 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Calling method '>' {{(pid=116157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:13:05.196936 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.compute.api [None req-d964c408-ae87-4724-ab01-df6a7a460584 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] [instance: fa7c86bc-c46f-4120-8f3d-d795f8d7c5cc] Fetching instance by UUID {{(pid=116157) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:13:05.200159 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: INFO nova.api.openstack.requestlog [None req-80c8907d-2c84-43d2-a823-f762ba9553d8 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] 10.222.0.18 "GET /compute/v2.1/servers/b89094ac-aee1-4bd6-a33d-8c4347cebfc7/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041016 Dec 15 03:13:05.200922 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: [pid: 116156|app: 0|req: 716/1435] 10.222.0.18 () {60 vars in 1342 bytes} [Wed Dec 15 03:13:05 2021] GET /compute/v2.1/servers/b89094ac-aee1-4bd6-a33d-8c4347cebfc7/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 03:13:05.204039 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-d964c408-ae87-4724-ab01-df6a7a460584 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:13:05.204039 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-d964c408-ae87-4724-ab01-df6a7a460584 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:13:05.204287 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-d964c408-ae87-4724-ab01-df6a7a460584 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:13:05.204636 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-d964c408-ae87-4724-ab01-df6a7a460584 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:13:05.339364 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.policy [None req-d964c408-ae87-4724-ab01-df6a7a460584 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c4c0c82448e40ba801c0b52ec44e74a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a093d0bf43046aaa845f3cc115f3f5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116157) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:13:05.349570 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: INFO nova.api.openstack.requestlog [None req-d964c408-ae87-4724-ab01-df6a7a460584 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] 10.222.0.18 "GET /compute/v2.1/servers/fa7c86bc-c46f-4120-8f3d-d795f8d7c5cc" status: 200 len: 1570 microversion: 2.1 time: 0.156784 Dec 15 03:13:05.350184 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: [pid: 116157|app: 0|req: 720/1436] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 03:13:05 2021] GET /compute/v2.1/servers/fa7c86bc-c46f-4120-8f3d-d795f8d7c5cc => generated 1570 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 03:13:05.810528 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi [None req-3991bb17-8b86-4247-bf03-7c699326db24 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Calling method '>' {{(pid=116156) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:13:05.811146 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.compute.api [None req-3991bb17-8b86-4247-bf03-7c699326db24 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] [instance: bbb8462c-9501-4541-b67e-43ec5c5061a7] Fetching instance by UUID {{(pid=116156) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:13:05.816962 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-3991bb17-8b86-4247-bf03-7c699326db24 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:13:05.817418 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-3991bb17-8b86-4247-bf03-7c699326db24 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:13:05.818215 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-3991bb17-8b86-4247-bf03-7c699326db24 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:13:05.818653 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-3991bb17-8b86-4247-bf03-7c699326db24 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:13:05.884655 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.policy [None req-3991bb17-8b86-4247-bf03-7c699326db24 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97bdf19af9e34fc3886ff451cb9d7a27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '494b56bf5eae4d56a5591546f85bc32b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116156) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:13:05.891912 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: INFO nova.api.openstack.requestlog [None req-3991bb17-8b86-4247-bf03-7c699326db24 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] 10.222.0.18 "GET /compute/v2.1/servers/bbb8462c-9501-4541-b67e-43ec5c5061a7" status: 200 len: 1226 microversion: 2.1 time: 0.085021 Dec 15 03:13:05.892463 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: [pid: 116156|app: 0|req: 717/1437] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 03:13:05 2021] GET /compute/v2.1/servers/bbb8462c-9501-4541-b67e-43ec5c5061a7 => generated 1226 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 03:13:06.211554 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi [None req-2cf5d51d-ec50-4ae5-b2ea-c6c4a067434f tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Calling method '>' {{(pid=116157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:13:06.212468 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.compute.api [None req-2cf5d51d-ec50-4ae5-b2ea-c6c4a067434f tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] [instance: b89094ac-aee1-4bd6-a33d-8c4347cebfc7] Fetching instance by UUID {{(pid=116157) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:13:06.218752 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-2cf5d51d-ec50-4ae5-b2ea-c6c4a067434f tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:13:06.219212 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-2cf5d51d-ec50-4ae5-b2ea-c6c4a067434f tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:13:06.220000 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-2cf5d51d-ec50-4ae5-b2ea-c6c4a067434f tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:13:06.220442 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-2cf5d51d-ec50-4ae5-b2ea-c6c4a067434f tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:13:06.249081 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: INFO nova.api.openstack.requestlog [None req-2cf5d51d-ec50-4ae5-b2ea-c6c4a067434f tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] 10.222.0.18 "GET /compute/v2.1/servers/b89094ac-aee1-4bd6-a33d-8c4347cebfc7/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041283 Dec 15 03:13:06.249617 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: [pid: 116157|app: 0|req: 721/1438] 10.222.0.18 () {60 vars in 1342 bytes} [Wed Dec 15 03:13:06 2021] GET /compute/v2.1/servers/b89094ac-aee1-4bd6-a33d-8c4347cebfc7/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 03:13:06.367486 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi [None req-08ef2038-0676-44b5-a8c0-8f144fd4eac3 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Calling method '>' {{(pid=116156) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:13:06.368697 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.compute.api [None req-08ef2038-0676-44b5-a8c0-8f144fd4eac3 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] [instance: fa7c86bc-c46f-4120-8f3d-d795f8d7c5cc] Fetching instance by UUID {{(pid=116156) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:13:06.374823 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-08ef2038-0676-44b5-a8c0-8f144fd4eac3 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:13:06.375274 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-08ef2038-0676-44b5-a8c0-8f144fd4eac3 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:13:06.376052 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-08ef2038-0676-44b5-a8c0-8f144fd4eac3 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:13:06.376491 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-08ef2038-0676-44b5-a8c0-8f144fd4eac3 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:13:06.508542 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.policy [None req-08ef2038-0676-44b5-a8c0-8f144fd4eac3 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c4c0c82448e40ba801c0b52ec44e74a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a093d0bf43046aaa845f3cc115f3f5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116156) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:13:06.516084 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: INFO nova.api.openstack.requestlog [None req-08ef2038-0676-44b5-a8c0-8f144fd4eac3 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] 10.222.0.18 "GET /compute/v2.1/servers/fa7c86bc-c46f-4120-8f3d-d795f8d7c5cc" status: 200 len: 1570 microversion: 2.1 time: 0.152219 Dec 15 03:13:06.516644 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: [pid: 116156|app: 0|req: 718/1439] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 03:13:06 2021] GET /compute/v2.1/servers/fa7c86bc-c46f-4120-8f3d-d795f8d7c5cc => generated 1570 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 03:13:06.908920 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi [None req-889f90eb-c767-49e9-b95f-da428c05f03f tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Calling method '>' {{(pid=116157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:13:06.909523 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.compute.api [None req-889f90eb-c767-49e9-b95f-da428c05f03f tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] [instance: bbb8462c-9501-4541-b67e-43ec5c5061a7] Fetching instance by UUID {{(pid=116157) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:13:06.916005 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-889f90eb-c767-49e9-b95f-da428c05f03f tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:13:06.916448 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-889f90eb-c767-49e9-b95f-da428c05f03f tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:13:06.917216 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-889f90eb-c767-49e9-b95f-da428c05f03f tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:13:06.917643 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-889f90eb-c767-49e9-b95f-da428c05f03f tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:13:06.975001 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.policy [None req-889f90eb-c767-49e9-b95f-da428c05f03f tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97bdf19af9e34fc3886ff451cb9d7a27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '494b56bf5eae4d56a5591546f85bc32b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116157) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:13:06.982839 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: INFO nova.api.openstack.requestlog [None req-889f90eb-c767-49e9-b95f-da428c05f03f tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] 10.222.0.18 "GET /compute/v2.1/servers/bbb8462c-9501-4541-b67e-43ec5c5061a7" status: 200 len: 1226 microversion: 2.1 time: 0.077509 Dec 15 03:13:06.983394 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: [pid: 116157|app: 0|req: 722/1440] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 03:13:06 2021] GET /compute/v2.1/servers/bbb8462c-9501-4541-b67e-43ec5c5061a7 => generated 1226 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 03:13:07.260477 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi [None req-17ba8147-2efe-4b8a-bcc1-f82870efa372 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Calling method '>' {{(pid=116156) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:13:07.261405 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.compute.api [None req-17ba8147-2efe-4b8a-bcc1-f82870efa372 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] [instance: b89094ac-aee1-4bd6-a33d-8c4347cebfc7] Fetching instance by UUID {{(pid=116156) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:13:07.267314 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-17ba8147-2efe-4b8a-bcc1-f82870efa372 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:13:07.267759 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-17ba8147-2efe-4b8a-bcc1-f82870efa372 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:13:07.268535 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-17ba8147-2efe-4b8a-bcc1-f82870efa372 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:13:07.268966 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-17ba8147-2efe-4b8a-bcc1-f82870efa372 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:13:07.296963 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: INFO nova.api.openstack.requestlog [None req-17ba8147-2efe-4b8a-bcc1-f82870efa372 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] 10.222.0.18 "GET /compute/v2.1/servers/b89094ac-aee1-4bd6-a33d-8c4347cebfc7/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.040108 Dec 15 03:13:07.297590 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: [pid: 116156|app: 0|req: 719/1441] 10.222.0.18 () {60 vars in 1342 bytes} [Wed Dec 15 03:13:07 2021] GET /compute/v2.1/servers/b89094ac-aee1-4bd6-a33d-8c4347cebfc7/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 03:13:07.533023 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi [None req-8a201c3b-7314-4589-8229-15d846b2ad0f tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Calling method '>' {{(pid=116157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:13:07.533554 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.compute.api [None req-8a201c3b-7314-4589-8229-15d846b2ad0f tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] [instance: fa7c86bc-c46f-4120-8f3d-d795f8d7c5cc] Fetching instance by UUID {{(pid=116157) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:13:07.540496 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-8a201c3b-7314-4589-8229-15d846b2ad0f tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:13:07.540951 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-8a201c3b-7314-4589-8229-15d846b2ad0f tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:13:07.541733 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-8a201c3b-7314-4589-8229-15d846b2ad0f tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:13:07.542203 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-8a201c3b-7314-4589-8229-15d846b2ad0f tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:13:07.670052 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.policy [None req-8a201c3b-7314-4589-8229-15d846b2ad0f tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c4c0c82448e40ba801c0b52ec44e74a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a093d0bf43046aaa845f3cc115f3f5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116157) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:13:07.677439 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: INFO nova.api.openstack.requestlog [None req-8a201c3b-7314-4589-8229-15d846b2ad0f tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] 10.222.0.18 "GET /compute/v2.1/servers/fa7c86bc-c46f-4120-8f3d-d795f8d7c5cc" status: 200 len: 1570 microversion: 2.1 time: 0.148133 Dec 15 03:13:07.677999 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: [pid: 116157|app: 0|req: 723/1442] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 03:13:07 2021] GET /compute/v2.1/servers/fa7c86bc-c46f-4120-8f3d-d795f8d7c5cc => generated 1570 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 03:13:07.999008 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi [None req-9902b601-b66d-4c53-b9cd-d7a1482bb5de tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Calling method '>' {{(pid=116156) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:13:07.999616 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.compute.api [None req-9902b601-b66d-4c53-b9cd-d7a1482bb5de tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] [instance: bbb8462c-9501-4541-b67e-43ec5c5061a7] Fetching instance by UUID {{(pid=116156) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:13:08.005760 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-9902b601-b66d-4c53-b9cd-d7a1482bb5de tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:13:08.006241 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-9902b601-b66d-4c53-b9cd-d7a1482bb5de tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:13:08.007039 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-9902b601-b66d-4c53-b9cd-d7a1482bb5de tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:13:08.007471 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-9902b601-b66d-4c53-b9cd-d7a1482bb5de tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:13:08.111908 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.policy [None req-9902b601-b66d-4c53-b9cd-d7a1482bb5de tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97bdf19af9e34fc3886ff451cb9d7a27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '494b56bf5eae4d56a5591546f85bc32b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116156) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:13:08.119212 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: INFO nova.api.openstack.requestlog [None req-9902b601-b66d-4c53-b9cd-d7a1482bb5de tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] 10.222.0.18 "GET /compute/v2.1/servers/bbb8462c-9501-4541-b67e-43ec5c5061a7" status: 200 len: 1226 microversion: 2.1 time: 0.123926 Dec 15 03:13:08.119757 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: [pid: 116156|app: 0|req: 720/1443] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 03:13:07 2021] GET /compute/v2.1/servers/bbb8462c-9501-4541-b67e-43ec5c5061a7 => generated 1226 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 03:13:08.309659 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi [None req-7e683f09-8ab7-4025-9127-b244d633d55e tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Calling method '>' {{(pid=116157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:13:08.310590 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.compute.api [None req-7e683f09-8ab7-4025-9127-b244d633d55e tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] [instance: b89094ac-aee1-4bd6-a33d-8c4347cebfc7] Fetching instance by UUID {{(pid=116157) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:13:08.316485 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-7e683f09-8ab7-4025-9127-b244d633d55e tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:13:08.316942 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-7e683f09-8ab7-4025-9127-b244d633d55e tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:13:08.317725 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-7e683f09-8ab7-4025-9127-b244d633d55e tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:13:08.318192 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-7e683f09-8ab7-4025-9127-b244d633d55e tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:13:08.346514 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: INFO nova.api.openstack.requestlog [None req-7e683f09-8ab7-4025-9127-b244d633d55e tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] 10.222.0.18 "GET /compute/v2.1/servers/b89094ac-aee1-4bd6-a33d-8c4347cebfc7/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041361 Dec 15 03:13:08.347061 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: [pid: 116157|app: 0|req: 724/1444] 10.222.0.18 () {60 vars in 1342 bytes} [Wed Dec 15 03:13:08 2021] GET /compute/v2.1/servers/b89094ac-aee1-4bd6-a33d-8c4347cebfc7/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 03:13:08.694328 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi [None req-6e21b820-71f7-4f53-beb7-9b54a266a06c tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Calling method '>' {{(pid=116156) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:13:08.694851 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.compute.api [None req-6e21b820-71f7-4f53-beb7-9b54a266a06c tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] [instance: fa7c86bc-c46f-4120-8f3d-d795f8d7c5cc] Fetching instance by UUID {{(pid=116156) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:13:08.700659 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-6e21b820-71f7-4f53-beb7-9b54a266a06c tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:13:08.701104 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-6e21b820-71f7-4f53-beb7-9b54a266a06c tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:13:08.701870 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-6e21b820-71f7-4f53-beb7-9b54a266a06c tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:13:08.702325 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-6e21b820-71f7-4f53-beb7-9b54a266a06c tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:13:08.736845 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Dec 15 03:13:08.737045 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: Wed Dec 15 03:13:08 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/fa7c86bc-c46f-4120-8f3d-d795f8d7c5cc (ip 10.222.0.18) !!! Dec 15 03:13:08.836285 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.policy [None req-6e21b820-71f7-4f53-beb7-9b54a266a06c tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c4c0c82448e40ba801c0b52ec44e74a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a093d0bf43046aaa845f3cc115f3f5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116156) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:13:08.846200 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: INFO nova.api.openstack.requestlog [None req-6e21b820-71f7-4f53-beb7-9b54a266a06c tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] 10.222.0.18 "GET /compute/v2.1/servers/fa7c86bc-c46f-4120-8f3d-d795f8d7c5cc" status: 200 len: 1570 microversion: 2.1 time: 0.155550 Dec 15 03:13:08.846755 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: [pid: 116156|app: 0|req: 721/1445] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 03:13:08 2021] GET /compute/v2.1/servers/fa7c86bc-c46f-4120-8f3d-d795f8d7c5cc => generated 1570 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 03:13:09.134736 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi [None req-1a87237d-d875-458e-aeea-0021d2430383 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Calling method '>' {{(pid=116157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:13:09.135353 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.compute.api [None req-1a87237d-d875-458e-aeea-0021d2430383 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] [instance: bbb8462c-9501-4541-b67e-43ec5c5061a7] Fetching instance by UUID {{(pid=116157) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:13:09.141609 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-1a87237d-d875-458e-aeea-0021d2430383 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:13:09.142092 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-1a87237d-d875-458e-aeea-0021d2430383 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:13:09.142873 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-1a87237d-d875-458e-aeea-0021d2430383 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:13:09.143310 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-1a87237d-d875-458e-aeea-0021d2430383 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:13:09.252702 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.policy [None req-1a87237d-d875-458e-aeea-0021d2430383 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97bdf19af9e34fc3886ff451cb9d7a27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '494b56bf5eae4d56a5591546f85bc32b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116157) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:13:09.259863 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: INFO nova.api.openstack.requestlog [None req-1a87237d-d875-458e-aeea-0021d2430383 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] 10.222.0.18 "GET /compute/v2.1/servers/bbb8462c-9501-4541-b67e-43ec5c5061a7" status: 200 len: 1226 microversion: 2.1 time: 0.128799 Dec 15 03:13:09.260431 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: [pid: 116157|app: 0|req: 725/1446] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 03:13:09 2021] GET /compute/v2.1/servers/bbb8462c-9501-4541-b67e-43ec5c5061a7 => generated 1226 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 03:13:09.357483 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi [None req-60bc227d-9b52-48a4-b674-d3431a4b26b7 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Calling method '>' {{(pid=116156) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:13:09.358409 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.compute.api [None req-60bc227d-9b52-48a4-b674-d3431a4b26b7 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] [instance: b89094ac-aee1-4bd6-a33d-8c4347cebfc7] Fetching instance by UUID {{(pid=116156) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:13:09.365220 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-60bc227d-9b52-48a4-b674-d3431a4b26b7 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:13:09.365665 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-60bc227d-9b52-48a4-b674-d3431a4b26b7 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:13:09.366463 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-60bc227d-9b52-48a4-b674-d3431a4b26b7 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:13:09.366892 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-60bc227d-9b52-48a4-b674-d3431a4b26b7 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:13:09.394871 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: INFO nova.api.openstack.requestlog [None req-60bc227d-9b52-48a4-b674-d3431a4b26b7 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] 10.222.0.18 "GET /compute/v2.1/servers/b89094ac-aee1-4bd6-a33d-8c4347cebfc7/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041089 Dec 15 03:13:09.395338 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: [pid: 116156|app: 0|req: 722/1447] 10.222.0.18 () {60 vars in 1342 bytes} [Wed Dec 15 03:13:09 2021] GET /compute/v2.1/servers/b89094ac-aee1-4bd6-a33d-8c4347cebfc7/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 03:13:09.485388 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Dec 15 03:13:09.485619 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: Wed Dec 15 03:13:09 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Dec 15 03:13:09.862991 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi [None req-b3255a5f-44a9-472d-bc1b-79f523c07def tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Calling method '>' {{(pid=116157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:13:09.863606 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.compute.api [None req-b3255a5f-44a9-472d-bc1b-79f523c07def tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] [instance: fa7c86bc-c46f-4120-8f3d-d795f8d7c5cc] Fetching instance by UUID {{(pid=116157) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:13:09.870148 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-b3255a5f-44a9-472d-bc1b-79f523c07def tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:13:09.870602 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-b3255a5f-44a9-472d-bc1b-79f523c07def tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:13:09.871383 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-b3255a5f-44a9-472d-bc1b-79f523c07def tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:13:09.871819 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-b3255a5f-44a9-472d-bc1b-79f523c07def tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:13:10.003847 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.policy [None req-b3255a5f-44a9-472d-bc1b-79f523c07def tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c4c0c82448e40ba801c0b52ec44e74a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a093d0bf43046aaa845f3cc115f3f5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116157) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:13:10.011604 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: INFO nova.api.openstack.requestlog [None req-b3255a5f-44a9-472d-bc1b-79f523c07def tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] 10.222.0.18 "GET /compute/v2.1/servers/fa7c86bc-c46f-4120-8f3d-d795f8d7c5cc" status: 200 len: 1570 microversion: 2.1 time: 0.152593 Dec 15 03:13:10.012171 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: [pid: 116157|app: 0|req: 726/1448] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 03:13:09 2021] GET /compute/v2.1/servers/fa7c86bc-c46f-4120-8f3d-d795f8d7c5cc => generated 1570 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 03:13:10.276148 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi [None req-6e791b5e-4469-41ff-8796-68c6e3499911 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Calling method '>' {{(pid=116156) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:13:10.276755 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.compute.api [None req-6e791b5e-4469-41ff-8796-68c6e3499911 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] [instance: bbb8462c-9501-4541-b67e-43ec5c5061a7] Fetching instance by UUID {{(pid=116156) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:13:10.282554 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-6e791b5e-4469-41ff-8796-68c6e3499911 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:13:10.282998 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-6e791b5e-4469-41ff-8796-68c6e3499911 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:13:10.283764 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-6e791b5e-4469-41ff-8796-68c6e3499911 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:13:10.284193 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-6e791b5e-4469-41ff-8796-68c6e3499911 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:13:10.343154 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.policy [None req-6e791b5e-4469-41ff-8796-68c6e3499911 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97bdf19af9e34fc3886ff451cb9d7a27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '494b56bf5eae4d56a5591546f85bc32b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116156) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:13:10.350235 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: INFO nova.api.openstack.requestlog [None req-6e791b5e-4469-41ff-8796-68c6e3499911 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] 10.222.0.18 "GET /compute/v2.1/servers/bbb8462c-9501-4541-b67e-43ec5c5061a7" status: 200 len: 1226 microversion: 2.1 time: 0.077641 Dec 15 03:13:10.350787 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: [pid: 116156|app: 0|req: 723/1449] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 03:13:10 2021] GET /compute/v2.1/servers/bbb8462c-9501-4541-b67e-43ec5c5061a7 => generated 1226 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 03:13:10.405907 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi [None req-3c6b02f4-22d7-45b9-9b6a-e05b03166d1c tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Calling method '>' {{(pid=116157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:13:10.406825 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.compute.api [None req-3c6b02f4-22d7-45b9-9b6a-e05b03166d1c tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] [instance: b89094ac-aee1-4bd6-a33d-8c4347cebfc7] Fetching instance by UUID {{(pid=116157) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:13:10.412906 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-3c6b02f4-22d7-45b9-9b6a-e05b03166d1c tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:13:10.413352 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-3c6b02f4-22d7-45b9-9b6a-e05b03166d1c tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:13:10.414155 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-3c6b02f4-22d7-45b9-9b6a-e05b03166d1c tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:13:10.414589 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-3c6b02f4-22d7-45b9-9b6a-e05b03166d1c tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:13:10.442828 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: INFO nova.api.openstack.requestlog [None req-3c6b02f4-22d7-45b9-9b6a-e05b03166d1c tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] 10.222.0.18 "GET /compute/v2.1/servers/b89094ac-aee1-4bd6-a33d-8c4347cebfc7/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.040600 Dec 15 03:13:10.443351 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: [pid: 116157|app: 0|req: 727/1450] 10.222.0.18 () {60 vars in 1342 bytes} [Wed Dec 15 03:13:10 2021] GET /compute/v2.1/servers/b89094ac-aee1-4bd6-a33d-8c4347cebfc7/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 03:13:11.028857 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi [None req-b04dc1ae-7ad1-4b04-ab45-b664dacefed3 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Calling method '>' {{(pid=116156) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:13:11.029490 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.compute.api [None req-b04dc1ae-7ad1-4b04-ab45-b664dacefed3 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] [instance: fa7c86bc-c46f-4120-8f3d-d795f8d7c5cc] Fetching instance by UUID {{(pid=116156) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:13:11.035431 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-b04dc1ae-7ad1-4b04-ab45-b664dacefed3 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:13:11.035882 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-b04dc1ae-7ad1-4b04-ab45-b664dacefed3 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:13:11.036655 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-b04dc1ae-7ad1-4b04-ab45-b664dacefed3 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:13:11.037089 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-b04dc1ae-7ad1-4b04-ab45-b664dacefed3 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:13:11.166644 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.policy [None req-b04dc1ae-7ad1-4b04-ab45-b664dacefed3 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c4c0c82448e40ba801c0b52ec44e74a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a093d0bf43046aaa845f3cc115f3f5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116156) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:13:11.173815 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: INFO nova.api.openstack.requestlog [None req-b04dc1ae-7ad1-4b04-ab45-b664dacefed3 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] 10.222.0.18 "GET /compute/v2.1/servers/fa7c86bc-c46f-4120-8f3d-d795f8d7c5cc" status: 200 len: 1570 microversion: 2.1 time: 0.148642 Dec 15 03:13:11.174409 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: [pid: 116156|app: 0|req: 724/1451] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 03:13:11 2021] GET /compute/v2.1/servers/fa7c86bc-c46f-4120-8f3d-d795f8d7c5cc => generated 1570 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 03:13:11.367393 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi [None req-991446ae-7920-42a1-b582-c8020d512208 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Calling method '>' {{(pid=116157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:13:11.367943 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.compute.api [None req-991446ae-7920-42a1-b582-c8020d512208 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] [instance: bbb8462c-9501-4541-b67e-43ec5c5061a7] Fetching instance by UUID {{(pid=116157) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:13:11.373715 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-991446ae-7920-42a1-b582-c8020d512208 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:13:11.374206 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-991446ae-7920-42a1-b582-c8020d512208 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:13:11.374975 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-991446ae-7920-42a1-b582-c8020d512208 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:13:11.375404 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-991446ae-7920-42a1-b582-c8020d512208 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:13:11.432582 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.policy [None req-991446ae-7920-42a1-b582-c8020d512208 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97bdf19af9e34fc3886ff451cb9d7a27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '494b56bf5eae4d56a5591546f85bc32b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116157) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:13:11.439665 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: INFO nova.api.openstack.requestlog [None req-991446ae-7920-42a1-b582-c8020d512208 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] 10.222.0.18 "GET /compute/v2.1/servers/bbb8462c-9501-4541-b67e-43ec5c5061a7" status: 200 len: 1226 microversion: 2.1 time: 0.075933 Dec 15 03:13:11.440217 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: [pid: 116157|app: 0|req: 728/1452] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 03:13:11 2021] GET /compute/v2.1/servers/bbb8462c-9501-4541-b67e-43ec5c5061a7 => generated 1226 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 03:13:11.454716 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi [None req-8e9d95c5-8e4a-4bf2-b7bf-586686eda3b8 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Calling method '>' {{(pid=116156) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:13:11.455618 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.compute.api [None req-8e9d95c5-8e4a-4bf2-b7bf-586686eda3b8 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] [instance: b89094ac-aee1-4bd6-a33d-8c4347cebfc7] Fetching instance by UUID {{(pid=116156) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:13:11.461340 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-8e9d95c5-8e4a-4bf2-b7bf-586686eda3b8 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:13:11.462322 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-8e9d95c5-8e4a-4bf2-b7bf-586686eda3b8 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:13:11.463098 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-8e9d95c5-8e4a-4bf2-b7bf-586686eda3b8 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:13:11.463531 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-8e9d95c5-8e4a-4bf2-b7bf-586686eda3b8 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:13:11.491898 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: INFO nova.api.openstack.requestlog [None req-8e9d95c5-8e4a-4bf2-b7bf-586686eda3b8 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] 10.222.0.18 "GET /compute/v2.1/servers/b89094ac-aee1-4bd6-a33d-8c4347cebfc7/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.040955 Dec 15 03:13:11.492427 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: [pid: 116156|app: 0|req: 725/1453] 10.222.0.18 () {60 vars in 1342 bytes} [Wed Dec 15 03:13:11 2021] GET /compute/v2.1/servers/b89094ac-aee1-4bd6-a33d-8c4347cebfc7/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Dec 15 03:13:12.191361 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi [None req-8140c37a-ee4d-466f-94fa-b8d98feebb98 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Calling method '>' {{(pid=116157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:13:12.191970 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.compute.api [None req-8140c37a-ee4d-466f-94fa-b8d98feebb98 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] [instance: fa7c86bc-c46f-4120-8f3d-d795f8d7c5cc] Fetching instance by UUID {{(pid=116157) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:13:12.198463 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-8140c37a-ee4d-466f-94fa-b8d98feebb98 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:13:12.198916 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-8140c37a-ee4d-466f-94fa-b8d98feebb98 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:13:12.199731 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-8140c37a-ee4d-466f-94fa-b8d98feebb98 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:13:12.200166 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-8140c37a-ee4d-466f-94fa-b8d98feebb98 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:13:12.327690 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.policy [None req-8140c37a-ee4d-466f-94fa-b8d98feebb98 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c4c0c82448e40ba801c0b52ec44e74a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a093d0bf43046aaa845f3cc115f3f5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116157) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:13:12.335294 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: INFO nova.api.openstack.requestlog [None req-8140c37a-ee4d-466f-94fa-b8d98feebb98 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] 10.222.0.18 "GET /compute/v2.1/servers/fa7c86bc-c46f-4120-8f3d-d795f8d7c5cc" status: 200 len: 1570 microversion: 2.1 time: 0.147590 Dec 15 03:13:12.335856 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: [pid: 116157|app: 0|req: 729/1454] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 03:13:12 2021] GET /compute/v2.1/servers/fa7c86bc-c46f-4120-8f3d-d795f8d7c5cc => generated 1570 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 03:13:12.456042 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi [None req-04639ff7-4520-4b6b-adde-2e1799781faf tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Calling method '>' {{(pid=116156) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:13:12.456555 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.compute.api [None req-04639ff7-4520-4b6b-adde-2e1799781faf tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] [instance: bbb8462c-9501-4541-b67e-43ec5c5061a7] Fetching instance by UUID {{(pid=116156) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:13:12.462725 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-04639ff7-4520-4b6b-adde-2e1799781faf tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:13:12.463177 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-04639ff7-4520-4b6b-adde-2e1799781faf tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:13:12.463951 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-04639ff7-4520-4b6b-adde-2e1799781faf tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:13:12.464388 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-04639ff7-4520-4b6b-adde-2e1799781faf tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:13:12.502527 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi [None req-858d21ab-ea5b-4304-a186-b188598c16ba tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Calling method '>' {{(pid=116157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:13:12.503465 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.compute.api [None req-858d21ab-ea5b-4304-a186-b188598c16ba tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] [instance: b89094ac-aee1-4bd6-a33d-8c4347cebfc7] Fetching instance by UUID {{(pid=116157) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:13:12.509666 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-858d21ab-ea5b-4304-a186-b188598c16ba tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:13:12.510160 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-858d21ab-ea5b-4304-a186-b188598c16ba tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:13:12.510949 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-858d21ab-ea5b-4304-a186-b188598c16ba tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:13:12.511390 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-858d21ab-ea5b-4304-a186-b188598c16ba tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:13:12.521972 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.policy [None req-04639ff7-4520-4b6b-adde-2e1799781faf tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97bdf19af9e34fc3886ff451cb9d7a27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '494b56bf5eae4d56a5591546f85bc32b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116156) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:13:12.529167 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: INFO nova.api.openstack.requestlog [None req-04639ff7-4520-4b6b-adde-2e1799781faf tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] 10.222.0.18 "GET /compute/v2.1/servers/bbb8462c-9501-4541-b67e-43ec5c5061a7" status: 200 len: 1226 microversion: 2.1 time: 0.076808 Dec 15 03:13:12.529728 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: [pid: 116156|app: 0|req: 726/1455] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 03:13:12 2021] GET /compute/v2.1/servers/bbb8462c-9501-4541-b67e-43ec5c5061a7 => generated 1226 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 03:13:12.540815 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: INFO nova.api.openstack.requestlog [None req-858d21ab-ea5b-4304-a186-b188598c16ba tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] 10.222.0.18 "GET /compute/v2.1/servers/b89094ac-aee1-4bd6-a33d-8c4347cebfc7/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041983 Dec 15 03:13:12.541353 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: [pid: 116157|app: 0|req: 730/1456] 10.222.0.18 () {60 vars in 1342 bytes} [Wed Dec 15 03:13:12 2021] GET /compute/v2.1/servers/b89094ac-aee1-4bd6-a33d-8c4347cebfc7/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Dec 15 03:13:13.351427 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi [None req-7a81559d-67ee-49f8-bbb6-78d1bc39cd90 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Calling method '>' {{(pid=116156) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:13:13.352040 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.compute.api [None req-7a81559d-67ee-49f8-bbb6-78d1bc39cd90 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] [instance: fa7c86bc-c46f-4120-8f3d-d795f8d7c5cc] Fetching instance by UUID {{(pid=116156) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:13:13.358319 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-7a81559d-67ee-49f8-bbb6-78d1bc39cd90 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:13:13.358772 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-7a81559d-67ee-49f8-bbb6-78d1bc39cd90 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:13:13.359546 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-7a81559d-67ee-49f8-bbb6-78d1bc39cd90 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:13:13.359984 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-7a81559d-67ee-49f8-bbb6-78d1bc39cd90 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:13:13.493429 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.policy [None req-7a81559d-67ee-49f8-bbb6-78d1bc39cd90 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c4c0c82448e40ba801c0b52ec44e74a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a093d0bf43046aaa845f3cc115f3f5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116156) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:13:13.500614 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: INFO nova.api.openstack.requestlog [None req-7a81559d-67ee-49f8-bbb6-78d1bc39cd90 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] 10.222.0.18 "GET /compute/v2.1/servers/fa7c86bc-c46f-4120-8f3d-d795f8d7c5cc" status: 200 len: 1570 microversion: 2.1 time: 0.152826 Dec 15 03:13:13.501167 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: [pid: 116156|app: 0|req: 727/1457] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 03:13:13 2021] GET /compute/v2.1/servers/fa7c86bc-c46f-4120-8f3d-d795f8d7c5cc => generated 1570 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 03:13:13.546236 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi [None req-ec5e04dc-91fb-4341-a785-db7476d2b3b1 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Calling method '>' {{(pid=116157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:13:13.546858 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.compute.api [None req-ec5e04dc-91fb-4341-a785-db7476d2b3b1 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] [instance: bbb8462c-9501-4541-b67e-43ec5c5061a7] Fetching instance by UUID {{(pid=116157) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:13:13.551694 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi [None req-4a4b3d53-231a-4bcb-a5de-81bc93938aa0 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Calling method '>' {{(pid=116156) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:13:13.552587 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.compute.api [None req-4a4b3d53-231a-4bcb-a5de-81bc93938aa0 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] [instance: b89094ac-aee1-4bd6-a33d-8c4347cebfc7] Fetching instance by UUID {{(pid=116156) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:13:13.553093 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-ec5e04dc-91fb-4341-a785-db7476d2b3b1 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:13:13.553546 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-ec5e04dc-91fb-4341-a785-db7476d2b3b1 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:13:13.554415 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-ec5e04dc-91fb-4341-a785-db7476d2b3b1 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:13:13.554878 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-ec5e04dc-91fb-4341-a785-db7476d2b3b1 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:13:13.558309 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-4a4b3d53-231a-4bcb-a5de-81bc93938aa0 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:13:13.558766 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-4a4b3d53-231a-4bcb-a5de-81bc93938aa0 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:13:13.559543 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-4a4b3d53-231a-4bcb-a5de-81bc93938aa0 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:13:13.559978 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-4a4b3d53-231a-4bcb-a5de-81bc93938aa0 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:13:13.588501 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: INFO nova.api.openstack.requestlog [None req-4a4b3d53-231a-4bcb-a5de-81bc93938aa0 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] 10.222.0.18 "GET /compute/v2.1/servers/b89094ac-aee1-4bd6-a33d-8c4347cebfc7/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.040368 Dec 15 03:13:13.589060 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: [pid: 116156|app: 0|req: 728/1458] 10.222.0.18 () {60 vars in 1342 bytes} [Wed Dec 15 03:13:13 2021] GET /compute/v2.1/servers/b89094ac-aee1-4bd6-a33d-8c4347cebfc7/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Dec 15 03:13:13.619079 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.policy [None req-ec5e04dc-91fb-4341-a785-db7476d2b3b1 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97bdf19af9e34fc3886ff451cb9d7a27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '494b56bf5eae4d56a5591546f85bc32b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116157) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:13:13.626283 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: INFO nova.api.openstack.requestlog [None req-ec5e04dc-91fb-4341-a785-db7476d2b3b1 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] 10.222.0.18 "GET /compute/v2.1/servers/bbb8462c-9501-4541-b67e-43ec5c5061a7" status: 200 len: 1226 microversion: 2.1 time: 0.083694 Dec 15 03:13:13.626833 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: [pid: 116157|app: 0|req: 731/1459] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 03:13:13 2021] GET /compute/v2.1/servers/bbb8462c-9501-4541-b67e-43ec5c5061a7 => generated 1226 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 03:13:14.517369 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi [None req-9fdb32a0-5cd7-41a3-a0d3-ed5164b74ce2 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Calling method '>' {{(pid=116156) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:13:14.517903 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.compute.api [None req-9fdb32a0-5cd7-41a3-a0d3-ed5164b74ce2 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] [instance: fa7c86bc-c46f-4120-8f3d-d795f8d7c5cc] Fetching instance by UUID {{(pid=116156) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:13:14.524597 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-9fdb32a0-5cd7-41a3-a0d3-ed5164b74ce2 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:13:14.525041 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-9fdb32a0-5cd7-41a3-a0d3-ed5164b74ce2 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:13:14.525809 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-9fdb32a0-5cd7-41a3-a0d3-ed5164b74ce2 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:13:14.526272 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-9fdb32a0-5cd7-41a3-a0d3-ed5164b74ce2 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:13:14.599789 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi [None req-dfd3b3d4-49ad-4d16-a548-39593409e4c9 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Calling method '>' {{(pid=116157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:13:14.600693 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.compute.api [None req-dfd3b3d4-49ad-4d16-a548-39593409e4c9 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] [instance: b89094ac-aee1-4bd6-a33d-8c4347cebfc7] Fetching instance by UUID {{(pid=116157) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:13:14.606978 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-dfd3b3d4-49ad-4d16-a548-39593409e4c9 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:13:14.607432 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-dfd3b3d4-49ad-4d16-a548-39593409e4c9 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:13:14.608215 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-dfd3b3d4-49ad-4d16-a548-39593409e4c9 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:13:14.608653 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-dfd3b3d4-49ad-4d16-a548-39593409e4c9 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:13:14.637908 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: INFO nova.api.openstack.requestlog [None req-dfd3b3d4-49ad-4d16-a548-39593409e4c9 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] 10.222.0.18 "GET /compute/v2.1/servers/b89094ac-aee1-4bd6-a33d-8c4347cebfc7/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041809 Dec 15 03:13:14.638647 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: [pid: 116157|app: 0|req: 732/1460] 10.222.0.18 () {60 vars in 1342 bytes} [Wed Dec 15 03:13:14 2021] GET /compute/v2.1/servers/b89094ac-aee1-4bd6-a33d-8c4347cebfc7/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Dec 15 03:13:14.642638 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi [None req-f46a2061-39b7-45e6-abbf-b2e6ad1fc217 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Calling method '>' {{(pid=116157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:13:14.643267 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.compute.api [None req-f46a2061-39b7-45e6-abbf-b2e6ad1fc217 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] [instance: bbb8462c-9501-4541-b67e-43ec5c5061a7] Fetching instance by UUID {{(pid=116157) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:13:14.648703 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-f46a2061-39b7-45e6-abbf-b2e6ad1fc217 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:13:14.649753 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-f46a2061-39b7-45e6-abbf-b2e6ad1fc217 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:13:14.650556 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-f46a2061-39b7-45e6-abbf-b2e6ad1fc217 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:13:14.650999 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-f46a2061-39b7-45e6-abbf-b2e6ad1fc217 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:13:14.658990 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.policy [None req-9fdb32a0-5cd7-41a3-a0d3-ed5164b74ce2 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c4c0c82448e40ba801c0b52ec44e74a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a093d0bf43046aaa845f3cc115f3f5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116156) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:13:14.666208 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: INFO nova.api.openstack.requestlog [None req-9fdb32a0-5cd7-41a3-a0d3-ed5164b74ce2 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] 10.222.0.18 "GET /compute/v2.1/servers/fa7c86bc-c46f-4120-8f3d-d795f8d7c5cc" status: 200 len: 1570 microversion: 2.1 time: 0.152498 Dec 15 03:13:14.666769 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: [pid: 116156|app: 0|req: 729/1461] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 03:13:14 2021] GET /compute/v2.1/servers/fa7c86bc-c46f-4120-8f3d-d795f8d7c5cc => generated 1570 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 03:13:14.708522 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.policy [None req-f46a2061-39b7-45e6-abbf-b2e6ad1fc217 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97bdf19af9e34fc3886ff451cb9d7a27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '494b56bf5eae4d56a5591546f85bc32b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116157) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:13:14.716201 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: INFO nova.api.openstack.requestlog [None req-f46a2061-39b7-45e6-abbf-b2e6ad1fc217 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] 10.222.0.18 "GET /compute/v2.1/servers/bbb8462c-9501-4541-b67e-43ec5c5061a7" status: 200 len: 1226 microversion: 2.1 time: 0.076761 Dec 15 03:13:14.716752 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: [pid: 116157|app: 0|req: 733/1462] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 03:13:14 2021] GET /compute/v2.1/servers/bbb8462c-9501-4541-b67e-43ec5c5061a7 => generated 1226 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 03:13:15.649654 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi [None req-65c040b5-d737-4c58-b5d4-9bf02ffbdcea tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Calling method '>' {{(pid=116156) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:13:15.650583 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.compute.api [None req-65c040b5-d737-4c58-b5d4-9bf02ffbdcea tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] [instance: b89094ac-aee1-4bd6-a33d-8c4347cebfc7] Fetching instance by UUID {{(pid=116156) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:13:15.656828 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-65c040b5-d737-4c58-b5d4-9bf02ffbdcea tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:13:15.657274 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-65c040b5-d737-4c58-b5d4-9bf02ffbdcea tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:13:15.658084 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-65c040b5-d737-4c58-b5d4-9bf02ffbdcea tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:13:15.658522 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-65c040b5-d737-4c58-b5d4-9bf02ffbdcea tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:13:15.682164 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi [None req-1a2b9e8c-ed69-4919-909b-3649933bd0d2 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Calling method '>' {{(pid=116157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:13:15.682866 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.compute.api [None req-1a2b9e8c-ed69-4919-909b-3649933bd0d2 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] [instance: fa7c86bc-c46f-4120-8f3d-d795f8d7c5cc] Fetching instance by UUID {{(pid=116157) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:13:15.687363 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: INFO nova.api.openstack.requestlog [None req-65c040b5-d737-4c58-b5d4-9bf02ffbdcea tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] 10.222.0.18 "GET /compute/v2.1/servers/b89094ac-aee1-4bd6-a33d-8c4347cebfc7/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041898 Dec 15 03:13:15.687904 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: [pid: 116156|app: 0|req: 730/1463] 10.222.0.18 () {60 vars in 1342 bytes} [Wed Dec 15 03:13:15 2021] GET /compute/v2.1/servers/b89094ac-aee1-4bd6-a33d-8c4347cebfc7/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 03:13:15.689032 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-1a2b9e8c-ed69-4919-909b-3649933bd0d2 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:13:15.689486 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-1a2b9e8c-ed69-4919-909b-3649933bd0d2 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:13:15.690310 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-1a2b9e8c-ed69-4919-909b-3649933bd0d2 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:13:15.690750 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-1a2b9e8c-ed69-4919-909b-3649933bd0d2 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:13:15.732721 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi [None req-f1ee2f2c-ea57-4b9e-91fa-fc1d1e4f630c tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Calling method '>' {{(pid=116156) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:13:15.733336 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.compute.api [None req-f1ee2f2c-ea57-4b9e-91fa-fc1d1e4f630c tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] [instance: bbb8462c-9501-4541-b67e-43ec5c5061a7] Fetching instance by UUID {{(pid=116156) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:13:15.739674 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-f1ee2f2c-ea57-4b9e-91fa-fc1d1e4f630c tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:13:15.740150 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-f1ee2f2c-ea57-4b9e-91fa-fc1d1e4f630c tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:13:15.740926 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-f1ee2f2c-ea57-4b9e-91fa-fc1d1e4f630c tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:13:15.741356 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-f1ee2f2c-ea57-4b9e-91fa-fc1d1e4f630c tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:13:15.799823 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.policy [None req-f1ee2f2c-ea57-4b9e-91fa-fc1d1e4f630c tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97bdf19af9e34fc3886ff451cb9d7a27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '494b56bf5eae4d56a5591546f85bc32b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116156) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:13:15.807001 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: INFO nova.api.openstack.requestlog [None req-f1ee2f2c-ea57-4b9e-91fa-fc1d1e4f630c tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] 10.222.0.18 "GET /compute/v2.1/servers/bbb8462c-9501-4541-b67e-43ec5c5061a7" status: 200 len: 1226 microversion: 2.1 time: 0.077802 Dec 15 03:13:15.807562 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: [pid: 116156|app: 0|req: 731/1464] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 03:13:15 2021] GET /compute/v2.1/servers/bbb8462c-9501-4541-b67e-43ec5c5061a7 => generated 1226 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 03:13:15.826894 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.policy [None req-1a2b9e8c-ed69-4919-909b-3649933bd0d2 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c4c0c82448e40ba801c0b52ec44e74a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a093d0bf43046aaa845f3cc115f3f5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116157) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:13:15.834143 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: INFO nova.api.openstack.requestlog [None req-1a2b9e8c-ed69-4919-909b-3649933bd0d2 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] 10.222.0.18 "GET /compute/v2.1/servers/fa7c86bc-c46f-4120-8f3d-d795f8d7c5cc" status: 200 len: 1570 microversion: 2.1 time: 0.155595 Dec 15 03:13:15.834706 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: [pid: 116157|app: 0|req: 734/1465] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 03:13:15 2021] GET /compute/v2.1/servers/fa7c86bc-c46f-4120-8f3d-d795f8d7c5cc => generated 1570 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 03:13:16.698792 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi [None req-aed34d88-ff3a-4ece-88a1-7cc4dbc2d556 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Calling method '>' {{(pid=116156) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:13:16.699729 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.compute.api [None req-aed34d88-ff3a-4ece-88a1-7cc4dbc2d556 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] [instance: b89094ac-aee1-4bd6-a33d-8c4347cebfc7] Fetching instance by UUID {{(pid=116156) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:13:16.705911 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-aed34d88-ff3a-4ece-88a1-7cc4dbc2d556 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:13:16.706391 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-aed34d88-ff3a-4ece-88a1-7cc4dbc2d556 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:13:16.707166 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-aed34d88-ff3a-4ece-88a1-7cc4dbc2d556 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:13:16.707602 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-aed34d88-ff3a-4ece-88a1-7cc4dbc2d556 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:13:16.735141 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: INFO nova.api.openstack.requestlog [None req-aed34d88-ff3a-4ece-88a1-7cc4dbc2d556 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] 10.222.0.18 "GET /compute/v2.1/servers/b89094ac-aee1-4bd6-a33d-8c4347cebfc7/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.040761 Dec 15 03:13:16.735689 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: [pid: 116156|app: 0|req: 732/1466] 10.222.0.18 () {60 vars in 1342 bytes} [Wed Dec 15 03:13:16 2021] GET /compute/v2.1/servers/b89094ac-aee1-4bd6-a33d-8c4347cebfc7/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 03:13:16.822709 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi [None req-84c583c1-5568-4954-9448-4b27e0702496 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Calling method '>' {{(pid=116157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:13:16.823321 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.compute.api [None req-84c583c1-5568-4954-9448-4b27e0702496 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] [instance: bbb8462c-9501-4541-b67e-43ec5c5061a7] Fetching instance by UUID {{(pid=116157) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:13:16.829495 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-84c583c1-5568-4954-9448-4b27e0702496 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:13:16.829947 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-84c583c1-5568-4954-9448-4b27e0702496 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:13:16.830758 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-84c583c1-5568-4954-9448-4b27e0702496 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:13:16.831197 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-84c583c1-5568-4954-9448-4b27e0702496 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:13:16.851451 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi [None req-fdfac32a-59a5-4bcb-ad0a-b5a1adfc1c04 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Calling method '>' {{(pid=116156) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:13:16.852567 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.compute.api [None req-fdfac32a-59a5-4bcb-ad0a-b5a1adfc1c04 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] [instance: fa7c86bc-c46f-4120-8f3d-d795f8d7c5cc] Fetching instance by UUID {{(pid=116156) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:13:16.858312 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-fdfac32a-59a5-4bcb-ad0a-b5a1adfc1c04 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:13:16.858773 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-fdfac32a-59a5-4bcb-ad0a-b5a1adfc1c04 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:13:16.859585 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-fdfac32a-59a5-4bcb-ad0a-b5a1adfc1c04 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:13:16.860040 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-fdfac32a-59a5-4bcb-ad0a-b5a1adfc1c04 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:13:16.889453 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.policy [None req-84c583c1-5568-4954-9448-4b27e0702496 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97bdf19af9e34fc3886ff451cb9d7a27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '494b56bf5eae4d56a5591546f85bc32b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116157) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:13:16.897853 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: INFO nova.api.openstack.requestlog [None req-84c583c1-5568-4954-9448-4b27e0702496 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] 10.222.0.18 "GET /compute/v2.1/servers/bbb8462c-9501-4541-b67e-43ec5c5061a7" status: 200 len: 1226 microversion: 2.1 time: 0.078741 Dec 15 03:13:16.898556 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: [pid: 116157|app: 0|req: 735/1467] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 03:13:16 2021] GET /compute/v2.1/servers/bbb8462c-9501-4541-b67e-43ec5c5061a7 => generated 1226 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 03:13:16.991733 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.policy [None req-fdfac32a-59a5-4bcb-ad0a-b5a1adfc1c04 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c4c0c82448e40ba801c0b52ec44e74a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a093d0bf43046aaa845f3cc115f3f5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116156) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:13:16.999503 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: INFO nova.api.openstack.requestlog [None req-fdfac32a-59a5-4bcb-ad0a-b5a1adfc1c04 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] 10.222.0.18 "GET /compute/v2.1/servers/fa7c86bc-c46f-4120-8f3d-d795f8d7c5cc" status: 200 len: 1570 microversion: 2.1 time: 0.151608 Dec 15 03:13:17.000067 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: [pid: 116156|app: 0|req: 733/1468] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 03:13:16 2021] GET /compute/v2.1/servers/fa7c86bc-c46f-4120-8f3d-d795f8d7c5cc => generated 1570 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 03:13:17.746599 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi [None req-69829245-1e1d-4fb2-8753-bc33f65fb585 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Calling method '>' {{(pid=116157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:13:17.747505 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.compute.api [None req-69829245-1e1d-4fb2-8753-bc33f65fb585 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] [instance: b89094ac-aee1-4bd6-a33d-8c4347cebfc7] Fetching instance by UUID {{(pid=116157) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:13:17.753365 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-69829245-1e1d-4fb2-8753-bc33f65fb585 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:13:17.753812 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-69829245-1e1d-4fb2-8753-bc33f65fb585 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:13:17.754616 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-69829245-1e1d-4fb2-8753-bc33f65fb585 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:13:17.755054 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-69829245-1e1d-4fb2-8753-bc33f65fb585 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:13:17.785088 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: INFO nova.api.openstack.requestlog [None req-69829245-1e1d-4fb2-8753-bc33f65fb585 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] 10.222.0.18 "GET /compute/v2.1/servers/b89094ac-aee1-4bd6-a33d-8c4347cebfc7/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042287 Dec 15 03:13:17.785644 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: [pid: 116157|app: 0|req: 736/1469] 10.222.0.18 () {60 vars in 1342 bytes} [Wed Dec 15 03:13:17 2021] GET /compute/v2.1/servers/b89094ac-aee1-4bd6-a33d-8c4347cebfc7/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 03:13:17.914669 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi [None req-994e4bd1-d198-4ba9-8d34-22184595dd16 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Calling method '>' {{(pid=116156) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:13:17.915272 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.compute.api [None req-994e4bd1-d198-4ba9-8d34-22184595dd16 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] [instance: bbb8462c-9501-4541-b67e-43ec5c5061a7] Fetching instance by UUID {{(pid=116156) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:13:17.921455 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-994e4bd1-d198-4ba9-8d34-22184595dd16 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:13:17.921900 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-994e4bd1-d198-4ba9-8d34-22184595dd16 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:13:17.922704 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-994e4bd1-d198-4ba9-8d34-22184595dd16 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:13:17.923137 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-994e4bd1-d198-4ba9-8d34-22184595dd16 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:13:17.981717 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.policy [None req-994e4bd1-d198-4ba9-8d34-22184595dd16 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97bdf19af9e34fc3886ff451cb9d7a27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '494b56bf5eae4d56a5591546f85bc32b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116156) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:13:17.989064 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: INFO nova.api.openstack.requestlog [None req-994e4bd1-d198-4ba9-8d34-22184595dd16 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] 10.222.0.18 "GET /compute/v2.1/servers/bbb8462c-9501-4541-b67e-43ec5c5061a7" status: 200 len: 1226 microversion: 2.1 time: 0.078273 Dec 15 03:13:17.989603 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: [pid: 116156|app: 0|req: 734/1470] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 03:13:17 2021] GET /compute/v2.1/servers/bbb8462c-9501-4541-b67e-43ec5c5061a7 => generated 1226 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 03:13:18.016288 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi [None req-b13c746e-b897-4fb9-b970-57cbd3133ab6 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Calling method '>' {{(pid=116157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:13:18.016836 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.compute.api [None req-b13c746e-b897-4fb9-b970-57cbd3133ab6 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] [instance: fa7c86bc-c46f-4120-8f3d-d795f8d7c5cc] Fetching instance by UUID {{(pid=116157) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:13:18.023053 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-b13c746e-b897-4fb9-b970-57cbd3133ab6 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:13:18.023514 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-b13c746e-b897-4fb9-b970-57cbd3133ab6 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:13:18.024298 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-b13c746e-b897-4fb9-b970-57cbd3133ab6 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:13:18.024733 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-b13c746e-b897-4fb9-b970-57cbd3133ab6 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:13:18.157020 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.policy [None req-b13c746e-b897-4fb9-b970-57cbd3133ab6 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c4c0c82448e40ba801c0b52ec44e74a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a093d0bf43046aaa845f3cc115f3f5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116157) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:13:18.164253 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: INFO nova.api.openstack.requestlog [None req-b13c746e-b897-4fb9-b970-57cbd3133ab6 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] 10.222.0.18 "GET /compute/v2.1/servers/fa7c86bc-c46f-4120-8f3d-d795f8d7c5cc" status: 200 len: 1570 microversion: 2.1 time: 0.151676 Dec 15 03:13:18.164805 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: [pid: 116157|app: 0|req: 737/1471] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 03:13:18 2021] GET /compute/v2.1/servers/fa7c86bc-c46f-4120-8f3d-d795f8d7c5cc => generated 1570 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 03:13:18.433288 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Dec 15 03:13:18.433511 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: Wed Dec 15 03:13:18 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Dec 15 03:13:18.796236 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi [None req-f20b300d-1199-494b-9625-31ee26a6fb36 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Calling method '>' {{(pid=116156) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:13:18.797050 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.compute.api [None req-f20b300d-1199-494b-9625-31ee26a6fb36 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] [instance: b89094ac-aee1-4bd6-a33d-8c4347cebfc7] Fetching instance by UUID {{(pid=116156) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:13:18.802942 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-f20b300d-1199-494b-9625-31ee26a6fb36 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:13:18.803397 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-f20b300d-1199-494b-9625-31ee26a6fb36 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:13:18.804179 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-f20b300d-1199-494b-9625-31ee26a6fb36 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:13:18.804614 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-f20b300d-1199-494b-9625-31ee26a6fb36 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:13:18.832312 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: INFO nova.api.openstack.requestlog [None req-f20b300d-1199-494b-9625-31ee26a6fb36 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] 10.222.0.18 "GET /compute/v2.1/servers/b89094ac-aee1-4bd6-a33d-8c4347cebfc7/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.039923 Dec 15 03:13:18.832849 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: [pid: 116156|app: 0|req: 735/1472] 10.222.0.18 () {60 vars in 1342 bytes} [Wed Dec 15 03:13:18 2021] GET /compute/v2.1/servers/b89094ac-aee1-4bd6-a33d-8c4347cebfc7/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 03:13:19.006253 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi [None req-e452457d-bed3-4de1-af69-50e527dc9f89 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Calling method '>' {{(pid=116157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:13:19.006857 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.compute.api [None req-e452457d-bed3-4de1-af69-50e527dc9f89 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] [instance: bbb8462c-9501-4541-b67e-43ec5c5061a7] Fetching instance by UUID {{(pid=116157) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:13:19.013139 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-e452457d-bed3-4de1-af69-50e527dc9f89 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:13:19.013616 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-e452457d-bed3-4de1-af69-50e527dc9f89 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:13:19.014414 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-e452457d-bed3-4de1-af69-50e527dc9f89 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:13:19.014847 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-e452457d-bed3-4de1-af69-50e527dc9f89 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:13:19.072356 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.policy [None req-e452457d-bed3-4de1-af69-50e527dc9f89 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97bdf19af9e34fc3886ff451cb9d7a27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '494b56bf5eae4d56a5591546f85bc32b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116157) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:13:19.079945 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: INFO nova.api.openstack.requestlog [None req-e452457d-bed3-4de1-af69-50e527dc9f89 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] 10.222.0.18 "GET /compute/v2.1/servers/bbb8462c-9501-4541-b67e-43ec5c5061a7" status: 200 len: 1226 microversion: 2.1 time: 0.077339 Dec 15 03:13:19.080494 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: [pid: 116157|app: 0|req: 738/1473] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 03:13:19 2021] GET /compute/v2.1/servers/bbb8462c-9501-4541-b67e-43ec5c5061a7 => generated 1226 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 03:13:19.180073 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi [None req-e91ef28f-93e4-415b-93d5-405c87ba872f tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Calling method '>' {{(pid=116156) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:13:19.180677 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.compute.api [None req-e91ef28f-93e4-415b-93d5-405c87ba872f tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] [instance: fa7c86bc-c46f-4120-8f3d-d795f8d7c5cc] Fetching instance by UUID {{(pid=116156) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:13:19.186838 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-e91ef28f-93e4-415b-93d5-405c87ba872f tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:13:19.187284 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-e91ef28f-93e4-415b-93d5-405c87ba872f tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:13:19.188048 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-e91ef28f-93e4-415b-93d5-405c87ba872f tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:13:19.188476 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-e91ef28f-93e4-415b-93d5-405c87ba872f tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:13:19.316907 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.policy [None req-e91ef28f-93e4-415b-93d5-405c87ba872f tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c4c0c82448e40ba801c0b52ec44e74a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a093d0bf43046aaa845f3cc115f3f5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116156) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:13:19.324637 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: INFO nova.api.openstack.requestlog [None req-e91ef28f-93e4-415b-93d5-405c87ba872f tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] 10.222.0.18 "GET /compute/v2.1/servers/fa7c86bc-c46f-4120-8f3d-d795f8d7c5cc" status: 200 len: 1570 microversion: 2.1 time: 0.148061 Dec 15 03:13:19.325121 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: [pid: 116156|app: 0|req: 736/1474] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 03:13:19 2021] GET /compute/v2.1/servers/fa7c86bc-c46f-4120-8f3d-d795f8d7c5cc => generated 1570 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 03:13:19.843947 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi [None req-ba3ef94c-fda7-4684-b263-5c421de21be6 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Calling method '>' {{(pid=116157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:13:19.844852 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.compute.api [None req-ba3ef94c-fda7-4684-b263-5c421de21be6 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] [instance: b89094ac-aee1-4bd6-a33d-8c4347cebfc7] Fetching instance by UUID {{(pid=116157) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:13:19.850729 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-ba3ef94c-fda7-4684-b263-5c421de21be6 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:13:19.851180 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-ba3ef94c-fda7-4684-b263-5c421de21be6 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:13:19.851959 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-ba3ef94c-fda7-4684-b263-5c421de21be6 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:13:19.852397 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-ba3ef94c-fda7-4684-b263-5c421de21be6 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:13:19.881435 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: INFO nova.api.openstack.requestlog [None req-ba3ef94c-fda7-4684-b263-5c421de21be6 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] 10.222.0.18 "GET /compute/v2.1/servers/b89094ac-aee1-4bd6-a33d-8c4347cebfc7/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041242 Dec 15 03:13:19.881973 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: [pid: 116157|app: 0|req: 739/1475] 10.222.0.18 () {60 vars in 1342 bytes} [Wed Dec 15 03:13:19 2021] GET /compute/v2.1/servers/b89094ac-aee1-4bd6-a33d-8c4347cebfc7/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 03:13:20.097021 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi [None req-37a86039-e3f7-4653-b3b0-7a4798dd7292 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Calling method '>' {{(pid=116156) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:13:20.097558 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.compute.api [None req-37a86039-e3f7-4653-b3b0-7a4798dd7292 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] [instance: bbb8462c-9501-4541-b67e-43ec5c5061a7] Fetching instance by UUID {{(pid=116156) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:13:20.104075 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-37a86039-e3f7-4653-b3b0-7a4798dd7292 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:13:20.104567 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-37a86039-e3f7-4653-b3b0-7a4798dd7292 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:13:20.105346 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-37a86039-e3f7-4653-b3b0-7a4798dd7292 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:13:20.105780 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-37a86039-e3f7-4653-b3b0-7a4798dd7292 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:13:20.167036 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.policy [None req-37a86039-e3f7-4653-b3b0-7a4798dd7292 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97bdf19af9e34fc3886ff451cb9d7a27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '494b56bf5eae4d56a5591546f85bc32b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116156) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:13:20.174099 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: INFO nova.api.openstack.requestlog [None req-37a86039-e3f7-4653-b3b0-7a4798dd7292 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] 10.222.0.18 "GET /compute/v2.1/servers/bbb8462c-9501-4541-b67e-43ec5c5061a7" status: 200 len: 1226 microversion: 2.1 time: 0.080717 Dec 15 03:13:20.174646 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: [pid: 116156|app: 0|req: 737/1476] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 03:13:20 2021] GET /compute/v2.1/servers/bbb8462c-9501-4541-b67e-43ec5c5061a7 => generated 1226 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 03:13:20.341501 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi [None req-2f14aded-b1b8-4ff0-8b2b-307c3289db0e tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Calling method '>' {{(pid=116157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:13:20.342147 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.compute.api [None req-2f14aded-b1b8-4ff0-8b2b-307c3289db0e tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] [instance: fa7c86bc-c46f-4120-8f3d-d795f8d7c5cc] Fetching instance by UUID {{(pid=116157) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:13:20.348482 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-2f14aded-b1b8-4ff0-8b2b-307c3289db0e tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:13:20.349047 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-2f14aded-b1b8-4ff0-8b2b-307c3289db0e tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:13:20.349960 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-2f14aded-b1b8-4ff0-8b2b-307c3289db0e tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:13:20.350427 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-2f14aded-b1b8-4ff0-8b2b-307c3289db0e tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:13:20.477159 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.policy [None req-2f14aded-b1b8-4ff0-8b2b-307c3289db0e tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c4c0c82448e40ba801c0b52ec44e74a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a093d0bf43046aaa845f3cc115f3f5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116157) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:13:20.484943 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: INFO nova.api.openstack.requestlog [None req-2f14aded-b1b8-4ff0-8b2b-307c3289db0e tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] 10.222.0.18 "GET /compute/v2.1/servers/fa7c86bc-c46f-4120-8f3d-d795f8d7c5cc" status: 200 len: 1570 microversion: 2.1 time: 0.147556 Dec 15 03:13:20.485503 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: [pid: 116157|app: 0|req: 740/1477] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 03:13:20 2021] GET /compute/v2.1/servers/fa7c86bc-c46f-4120-8f3d-d795f8d7c5cc => generated 1570 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 03:13:20.892870 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi [None req-16ec42e7-e98e-420d-abbc-0f939d311514 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Calling method '>' {{(pid=116156) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:13:20.893806 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.compute.api [None req-16ec42e7-e98e-420d-abbc-0f939d311514 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] [instance: b89094ac-aee1-4bd6-a33d-8c4347cebfc7] Fetching instance by UUID {{(pid=116156) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:13:20.900107 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-16ec42e7-e98e-420d-abbc-0f939d311514 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:13:20.900558 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-16ec42e7-e98e-420d-abbc-0f939d311514 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:13:20.901341 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-16ec42e7-e98e-420d-abbc-0f939d311514 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:13:20.901779 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-16ec42e7-e98e-420d-abbc-0f939d311514 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:13:20.930219 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: INFO nova.api.openstack.requestlog [None req-16ec42e7-e98e-420d-abbc-0f939d311514 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] 10.222.0.18 "GET /compute/v2.1/servers/b89094ac-aee1-4bd6-a33d-8c4347cebfc7/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041103 Dec 15 03:13:20.930761 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: [pid: 116156|app: 0|req: 738/1478] 10.222.0.18 () {60 vars in 1342 bytes} [Wed Dec 15 03:13:20 2021] GET /compute/v2.1/servers/b89094ac-aee1-4bd6-a33d-8c4347cebfc7/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 03:13:21.190545 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi [None req-098ccf00-7846-4389-acb7-d254ca399777 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Calling method '>' {{(pid=116157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:13:21.191085 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.compute.api [None req-098ccf00-7846-4389-acb7-d254ca399777 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] [instance: bbb8462c-9501-4541-b67e-43ec5c5061a7] Fetching instance by UUID {{(pid=116157) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:13:21.197530 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-098ccf00-7846-4389-acb7-d254ca399777 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:13:21.198004 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-098ccf00-7846-4389-acb7-d254ca399777 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:13:21.198778 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-098ccf00-7846-4389-acb7-d254ca399777 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:13:21.199219 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-098ccf00-7846-4389-acb7-d254ca399777 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:13:21.256922 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.policy [None req-098ccf00-7846-4389-acb7-d254ca399777 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97bdf19af9e34fc3886ff451cb9d7a27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '494b56bf5eae4d56a5591546f85bc32b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116157) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:13:21.264851 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: INFO nova.api.openstack.requestlog [None req-098ccf00-7846-4389-acb7-d254ca399777 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] 10.222.0.18 "GET /compute/v2.1/servers/bbb8462c-9501-4541-b67e-43ec5c5061a7" status: 200 len: 1226 microversion: 2.1 time: 0.078004 Dec 15 03:13:21.265402 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: [pid: 116157|app: 0|req: 741/1479] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 03:13:21 2021] GET /compute/v2.1/servers/bbb8462c-9501-4541-b67e-43ec5c5061a7 => generated 1226 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 03:13:21.502066 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi [None req-c55d4ced-06d7-4226-b195-fd40e24cae14 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Calling method '>' {{(pid=116156) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:13:21.502626 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.compute.api [None req-c55d4ced-06d7-4226-b195-fd40e24cae14 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] [instance: fa7c86bc-c46f-4120-8f3d-d795f8d7c5cc] Fetching instance by UUID {{(pid=116156) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:13:21.508380 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-c55d4ced-06d7-4226-b195-fd40e24cae14 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:13:21.508830 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-c55d4ced-06d7-4226-b195-fd40e24cae14 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:13:21.509593 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-c55d4ced-06d7-4226-b195-fd40e24cae14 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:13:21.510049 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-c55d4ced-06d7-4226-b195-fd40e24cae14 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:13:21.637247 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.policy [None req-c55d4ced-06d7-4226-b195-fd40e24cae14 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c4c0c82448e40ba801c0b52ec44e74a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a093d0bf43046aaa845f3cc115f3f5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116156) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:13:21.644466 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: INFO nova.api.openstack.requestlog [None req-c55d4ced-06d7-4226-b195-fd40e24cae14 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] 10.222.0.18 "GET /compute/v2.1/servers/fa7c86bc-c46f-4120-8f3d-d795f8d7c5cc" status: 200 len: 1570 microversion: 2.1 time: 0.146068 Dec 15 03:13:21.645011 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: [pid: 116156|app: 0|req: 739/1480] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 03:13:21 2021] GET /compute/v2.1/servers/fa7c86bc-c46f-4120-8f3d-d795f8d7c5cc => generated 1570 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 03:13:21.942098 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi [None req-a33b53bb-a558-409e-baf3-80eceabd241e tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Calling method '>' {{(pid=116157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:13:21.943015 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.compute.api [None req-a33b53bb-a558-409e-baf3-80eceabd241e tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] [instance: b89094ac-aee1-4bd6-a33d-8c4347cebfc7] Fetching instance by UUID {{(pid=116157) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:13:21.949269 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-a33b53bb-a558-409e-baf3-80eceabd241e tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:13:21.949729 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-a33b53bb-a558-409e-baf3-80eceabd241e tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:13:21.950536 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-a33b53bb-a558-409e-baf3-80eceabd241e tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:13:21.950978 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-a33b53bb-a558-409e-baf3-80eceabd241e tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:13:21.979912 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: INFO nova.api.openstack.requestlog [None req-a33b53bb-a558-409e-baf3-80eceabd241e tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] 10.222.0.18 "GET /compute/v2.1/servers/b89094ac-aee1-4bd6-a33d-8c4347cebfc7/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041586 Dec 15 03:13:21.980451 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: [pid: 116157|app: 0|req: 742/1481] 10.222.0.18 () {60 vars in 1342 bytes} [Wed Dec 15 03:13:21 2021] GET /compute/v2.1/servers/b89094ac-aee1-4bd6-a33d-8c4347cebfc7/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 03:13:22.281611 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi [None req-cf4d7d0c-9666-4b7e-8189-3c193de0b465 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Calling method '>' {{(pid=116156) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:13:22.282240 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.compute.api [None req-cf4d7d0c-9666-4b7e-8189-3c193de0b465 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] [instance: bbb8462c-9501-4541-b67e-43ec5c5061a7] Fetching instance by UUID {{(pid=116156) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:13:22.288419 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-cf4d7d0c-9666-4b7e-8189-3c193de0b465 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:13:22.288872 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-cf4d7d0c-9666-4b7e-8189-3c193de0b465 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:13:22.289640 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-cf4d7d0c-9666-4b7e-8189-3c193de0b465 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:13:22.290096 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-cf4d7d0c-9666-4b7e-8189-3c193de0b465 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:13:22.348081 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.policy [None req-cf4d7d0c-9666-4b7e-8189-3c193de0b465 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97bdf19af9e34fc3886ff451cb9d7a27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '494b56bf5eae4d56a5591546f85bc32b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116156) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:13:22.355270 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: INFO nova.api.openstack.requestlog [None req-cf4d7d0c-9666-4b7e-8189-3c193de0b465 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] 10.222.0.18 "GET /compute/v2.1/servers/bbb8462c-9501-4541-b67e-43ec5c5061a7" status: 200 len: 1226 microversion: 2.1 time: 0.077293 Dec 15 03:13:22.355820 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: [pid: 116156|app: 0|req: 740/1482] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 03:13:22 2021] GET /compute/v2.1/servers/bbb8462c-9501-4541-b67e-43ec5c5061a7 => generated 1226 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 03:13:22.661743 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi [None req-d2921951-bb9f-4479-bf37-243682c1f85e tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Calling method '>' {{(pid=116157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:13:22.662379 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.compute.api [None req-d2921951-bb9f-4479-bf37-243682c1f85e tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] [instance: fa7c86bc-c46f-4120-8f3d-d795f8d7c5cc] Fetching instance by UUID {{(pid=116157) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:13:22.668304 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-d2921951-bb9f-4479-bf37-243682c1f85e tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:13:22.668749 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-d2921951-bb9f-4479-bf37-243682c1f85e tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:13:22.669522 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-d2921951-bb9f-4479-bf37-243682c1f85e tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:13:22.669951 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-d2921951-bb9f-4479-bf37-243682c1f85e tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:13:22.800415 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.policy [None req-d2921951-bb9f-4479-bf37-243682c1f85e tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c4c0c82448e40ba801c0b52ec44e74a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a093d0bf43046aaa845f3cc115f3f5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116157) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:13:22.808225 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: INFO nova.api.openstack.requestlog [None req-d2921951-bb9f-4479-bf37-243682c1f85e tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] 10.222.0.18 "GET /compute/v2.1/servers/fa7c86bc-c46f-4120-8f3d-d795f8d7c5cc" status: 200 len: 1570 microversion: 2.1 time: 0.150103 Dec 15 03:13:22.808781 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: [pid: 116157|app: 0|req: 743/1483] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 03:13:22 2021] GET /compute/v2.1/servers/fa7c86bc-c46f-4120-8f3d-d795f8d7c5cc => generated 1570 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 03:13:22.991757 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi [None req-2979036f-6b00-43ba-b3ce-537b2fbce205 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Calling method '>' {{(pid=116156) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:13:22.992591 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.compute.api [None req-2979036f-6b00-43ba-b3ce-537b2fbce205 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] [instance: b89094ac-aee1-4bd6-a33d-8c4347cebfc7] Fetching instance by UUID {{(pid=116156) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:13:22.999012 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-2979036f-6b00-43ba-b3ce-537b2fbce205 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:13:22.999464 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-2979036f-6b00-43ba-b3ce-537b2fbce205 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:13:23.000246 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-2979036f-6b00-43ba-b3ce-537b2fbce205 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:13:23.000680 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-2979036f-6b00-43ba-b3ce-537b2fbce205 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:13:23.028117 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: INFO nova.api.openstack.requestlog [None req-2979036f-6b00-43ba-b3ce-537b2fbce205 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] 10.222.0.18 "GET /compute/v2.1/servers/b89094ac-aee1-4bd6-a33d-8c4347cebfc7/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.040247 Dec 15 03:13:23.028650 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: [pid: 116156|app: 0|req: 741/1484] 10.222.0.18 () {60 vars in 1342 bytes} [Wed Dec 15 03:13:22 2021] GET /compute/v2.1/servers/b89094ac-aee1-4bd6-a33d-8c4347cebfc7/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 03:13:23.372469 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi [None req-af979a3f-606d-4edb-913f-b7bbe94e5db4 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Calling method '>' {{(pid=116157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:13:23.373082 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.compute.api [None req-af979a3f-606d-4edb-913f-b7bbe94e5db4 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] [instance: bbb8462c-9501-4541-b67e-43ec5c5061a7] Fetching instance by UUID {{(pid=116157) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:13:23.379359 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-af979a3f-606d-4edb-913f-b7bbe94e5db4 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:13:23.379816 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-af979a3f-606d-4edb-913f-b7bbe94e5db4 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:13:23.380599 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-af979a3f-606d-4edb-913f-b7bbe94e5db4 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:13:23.381042 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-af979a3f-606d-4edb-913f-b7bbe94e5db4 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:13:23.438536 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.policy [None req-af979a3f-606d-4edb-913f-b7bbe94e5db4 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97bdf19af9e34fc3886ff451cb9d7a27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '494b56bf5eae4d56a5591546f85bc32b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116157) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:13:23.445875 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: INFO nova.api.openstack.requestlog [None req-af979a3f-606d-4edb-913f-b7bbe94e5db4 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] 10.222.0.18 "GET /compute/v2.1/servers/bbb8462c-9501-4541-b67e-43ec5c5061a7" status: 200 len: 1226 microversion: 2.1 time: 0.077076 Dec 15 03:13:23.446625 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: [pid: 116157|app: 0|req: 744/1485] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 03:13:23 2021] GET /compute/v2.1/servers/bbb8462c-9501-4541-b67e-43ec5c5061a7 => generated 1226 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 03:13:23.825412 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi [None req-d61ac811-01ed-41b8-bd2c-f21d8c26428e tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Calling method '>' {{(pid=116156) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:13:23.826144 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.compute.api [None req-d61ac811-01ed-41b8-bd2c-f21d8c26428e tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] [instance: fa7c86bc-c46f-4120-8f3d-d795f8d7c5cc] Fetching instance by UUID {{(pid=116156) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:13:23.832466 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-d61ac811-01ed-41b8-bd2c-f21d8c26428e tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:13:23.832924 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-d61ac811-01ed-41b8-bd2c-f21d8c26428e tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:13:23.833707 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-d61ac811-01ed-41b8-bd2c-f21d8c26428e tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:13:23.834178 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-d61ac811-01ed-41b8-bd2c-f21d8c26428e tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:13:23.994939 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.policy [None req-d61ac811-01ed-41b8-bd2c-f21d8c26428e tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c4c0c82448e40ba801c0b52ec44e74a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a093d0bf43046aaa845f3cc115f3f5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116156) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:13:24.002350 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: INFO nova.api.openstack.requestlog [None req-d61ac811-01ed-41b8-bd2c-f21d8c26428e tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] 10.222.0.18 "GET /compute/v2.1/servers/fa7c86bc-c46f-4120-8f3d-d795f8d7c5cc" status: 200 len: 1570 microversion: 2.1 time: 0.181072 Dec 15 03:13:24.002947 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: [pid: 116156|app: 0|req: 742/1486] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 03:13:23 2021] GET /compute/v2.1/servers/fa7c86bc-c46f-4120-8f3d-d795f8d7c5cc => generated 1570 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 03:13:24.038708 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi [None req-40b9f5ec-bd15-45ce-85ce-b8fe4cd2989b tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Calling method '>' {{(pid=116157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:13:24.039606 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.compute.api [None req-40b9f5ec-bd15-45ce-85ce-b8fe4cd2989b tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] [instance: b89094ac-aee1-4bd6-a33d-8c4347cebfc7] Fetching instance by UUID {{(pid=116157) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:13:24.045342 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-40b9f5ec-bd15-45ce-85ce-b8fe4cd2989b tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:13:24.045790 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-40b9f5ec-bd15-45ce-85ce-b8fe4cd2989b tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:13:24.046596 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-40b9f5ec-bd15-45ce-85ce-b8fe4cd2989b tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:13:24.047029 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-40b9f5ec-bd15-45ce-85ce-b8fe4cd2989b tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:13:24.076245 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: INFO nova.api.openstack.requestlog [None req-40b9f5ec-bd15-45ce-85ce-b8fe4cd2989b tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] 10.222.0.18 "GET /compute/v2.1/servers/b89094ac-aee1-4bd6-a33d-8c4347cebfc7/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041238 Dec 15 03:13:24.076717 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: [pid: 116157|app: 0|req: 745/1487] 10.222.0.18 () {60 vars in 1342 bytes} [Wed Dec 15 03:13:24 2021] GET /compute/v2.1/servers/b89094ac-aee1-4bd6-a33d-8c4347cebfc7/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 03:13:24.462829 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi [None req-ff965244-61ce-46fd-bfa2-e2ff4c313d04 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Calling method '>' {{(pid=116156) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:13:24.463480 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.compute.api [None req-ff965244-61ce-46fd-bfa2-e2ff4c313d04 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] [instance: bbb8462c-9501-4541-b67e-43ec5c5061a7] Fetching instance by UUID {{(pid=116156) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:13:24.469533 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-ff965244-61ce-46fd-bfa2-e2ff4c313d04 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:13:24.470011 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-ff965244-61ce-46fd-bfa2-e2ff4c313d04 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:13:24.470821 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-ff965244-61ce-46fd-bfa2-e2ff4c313d04 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:13:24.471261 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-ff965244-61ce-46fd-bfa2-e2ff4c313d04 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:13:24.682762 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.policy [None req-ff965244-61ce-46fd-bfa2-e2ff4c313d04 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97bdf19af9e34fc3886ff451cb9d7a27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '494b56bf5eae4d56a5591546f85bc32b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116156) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:13:24.689914 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: INFO nova.api.openstack.requestlog [None req-ff965244-61ce-46fd-bfa2-e2ff4c313d04 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] 10.222.0.18 "GET /compute/v2.1/servers/bbb8462c-9501-4541-b67e-43ec5c5061a7" status: 200 len: 1226 microversion: 2.1 time: 0.230839 Dec 15 03:13:24.690509 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: [pid: 116156|app: 0|req: 743/1488] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 03:13:24 2021] GET /compute/v2.1/servers/bbb8462c-9501-4541-b67e-43ec5c5061a7 => generated 1226 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 03:13:25.019011 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi [None req-b6937f8e-68cb-41d0-8566-5cc5b3cc672d tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Calling method '>' {{(pid=116157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:13:25.019614 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.compute.api [None req-b6937f8e-68cb-41d0-8566-5cc5b3cc672d tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] [instance: fa7c86bc-c46f-4120-8f3d-d795f8d7c5cc] Fetching instance by UUID {{(pid=116157) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:13:25.026417 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-b6937f8e-68cb-41d0-8566-5cc5b3cc672d tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:13:25.026866 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-b6937f8e-68cb-41d0-8566-5cc5b3cc672d tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:13:25.027636 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-b6937f8e-68cb-41d0-8566-5cc5b3cc672d tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:13:25.028064 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-b6937f8e-68cb-41d0-8566-5cc5b3cc672d tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:13:25.088342 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi [None req-41208b81-2400-4feb-8cb7-531927ecbc2d tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Calling method '>' {{(pid=116156) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:13:25.089300 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.compute.api [None req-41208b81-2400-4feb-8cb7-531927ecbc2d tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] [instance: b89094ac-aee1-4bd6-a33d-8c4347cebfc7] Fetching instance by UUID {{(pid=116156) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:13:25.095548 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-41208b81-2400-4feb-8cb7-531927ecbc2d tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:13:25.096007 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-41208b81-2400-4feb-8cb7-531927ecbc2d tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:13:25.096786 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-41208b81-2400-4feb-8cb7-531927ecbc2d tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:13:25.097228 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-41208b81-2400-4feb-8cb7-531927ecbc2d tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:13:25.125864 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: INFO nova.api.openstack.requestlog [None req-41208b81-2400-4feb-8cb7-531927ecbc2d tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] 10.222.0.18 "GET /compute/v2.1/servers/b89094ac-aee1-4bd6-a33d-8c4347cebfc7/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041881 Dec 15 03:13:25.126452 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: [pid: 116156|app: 0|req: 744/1489] 10.222.0.18 () {60 vars in 1342 bytes} [Wed Dec 15 03:13:25 2021] GET /compute/v2.1/servers/b89094ac-aee1-4bd6-a33d-8c4347cebfc7/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Dec 15 03:13:25.156691 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.policy [None req-b6937f8e-68cb-41d0-8566-5cc5b3cc672d tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c4c0c82448e40ba801c0b52ec44e74a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a093d0bf43046aaa845f3cc115f3f5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116157) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:13:25.163882 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: INFO nova.api.openstack.requestlog [None req-b6937f8e-68cb-41d0-8566-5cc5b3cc672d tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] 10.222.0.18 "GET /compute/v2.1/servers/fa7c86bc-c46f-4120-8f3d-d795f8d7c5cc" status: 200 len: 1570 microversion: 2.1 time: 0.148499 Dec 15 03:13:25.164440 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: [pid: 116157|app: 0|req: 746/1490] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 03:13:25 2021] GET /compute/v2.1/servers/fa7c86bc-c46f-4120-8f3d-d795f8d7c5cc => generated 1570 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 03:13:25.706542 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi [None req-ff761b28-3f69-4009-8877-4cb89abfc25c tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Calling method '>' {{(pid=116156) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:13:25.707161 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.compute.api [None req-ff761b28-3f69-4009-8877-4cb89abfc25c tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] [instance: bbb8462c-9501-4541-b67e-43ec5c5061a7] Fetching instance by UUID {{(pid=116156) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:13:25.713016 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-ff761b28-3f69-4009-8877-4cb89abfc25c tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:13:25.713472 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-ff761b28-3f69-4009-8877-4cb89abfc25c tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:13:25.714286 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-ff761b28-3f69-4009-8877-4cb89abfc25c tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:13:25.714725 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-ff761b28-3f69-4009-8877-4cb89abfc25c tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:13:25.773421 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.policy [None req-ff761b28-3f69-4009-8877-4cb89abfc25c tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97bdf19af9e34fc3886ff451cb9d7a27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '494b56bf5eae4d56a5591546f85bc32b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116156) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:13:25.780865 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: INFO nova.api.openstack.requestlog [None req-ff761b28-3f69-4009-8877-4cb89abfc25c tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] 10.222.0.18 "GET /compute/v2.1/servers/bbb8462c-9501-4541-b67e-43ec5c5061a7" status: 200 len: 1226 microversion: 2.1 time: 0.077955 Dec 15 03:13:25.781410 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: [pid: 116156|app: 0|req: 745/1491] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 03:13:25 2021] GET /compute/v2.1/servers/bbb8462c-9501-4541-b67e-43ec5c5061a7 => generated 1226 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 03:13:26.136544 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi [None req-1a11606e-7ba7-42b9-a017-e70a1193531a tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Calling method '>' {{(pid=116157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:13:26.137465 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.compute.api [None req-1a11606e-7ba7-42b9-a017-e70a1193531a tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] [instance: b89094ac-aee1-4bd6-a33d-8c4347cebfc7] Fetching instance by UUID {{(pid=116157) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:13:26.143721 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-1a11606e-7ba7-42b9-a017-e70a1193531a tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:13:26.144169 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-1a11606e-7ba7-42b9-a017-e70a1193531a tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:13:26.144946 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-1a11606e-7ba7-42b9-a017-e70a1193531a tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:13:26.145381 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-1a11606e-7ba7-42b9-a017-e70a1193531a tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:13:26.174252 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: INFO nova.api.openstack.requestlog [None req-1a11606e-7ba7-42b9-a017-e70a1193531a tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] 10.222.0.18 "GET /compute/v2.1/servers/b89094ac-aee1-4bd6-a33d-8c4347cebfc7/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041413 Dec 15 03:13:26.174783 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: [pid: 116157|app: 0|req: 747/1492] 10.222.0.18 () {60 vars in 1342 bytes} [Wed Dec 15 03:13:26 2021] GET /compute/v2.1/servers/b89094ac-aee1-4bd6-a33d-8c4347cebfc7/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 03:13:26.180233 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi [None req-e64dc557-10e5-487b-8966-60b2ae6f2eb5 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Calling method '>' {{(pid=116156) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:13:26.180884 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.compute.api [None req-e64dc557-10e5-487b-8966-60b2ae6f2eb5 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] [instance: fa7c86bc-c46f-4120-8f3d-d795f8d7c5cc] Fetching instance by UUID {{(pid=116156) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:13:26.187187 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-e64dc557-10e5-487b-8966-60b2ae6f2eb5 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:13:26.187641 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-e64dc557-10e5-487b-8966-60b2ae6f2eb5 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:13:26.188422 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-e64dc557-10e5-487b-8966-60b2ae6f2eb5 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:13:26.188867 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-e64dc557-10e5-487b-8966-60b2ae6f2eb5 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:13:26.318793 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.policy [None req-e64dc557-10e5-487b-8966-60b2ae6f2eb5 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c4c0c82448e40ba801c0b52ec44e74a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a093d0bf43046aaa845f3cc115f3f5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116156) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:13:26.326022 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: INFO nova.api.openstack.requestlog [None req-e64dc557-10e5-487b-8966-60b2ae6f2eb5 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] 10.222.0.18 "GET /compute/v2.1/servers/fa7c86bc-c46f-4120-8f3d-d795f8d7c5cc" status: 200 len: 1570 microversion: 2.1 time: 0.149356 Dec 15 03:13:26.326583 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: [pid: 116156|app: 0|req: 746/1493] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 03:13:26 2021] GET /compute/v2.1/servers/fa7c86bc-c46f-4120-8f3d-d795f8d7c5cc => generated 1570 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 03:13:26.797185 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi [None req-6e3946d9-bf19-4409-8598-a3b57ede9936 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Calling method '>' {{(pid=116157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:13:26.797813 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.compute.api [None req-6e3946d9-bf19-4409-8598-a3b57ede9936 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] [instance: bbb8462c-9501-4541-b67e-43ec5c5061a7] Fetching instance by UUID {{(pid=116157) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:13:26.803622 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-6e3946d9-bf19-4409-8598-a3b57ede9936 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:13:26.804068 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-6e3946d9-bf19-4409-8598-a3b57ede9936 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:13:26.804841 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-6e3946d9-bf19-4409-8598-a3b57ede9936 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:13:26.805277 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-6e3946d9-bf19-4409-8598-a3b57ede9936 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:13:26.867590 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.policy [None req-6e3946d9-bf19-4409-8598-a3b57ede9936 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97bdf19af9e34fc3886ff451cb9d7a27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '494b56bf5eae4d56a5591546f85bc32b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116157) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:13:26.875456 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: INFO nova.api.openstack.requestlog [None req-6e3946d9-bf19-4409-8598-a3b57ede9936 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] 10.222.0.18 "GET /compute/v2.1/servers/bbb8462c-9501-4541-b67e-43ec5c5061a7" status: 200 len: 1226 microversion: 2.1 time: 0.081877 Dec 15 03:13:26.876007 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: [pid: 116157|app: 0|req: 748/1494] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 03:13:26 2021] GET /compute/v2.1/servers/bbb8462c-9501-4541-b67e-43ec5c5061a7 => generated 1226 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 03:13:27.184662 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi [None req-ba5648a4-9e02-4787-867a-07a253958a30 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Calling method '>' {{(pid=116156) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:13:27.185480 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.compute.api [None req-ba5648a4-9e02-4787-867a-07a253958a30 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] [instance: b89094ac-aee1-4bd6-a33d-8c4347cebfc7] Fetching instance by UUID {{(pid=116156) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:13:27.191794 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-ba5648a4-9e02-4787-867a-07a253958a30 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:13:27.192252 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-ba5648a4-9e02-4787-867a-07a253958a30 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:13:27.193046 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-ba5648a4-9e02-4787-867a-07a253958a30 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:13:27.193483 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-ba5648a4-9e02-4787-867a-07a253958a30 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:13:27.223259 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: INFO nova.api.openstack.requestlog [None req-ba5648a4-9e02-4787-867a-07a253958a30 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] 10.222.0.18 "GET /compute/v2.1/servers/b89094ac-aee1-4bd6-a33d-8c4347cebfc7/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042459 Dec 15 03:13:27.223812 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: [pid: 116156|app: 0|req: 747/1495] 10.222.0.18 () {60 vars in 1342 bytes} [Wed Dec 15 03:13:27 2021] GET /compute/v2.1/servers/b89094ac-aee1-4bd6-a33d-8c4347cebfc7/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Dec 15 03:13:27.343320 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi [None req-91e37f03-43d4-44eb-bf0c-afd4e5f63437 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Calling method '>' {{(pid=116157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:13:27.343926 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.compute.api [None req-91e37f03-43d4-44eb-bf0c-afd4e5f63437 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] [instance: fa7c86bc-c46f-4120-8f3d-d795f8d7c5cc] Fetching instance by UUID {{(pid=116157) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:13:27.350112 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-91e37f03-43d4-44eb-bf0c-afd4e5f63437 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:13:27.350554 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-91e37f03-43d4-44eb-bf0c-afd4e5f63437 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:13:27.351323 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-91e37f03-43d4-44eb-bf0c-afd4e5f63437 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:13:27.351752 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-91e37f03-43d4-44eb-bf0c-afd4e5f63437 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:13:27.480266 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.policy [None req-91e37f03-43d4-44eb-bf0c-afd4e5f63437 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c4c0c82448e40ba801c0b52ec44e74a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a093d0bf43046aaa845f3cc115f3f5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116157) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:13:27.487782 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: INFO nova.api.openstack.requestlog [None req-91e37f03-43d4-44eb-bf0c-afd4e5f63437 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] 10.222.0.18 "GET /compute/v2.1/servers/fa7c86bc-c46f-4120-8f3d-d795f8d7c5cc" status: 200 len: 1570 microversion: 2.1 time: 0.148124 Dec 15 03:13:27.488375 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: [pid: 116157|app: 0|req: 749/1496] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 03:13:27 2021] GET /compute/v2.1/servers/fa7c86bc-c46f-4120-8f3d-d795f8d7c5cc => generated 1570 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 03:13:27.891901 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi [None req-b89bad84-bddc-4dd8-b186-5999ab2fd3fa tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Calling method '>' {{(pid=116156) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:13:27.892502 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.compute.api [None req-b89bad84-bddc-4dd8-b186-5999ab2fd3fa tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] [instance: bbb8462c-9501-4541-b67e-43ec5c5061a7] Fetching instance by UUID {{(pid=116156) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:13:27.898291 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-b89bad84-bddc-4dd8-b186-5999ab2fd3fa tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:13:27.898738 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-b89bad84-bddc-4dd8-b186-5999ab2fd3fa tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:13:27.899502 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-b89bad84-bddc-4dd8-b186-5999ab2fd3fa tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:13:27.899934 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-b89bad84-bddc-4dd8-b186-5999ab2fd3fa tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:13:27.959476 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.policy [None req-b89bad84-bddc-4dd8-b186-5999ab2fd3fa tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97bdf19af9e34fc3886ff451cb9d7a27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '494b56bf5eae4d56a5591546f85bc32b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116156) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:13:27.966620 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: INFO nova.api.openstack.requestlog [None req-b89bad84-bddc-4dd8-b186-5999ab2fd3fa tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] 10.222.0.18 "GET /compute/v2.1/servers/bbb8462c-9501-4541-b67e-43ec5c5061a7" status: 200 len: 1226 microversion: 2.1 time: 0.078358 Dec 15 03:13:27.967177 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: [pid: 116156|app: 0|req: 748/1497] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 03:13:27 2021] GET /compute/v2.1/servers/bbb8462c-9501-4541-b67e-43ec5c5061a7 => generated 1226 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 03:13:28.235318 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi [None req-a171bc7a-2c95-441f-a9db-02ef36db4149 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Calling method '>' {{(pid=116157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:13:28.236483 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.compute.api [None req-a171bc7a-2c95-441f-a9db-02ef36db4149 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] [instance: b89094ac-aee1-4bd6-a33d-8c4347cebfc7] Fetching instance by UUID {{(pid=116157) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:13:28.242416 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-a171bc7a-2c95-441f-a9db-02ef36db4149 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:13:28.242879 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-a171bc7a-2c95-441f-a9db-02ef36db4149 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:13:28.243668 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-a171bc7a-2c95-441f-a9db-02ef36db4149 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:13:28.244778 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-a171bc7a-2c95-441f-a9db-02ef36db4149 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:13:28.273754 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: INFO nova.api.openstack.requestlog [None req-a171bc7a-2c95-441f-a9db-02ef36db4149 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] 10.222.0.18 "GET /compute/v2.1/servers/b89094ac-aee1-4bd6-a33d-8c4347cebfc7/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042315 Dec 15 03:13:28.274339 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: [pid: 116157|app: 0|req: 750/1498] 10.222.0.18 () {60 vars in 1342 bytes} [Wed Dec 15 03:13:28 2021] GET /compute/v2.1/servers/b89094ac-aee1-4bd6-a33d-8c4347cebfc7/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 03:13:28.504456 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi [None req-351095e8-164c-474d-9dff-606ad6aed0dd tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Calling method '>' {{(pid=116156) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:13:28.504996 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.compute.api [None req-351095e8-164c-474d-9dff-606ad6aed0dd tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] [instance: fa7c86bc-c46f-4120-8f3d-d795f8d7c5cc] Fetching instance by UUID {{(pid=116156) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:13:28.511196 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-351095e8-164c-474d-9dff-606ad6aed0dd tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:13:28.511647 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-351095e8-164c-474d-9dff-606ad6aed0dd tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:13:28.512428 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-351095e8-164c-474d-9dff-606ad6aed0dd tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:13:28.512864 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-351095e8-164c-474d-9dff-606ad6aed0dd tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:13:28.641287 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.policy [None req-351095e8-164c-474d-9dff-606ad6aed0dd tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c4c0c82448e40ba801c0b52ec44e74a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a093d0bf43046aaa845f3cc115f3f5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116156) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:13:28.648572 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: INFO nova.api.openstack.requestlog [None req-351095e8-164c-474d-9dff-606ad6aed0dd tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] 10.222.0.18 "GET /compute/v2.1/servers/fa7c86bc-c46f-4120-8f3d-d795f8d7c5cc" status: 200 len: 1570 microversion: 2.1 time: 0.147795 Dec 15 03:13:28.649132 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: [pid: 116156|app: 0|req: 749/1499] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 03:13:28 2021] GET /compute/v2.1/servers/fa7c86bc-c46f-4120-8f3d-d795f8d7c5cc => generated 1570 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 03:13:28.983042 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi [None req-44f61af5-c91f-4299-8c44-2b6fda084c19 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Calling method '>' {{(pid=116157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:13:28.983653 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.compute.api [None req-44f61af5-c91f-4299-8c44-2b6fda084c19 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] [instance: bbb8462c-9501-4541-b67e-43ec5c5061a7] Fetching instance by UUID {{(pid=116157) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:13:28.990234 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-44f61af5-c91f-4299-8c44-2b6fda084c19 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:13:28.990693 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-44f61af5-c91f-4299-8c44-2b6fda084c19 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:13:28.991478 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-44f61af5-c91f-4299-8c44-2b6fda084c19 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:13:28.991976 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-44f61af5-c91f-4299-8c44-2b6fda084c19 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:13:29.050784 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.policy [None req-44f61af5-c91f-4299-8c44-2b6fda084c19 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97bdf19af9e34fc3886ff451cb9d7a27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '494b56bf5eae4d56a5591546f85bc32b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116157) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:13:29.058018 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: INFO nova.api.openstack.requestlog [None req-44f61af5-c91f-4299-8c44-2b6fda084c19 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] 10.222.0.18 "GET /compute/v2.1/servers/bbb8462c-9501-4541-b67e-43ec5c5061a7" status: 200 len: 1226 microversion: 2.1 time: 0.078601 Dec 15 03:13:29.058570 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: [pid: 116157|app: 0|req: 751/1500] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 03:13:28 2021] GET /compute/v2.1/servers/bbb8462c-9501-4541-b67e-43ec5c5061a7 => generated 1226 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 03:13:29.284627 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi [None req-35ad917a-fffd-4cf6-b265-314856684c13 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Calling method '>' {{(pid=116156) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:13:29.285558 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.compute.api [None req-35ad917a-fffd-4cf6-b265-314856684c13 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] [instance: b89094ac-aee1-4bd6-a33d-8c4347cebfc7] Fetching instance by UUID {{(pid=116156) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:13:29.291344 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-35ad917a-fffd-4cf6-b265-314856684c13 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:13:29.291796 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-35ad917a-fffd-4cf6-b265-314856684c13 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:13:29.292578 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-35ad917a-fffd-4cf6-b265-314856684c13 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:13:29.293014 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-35ad917a-fffd-4cf6-b265-314856684c13 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:13:29.321763 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: INFO nova.api.openstack.requestlog [None req-35ad917a-fffd-4cf6-b265-314856684c13 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] 10.222.0.18 "GET /compute/v2.1/servers/b89094ac-aee1-4bd6-a33d-8c4347cebfc7/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.040970 Dec 15 03:13:29.322964 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: [pid: 116156|app: 0|req: 750/1501] 10.222.0.18 () {60 vars in 1342 bytes} [Wed Dec 15 03:13:29 2021] GET /compute/v2.1/servers/b89094ac-aee1-4bd6-a33d-8c4347cebfc7/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 03:13:29.665151 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi [None req-42be056b-76d5-4078-8190-c76051515bbb tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Calling method '>' {{(pid=116157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:13:29.665755 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.compute.api [None req-42be056b-76d5-4078-8190-c76051515bbb tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] [instance: fa7c86bc-c46f-4120-8f3d-d795f8d7c5cc] Fetching instance by UUID {{(pid=116157) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:13:29.672199 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-42be056b-76d5-4078-8190-c76051515bbb tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:13:29.672646 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-42be056b-76d5-4078-8190-c76051515bbb tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:13:29.673411 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-42be056b-76d5-4078-8190-c76051515bbb tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:13:29.673843 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-42be056b-76d5-4078-8190-c76051515bbb tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:13:29.803588 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.policy [None req-42be056b-76d5-4078-8190-c76051515bbb tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c4c0c82448e40ba801c0b52ec44e74a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a093d0bf43046aaa845f3cc115f3f5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116157) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:13:29.811309 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: INFO nova.api.openstack.requestlog [None req-42be056b-76d5-4078-8190-c76051515bbb tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] 10.222.0.18 "GET /compute/v2.1/servers/fa7c86bc-c46f-4120-8f3d-d795f8d7c5cc" status: 200 len: 1570 microversion: 2.1 time: 0.149783 Dec 15 03:13:29.811866 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: [pid: 116157|app: 0|req: 752/1502] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 03:13:29 2021] GET /compute/v2.1/servers/fa7c86bc-c46f-4120-8f3d-d795f8d7c5cc => generated 1570 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 03:13:30.074472 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi [None req-0bfd9d20-b60d-4cc9-ad3d-cb452e994181 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Calling method '>' {{(pid=116156) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:13:30.075104 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.compute.api [None req-0bfd9d20-b60d-4cc9-ad3d-cb452e994181 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] [instance: bbb8462c-9501-4541-b67e-43ec5c5061a7] Fetching instance by UUID {{(pid=116156) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:13:30.081178 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-0bfd9d20-b60d-4cc9-ad3d-cb452e994181 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:13:30.081624 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-0bfd9d20-b60d-4cc9-ad3d-cb452e994181 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:13:30.082419 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-0bfd9d20-b60d-4cc9-ad3d-cb452e994181 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:13:30.082851 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-0bfd9d20-b60d-4cc9-ad3d-cb452e994181 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:13:30.140272 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.policy [None req-0bfd9d20-b60d-4cc9-ad3d-cb452e994181 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97bdf19af9e34fc3886ff451cb9d7a27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '494b56bf5eae4d56a5591546f85bc32b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116156) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:13:30.147349 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: INFO nova.api.openstack.requestlog [None req-0bfd9d20-b60d-4cc9-ad3d-cb452e994181 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] 10.222.0.18 "GET /compute/v2.1/servers/bbb8462c-9501-4541-b67e-43ec5c5061a7" status: 200 len: 1226 microversion: 2.1 time: 0.076528 Dec 15 03:13:30.147889 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: [pid: 116156|app: 0|req: 751/1503] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 03:13:30 2021] GET /compute/v2.1/servers/bbb8462c-9501-4541-b67e-43ec5c5061a7 => generated 1226 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 03:13:30.334270 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi [None req-3bc88775-bda2-40f9-b28d-c2f2fd67d75a tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Calling method '>' {{(pid=116157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:13:30.335114 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.compute.api [None req-3bc88775-bda2-40f9-b28d-c2f2fd67d75a tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] [instance: b89094ac-aee1-4bd6-a33d-8c4347cebfc7] Fetching instance by UUID {{(pid=116157) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:13:30.341736 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-3bc88775-bda2-40f9-b28d-c2f2fd67d75a tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:13:30.342210 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-3bc88775-bda2-40f9-b28d-c2f2fd67d75a tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:13:30.342987 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-3bc88775-bda2-40f9-b28d-c2f2fd67d75a tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:13:30.343423 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-3bc88775-bda2-40f9-b28d-c2f2fd67d75a tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:13:30.371643 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: INFO nova.api.openstack.requestlog [None req-3bc88775-bda2-40f9-b28d-c2f2fd67d75a tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] 10.222.0.18 "GET /compute/v2.1/servers/b89094ac-aee1-4bd6-a33d-8c4347cebfc7/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041252 Dec 15 03:13:30.372185 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: [pid: 116157|app: 0|req: 753/1504] 10.222.0.18 () {60 vars in 1342 bytes} [Wed Dec 15 03:13:30 2021] GET /compute/v2.1/servers/b89094ac-aee1-4bd6-a33d-8c4347cebfc7/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 03:13:30.828194 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi [None req-f19c14d0-7864-49c3-b399-9b5d16885e67 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Calling method '>' {{(pid=116156) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:13:30.828800 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.compute.api [None req-f19c14d0-7864-49c3-b399-9b5d16885e67 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] [instance: fa7c86bc-c46f-4120-8f3d-d795f8d7c5cc] Fetching instance by UUID {{(pid=116156) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:13:30.834687 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-f19c14d0-7864-49c3-b399-9b5d16885e67 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:13:30.835137 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-f19c14d0-7864-49c3-b399-9b5d16885e67 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:13:30.835907 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-f19c14d0-7864-49c3-b399-9b5d16885e67 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:13:30.836337 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-f19c14d0-7864-49c3-b399-9b5d16885e67 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:13:30.968217 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.policy [None req-f19c14d0-7864-49c3-b399-9b5d16885e67 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c4c0c82448e40ba801c0b52ec44e74a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a093d0bf43046aaa845f3cc115f3f5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116156) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:13:30.975419 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: INFO nova.api.openstack.requestlog [None req-f19c14d0-7864-49c3-b399-9b5d16885e67 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] 10.222.0.18 "GET /compute/v2.1/servers/fa7c86bc-c46f-4120-8f3d-d795f8d7c5cc" status: 200 len: 1570 microversion: 2.1 time: 0.150908 Dec 15 03:13:30.976040 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: [pid: 116156|app: 0|req: 752/1505] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 03:13:30 2021] GET /compute/v2.1/servers/fa7c86bc-c46f-4120-8f3d-d795f8d7c5cc => generated 1570 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 03:13:31.165012 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi [None req-84f05902-5973-4624-b7be-d8cd7f0b5bcb tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Calling method '>' {{(pid=116157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:13:31.165571 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.compute.api [None req-84f05902-5973-4624-b7be-d8cd7f0b5bcb tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] [instance: bbb8462c-9501-4541-b67e-43ec5c5061a7] Fetching instance by UUID {{(pid=116157) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:13:31.171874 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-84f05902-5973-4624-b7be-d8cd7f0b5bcb tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:13:31.172332 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-84f05902-5973-4624-b7be-d8cd7f0b5bcb tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:13:31.173112 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-84f05902-5973-4624-b7be-d8cd7f0b5bcb tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:13:31.173552 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-84f05902-5973-4624-b7be-d8cd7f0b5bcb tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:13:31.231299 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.policy [None req-84f05902-5973-4624-b7be-d8cd7f0b5bcb tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97bdf19af9e34fc3886ff451cb9d7a27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '494b56bf5eae4d56a5591546f85bc32b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116157) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:13:31.238828 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: INFO nova.api.openstack.requestlog [None req-84f05902-5973-4624-b7be-d8cd7f0b5bcb tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] 10.222.0.18 "GET /compute/v2.1/servers/bbb8462c-9501-4541-b67e-43ec5c5061a7" status: 200 len: 1226 microversion: 2.1 time: 0.077548 Dec 15 03:13:31.239390 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: [pid: 116157|app: 0|req: 754/1506] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 03:13:31 2021] GET /compute/v2.1/servers/bbb8462c-9501-4541-b67e-43ec5c5061a7 => generated 1226 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 03:13:31.382981 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi [None req-6e92d00c-5afd-4d03-9d9d-fe924470a077 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Calling method '>' {{(pid=116156) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:13:31.383911 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.compute.api [None req-6e92d00c-5afd-4d03-9d9d-fe924470a077 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] [instance: b89094ac-aee1-4bd6-a33d-8c4347cebfc7] Fetching instance by UUID {{(pid=116156) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:13:31.390048 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-6e92d00c-5afd-4d03-9d9d-fe924470a077 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:13:31.390529 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-6e92d00c-5afd-4d03-9d9d-fe924470a077 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:13:31.391297 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-6e92d00c-5afd-4d03-9d9d-fe924470a077 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:13:31.391728 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-6e92d00c-5afd-4d03-9d9d-fe924470a077 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:13:31.420167 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: INFO nova.api.openstack.requestlog [None req-6e92d00c-5afd-4d03-9d9d-fe924470a077 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] 10.222.0.18 "GET /compute/v2.1/servers/b89094ac-aee1-4bd6-a33d-8c4347cebfc7/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.040873 Dec 15 03:13:31.420630 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: [pid: 116156|app: 0|req: 753/1507] 10.222.0.18 () {60 vars in 1342 bytes} [Wed Dec 15 03:13:31 2021] GET /compute/v2.1/servers/b89094ac-aee1-4bd6-a33d-8c4347cebfc7/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 03:13:31.992770 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi [None req-f905cc4e-d94d-42ce-a2e7-dfb8965cb48d tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Calling method '>' {{(pid=116157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:13:31.993380 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.compute.api [None req-f905cc4e-d94d-42ce-a2e7-dfb8965cb48d tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] [instance: fa7c86bc-c46f-4120-8f3d-d795f8d7c5cc] Fetching instance by UUID {{(pid=116157) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:13:31.999750 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-f905cc4e-d94d-42ce-a2e7-dfb8965cb48d tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:13:32.000202 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-f905cc4e-d94d-42ce-a2e7-dfb8965cb48d tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:13:32.000999 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-f905cc4e-d94d-42ce-a2e7-dfb8965cb48d tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:13:32.001419 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-f905cc4e-d94d-42ce-a2e7-dfb8965cb48d tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:13:32.129423 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.policy [None req-f905cc4e-d94d-42ce-a2e7-dfb8965cb48d tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c4c0c82448e40ba801c0b52ec44e74a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a093d0bf43046aaa845f3cc115f3f5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116157) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:13:32.137403 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: INFO nova.api.openstack.requestlog [None req-f905cc4e-d94d-42ce-a2e7-dfb8965cb48d tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] 10.222.0.18 "GET /compute/v2.1/servers/fa7c86bc-c46f-4120-8f3d-d795f8d7c5cc" status: 200 len: 1570 microversion: 2.1 time: 0.148266 Dec 15 03:13:32.137969 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: [pid: 116157|app: 0|req: 755/1508] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 03:13:31 2021] GET /compute/v2.1/servers/fa7c86bc-c46f-4120-8f3d-d795f8d7c5cc => generated 1570 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 03:13:32.256001 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi [None req-f637306d-65f9-4937-8044-fe51b56c54be tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Calling method '>' {{(pid=116156) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:13:32.256548 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.compute.api [None req-f637306d-65f9-4937-8044-fe51b56c54be tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] [instance: bbb8462c-9501-4541-b67e-43ec5c5061a7] Fetching instance by UUID {{(pid=116156) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:13:32.263075 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-f637306d-65f9-4937-8044-fe51b56c54be tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:13:32.263522 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-f637306d-65f9-4937-8044-fe51b56c54be tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:13:32.264288 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-f637306d-65f9-4937-8044-fe51b56c54be tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:13:32.264722 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-f637306d-65f9-4937-8044-fe51b56c54be tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:13:32.321127 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.policy [None req-f637306d-65f9-4937-8044-fe51b56c54be tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97bdf19af9e34fc3886ff451cb9d7a27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '494b56bf5eae4d56a5591546f85bc32b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116156) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:13:32.328901 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: INFO nova.api.openstack.requestlog [None req-f637306d-65f9-4937-8044-fe51b56c54be tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] 10.222.0.18 "GET /compute/v2.1/servers/bbb8462c-9501-4541-b67e-43ec5c5061a7" status: 200 len: 1226 microversion: 2.1 time: 0.076554 Dec 15 03:13:32.329452 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: [pid: 116156|app: 0|req: 754/1509] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 03:13:32 2021] GET /compute/v2.1/servers/bbb8462c-9501-4541-b67e-43ec5c5061a7 => generated 1226 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 03:13:32.431559 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi [None req-2d861818-60b5-46b5-8b27-dd523dabed8e tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Calling method '>' {{(pid=116157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:13:32.432966 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.compute.api [None req-2d861818-60b5-46b5-8b27-dd523dabed8e tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] [instance: b89094ac-aee1-4bd6-a33d-8c4347cebfc7] Fetching instance by UUID {{(pid=116157) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:13:32.438796 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-2d861818-60b5-46b5-8b27-dd523dabed8e tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:13:32.439248 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-2d861818-60b5-46b5-8b27-dd523dabed8e tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:13:32.440025 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-2d861818-60b5-46b5-8b27-dd523dabed8e tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:13:32.440468 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-2d861818-60b5-46b5-8b27-dd523dabed8e tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:13:32.468543 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: INFO nova.api.openstack.requestlog [None req-2d861818-60b5-46b5-8b27-dd523dabed8e tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] 10.222.0.18 "GET /compute/v2.1/servers/b89094ac-aee1-4bd6-a33d-8c4347cebfc7/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.040819 Dec 15 03:13:32.469083 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: [pid: 116157|app: 0|req: 756/1510] 10.222.0.18 () {60 vars in 1342 bytes} [Wed Dec 15 03:13:32 2021] GET /compute/v2.1/servers/b89094ac-aee1-4bd6-a33d-8c4347cebfc7/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 03:13:33.155138 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi [None req-020121af-3924-4d0c-ade0-d77bacb4130d tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Calling method '>' {{(pid=116156) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:13:33.155743 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.compute.api [None req-020121af-3924-4d0c-ade0-d77bacb4130d tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] [instance: fa7c86bc-c46f-4120-8f3d-d795f8d7c5cc] Fetching instance by UUID {{(pid=116156) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:13:33.161945 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-020121af-3924-4d0c-ade0-d77bacb4130d tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:13:33.162423 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-020121af-3924-4d0c-ade0-d77bacb4130d tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:13:33.163196 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-020121af-3924-4d0c-ade0-d77bacb4130d tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:13:33.163623 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-020121af-3924-4d0c-ade0-d77bacb4130d tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:13:33.305551 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.policy [None req-020121af-3924-4d0c-ade0-d77bacb4130d tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c4c0c82448e40ba801c0b52ec44e74a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a093d0bf43046aaa845f3cc115f3f5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116156) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:13:33.312748 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: INFO nova.api.openstack.requestlog [None req-020121af-3924-4d0c-ade0-d77bacb4130d tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] 10.222.0.18 "GET /compute/v2.1/servers/fa7c86bc-c46f-4120-8f3d-d795f8d7c5cc" status: 200 len: 1570 microversion: 2.1 time: 0.162352 Dec 15 03:13:33.313300 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: [pid: 116156|app: 0|req: 755/1511] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 03:13:33 2021] GET /compute/v2.1/servers/fa7c86bc-c46f-4120-8f3d-d795f8d7c5cc => generated 1570 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 03:13:33.345693 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi [None req-6e3fb079-dad4-4b4b-b5dc-4b15fe02c57d tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Calling method '>' {{(pid=116157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:13:33.346333 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.compute.api [None req-6e3fb079-dad4-4b4b-b5dc-4b15fe02c57d tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] [instance: bbb8462c-9501-4541-b67e-43ec5c5061a7] Fetching instance by UUID {{(pid=116157) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:13:33.352825 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-6e3fb079-dad4-4b4b-b5dc-4b15fe02c57d tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:13:33.353288 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-6e3fb079-dad4-4b4b-b5dc-4b15fe02c57d tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:13:33.354142 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-6e3fb079-dad4-4b4b-b5dc-4b15fe02c57d tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:13:33.354586 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-6e3fb079-dad4-4b4b-b5dc-4b15fe02c57d tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:13:33.412828 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.policy [None req-6e3fb079-dad4-4b4b-b5dc-4b15fe02c57d tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97bdf19af9e34fc3886ff451cb9d7a27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '494b56bf5eae4d56a5591546f85bc32b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116157) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:13:33.420214 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: INFO nova.api.openstack.requestlog [None req-6e3fb079-dad4-4b4b-b5dc-4b15fe02c57d tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] 10.222.0.18 "GET /compute/v2.1/servers/bbb8462c-9501-4541-b67e-43ec5c5061a7" status: 200 len: 1226 microversion: 2.1 time: 0.078272 Dec 15 03:13:33.420780 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: [pid: 116157|app: 0|req: 757/1512] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 03:13:33 2021] GET /compute/v2.1/servers/bbb8462c-9501-4541-b67e-43ec5c5061a7 => generated 1226 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 03:13:33.479864 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi [None req-21f84d65-7c60-471c-9f43-82b5a4036840 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Calling method '>' {{(pid=116156) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:13:33.480767 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.compute.api [None req-21f84d65-7c60-471c-9f43-82b5a4036840 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] [instance: b89094ac-aee1-4bd6-a33d-8c4347cebfc7] Fetching instance by UUID {{(pid=116156) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:13:33.486832 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-21f84d65-7c60-471c-9f43-82b5a4036840 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:13:33.487285 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-21f84d65-7c60-471c-9f43-82b5a4036840 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:13:33.488090 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-21f84d65-7c60-471c-9f43-82b5a4036840 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:13:33.488531 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-21f84d65-7c60-471c-9f43-82b5a4036840 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:13:33.517518 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: INFO nova.api.openstack.requestlog [None req-21f84d65-7c60-471c-9f43-82b5a4036840 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] 10.222.0.18 "GET /compute/v2.1/servers/b89094ac-aee1-4bd6-a33d-8c4347cebfc7/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041407 Dec 15 03:13:33.518071 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: [pid: 116156|app: 0|req: 756/1513] 10.222.0.18 () {60 vars in 1342 bytes} [Wed Dec 15 03:13:33 2021] GET /compute/v2.1/servers/b89094ac-aee1-4bd6-a33d-8c4347cebfc7/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 03:13:34.329338 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi [None req-08367f39-e052-48ec-8f2e-868c3d369403 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Calling method '>' {{(pid=116157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:13:34.329948 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.compute.api [None req-08367f39-e052-48ec-8f2e-868c3d369403 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] [instance: fa7c86bc-c46f-4120-8f3d-d795f8d7c5cc] Fetching instance by UUID {{(pid=116157) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:13:34.335801 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-08367f39-e052-48ec-8f2e-868c3d369403 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:13:34.336254 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-08367f39-e052-48ec-8f2e-868c3d369403 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:13:34.337038 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-08367f39-e052-48ec-8f2e-868c3d369403 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:13:34.337474 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-08367f39-e052-48ec-8f2e-868c3d369403 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:13:34.436854 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi [None req-29bc0e61-fd7c-4ed0-a589-1d006088182a tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Calling method '>' {{(pid=116156) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:13:34.437571 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.compute.api [None req-29bc0e61-fd7c-4ed0-a589-1d006088182a tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] [instance: bbb8462c-9501-4541-b67e-43ec5c5061a7] Fetching instance by UUID {{(pid=116156) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:13:34.444260 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-29bc0e61-fd7c-4ed0-a589-1d006088182a tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:13:34.444813 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-29bc0e61-fd7c-4ed0-a589-1d006088182a tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:13:34.445621 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-29bc0e61-fd7c-4ed0-a589-1d006088182a tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:13:34.446091 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-29bc0e61-fd7c-4ed0-a589-1d006088182a tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:13:34.509069 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.policy [None req-29bc0e61-fd7c-4ed0-a589-1d006088182a tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97bdf19af9e34fc3886ff451cb9d7a27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '494b56bf5eae4d56a5591546f85bc32b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116156) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:13:34.517601 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: INFO nova.api.openstack.requestlog [None req-29bc0e61-fd7c-4ed0-a589-1d006088182a tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] 10.222.0.18 "GET /compute/v2.1/servers/bbb8462c-9501-4541-b67e-43ec5c5061a7" status: 200 len: 1226 microversion: 2.1 time: 0.084846 Dec 15 03:13:34.518228 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: [pid: 116156|app: 0|req: 757/1514] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 03:13:34 2021] GET /compute/v2.1/servers/bbb8462c-9501-4541-b67e-43ec5c5061a7 => generated 1226 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 03:13:34.528719 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi [None req-a2b5708d-5bc5-43f6-8320-af3bfb375602 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Calling method '>' {{(pid=116156) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:13:34.529659 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.compute.api [None req-a2b5708d-5bc5-43f6-8320-af3bfb375602 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] [instance: b89094ac-aee1-4bd6-a33d-8c4347cebfc7] Fetching instance by UUID {{(pid=116156) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:13:34.535978 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-a2b5708d-5bc5-43f6-8320-af3bfb375602 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:13:34.536431 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-a2b5708d-5bc5-43f6-8320-af3bfb375602 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:13:34.537229 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-a2b5708d-5bc5-43f6-8320-af3bfb375602 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:13:34.537666 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-a2b5708d-5bc5-43f6-8320-af3bfb375602 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:13:34.568329 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: INFO nova.api.openstack.requestlog [None req-a2b5708d-5bc5-43f6-8320-af3bfb375602 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] 10.222.0.18 "GET /compute/v2.1/servers/b89094ac-aee1-4bd6-a33d-8c4347cebfc7/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043481 Dec 15 03:13:34.568911 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: [pid: 116156|app: 0|req: 758/1515] 10.222.0.18 () {60 vars in 1342 bytes} [Wed Dec 15 03:13:34 2021] GET /compute/v2.1/servers/b89094ac-aee1-4bd6-a33d-8c4347cebfc7/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Dec 15 03:13:34.693345 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.policy [None req-08367f39-e052-48ec-8f2e-868c3d369403 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c4c0c82448e40ba801c0b52ec44e74a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a093d0bf43046aaa845f3cc115f3f5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116157) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:13:34.701206 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: INFO nova.api.openstack.requestlog [None req-08367f39-e052-48ec-8f2e-868c3d369403 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] 10.222.0.18 "GET /compute/v2.1/servers/fa7c86bc-c46f-4120-8f3d-d795f8d7c5cc" status: 200 len: 1570 microversion: 2.1 time: 0.375510 Dec 15 03:13:34.701772 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: [pid: 116157|app: 0|req: 758/1516] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 03:13:34 2021] GET /compute/v2.1/servers/fa7c86bc-c46f-4120-8f3d-d795f8d7c5cc => generated 1570 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 03:13:35.534662 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi [None req-cd0ff2f8-b068-4853-9ecb-23291ece7c78 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Calling method '>' {{(pid=116156) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:13:35.535199 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.compute.api [None req-cd0ff2f8-b068-4853-9ecb-23291ece7c78 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] [instance: bbb8462c-9501-4541-b67e-43ec5c5061a7] Fetching instance by UUID {{(pid=116156) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:13:35.541431 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-cd0ff2f8-b068-4853-9ecb-23291ece7c78 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:13:35.542414 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-cd0ff2f8-b068-4853-9ecb-23291ece7c78 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:13:35.543187 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-cd0ff2f8-b068-4853-9ecb-23291ece7c78 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:13:35.543623 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-cd0ff2f8-b068-4853-9ecb-23291ece7c78 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:13:35.579922 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi [None req-78cb92d7-3515-48e3-921c-9ba0a536ce2e tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Calling method '>' {{(pid=116157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:13:35.580935 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.compute.api [None req-78cb92d7-3515-48e3-921c-9ba0a536ce2e tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] [instance: b89094ac-aee1-4bd6-a33d-8c4347cebfc7] Fetching instance by UUID {{(pid=116157) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:13:35.587485 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-78cb92d7-3515-48e3-921c-9ba0a536ce2e tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:13:35.587937 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-78cb92d7-3515-48e3-921c-9ba0a536ce2e tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:13:35.588799 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-78cb92d7-3515-48e3-921c-9ba0a536ce2e tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:13:35.589237 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-78cb92d7-3515-48e3-921c-9ba0a536ce2e tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:13:35.604059 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.policy [None req-cd0ff2f8-b068-4853-9ecb-23291ece7c78 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97bdf19af9e34fc3886ff451cb9d7a27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '494b56bf5eae4d56a5591546f85bc32b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116156) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:13:35.612223 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: INFO nova.api.openstack.requestlog [None req-cd0ff2f8-b068-4853-9ecb-23291ece7c78 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] 10.222.0.18 "GET /compute/v2.1/servers/bbb8462c-9501-4541-b67e-43ec5c5061a7" status: 200 len: 1226 microversion: 2.1 time: 0.081371 Dec 15 03:13:35.612787 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: [pid: 116156|app: 0|req: 759/1517] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 03:13:35 2021] GET /compute/v2.1/servers/bbb8462c-9501-4541-b67e-43ec5c5061a7 => generated 1226 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 03:13:35.618559 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: INFO nova.api.openstack.requestlog [None req-78cb92d7-3515-48e3-921c-9ba0a536ce2e tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] 10.222.0.18 "GET /compute/v2.1/servers/b89094ac-aee1-4bd6-a33d-8c4347cebfc7/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042316 Dec 15 03:13:35.619106 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: [pid: 116157|app: 0|req: 759/1518] 10.222.0.18 () {60 vars in 1342 bytes} [Wed Dec 15 03:13:35 2021] GET /compute/v2.1/servers/b89094ac-aee1-4bd6-a33d-8c4347cebfc7/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Dec 15 03:13:35.717934 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi [None req-190f2844-3ac4-4bdc-a290-0d31d382efa0 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Calling method '>' {{(pid=116156) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:13:35.718562 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.compute.api [None req-190f2844-3ac4-4bdc-a290-0d31d382efa0 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] [instance: fa7c86bc-c46f-4120-8f3d-d795f8d7c5cc] Fetching instance by UUID {{(pid=116156) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:13:35.724339 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-190f2844-3ac4-4bdc-a290-0d31d382efa0 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:13:35.724784 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-190f2844-3ac4-4bdc-a290-0d31d382efa0 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:13:35.725551 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-190f2844-3ac4-4bdc-a290-0d31d382efa0 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:13:35.726006 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-190f2844-3ac4-4bdc-a290-0d31d382efa0 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:13:35.853528 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.policy [None req-190f2844-3ac4-4bdc-a290-0d31d382efa0 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c4c0c82448e40ba801c0b52ec44e74a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a093d0bf43046aaa845f3cc115f3f5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116156) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:13:35.861780 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: INFO nova.api.openstack.requestlog [None req-190f2844-3ac4-4bdc-a290-0d31d382efa0 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] 10.222.0.18 "GET /compute/v2.1/servers/fa7c86bc-c46f-4120-8f3d-d795f8d7c5cc" status: 200 len: 1570 microversion: 2.1 time: 0.147435 Dec 15 03:13:35.862387 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: [pid: 116156|app: 0|req: 760/1519] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 03:13:35 2021] GET /compute/v2.1/servers/fa7c86bc-c46f-4120-8f3d-d795f8d7c5cc => generated 1570 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 03:13:36.629840 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi [None req-e470ff1a-11cf-4254-9032-e844e4637bb7 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Calling method '>' {{(pid=116157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:13:36.630495 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi [None req-3a792c1b-689e-4694-8650-10e631dd0c24 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Calling method '>' {{(pid=116156) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:13:36.630898 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.compute.api [None req-e470ff1a-11cf-4254-9032-e844e4637bb7 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] [instance: bbb8462c-9501-4541-b67e-43ec5c5061a7] Fetching instance by UUID {{(pid=116157) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:13:36.631261 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.compute.api [None req-3a792c1b-689e-4694-8650-10e631dd0c24 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] [instance: b89094ac-aee1-4bd6-a33d-8c4347cebfc7] Fetching instance by UUID {{(pid=116156) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:13:36.637611 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-e470ff1a-11cf-4254-9032-e844e4637bb7 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:13:36.637898 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-3a792c1b-689e-4694-8650-10e631dd0c24 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:13:36.638165 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-e470ff1a-11cf-4254-9032-e844e4637bb7 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:13:36.638388 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-3a792c1b-689e-4694-8650-10e631dd0c24 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:13:36.638952 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-e470ff1a-11cf-4254-9032-e844e4637bb7 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:13:36.639477 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-e470ff1a-11cf-4254-9032-e844e4637bb7 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:13:36.639590 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-3a792c1b-689e-4694-8650-10e631dd0c24 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:13:36.639854 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-3a792c1b-689e-4694-8650-10e631dd0c24 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:13:36.668667 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: INFO nova.api.openstack.requestlog [None req-3a792c1b-689e-4694-8650-10e631dd0c24 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] 10.222.0.18 "GET /compute/v2.1/servers/b89094ac-aee1-4bd6-a33d-8c4347cebfc7/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042027 Dec 15 03:13:36.672284 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: [pid: 116156|app: 0|req: 761/1520] 10.222.0.18 () {60 vars in 1342 bytes} [Wed Dec 15 03:13:36 2021] GET /compute/v2.1/servers/b89094ac-aee1-4bd6-a33d-8c4347cebfc7/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Dec 15 03:13:36.697825 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.policy [None req-e470ff1a-11cf-4254-9032-e844e4637bb7 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97bdf19af9e34fc3886ff451cb9d7a27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '494b56bf5eae4d56a5591546f85bc32b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116157) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:13:36.706028 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: INFO nova.api.openstack.requestlog [None req-e470ff1a-11cf-4254-9032-e844e4637bb7 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] 10.222.0.18 "GET /compute/v2.1/servers/bbb8462c-9501-4541-b67e-43ec5c5061a7" status: 200 len: 1226 microversion: 2.1 time: 0.079818 Dec 15 03:13:36.706589 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: [pid: 116157|app: 0|req: 760/1521] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 03:13:36 2021] GET /compute/v2.1/servers/bbb8462c-9501-4541-b67e-43ec5c5061a7 => generated 1226 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 03:13:36.878738 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi [None req-9192ecfd-e201-45ff-b954-95bfdb8ec6c2 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Calling method '>' {{(pid=116156) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:13:36.879354 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.compute.api [None req-9192ecfd-e201-45ff-b954-95bfdb8ec6c2 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] [instance: fa7c86bc-c46f-4120-8f3d-d795f8d7c5cc] Fetching instance by UUID {{(pid=116156) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:13:36.885299 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-9192ecfd-e201-45ff-b954-95bfdb8ec6c2 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:13:36.886359 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-9192ecfd-e201-45ff-b954-95bfdb8ec6c2 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:13:36.887141 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-9192ecfd-e201-45ff-b954-95bfdb8ec6c2 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:13:36.887583 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-9192ecfd-e201-45ff-b954-95bfdb8ec6c2 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:13:37.014239 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.policy [None req-9192ecfd-e201-45ff-b954-95bfdb8ec6c2 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c4c0c82448e40ba801c0b52ec44e74a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a093d0bf43046aaa845f3cc115f3f5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116156) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:13:37.021508 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: INFO nova.api.openstack.requestlog [None req-9192ecfd-e201-45ff-b954-95bfdb8ec6c2 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] 10.222.0.18 "GET /compute/v2.1/servers/fa7c86bc-c46f-4120-8f3d-d795f8d7c5cc" status: 200 len: 1570 microversion: 2.1 time: 0.146403 Dec 15 03:13:37.022183 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: [pid: 116156|app: 0|req: 762/1522] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 03:13:36 2021] GET /compute/v2.1/servers/fa7c86bc-c46f-4120-8f3d-d795f8d7c5cc => generated 1570 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 03:13:37.679409 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi [None req-e0171f89-2737-4d91-8dbb-fbc1ab9a9099 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Calling method '>' {{(pid=116157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:13:37.680321 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.compute.api [None req-e0171f89-2737-4d91-8dbb-fbc1ab9a9099 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] [instance: b89094ac-aee1-4bd6-a33d-8c4347cebfc7] Fetching instance by UUID {{(pid=116157) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:13:37.686655 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-e0171f89-2737-4d91-8dbb-fbc1ab9a9099 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:13:37.687110 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-e0171f89-2737-4d91-8dbb-fbc1ab9a9099 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:13:37.687896 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-e0171f89-2737-4d91-8dbb-fbc1ab9a9099 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:13:37.688337 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-e0171f89-2737-4d91-8dbb-fbc1ab9a9099 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:13:37.717426 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: INFO nova.api.openstack.requestlog [None req-e0171f89-2737-4d91-8dbb-fbc1ab9a9099 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] 10.222.0.18 "GET /compute/v2.1/servers/b89094ac-aee1-4bd6-a33d-8c4347cebfc7/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041813 Dec 15 03:13:37.717992 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: [pid: 116157|app: 0|req: 761/1523] 10.222.0.18 () {60 vars in 1342 bytes} [Wed Dec 15 03:13:37 2021] GET /compute/v2.1/servers/b89094ac-aee1-4bd6-a33d-8c4347cebfc7/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 03:13:37.722644 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi [None req-9388927a-ff44-44df-b644-e38cbd91921d tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Calling method '>' {{(pid=116156) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:13:37.723265 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.compute.api [None req-9388927a-ff44-44df-b644-e38cbd91921d tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] [instance: bbb8462c-9501-4541-b67e-43ec5c5061a7] Fetching instance by UUID {{(pid=116156) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:13:37.729421 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-9388927a-ff44-44df-b644-e38cbd91921d tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:13:37.729878 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-9388927a-ff44-44df-b644-e38cbd91921d tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:13:37.730780 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-9388927a-ff44-44df-b644-e38cbd91921d tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:13:37.731215 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-9388927a-ff44-44df-b644-e38cbd91921d tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:13:37.791791 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.policy [None req-9388927a-ff44-44df-b644-e38cbd91921d tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97bdf19af9e34fc3886ff451cb9d7a27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '494b56bf5eae4d56a5591546f85bc32b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116156) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:13:37.798919 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: INFO nova.api.openstack.requestlog [None req-9388927a-ff44-44df-b644-e38cbd91921d tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] 10.222.0.18 "GET /compute/v2.1/servers/bbb8462c-9501-4541-b67e-43ec5c5061a7" status: 200 len: 1226 microversion: 2.1 time: 0.079961 Dec 15 03:13:37.799467 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: [pid: 116156|app: 0|req: 763/1524] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 03:13:37 2021] GET /compute/v2.1/servers/bbb8462c-9501-4541-b67e-43ec5c5061a7 => generated 1226 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 03:13:38.038407 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi [None req-991dbe8a-da81-42a0-afad-1a78d48f45b7 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Calling method '>' {{(pid=116157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:13:38.038941 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.compute.api [None req-991dbe8a-da81-42a0-afad-1a78d48f45b7 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] [instance: fa7c86bc-c46f-4120-8f3d-d795f8d7c5cc] Fetching instance by UUID {{(pid=116157) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:13:38.045018 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-991dbe8a-da81-42a0-afad-1a78d48f45b7 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:13:38.045472 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-991dbe8a-da81-42a0-afad-1a78d48f45b7 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:13:38.046444 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-991dbe8a-da81-42a0-afad-1a78d48f45b7 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:13:38.046950 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-991dbe8a-da81-42a0-afad-1a78d48f45b7 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:13:38.174749 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.policy [None req-991dbe8a-da81-42a0-afad-1a78d48f45b7 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c4c0c82448e40ba801c0b52ec44e74a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a093d0bf43046aaa845f3cc115f3f5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116157) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:13:38.182007 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: INFO nova.api.openstack.requestlog [None req-991dbe8a-da81-42a0-afad-1a78d48f45b7 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] 10.222.0.18 "GET /compute/v2.1/servers/fa7c86bc-c46f-4120-8f3d-d795f8d7c5cc" status: 200 len: 1570 microversion: 2.1 time: 0.147301 Dec 15 03:13:38.183152 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: [pid: 116157|app: 0|req: 762/1525] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 03:13:38 2021] GET /compute/v2.1/servers/fa7c86bc-c46f-4120-8f3d-d795f8d7c5cc => generated 1570 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 03:13:38.728600 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi [None req-21c1973f-41f0-4a25-8da9-b787b9686942 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Calling method '>' {{(pid=116156) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:13:38.729534 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.compute.api [None req-21c1973f-41f0-4a25-8da9-b787b9686942 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] [instance: b89094ac-aee1-4bd6-a33d-8c4347cebfc7] Fetching instance by UUID {{(pid=116156) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:13:38.735794 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-21c1973f-41f0-4a25-8da9-b787b9686942 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:13:38.736511 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-21c1973f-41f0-4a25-8da9-b787b9686942 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:13:38.737282 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-21c1973f-41f0-4a25-8da9-b787b9686942 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:13:38.737721 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-21c1973f-41f0-4a25-8da9-b787b9686942 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:13:38.765957 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: INFO nova.api.openstack.requestlog [None req-21c1973f-41f0-4a25-8da9-b787b9686942 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] 10.222.0.18 "GET /compute/v2.1/servers/b89094ac-aee1-4bd6-a33d-8c4347cebfc7/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041121 Dec 15 03:13:38.766537 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: [pid: 116156|app: 0|req: 764/1526] 10.222.0.18 () {60 vars in 1342 bytes} [Wed Dec 15 03:13:38 2021] GET /compute/v2.1/servers/b89094ac-aee1-4bd6-a33d-8c4347cebfc7/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 03:13:38.815238 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi [None req-66a064af-0bbc-40a3-b0ee-3b538923e37f tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Calling method '>' {{(pid=116157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:13:38.815851 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.compute.api [None req-66a064af-0bbc-40a3-b0ee-3b538923e37f tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] [instance: bbb8462c-9501-4541-b67e-43ec5c5061a7] Fetching instance by UUID {{(pid=116157) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:13:38.822096 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-66a064af-0bbc-40a3-b0ee-3b538923e37f tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:13:38.822549 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-66a064af-0bbc-40a3-b0ee-3b538923e37f tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:13:38.823836 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-66a064af-0bbc-40a3-b0ee-3b538923e37f tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:13:38.824271 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-66a064af-0bbc-40a3-b0ee-3b538923e37f tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:13:38.885230 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.policy [None req-66a064af-0bbc-40a3-b0ee-3b538923e37f tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97bdf19af9e34fc3886ff451cb9d7a27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '494b56bf5eae4d56a5591546f85bc32b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116157) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:13:38.892918 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: INFO nova.api.openstack.requestlog [None req-66a064af-0bbc-40a3-b0ee-3b538923e37f tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] 10.222.0.18 "GET /compute/v2.1/servers/bbb8462c-9501-4541-b67e-43ec5c5061a7" status: 200 len: 1226 microversion: 2.1 time: 0.081433 Dec 15 03:13:38.893475 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: [pid: 116157|app: 0|req: 763/1527] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 03:13:38 2021] GET /compute/v2.1/servers/bbb8462c-9501-4541-b67e-43ec5c5061a7 => generated 1226 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 03:13:39.200037 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi [None req-e4db9cdf-4dfc-437e-a2d6-dd95e6e2c29e tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Calling method '>' {{(pid=116156) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:13:39.200761 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.compute.api [None req-e4db9cdf-4dfc-437e-a2d6-dd95e6e2c29e tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] [instance: fa7c86bc-c46f-4120-8f3d-d795f8d7c5cc] Fetching instance by UUID {{(pid=116156) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:13:39.206732 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-e4db9cdf-4dfc-437e-a2d6-dd95e6e2c29e tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:13:39.207274 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-e4db9cdf-4dfc-437e-a2d6-dd95e6e2c29e tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:13:39.207962 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-e4db9cdf-4dfc-437e-a2d6-dd95e6e2c29e tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:13:39.208394 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-e4db9cdf-4dfc-437e-a2d6-dd95e6e2c29e tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:13:39.336032 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.policy [None req-e4db9cdf-4dfc-437e-a2d6-dd95e6e2c29e tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c4c0c82448e40ba801c0b52ec44e74a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a093d0bf43046aaa845f3cc115f3f5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116156) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:13:39.343222 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: INFO nova.api.openstack.requestlog [None req-e4db9cdf-4dfc-437e-a2d6-dd95e6e2c29e tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] 10.222.0.18 "GET /compute/v2.1/servers/fa7c86bc-c46f-4120-8f3d-d795f8d7c5cc" status: 200 len: 1570 microversion: 2.1 time: 0.147421 Dec 15 03:13:39.343772 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: [pid: 116156|app: 0|req: 765/1528] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 03:13:39 2021] GET /compute/v2.1/servers/fa7c86bc-c46f-4120-8f3d-d795f8d7c5cc => generated 1570 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 03:13:39.777874 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi [None req-50fb831a-86ac-4fce-8a17-75412ae6f4ca tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Calling method '>' {{(pid=116157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:13:39.778832 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.compute.api [None req-50fb831a-86ac-4fce-8a17-75412ae6f4ca tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] [instance: b89094ac-aee1-4bd6-a33d-8c4347cebfc7] Fetching instance by UUID {{(pid=116157) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:13:39.784744 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-50fb831a-86ac-4fce-8a17-75412ae6f4ca tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:13:39.785206 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-50fb831a-86ac-4fce-8a17-75412ae6f4ca tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:13:39.786000 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-50fb831a-86ac-4fce-8a17-75412ae6f4ca tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:13:39.786454 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-50fb831a-86ac-4fce-8a17-75412ae6f4ca tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:13:39.814778 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: INFO nova.api.openstack.requestlog [None req-50fb831a-86ac-4fce-8a17-75412ae6f4ca tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] 10.222.0.18 "GET /compute/v2.1/servers/b89094ac-aee1-4bd6-a33d-8c4347cebfc7/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041220 Dec 15 03:13:39.815316 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: [pid: 116157|app: 0|req: 764/1529] 10.222.0.18 () {60 vars in 1342 bytes} [Wed Dec 15 03:13:39 2021] GET /compute/v2.1/servers/b89094ac-aee1-4bd6-a33d-8c4347cebfc7/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 03:13:39.908387 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi [None req-12136437-5349-4f97-97c5-2b5923139a95 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Calling method '>' {{(pid=116156) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:13:39.908996 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.compute.api [None req-12136437-5349-4f97-97c5-2b5923139a95 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] [instance: bbb8462c-9501-4541-b67e-43ec5c5061a7] Fetching instance by UUID {{(pid=116156) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:13:39.915302 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-12136437-5349-4f97-97c5-2b5923139a95 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:13:39.915758 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-12136437-5349-4f97-97c5-2b5923139a95 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:13:39.916535 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-12136437-5349-4f97-97c5-2b5923139a95 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:13:39.917557 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-12136437-5349-4f97-97c5-2b5923139a95 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:13:39.974872 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.policy [None req-12136437-5349-4f97-97c5-2b5923139a95 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97bdf19af9e34fc3886ff451cb9d7a27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '494b56bf5eae4d56a5591546f85bc32b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116156) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:13:39.981914 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: INFO nova.api.openstack.requestlog [None req-12136437-5349-4f97-97c5-2b5923139a95 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] 10.222.0.18 "GET /compute/v2.1/servers/bbb8462c-9501-4541-b67e-43ec5c5061a7" status: 200 len: 1226 microversion: 2.1 time: 0.077111 Dec 15 03:13:39.982510 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: [pid: 116156|app: 0|req: 766/1530] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 03:13:39 2021] GET /compute/v2.1/servers/bbb8462c-9501-4541-b67e-43ec5c5061a7 => generated 1226 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 03:13:40.360575 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi [None req-0a45e135-59bb-4695-83ed-913f66f4d890 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Calling method '>' {{(pid=116157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:13:40.361456 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.compute.api [None req-0a45e135-59bb-4695-83ed-913f66f4d890 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] [instance: fa7c86bc-c46f-4120-8f3d-d795f8d7c5cc] Fetching instance by UUID {{(pid=116157) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:13:40.367754 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-0a45e135-59bb-4695-83ed-913f66f4d890 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:13:40.368213 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-0a45e135-59bb-4695-83ed-913f66f4d890 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:13:40.368997 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-0a45e135-59bb-4695-83ed-913f66f4d890 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:13:40.369436 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-0a45e135-59bb-4695-83ed-913f66f4d890 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:13:40.497541 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.policy [None req-0a45e135-59bb-4695-83ed-913f66f4d890 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c4c0c82448e40ba801c0b52ec44e74a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a093d0bf43046aaa845f3cc115f3f5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116157) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:13:40.504918 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: INFO nova.api.openstack.requestlog [None req-0a45e135-59bb-4695-83ed-913f66f4d890 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] 10.222.0.18 "GET /compute/v2.1/servers/fa7c86bc-c46f-4120-8f3d-d795f8d7c5cc" status: 200 len: 1570 microversion: 2.1 time: 0.148038 Dec 15 03:13:40.505489 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: [pid: 116157|app: 0|req: 765/1531] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 03:13:40 2021] GET /compute/v2.1/servers/fa7c86bc-c46f-4120-8f3d-d795f8d7c5cc => generated 1570 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 03:13:40.826120 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi [None req-a03ec6a8-1dec-45a3-b799-23cc8b351290 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Calling method '>' {{(pid=116156) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:13:40.827025 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.compute.api [None req-a03ec6a8-1dec-45a3-b799-23cc8b351290 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] [instance: b89094ac-aee1-4bd6-a33d-8c4347cebfc7] Fetching instance by UUID {{(pid=116156) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:13:40.832993 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-a03ec6a8-1dec-45a3-b799-23cc8b351290 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:13:40.833444 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-a03ec6a8-1dec-45a3-b799-23cc8b351290 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:13:40.834241 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-a03ec6a8-1dec-45a3-b799-23cc8b351290 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:13:40.834678 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-a03ec6a8-1dec-45a3-b799-23cc8b351290 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:13:40.863017 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: INFO nova.api.openstack.requestlog [None req-a03ec6a8-1dec-45a3-b799-23cc8b351290 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] 10.222.0.18 "GET /compute/v2.1/servers/b89094ac-aee1-4bd6-a33d-8c4347cebfc7/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.040722 Dec 15 03:13:40.863559 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: [pid: 116156|app: 0|req: 767/1532] 10.222.0.18 () {60 vars in 1342 bytes} [Wed Dec 15 03:13:40 2021] GET /compute/v2.1/servers/b89094ac-aee1-4bd6-a33d-8c4347cebfc7/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 03:13:40.999281 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi [None req-52804cf7-df9a-4e92-9233-7984cac83bd7 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Calling method '>' {{(pid=116157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:13:40.999881 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.compute.api [None req-52804cf7-df9a-4e92-9233-7984cac83bd7 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] [instance: bbb8462c-9501-4541-b67e-43ec5c5061a7] Fetching instance by UUID {{(pid=116157) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:13:41.005740 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-52804cf7-df9a-4e92-9233-7984cac83bd7 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:13:41.006221 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-52804cf7-df9a-4e92-9233-7984cac83bd7 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:13:41.006992 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-52804cf7-df9a-4e92-9233-7984cac83bd7 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:13:41.007423 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-52804cf7-df9a-4e92-9233-7984cac83bd7 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:13:41.064159 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.policy [None req-52804cf7-df9a-4e92-9233-7984cac83bd7 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97bdf19af9e34fc3886ff451cb9d7a27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '494b56bf5eae4d56a5591546f85bc32b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116157) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:13:41.071266 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: INFO nova.api.openstack.requestlog [None req-52804cf7-df9a-4e92-9233-7984cac83bd7 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] 10.222.0.18 "GET /compute/v2.1/servers/bbb8462c-9501-4541-b67e-43ec5c5061a7" status: 200 len: 1226 microversion: 2.1 time: 0.076233 Dec 15 03:13:41.071825 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: [pid: 116157|app: 0|req: 766/1533] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 03:13:40 2021] GET /compute/v2.1/servers/bbb8462c-9501-4541-b67e-43ec5c5061a7 => generated 1226 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 03:13:41.522454 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi [None req-90d6003f-4dff-40a4-b7c4-6ab7c031668f tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Calling method '>' {{(pid=116156) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:13:41.523038 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.compute.api [None req-90d6003f-4dff-40a4-b7c4-6ab7c031668f tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] [instance: fa7c86bc-c46f-4120-8f3d-d795f8d7c5cc] Fetching instance by UUID {{(pid=116156) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:13:41.529365 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-90d6003f-4dff-40a4-b7c4-6ab7c031668f tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:13:41.529816 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-90d6003f-4dff-40a4-b7c4-6ab7c031668f tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:13:41.530616 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-90d6003f-4dff-40a4-b7c4-6ab7c031668f tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:13:41.531054 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-90d6003f-4dff-40a4-b7c4-6ab7c031668f tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:13:41.661186 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.policy [None req-90d6003f-4dff-40a4-b7c4-6ab7c031668f tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c4c0c82448e40ba801c0b52ec44e74a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a093d0bf43046aaa845f3cc115f3f5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116156) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:13:41.668414 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: INFO nova.api.openstack.requestlog [None req-90d6003f-4dff-40a4-b7c4-6ab7c031668f tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] 10.222.0.18 "GET /compute/v2.1/servers/fa7c86bc-c46f-4120-8f3d-d795f8d7c5cc" status: 200 len: 1570 microversion: 2.1 time: 0.149631 Dec 15 03:13:41.668971 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: [pid: 116156|app: 0|req: 768/1534] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 03:13:41 2021] GET /compute/v2.1/servers/fa7c86bc-c46f-4120-8f3d-d795f8d7c5cc => generated 1570 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 03:13:41.874983 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi [None req-5a928c6c-08bc-4233-97a1-822db119c4c4 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Calling method '>' {{(pid=116157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:13:41.875885 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.compute.api [None req-5a928c6c-08bc-4233-97a1-822db119c4c4 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] [instance: b89094ac-aee1-4bd6-a33d-8c4347cebfc7] Fetching instance by UUID {{(pid=116157) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:13:41.882127 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-5a928c6c-08bc-4233-97a1-822db119c4c4 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:13:41.882576 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-5a928c6c-08bc-4233-97a1-822db119c4c4 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:13:41.883347 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-5a928c6c-08bc-4233-97a1-822db119c4c4 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:13:41.883840 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-5a928c6c-08bc-4233-97a1-822db119c4c4 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:13:41.912747 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: INFO nova.api.openstack.requestlog [None req-5a928c6c-08bc-4233-97a1-822db119c4c4 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] 10.222.0.18 "GET /compute/v2.1/servers/b89094ac-aee1-4bd6-a33d-8c4347cebfc7/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041611 Dec 15 03:13:41.913290 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: [pid: 116157|app: 0|req: 767/1535] 10.222.0.18 () {60 vars in 1342 bytes} [Wed Dec 15 03:13:41 2021] GET /compute/v2.1/servers/b89094ac-aee1-4bd6-a33d-8c4347cebfc7/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Dec 15 03:13:42.088081 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi [None req-27e00ab7-e9b6-48db-a287-4cd53f4cc307 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Calling method '>' {{(pid=116156) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:13:42.088707 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.compute.api [None req-27e00ab7-e9b6-48db-a287-4cd53f4cc307 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] [instance: bbb8462c-9501-4541-b67e-43ec5c5061a7] Fetching instance by UUID {{(pid=116156) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:13:42.094859 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-27e00ab7-e9b6-48db-a287-4cd53f4cc307 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:13:42.095308 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-27e00ab7-e9b6-48db-a287-4cd53f4cc307 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:13:42.096082 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-27e00ab7-e9b6-48db-a287-4cd53f4cc307 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:13:42.096520 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-27e00ab7-e9b6-48db-a287-4cd53f4cc307 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:13:42.154085 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.policy [None req-27e00ab7-e9b6-48db-a287-4cd53f4cc307 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97bdf19af9e34fc3886ff451cb9d7a27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '494b56bf5eae4d56a5591546f85bc32b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116156) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:13:42.166412 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: INFO nova.api.openstack.requestlog [None req-27e00ab7-e9b6-48db-a287-4cd53f4cc307 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] 10.222.0.18 "GET /compute/v2.1/servers/bbb8462c-9501-4541-b67e-43ec5c5061a7" status: 200 len: 1226 microversion: 2.1 time: 0.081852 Dec 15 03:13:42.166975 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: [pid: 116156|app: 0|req: 769/1536] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 03:13:42 2021] GET /compute/v2.1/servers/bbb8462c-9501-4541-b67e-43ec5c5061a7 => generated 1226 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 03:13:42.684343 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi [None req-f4d99573-a2e8-450b-ab01-1cbdfd5b768a tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Calling method '>' {{(pid=116157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:13:42.684977 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.compute.api [None req-f4d99573-a2e8-450b-ab01-1cbdfd5b768a tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] [instance: fa7c86bc-c46f-4120-8f3d-d795f8d7c5cc] Fetching instance by UUID {{(pid=116157) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:13:42.690820 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-f4d99573-a2e8-450b-ab01-1cbdfd5b768a tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:13:42.691267 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-f4d99573-a2e8-450b-ab01-1cbdfd5b768a tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:13:42.692093 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-f4d99573-a2e8-450b-ab01-1cbdfd5b768a tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:13:42.692524 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-f4d99573-a2e8-450b-ab01-1cbdfd5b768a tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:13:42.821647 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.policy [None req-f4d99573-a2e8-450b-ab01-1cbdfd5b768a tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c4c0c82448e40ba801c0b52ec44e74a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a093d0bf43046aaa845f3cc115f3f5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116157) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:13:42.828833 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: INFO nova.api.openstack.requestlog [None req-f4d99573-a2e8-450b-ab01-1cbdfd5b768a tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] 10.222.0.18 "GET /compute/v2.1/servers/fa7c86bc-c46f-4120-8f3d-d795f8d7c5cc" status: 200 len: 1570 microversion: 2.1 time: 0.148282 Dec 15 03:13:42.829392 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: [pid: 116157|app: 0|req: 768/1537] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 03:13:42 2021] GET /compute/v2.1/servers/fa7c86bc-c46f-4120-8f3d-d795f8d7c5cc => generated 1570 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 03:13:42.923907 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi [None req-216737b2-f5dd-4452-a9d0-f65a85744d7f tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Calling method '>' {{(pid=116156) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:13:42.924808 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.compute.api [None req-216737b2-f5dd-4452-a9d0-f65a85744d7f tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] [instance: b89094ac-aee1-4bd6-a33d-8c4347cebfc7] Fetching instance by UUID {{(pid=116156) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:13:42.930606 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-216737b2-f5dd-4452-a9d0-f65a85744d7f tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:13:42.931054 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-216737b2-f5dd-4452-a9d0-f65a85744d7f tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:13:42.931832 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-216737b2-f5dd-4452-a9d0-f65a85744d7f tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:13:42.932267 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-216737b2-f5dd-4452-a9d0-f65a85744d7f tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:13:42.960295 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: INFO nova.api.openstack.requestlog [None req-216737b2-f5dd-4452-a9d0-f65a85744d7f tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] 10.222.0.18 "GET /compute/v2.1/servers/b89094ac-aee1-4bd6-a33d-8c4347cebfc7/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.040060 Dec 15 03:13:42.960763 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: [pid: 116156|app: 0|req: 770/1538] 10.222.0.18 () {60 vars in 1342 bytes} [Wed Dec 15 03:13:42 2021] GET /compute/v2.1/servers/b89094ac-aee1-4bd6-a33d-8c4347cebfc7/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 03:13:43.182212 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi [None req-aea15964-5c6e-4bf1-8ee6-e90318d174a4 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Calling method '>' {{(pid=116157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:13:43.182818 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.compute.api [None req-aea15964-5c6e-4bf1-8ee6-e90318d174a4 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] [instance: bbb8462c-9501-4541-b67e-43ec5c5061a7] Fetching instance by UUID {{(pid=116157) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:13:43.189532 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-aea15964-5c6e-4bf1-8ee6-e90318d174a4 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:13:43.189997 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-aea15964-5c6e-4bf1-8ee6-e90318d174a4 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:13:43.190812 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-aea15964-5c6e-4bf1-8ee6-e90318d174a4 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:13:43.191253 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-aea15964-5c6e-4bf1-8ee6-e90318d174a4 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:13:43.250640 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.policy [None req-aea15964-5c6e-4bf1-8ee6-e90318d174a4 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97bdf19af9e34fc3886ff451cb9d7a27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '494b56bf5eae4d56a5591546f85bc32b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116157) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:13:43.257713 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: INFO nova.api.openstack.requestlog [None req-aea15964-5c6e-4bf1-8ee6-e90318d174a4 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] 10.222.0.18 "GET /compute/v2.1/servers/bbb8462c-9501-4541-b67e-43ec5c5061a7" status: 200 len: 1226 microversion: 2.1 time: 0.079123 Dec 15 03:13:43.258330 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: [pid: 116157|app: 0|req: 769/1539] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 03:13:43 2021] GET /compute/v2.1/servers/bbb8462c-9501-4541-b67e-43ec5c5061a7 => generated 1226 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 03:13:43.845583 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi [None req-affff62a-14db-4d3d-9842-23bd307073da tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Calling method '>' {{(pid=116156) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:13:43.846215 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.compute.api [None req-affff62a-14db-4d3d-9842-23bd307073da tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] [instance: fa7c86bc-c46f-4120-8f3d-d795f8d7c5cc] Fetching instance by UUID {{(pid=116156) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:13:43.852396 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-affff62a-14db-4d3d-9842-23bd307073da tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:13:43.852843 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-affff62a-14db-4d3d-9842-23bd307073da tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:13:43.853613 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-affff62a-14db-4d3d-9842-23bd307073da tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:13:43.854583 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-affff62a-14db-4d3d-9842-23bd307073da tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:13:43.972197 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi [None req-566f8e23-c983-4e9d-81d3-d08a25ccf233 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Calling method '>' {{(pid=116157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:13:43.973093 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.compute.api [None req-566f8e23-c983-4e9d-81d3-d08a25ccf233 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] [instance: b89094ac-aee1-4bd6-a33d-8c4347cebfc7] Fetching instance by UUID {{(pid=116157) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:13:43.978818 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-566f8e23-c983-4e9d-81d3-d08a25ccf233 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:13:43.979766 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-566f8e23-c983-4e9d-81d3-d08a25ccf233 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:13:43.980539 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-566f8e23-c983-4e9d-81d3-d08a25ccf233 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:13:43.980971 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-566f8e23-c983-4e9d-81d3-d08a25ccf233 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:13:43.984986 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.policy [None req-affff62a-14db-4d3d-9842-23bd307073da tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c4c0c82448e40ba801c0b52ec44e74a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a093d0bf43046aaa845f3cc115f3f5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116156) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:13:43.992467 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: INFO nova.api.openstack.requestlog [None req-affff62a-14db-4d3d-9842-23bd307073da tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] 10.222.0.18 "GET /compute/v2.1/servers/fa7c86bc-c46f-4120-8f3d-d795f8d7c5cc" status: 200 len: 1570 microversion: 2.1 time: 0.150537 Dec 15 03:13:43.993025 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: [pid: 116156|app: 0|req: 771/1540] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 03:13:43 2021] GET /compute/v2.1/servers/fa7c86bc-c46f-4120-8f3d-d795f8d7c5cc => generated 1570 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 03:13:44.010166 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: INFO nova.api.openstack.requestlog [None req-566f8e23-c983-4e9d-81d3-d08a25ccf233 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] 10.222.0.18 "GET /compute/v2.1/servers/b89094ac-aee1-4bd6-a33d-8c4347cebfc7/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041690 Dec 15 03:13:44.010707 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: [pid: 116157|app: 0|req: 770/1541] 10.222.0.18 () {60 vars in 1342 bytes} [Wed Dec 15 03:13:43 2021] GET /compute/v2.1/servers/b89094ac-aee1-4bd6-a33d-8c4347cebfc7/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Dec 15 03:13:44.274734 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi [None req-3e9230f9-d987-4021-a13c-fce8a021684f tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Calling method '>' {{(pid=116156) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:13:44.275339 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.compute.api [None req-3e9230f9-d987-4021-a13c-fce8a021684f tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] [instance: bbb8462c-9501-4541-b67e-43ec5c5061a7] Fetching instance by UUID {{(pid=116156) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:13:44.281903 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-3e9230f9-d987-4021-a13c-fce8a021684f tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:13:44.282381 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-3e9230f9-d987-4021-a13c-fce8a021684f tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:13:44.283152 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-3e9230f9-d987-4021-a13c-fce8a021684f tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:13:44.283583 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-3e9230f9-d987-4021-a13c-fce8a021684f tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:13:44.341119 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.policy [None req-3e9230f9-d987-4021-a13c-fce8a021684f tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97bdf19af9e34fc3886ff451cb9d7a27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '494b56bf5eae4d56a5591546f85bc32b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116156) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:13:44.348217 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: INFO nova.api.openstack.requestlog [None req-3e9230f9-d987-4021-a13c-fce8a021684f tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] 10.222.0.18 "GET /compute/v2.1/servers/bbb8462c-9501-4541-b67e-43ec5c5061a7" status: 200 len: 1226 microversion: 2.1 time: 0.077124 Dec 15 03:13:44.348765 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: [pid: 116156|app: 0|req: 772/1542] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 03:13:44 2021] GET /compute/v2.1/servers/bbb8462c-9501-4541-b67e-43ec5c5061a7 => generated 1226 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 03:13:45.010753 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi [None req-4f133be4-86fe-456e-af3f-63a4d4a4d0f6 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Calling method '>' {{(pid=116157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:13:45.011358 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.compute.api [None req-4f133be4-86fe-456e-af3f-63a4d4a4d0f6 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] [instance: fa7c86bc-c46f-4120-8f3d-d795f8d7c5cc] Fetching instance by UUID {{(pid=116157) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:13:45.017529 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-4f133be4-86fe-456e-af3f-63a4d4a4d0f6 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:13:45.017993 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-4f133be4-86fe-456e-af3f-63a4d4a4d0f6 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:13:45.018777 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-4f133be4-86fe-456e-af3f-63a4d4a4d0f6 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:13:45.019208 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-4f133be4-86fe-456e-af3f-63a4d4a4d0f6 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:13:45.021148 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi [None req-f1ebf0ad-b66d-4978-b072-8ac489d52df8 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Calling method '>' {{(pid=116156) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:13:45.022074 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.compute.api [None req-f1ebf0ad-b66d-4978-b072-8ac489d52df8 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] [instance: b89094ac-aee1-4bd6-a33d-8c4347cebfc7] Fetching instance by UUID {{(pid=116156) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:13:45.027963 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-f1ebf0ad-b66d-4978-b072-8ac489d52df8 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:13:45.028413 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-f1ebf0ad-b66d-4978-b072-8ac489d52df8 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:13:45.029190 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-f1ebf0ad-b66d-4978-b072-8ac489d52df8 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:13:45.029625 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-f1ebf0ad-b66d-4978-b072-8ac489d52df8 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:13:45.058544 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: INFO nova.api.openstack.requestlog [None req-f1ebf0ad-b66d-4978-b072-8ac489d52df8 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] 10.222.0.18 "GET /compute/v2.1/servers/b89094ac-aee1-4bd6-a33d-8c4347cebfc7/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.040885 Dec 15 03:13:45.059107 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: [pid: 116156|app: 0|req: 773/1543] 10.222.0.18 () {60 vars in 1342 bytes} [Wed Dec 15 03:13:45 2021] GET /compute/v2.1/servers/b89094ac-aee1-4bd6-a33d-8c4347cebfc7/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Dec 15 03:13:45.147592 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.policy [None req-4f133be4-86fe-456e-af3f-63a4d4a4d0f6 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c4c0c82448e40ba801c0b52ec44e74a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a093d0bf43046aaa845f3cc115f3f5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116157) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:13:45.155268 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: INFO nova.api.openstack.requestlog [None req-4f133be4-86fe-456e-af3f-63a4d4a4d0f6 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] 10.222.0.18 "GET /compute/v2.1/servers/fa7c86bc-c46f-4120-8f3d-d795f8d7c5cc" status: 200 len: 1570 microversion: 2.1 time: 0.148730 Dec 15 03:13:45.155822 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: [pid: 116157|app: 0|req: 771/1544] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 03:13:45 2021] GET /compute/v2.1/servers/fa7c86bc-c46f-4120-8f3d-d795f8d7c5cc => generated 1570 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 03:13:45.365589 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi [None req-c7e376ec-0ed7-4ff2-b384-086892156c81 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Calling method '>' {{(pid=116156) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:13:45.366222 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.compute.api [None req-c7e376ec-0ed7-4ff2-b384-086892156c81 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] [instance: bbb8462c-9501-4541-b67e-43ec5c5061a7] Fetching instance by UUID {{(pid=116156) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:13:45.372579 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-c7e376ec-0ed7-4ff2-b384-086892156c81 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:13:45.373026 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-c7e376ec-0ed7-4ff2-b384-086892156c81 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:13:45.373789 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-c7e376ec-0ed7-4ff2-b384-086892156c81 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:13:45.374246 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-c7e376ec-0ed7-4ff2-b384-086892156c81 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:13:45.430800 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.policy [None req-c7e376ec-0ed7-4ff2-b384-086892156c81 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97bdf19af9e34fc3886ff451cb9d7a27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '494b56bf5eae4d56a5591546f85bc32b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116156) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:13:45.438603 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: INFO nova.api.openstack.requestlog [None req-c7e376ec-0ed7-4ff2-b384-086892156c81 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] 10.222.0.18 "GET /compute/v2.1/servers/bbb8462c-9501-4541-b67e-43ec5c5061a7" status: 200 len: 1226 microversion: 2.1 time: 0.076753 Dec 15 03:13:45.439154 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: [pid: 116156|app: 0|req: 774/1545] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 03:13:45 2021] GET /compute/v2.1/servers/bbb8462c-9501-4541-b67e-43ec5c5061a7 => generated 1226 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 03:13:46.070018 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi [None req-d752f898-0f8f-4c3e-b59b-24fbd78cb9e8 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Calling method '>' {{(pid=116157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:13:46.070922 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.compute.api [None req-d752f898-0f8f-4c3e-b59b-24fbd78cb9e8 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] [instance: b89094ac-aee1-4bd6-a33d-8c4347cebfc7] Fetching instance by UUID {{(pid=116157) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:13:46.077785 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-d752f898-0f8f-4c3e-b59b-24fbd78cb9e8 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:13:46.078339 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-d752f898-0f8f-4c3e-b59b-24fbd78cb9e8 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:13:46.079122 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-d752f898-0f8f-4c3e-b59b-24fbd78cb9e8 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:13:46.079560 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-d752f898-0f8f-4c3e-b59b-24fbd78cb9e8 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:13:46.108030 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: INFO nova.api.openstack.requestlog [None req-d752f898-0f8f-4c3e-b59b-24fbd78cb9e8 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] 10.222.0.18 "GET /compute/v2.1/servers/b89094ac-aee1-4bd6-a33d-8c4347cebfc7/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041836 Dec 15 03:13:46.108565 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: [pid: 116157|app: 0|req: 772/1546] 10.222.0.18 () {60 vars in 1342 bytes} [Wed Dec 15 03:13:46 2021] GET /compute/v2.1/servers/b89094ac-aee1-4bd6-a33d-8c4347cebfc7/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 03:13:46.171918 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi [None req-f931f110-27aa-48f8-8a72-f2754004a972 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Calling method '>' {{(pid=116156) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:13:46.172521 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.compute.api [None req-f931f110-27aa-48f8-8a72-f2754004a972 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] [instance: fa7c86bc-c46f-4120-8f3d-d795f8d7c5cc] Fetching instance by UUID {{(pid=116156) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:13:46.178757 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-f931f110-27aa-48f8-8a72-f2754004a972 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:13:46.179198 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-f931f110-27aa-48f8-8a72-f2754004a972 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:13:46.179963 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-f931f110-27aa-48f8-8a72-f2754004a972 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:13:46.180391 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-f931f110-27aa-48f8-8a72-f2754004a972 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:13:46.311400 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.policy [None req-f931f110-27aa-48f8-8a72-f2754004a972 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c4c0c82448e40ba801c0b52ec44e74a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a093d0bf43046aaa845f3cc115f3f5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116156) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:13:46.318611 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: INFO nova.api.openstack.requestlog [None req-f931f110-27aa-48f8-8a72-f2754004a972 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] 10.222.0.18 "GET /compute/v2.1/servers/fa7c86bc-c46f-4120-8f3d-d795f8d7c5cc" status: 200 len: 1570 microversion: 2.1 time: 0.150311 Dec 15 03:13:46.319176 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: [pid: 116156|app: 0|req: 775/1547] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 03:13:46 2021] GET /compute/v2.1/servers/fa7c86bc-c46f-4120-8f3d-d795f8d7c5cc => generated 1570 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 03:13:46.454865 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi [None req-95dd25b1-f515-4d0d-9c2b-73d957c9eb5a tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Calling method '>' {{(pid=116157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:13:46.455426 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.compute.api [None req-95dd25b1-f515-4d0d-9c2b-73d957c9eb5a tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] [instance: bbb8462c-9501-4541-b67e-43ec5c5061a7] Fetching instance by UUID {{(pid=116157) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:13:46.461203 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-95dd25b1-f515-4d0d-9c2b-73d957c9eb5a tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:13:46.461664 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-95dd25b1-f515-4d0d-9c2b-73d957c9eb5a tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:13:46.462480 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-95dd25b1-f515-4d0d-9c2b-73d957c9eb5a tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:13:46.462922 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-95dd25b1-f515-4d0d-9c2b-73d957c9eb5a tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:13:46.520256 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.policy [None req-95dd25b1-f515-4d0d-9c2b-73d957c9eb5a tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97bdf19af9e34fc3886ff451cb9d7a27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '494b56bf5eae4d56a5591546f85bc32b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116157) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:13:46.527424 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: INFO nova.api.openstack.requestlog [None req-95dd25b1-f515-4d0d-9c2b-73d957c9eb5a tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] 10.222.0.18 "GET /compute/v2.1/servers/bbb8462c-9501-4541-b67e-43ec5c5061a7" status: 200 len: 1226 microversion: 2.1 time: 0.076387 Dec 15 03:13:46.527983 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: [pid: 116157|app: 0|req: 773/1548] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 03:13:46 2021] GET /compute/v2.1/servers/bbb8462c-9501-4541-b67e-43ec5c5061a7 => generated 1226 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 03:13:47.119704 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi [None req-051ad56c-5f21-409f-827c-0cdb92fb2f90 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Calling method '>' {{(pid=116156) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:13:47.120589 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.compute.api [None req-051ad56c-5f21-409f-827c-0cdb92fb2f90 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] [instance: b89094ac-aee1-4bd6-a33d-8c4347cebfc7] Fetching instance by UUID {{(pid=116156) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:13:47.126432 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-051ad56c-5f21-409f-827c-0cdb92fb2f90 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:13:47.126885 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-051ad56c-5f21-409f-827c-0cdb92fb2f90 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:13:47.127660 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-051ad56c-5f21-409f-827c-0cdb92fb2f90 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:13:47.128097 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-051ad56c-5f21-409f-827c-0cdb92fb2f90 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:13:47.156876 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: INFO nova.api.openstack.requestlog [None req-051ad56c-5f21-409f-827c-0cdb92fb2f90 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] 10.222.0.18 "GET /compute/v2.1/servers/b89094ac-aee1-4bd6-a33d-8c4347cebfc7/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041029 Dec 15 03:13:47.157416 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: [pid: 116156|app: 0|req: 776/1549] 10.222.0.18 () {60 vars in 1342 bytes} [Wed Dec 15 03:13:47 2021] GET /compute/v2.1/servers/b89094ac-aee1-4bd6-a33d-8c4347cebfc7/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 03:13:47.336345 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi [None req-c7b08dcb-7965-40a9-98c5-b2af792a57e9 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Calling method '>' {{(pid=116157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:13:47.336956 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.compute.api [None req-c7b08dcb-7965-40a9-98c5-b2af792a57e9 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] [instance: fa7c86bc-c46f-4120-8f3d-d795f8d7c5cc] Fetching instance by UUID {{(pid=116157) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:13:47.343714 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-c7b08dcb-7965-40a9-98c5-b2af792a57e9 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:13:47.344164 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-c7b08dcb-7965-40a9-98c5-b2af792a57e9 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:13:47.344941 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-c7b08dcb-7965-40a9-98c5-b2af792a57e9 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:13:47.345378 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-c7b08dcb-7965-40a9-98c5-b2af792a57e9 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:13:47.476823 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.policy [None req-c7b08dcb-7965-40a9-98c5-b2af792a57e9 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c4c0c82448e40ba801c0b52ec44e74a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a093d0bf43046aaa845f3cc115f3f5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116157) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:13:47.484024 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: INFO nova.api.openstack.requestlog [None req-c7b08dcb-7965-40a9-98c5-b2af792a57e9 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] 10.222.0.18 "GET /compute/v2.1/servers/fa7c86bc-c46f-4120-8f3d-d795f8d7c5cc" status: 200 len: 1570 microversion: 2.1 time: 0.151365 Dec 15 03:13:47.484588 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: [pid: 116157|app: 0|req: 774/1550] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 03:13:47 2021] GET /compute/v2.1/servers/fa7c86bc-c46f-4120-8f3d-d795f8d7c5cc => generated 1570 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 03:13:47.543781 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi [None req-d0c4e907-4392-4e42-ae69-57f1bd75a8e5 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Calling method '>' {{(pid=116156) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:13:47.544392 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.compute.api [None req-d0c4e907-4392-4e42-ae69-57f1bd75a8e5 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] [instance: bbb8462c-9501-4541-b67e-43ec5c5061a7] Fetching instance by UUID {{(pid=116156) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:13:47.550574 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-d0c4e907-4392-4e42-ae69-57f1bd75a8e5 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:13:47.551027 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-d0c4e907-4392-4e42-ae69-57f1bd75a8e5 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:13:47.551801 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-d0c4e907-4392-4e42-ae69-57f1bd75a8e5 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:13:47.552239 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-d0c4e907-4392-4e42-ae69-57f1bd75a8e5 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:13:47.609215 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.policy [None req-d0c4e907-4392-4e42-ae69-57f1bd75a8e5 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97bdf19af9e34fc3886ff451cb9d7a27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '494b56bf5eae4d56a5591546f85bc32b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116156) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:13:47.616638 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: INFO nova.api.openstack.requestlog [None req-d0c4e907-4392-4e42-ae69-57f1bd75a8e5 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] 10.222.0.18 "GET /compute/v2.1/servers/bbb8462c-9501-4541-b67e-43ec5c5061a7" status: 200 len: 1226 microversion: 2.1 time: 0.076416 Dec 15 03:13:47.617189 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: [pid: 116156|app: 0|req: 777/1551] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 03:13:47 2021] GET /compute/v2.1/servers/bbb8462c-9501-4541-b67e-43ec5c5061a7 => generated 1226 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 03:13:48.167864 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi [None req-16bdd661-17d8-4bfd-93d9-d2b962957f19 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Calling method '>' {{(pid=116157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:13:48.168765 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.compute.api [None req-16bdd661-17d8-4bfd-93d9-d2b962957f19 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] [instance: b89094ac-aee1-4bd6-a33d-8c4347cebfc7] Fetching instance by UUID {{(pid=116157) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:13:48.174467 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-16bdd661-17d8-4bfd-93d9-d2b962957f19 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:13:48.174912 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-16bdd661-17d8-4bfd-93d9-d2b962957f19 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:13:48.175681 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-16bdd661-17d8-4bfd-93d9-d2b962957f19 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:13:48.176111 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-16bdd661-17d8-4bfd-93d9-d2b962957f19 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:13:48.206921 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: INFO nova.api.openstack.requestlog [None req-16bdd661-17d8-4bfd-93d9-d2b962957f19 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] 10.222.0.18 "GET /compute/v2.1/servers/b89094ac-aee1-4bd6-a33d-8c4347cebfc7/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042827 Dec 15 03:13:48.207499 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: [pid: 116157|app: 0|req: 775/1552] 10.222.0.18 () {60 vars in 1342 bytes} [Wed Dec 15 03:13:48 2021] GET /compute/v2.1/servers/b89094ac-aee1-4bd6-a33d-8c4347cebfc7/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 03:13:48.501366 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi [None req-82d3a035-92cb-4d6a-b196-f09274edf4bc tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Calling method '>' {{(pid=116156) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:13:48.501898 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.compute.api [None req-82d3a035-92cb-4d6a-b196-f09274edf4bc tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] [instance: fa7c86bc-c46f-4120-8f3d-d795f8d7c5cc] Fetching instance by UUID {{(pid=116156) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:13:48.511560 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-82d3a035-92cb-4d6a-b196-f09274edf4bc tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:13:48.512013 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-82d3a035-92cb-4d6a-b196-f09274edf4bc tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:13:48.512793 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-82d3a035-92cb-4d6a-b196-f09274edf4bc tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:13:48.513239 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-82d3a035-92cb-4d6a-b196-f09274edf4bc tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:13:48.632439 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi [None req-6ad10d2a-2d77-4488-8226-ee7c1aa26471 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Calling method '>' {{(pid=116157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:13:48.633047 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.compute.api [None req-6ad10d2a-2d77-4488-8226-ee7c1aa26471 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] [instance: bbb8462c-9501-4541-b67e-43ec5c5061a7] Fetching instance by UUID {{(pid=116157) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:13:48.639444 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-6ad10d2a-2d77-4488-8226-ee7c1aa26471 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:13:48.639894 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-6ad10d2a-2d77-4488-8226-ee7c1aa26471 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:13:48.640420 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.policy [None req-82d3a035-92cb-4d6a-b196-f09274edf4bc tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c4c0c82448e40ba801c0b52ec44e74a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a093d0bf43046aaa845f3cc115f3f5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116156) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:13:48.640834 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-6ad10d2a-2d77-4488-8226-ee7c1aa26471 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:13:48.641100 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-6ad10d2a-2d77-4488-8226-ee7c1aa26471 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:13:48.647731 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: INFO nova.api.openstack.requestlog [None req-82d3a035-92cb-4d6a-b196-f09274edf4bc tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] 10.222.0.18 "GET /compute/v2.1/servers/fa7c86bc-c46f-4120-8f3d-d795f8d7c5cc" status: 200 len: 1570 microversion: 2.1 time: 0.150153 Dec 15 03:13:48.648294 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: [pid: 116156|app: 0|req: 778/1553] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 03:13:48 2021] GET /compute/v2.1/servers/fa7c86bc-c46f-4120-8f3d-d795f8d7c5cc => generated 1570 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 03:13:48.698696 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.policy [None req-6ad10d2a-2d77-4488-8226-ee7c1aa26471 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97bdf19af9e34fc3886ff451cb9d7a27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '494b56bf5eae4d56a5591546f85bc32b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116157) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:13:48.705762 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: INFO nova.api.openstack.requestlog [None req-6ad10d2a-2d77-4488-8226-ee7c1aa26471 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] 10.222.0.18 "GET /compute/v2.1/servers/bbb8462c-9501-4541-b67e-43ec5c5061a7" status: 200 len: 1226 microversion: 2.1 time: 0.077001 Dec 15 03:13:48.706363 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: [pid: 116157|app: 0|req: 776/1554] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 03:13:48 2021] GET /compute/v2.1/servers/bbb8462c-9501-4541-b67e-43ec5c5061a7 => generated 1226 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 03:13:49.219097 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi [None req-a3745114-285e-458a-8472-b774544064b3 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Calling method '>' {{(pid=116156) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:13:49.219998 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.compute.api [None req-a3745114-285e-458a-8472-b774544064b3 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] [instance: b89094ac-aee1-4bd6-a33d-8c4347cebfc7] Fetching instance by UUID {{(pid=116156) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:13:49.225712 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-a3745114-285e-458a-8472-b774544064b3 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:13:49.226208 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-a3745114-285e-458a-8472-b774544064b3 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:13:49.226985 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-a3745114-285e-458a-8472-b774544064b3 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:13:49.227451 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-a3745114-285e-458a-8472-b774544064b3 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:13:49.255723 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: INFO nova.api.openstack.requestlog [None req-a3745114-285e-458a-8472-b774544064b3 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] 10.222.0.18 "GET /compute/v2.1/servers/b89094ac-aee1-4bd6-a33d-8c4347cebfc7/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.040396 Dec 15 03:13:49.256274 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: [pid: 116156|app: 0|req: 779/1555] 10.222.0.18 () {60 vars in 1342 bytes} [Wed Dec 15 03:13:49 2021] GET /compute/v2.1/servers/b89094ac-aee1-4bd6-a33d-8c4347cebfc7/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 03:13:49.664337 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi [None req-11b93aa5-bde2-4edb-b581-4f2cb7e841e7 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Calling method '>' {{(pid=116157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:13:49.664948 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.compute.api [None req-11b93aa5-bde2-4edb-b581-4f2cb7e841e7 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] [instance: fa7c86bc-c46f-4120-8f3d-d795f8d7c5cc] Fetching instance by UUID {{(pid=116157) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:13:49.671256 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-11b93aa5-bde2-4edb-b581-4f2cb7e841e7 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:13:49.671710 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-11b93aa5-bde2-4edb-b581-4f2cb7e841e7 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:13:49.672493 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-11b93aa5-bde2-4edb-b581-4f2cb7e841e7 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:13:49.672934 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-11b93aa5-bde2-4edb-b581-4f2cb7e841e7 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:13:49.722968 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi [None req-b55c6a54-8676-444a-a1fe-9b3f4328ace2 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Calling method '>' {{(pid=116156) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:13:49.723676 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.compute.api [None req-b55c6a54-8676-444a-a1fe-9b3f4328ace2 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] [instance: bbb8462c-9501-4541-b67e-43ec5c5061a7] Fetching instance by UUID {{(pid=116156) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:13:49.730817 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-b55c6a54-8676-444a-a1fe-9b3f4328ace2 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:13:49.731268 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-b55c6a54-8676-444a-a1fe-9b3f4328ace2 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:13:49.732057 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-b55c6a54-8676-444a-a1fe-9b3f4328ace2 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:13:49.732508 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-b55c6a54-8676-444a-a1fe-9b3f4328ace2 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:13:49.796425 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.policy [None req-b55c6a54-8676-444a-a1fe-9b3f4328ace2 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97bdf19af9e34fc3886ff451cb9d7a27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '494b56bf5eae4d56a5591546f85bc32b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116156) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:13:49.802791 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.policy [None req-11b93aa5-bde2-4edb-b581-4f2cb7e841e7 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c4c0c82448e40ba801c0b52ec44e74a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a093d0bf43046aaa845f3cc115f3f5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116157) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:13:49.803751 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: INFO nova.api.openstack.requestlog [None req-b55c6a54-8676-444a-a1fe-9b3f4328ace2 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] 10.222.0.18 "GET /compute/v2.1/servers/bbb8462c-9501-4541-b67e-43ec5c5061a7" status: 200 len: 1226 microversion: 2.1 time: 0.084359 Dec 15 03:13:49.804478 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: [pid: 116156|app: 0|req: 780/1556] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 03:13:49 2021] GET /compute/v2.1/servers/bbb8462c-9501-4541-b67e-43ec5c5061a7 => generated 1226 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 03:13:49.810768 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: INFO nova.api.openstack.requestlog [None req-11b93aa5-bde2-4edb-b581-4f2cb7e841e7 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] 10.222.0.18 "GET /compute/v2.1/servers/fa7c86bc-c46f-4120-8f3d-d795f8d7c5cc" status: 200 len: 1570 microversion: 2.1 time: 0.150112 Dec 15 03:13:49.811313 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: [pid: 116157|app: 0|req: 777/1557] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 03:13:49 2021] GET /compute/v2.1/servers/fa7c86bc-c46f-4120-8f3d-d795f8d7c5cc => generated 1570 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 03:13:50.267343 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi [None req-4219d4ed-c5b1-47cc-9f9e-01ffca581406 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Calling method '>' {{(pid=116156) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:13:50.268239 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.compute.api [None req-4219d4ed-c5b1-47cc-9f9e-01ffca581406 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] [instance: b89094ac-aee1-4bd6-a33d-8c4347cebfc7] Fetching instance by UUID {{(pid=116156) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:13:50.274084 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-4219d4ed-c5b1-47cc-9f9e-01ffca581406 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:13:50.274525 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-4219d4ed-c5b1-47cc-9f9e-01ffca581406 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:13:50.275289 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-4219d4ed-c5b1-47cc-9f9e-01ffca581406 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:13:50.275753 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-4219d4ed-c5b1-47cc-9f9e-01ffca581406 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:13:50.303339 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: INFO nova.api.openstack.requestlog [None req-4219d4ed-c5b1-47cc-9f9e-01ffca581406 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] 10.222.0.18 "GET /compute/v2.1/servers/b89094ac-aee1-4bd6-a33d-8c4347cebfc7/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.039759 Dec 15 03:13:50.303882 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: [pid: 116156|app: 0|req: 781/1558] 10.222.0.18 () {60 vars in 1342 bytes} [Wed Dec 15 03:13:50 2021] GET /compute/v2.1/servers/b89094ac-aee1-4bd6-a33d-8c4347cebfc7/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 03:13:50.820867 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi [None req-626db42e-781f-4e71-8c9f-91d633488ff0 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Calling method '>' {{(pid=116157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:13:50.821482 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.compute.api [None req-626db42e-781f-4e71-8c9f-91d633488ff0 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] [instance: bbb8462c-9501-4541-b67e-43ec5c5061a7] Fetching instance by UUID {{(pid=116157) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:13:50.827206 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi [None req-101a5733-b8c5-4d81-a56c-e6ed11ba8a73 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Calling method '>' {{(pid=116156) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:13:50.827809 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.compute.api [None req-101a5733-b8c5-4d81-a56c-e6ed11ba8a73 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] [instance: fa7c86bc-c46f-4120-8f3d-d795f8d7c5cc] Fetching instance by UUID {{(pid=116156) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:13:50.827925 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-626db42e-781f-4e71-8c9f-91d633488ff0 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:13:50.828306 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-626db42e-781f-4e71-8c9f-91d633488ff0 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:13:50.829095 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-626db42e-781f-4e71-8c9f-91d633488ff0 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:13:50.829534 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-626db42e-781f-4e71-8c9f-91d633488ff0 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:13:50.833767 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-101a5733-b8c5-4d81-a56c-e6ed11ba8a73 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:13:50.834251 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-101a5733-b8c5-4d81-a56c-e6ed11ba8a73 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:13:50.835024 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-101a5733-b8c5-4d81-a56c-e6ed11ba8a73 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:13:50.835481 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-101a5733-b8c5-4d81-a56c-e6ed11ba8a73 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:13:50.892040 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.policy [None req-626db42e-781f-4e71-8c9f-91d633488ff0 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97bdf19af9e34fc3886ff451cb9d7a27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '494b56bf5eae4d56a5591546f85bc32b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116157) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:13:50.899356 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: INFO nova.api.openstack.requestlog [None req-626db42e-781f-4e71-8c9f-91d633488ff0 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] 10.222.0.18 "GET /compute/v2.1/servers/bbb8462c-9501-4541-b67e-43ec5c5061a7" status: 200 len: 1226 microversion: 2.1 time: 0.082199 Dec 15 03:13:50.899946 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: [pid: 116157|app: 0|req: 778/1559] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 03:13:50 2021] GET /compute/v2.1/servers/bbb8462c-9501-4541-b67e-43ec5c5061a7 => generated 1226 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 03:13:50.965358 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.policy [None req-101a5733-b8c5-4d81-a56c-e6ed11ba8a73 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c4c0c82448e40ba801c0b52ec44e74a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a093d0bf43046aaa845f3cc115f3f5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116156) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:13:50.972520 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: INFO nova.api.openstack.requestlog [None req-101a5733-b8c5-4d81-a56c-e6ed11ba8a73 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] 10.222.0.18 "GET /compute/v2.1/servers/fa7c86bc-c46f-4120-8f3d-d795f8d7c5cc" status: 200 len: 1570 microversion: 2.1 time: 0.148856 Dec 15 03:13:50.973069 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: [pid: 116156|app: 0|req: 782/1560] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 03:13:50 2021] GET /compute/v2.1/servers/fa7c86bc-c46f-4120-8f3d-d795f8d7c5cc => generated 1570 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 03:13:51.315047 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi [None req-5044e373-0c43-4825-a635-c6488b767102 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Calling method '>' {{(pid=116157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:13:51.315954 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.compute.api [None req-5044e373-0c43-4825-a635-c6488b767102 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] [instance: b89094ac-aee1-4bd6-a33d-8c4347cebfc7] Fetching instance by UUID {{(pid=116157) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:13:51.321856 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-5044e373-0c43-4825-a635-c6488b767102 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:13:51.322340 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-5044e373-0c43-4825-a635-c6488b767102 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:13:51.323659 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-5044e373-0c43-4825-a635-c6488b767102 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:13:51.324101 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-5044e373-0c43-4825-a635-c6488b767102 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:13:51.352691 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: INFO nova.api.openstack.requestlog [None req-5044e373-0c43-4825-a635-c6488b767102 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] 10.222.0.18 "GET /compute/v2.1/servers/b89094ac-aee1-4bd6-a33d-8c4347cebfc7/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041416 Dec 15 03:13:51.353235 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: [pid: 116157|app: 0|req: 779/1561] 10.222.0.18 () {60 vars in 1342 bytes} [Wed Dec 15 03:13:51 2021] GET /compute/v2.1/servers/b89094ac-aee1-4bd6-a33d-8c4347cebfc7/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 03:13:51.916340 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi [None req-3ca74afc-7411-4ef5-b1fb-eb3fab0cfe19 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Calling method '>' {{(pid=116156) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:13:51.916941 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.compute.api [None req-3ca74afc-7411-4ef5-b1fb-eb3fab0cfe19 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] [instance: bbb8462c-9501-4541-b67e-43ec5c5061a7] Fetching instance by UUID {{(pid=116156) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:13:51.923149 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-3ca74afc-7411-4ef5-b1fb-eb3fab0cfe19 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:13:51.923599 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-3ca74afc-7411-4ef5-b1fb-eb3fab0cfe19 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:13:51.924367 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-3ca74afc-7411-4ef5-b1fb-eb3fab0cfe19 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:13:51.924802 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-3ca74afc-7411-4ef5-b1fb-eb3fab0cfe19 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:13:51.982331 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.policy [None req-3ca74afc-7411-4ef5-b1fb-eb3fab0cfe19 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97bdf19af9e34fc3886ff451cb9d7a27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '494b56bf5eae4d56a5591546f85bc32b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116156) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:13:51.989806 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: INFO nova.api.openstack.requestlog [None req-3ca74afc-7411-4ef5-b1fb-eb3fab0cfe19 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] 10.222.0.18 "GET /compute/v2.1/servers/bbb8462c-9501-4541-b67e-43ec5c5061a7" status: 200 len: 1226 microversion: 2.1 time: 0.077116 Dec 15 03:13:51.990154 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi [None req-9332c6b0-ddf3-4ead-bc83-cfd4c2754256 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Calling method '>' {{(pid=116157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:13:51.990588 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: [pid: 116156|app: 0|req: 783/1562] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 03:13:51 2021] GET /compute/v2.1/servers/bbb8462c-9501-4541-b67e-43ec5c5061a7 => generated 1226 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 03:13:51.990759 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.compute.api [None req-9332c6b0-ddf3-4ead-bc83-cfd4c2754256 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] [instance: fa7c86bc-c46f-4120-8f3d-d795f8d7c5cc] Fetching instance by UUID {{(pid=116157) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:13:51.997523 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-9332c6b0-ddf3-4ead-bc83-cfd4c2754256 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:13:51.997963 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-9332c6b0-ddf3-4ead-bc83-cfd4c2754256 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:13:51.998758 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-9332c6b0-ddf3-4ead-bc83-cfd4c2754256 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:13:51.999188 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-9332c6b0-ddf3-4ead-bc83-cfd4c2754256 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:13:52.127099 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.policy [None req-9332c6b0-ddf3-4ead-bc83-cfd4c2754256 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c4c0c82448e40ba801c0b52ec44e74a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a093d0bf43046aaa845f3cc115f3f5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116157) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:13:52.134259 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: INFO nova.api.openstack.requestlog [None req-9332c6b0-ddf3-4ead-bc83-cfd4c2754256 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] 10.222.0.18 "GET /compute/v2.1/servers/fa7c86bc-c46f-4120-8f3d-d795f8d7c5cc" status: 200 len: 1570 microversion: 2.1 time: 0.147608 Dec 15 03:13:52.134818 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: [pid: 116157|app: 0|req: 780/1563] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 03:13:51 2021] GET /compute/v2.1/servers/fa7c86bc-c46f-4120-8f3d-d795f8d7c5cc => generated 1570 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 03:13:52.364750 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi [None req-2b267bf5-cddf-40e4-9a33-a47c84fef58d tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Calling method '>' {{(pid=116156) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:13:52.365644 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.compute.api [None req-2b267bf5-cddf-40e4-9a33-a47c84fef58d tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] [instance: b89094ac-aee1-4bd6-a33d-8c4347cebfc7] Fetching instance by UUID {{(pid=116156) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:13:52.371449 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-2b267bf5-cddf-40e4-9a33-a47c84fef58d tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:13:52.371900 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-2b267bf5-cddf-40e4-9a33-a47c84fef58d tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:13:52.372667 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-2b267bf5-cddf-40e4-9a33-a47c84fef58d tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:13:52.373100 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-2b267bf5-cddf-40e4-9a33-a47c84fef58d tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:13:52.400439 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: INFO nova.api.openstack.requestlog [None req-2b267bf5-cddf-40e4-9a33-a47c84fef58d tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] 10.222.0.18 "GET /compute/v2.1/servers/b89094ac-aee1-4bd6-a33d-8c4347cebfc7/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.039697 Dec 15 03:13:52.401466 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: [pid: 116156|app: 0|req: 784/1564] 10.222.0.18 () {60 vars in 1342 bytes} [Wed Dec 15 03:13:52 2021] GET /compute/v2.1/servers/b89094ac-aee1-4bd6-a33d-8c4347cebfc7/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 03:13:53.007269 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi [None req-440756d3-23fa-4636-ad7e-58014179f3bd tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Calling method '>' {{(pid=116157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:13:53.007847 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.compute.api [None req-440756d3-23fa-4636-ad7e-58014179f3bd tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] [instance: bbb8462c-9501-4541-b67e-43ec5c5061a7] Fetching instance by UUID {{(pid=116157) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:13:53.014603 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-440756d3-23fa-4636-ad7e-58014179f3bd tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:13:53.015055 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-440756d3-23fa-4636-ad7e-58014179f3bd tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:13:53.015831 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-440756d3-23fa-4636-ad7e-58014179f3bd tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:13:53.016268 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-440756d3-23fa-4636-ad7e-58014179f3bd tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:13:53.073276 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.policy [None req-440756d3-23fa-4636-ad7e-58014179f3bd tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97bdf19af9e34fc3886ff451cb9d7a27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '494b56bf5eae4d56a5591546f85bc32b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116157) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:13:53.080299 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: INFO nova.api.openstack.requestlog [None req-440756d3-23fa-4636-ad7e-58014179f3bd tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] 10.222.0.18 "GET /compute/v2.1/servers/bbb8462c-9501-4541-b67e-43ec5c5061a7" status: 200 len: 1226 microversion: 2.1 time: 0.076738 Dec 15 03:13:53.080853 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: [pid: 116157|app: 0|req: 781/1565] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 03:13:53 2021] GET /compute/v2.1/servers/bbb8462c-9501-4541-b67e-43ec5c5061a7 => generated 1226 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 03:13:53.150099 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi [None req-c4be02cf-5198-4c3b-9c80-aa3dc9427e01 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Calling method '>' {{(pid=116156) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:13:53.150705 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.compute.api [None req-c4be02cf-5198-4c3b-9c80-aa3dc9427e01 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] [instance: fa7c86bc-c46f-4120-8f3d-d795f8d7c5cc] Fetching instance by UUID {{(pid=116156) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:13:53.156845 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-c4be02cf-5198-4c3b-9c80-aa3dc9427e01 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:13:53.157292 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-c4be02cf-5198-4c3b-9c80-aa3dc9427e01 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:13:53.158081 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-c4be02cf-5198-4c3b-9c80-aa3dc9427e01 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:13:53.158517 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-c4be02cf-5198-4c3b-9c80-aa3dc9427e01 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:13:53.289382 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.policy [None req-c4be02cf-5198-4c3b-9c80-aa3dc9427e01 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c4c0c82448e40ba801c0b52ec44e74a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a093d0bf43046aaa845f3cc115f3f5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116156) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:13:53.296506 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: INFO nova.api.openstack.requestlog [None req-c4be02cf-5198-4c3b-9c80-aa3dc9427e01 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] 10.222.0.18 "GET /compute/v2.1/servers/fa7c86bc-c46f-4120-8f3d-d795f8d7c5cc" status: 200 len: 1570 microversion: 2.1 time: 0.149958 Dec 15 03:13:53.297055 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: [pid: 116156|app: 0|req: 785/1566] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 03:13:53 2021] GET /compute/v2.1/servers/fa7c86bc-c46f-4120-8f3d-d795f8d7c5cc => generated 1570 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 03:13:53.412228 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi [None req-592a7a1c-e3fa-4000-8210-3898bd8cdfd4 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Calling method '>' {{(pid=116157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:13:53.413128 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.compute.api [None req-592a7a1c-e3fa-4000-8210-3898bd8cdfd4 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] [instance: b89094ac-aee1-4bd6-a33d-8c4347cebfc7] Fetching instance by UUID {{(pid=116157) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:13:53.418950 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-592a7a1c-e3fa-4000-8210-3898bd8cdfd4 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:13:53.419402 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-592a7a1c-e3fa-4000-8210-3898bd8cdfd4 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:13:53.420180 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-592a7a1c-e3fa-4000-8210-3898bd8cdfd4 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:13:53.420616 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-592a7a1c-e3fa-4000-8210-3898bd8cdfd4 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:13:53.450312 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: INFO nova.api.openstack.requestlog [None req-592a7a1c-e3fa-4000-8210-3898bd8cdfd4 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] 10.222.0.18 "GET /compute/v2.1/servers/b89094ac-aee1-4bd6-a33d-8c4347cebfc7/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041416 Dec 15 03:13:53.451434 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: [pid: 116157|app: 0|req: 782/1567] 10.222.0.18 () {60 vars in 1342 bytes} [Wed Dec 15 03:13:53 2021] GET /compute/v2.1/servers/b89094ac-aee1-4bd6-a33d-8c4347cebfc7/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 03:13:54.097596 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi [None req-044b4a2f-13f1-494a-ad22-3c8229ee3cd1 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Calling method '>' {{(pid=116156) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:13:54.098221 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.compute.api [None req-044b4a2f-13f1-494a-ad22-3c8229ee3cd1 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] [instance: bbb8462c-9501-4541-b67e-43ec5c5061a7] Fetching instance by UUID {{(pid=116156) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:13:54.104602 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-044b4a2f-13f1-494a-ad22-3c8229ee3cd1 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:13:54.105061 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-044b4a2f-13f1-494a-ad22-3c8229ee3cd1 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:13:54.105833 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-044b4a2f-13f1-494a-ad22-3c8229ee3cd1 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:13:54.106294 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-044b4a2f-13f1-494a-ad22-3c8229ee3cd1 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:13:54.162962 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.policy [None req-044b4a2f-13f1-494a-ad22-3c8229ee3cd1 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97bdf19af9e34fc3886ff451cb9d7a27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '494b56bf5eae4d56a5591546f85bc32b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116156) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:13:54.170737 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: INFO nova.api.openstack.requestlog [None req-044b4a2f-13f1-494a-ad22-3c8229ee3cd1 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] 10.222.0.18 "GET /compute/v2.1/servers/bbb8462c-9501-4541-b67e-43ec5c5061a7" status: 200 len: 1226 microversion: 2.1 time: 0.076789 Dec 15 03:13:54.171283 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: [pid: 116156|app: 0|req: 786/1568] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 03:13:54 2021] GET /compute/v2.1/servers/bbb8462c-9501-4541-b67e-43ec5c5061a7 => generated 1226 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 03:13:54.313348 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi [None req-a0af4077-5379-42e7-b0bb-e020c66fb62c tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Calling method '>' {{(pid=116157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:13:54.313954 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.compute.api [None req-a0af4077-5379-42e7-b0bb-e020c66fb62c tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] [instance: fa7c86bc-c46f-4120-8f3d-d795f8d7c5cc] Fetching instance by UUID {{(pid=116157) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:13:54.320280 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-a0af4077-5379-42e7-b0bb-e020c66fb62c tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:13:54.320726 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-a0af4077-5379-42e7-b0bb-e020c66fb62c tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:13:54.321499 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-a0af4077-5379-42e7-b0bb-e020c66fb62c tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:13:54.321927 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-a0af4077-5379-42e7-b0bb-e020c66fb62c tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:13:54.453475 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.policy [None req-a0af4077-5379-42e7-b0bb-e020c66fb62c tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c4c0c82448e40ba801c0b52ec44e74a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a093d0bf43046aaa845f3cc115f3f5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116157) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:13:54.460915 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: INFO nova.api.openstack.requestlog [None req-a0af4077-5379-42e7-b0bb-e020c66fb62c tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] 10.222.0.18 "GET /compute/v2.1/servers/fa7c86bc-c46f-4120-8f3d-d795f8d7c5cc" status: 200 len: 1570 microversion: 2.1 time: 0.151418 Dec 15 03:13:54.461478 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: [pid: 116157|app: 0|req: 783/1569] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 03:13:54 2021] GET /compute/v2.1/servers/fa7c86bc-c46f-4120-8f3d-d795f8d7c5cc => generated 1570 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 03:13:54.461964 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi [None req-616ca221-b436-4f5e-b74d-859c045f0e01 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Calling method '>' {{(pid=116156) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:13:54.462918 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.compute.api [None req-616ca221-b436-4f5e-b74d-859c045f0e01 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] [instance: b89094ac-aee1-4bd6-a33d-8c4347cebfc7] Fetching instance by UUID {{(pid=116156) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:13:54.469803 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-616ca221-b436-4f5e-b74d-859c045f0e01 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:13:54.471341 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-616ca221-b436-4f5e-b74d-859c045f0e01 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:13:54.472136 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-616ca221-b436-4f5e-b74d-859c045f0e01 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:13:54.472573 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-616ca221-b436-4f5e-b74d-859c045f0e01 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:13:54.500708 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: INFO nova.api.openstack.requestlog [None req-616ca221-b436-4f5e-b74d-859c045f0e01 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] 10.222.0.18 "GET /compute/v2.1/servers/b89094ac-aee1-4bd6-a33d-8c4347cebfc7/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042525 Dec 15 03:13:54.501261 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: [pid: 116156|app: 0|req: 787/1570] 10.222.0.18 () {60 vars in 1342 bytes} [Wed Dec 15 03:13:54 2021] GET /compute/v2.1/servers/b89094ac-aee1-4bd6-a33d-8c4347cebfc7/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Dec 15 03:13:55.187938 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi [None req-e8f1077f-7688-485c-830a-7936c5d5f648 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Calling method '>' {{(pid=116157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:13:55.188565 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.compute.api [None req-e8f1077f-7688-485c-830a-7936c5d5f648 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] [instance: bbb8462c-9501-4541-b67e-43ec5c5061a7] Fetching instance by UUID {{(pid=116157) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:13:55.194359 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-e8f1077f-7688-485c-830a-7936c5d5f648 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:13:55.194816 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-e8f1077f-7688-485c-830a-7936c5d5f648 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:13:55.195604 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-e8f1077f-7688-485c-830a-7936c5d5f648 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:13:55.196047 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-e8f1077f-7688-485c-830a-7936c5d5f648 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:13:55.255878 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.policy [None req-e8f1077f-7688-485c-830a-7936c5d5f648 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97bdf19af9e34fc3886ff451cb9d7a27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '494b56bf5eae4d56a5591546f85bc32b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116157) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:13:55.263239 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: INFO nova.api.openstack.requestlog [None req-e8f1077f-7688-485c-830a-7936c5d5f648 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] 10.222.0.18 "GET /compute/v2.1/servers/bbb8462c-9501-4541-b67e-43ec5c5061a7" status: 200 len: 1226 microversion: 2.1 time: 0.078995 Dec 15 03:13:55.263803 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: [pid: 116157|app: 0|req: 784/1571] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 03:13:55 2021] GET /compute/v2.1/servers/bbb8462c-9501-4541-b67e-43ec5c5061a7 => generated 1226 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 03:13:55.479544 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi [None req-b438d2d2-207e-428e-b315-b0a541c5f762 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Calling method '>' {{(pid=116156) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:13:55.480151 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.compute.api [None req-b438d2d2-207e-428e-b315-b0a541c5f762 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] [instance: fa7c86bc-c46f-4120-8f3d-d795f8d7c5cc] Fetching instance by UUID {{(pid=116156) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:13:55.486653 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-b438d2d2-207e-428e-b315-b0a541c5f762 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:13:55.487108 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-b438d2d2-207e-428e-b315-b0a541c5f762 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:13:55.487880 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-b438d2d2-207e-428e-b315-b0a541c5f762 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:13:55.488319 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-b438d2d2-207e-428e-b315-b0a541c5f762 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:13:55.511194 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi [None req-0c111aef-4959-487c-8976-fc4089155f48 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Calling method '>' {{(pid=116157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:13:55.512020 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.compute.api [None req-0c111aef-4959-487c-8976-fc4089155f48 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] [instance: b89094ac-aee1-4bd6-a33d-8c4347cebfc7] Fetching instance by UUID {{(pid=116157) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:13:55.518238 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-0c111aef-4959-487c-8976-fc4089155f48 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:13:55.518687 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-0c111aef-4959-487c-8976-fc4089155f48 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:13:55.519493 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-0c111aef-4959-487c-8976-fc4089155f48 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:13:55.519934 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-0c111aef-4959-487c-8976-fc4089155f48 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:13:55.549473 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: INFO nova.api.openstack.requestlog [None req-0c111aef-4959-487c-8976-fc4089155f48 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] 10.222.0.18 "GET /compute/v2.1/servers/b89094ac-aee1-4bd6-a33d-8c4347cebfc7/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042107 Dec 15 03:13:55.550058 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: [pid: 116157|app: 0|req: 785/1572] 10.222.0.18 () {60 vars in 1342 bytes} [Wed Dec 15 03:13:55 2021] GET /compute/v2.1/servers/b89094ac-aee1-4bd6-a33d-8c4347cebfc7/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Dec 15 03:13:55.616309 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.policy [None req-b438d2d2-207e-428e-b315-b0a541c5f762 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c4c0c82448e40ba801c0b52ec44e74a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a093d0bf43046aaa845f3cc115f3f5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116156) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:13:55.623453 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: INFO nova.api.openstack.requestlog [None req-b438d2d2-207e-428e-b315-b0a541c5f762 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] 10.222.0.18 "GET /compute/v2.1/servers/fa7c86bc-c46f-4120-8f3d-d795f8d7c5cc" status: 200 len: 1570 microversion: 2.1 time: 0.148112 Dec 15 03:13:55.624011 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: [pid: 116156|app: 0|req: 788/1573] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 03:13:55 2021] GET /compute/v2.1/servers/fa7c86bc-c46f-4120-8f3d-d795f8d7c5cc => generated 1570 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 03:13:56.280341 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi [None req-df4e6a3d-6cf2-4ecb-8999-5f77ea38aedc tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Calling method '>' {{(pid=116157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:13:56.280945 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.compute.api [None req-df4e6a3d-6cf2-4ecb-8999-5f77ea38aedc tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] [instance: bbb8462c-9501-4541-b67e-43ec5c5061a7] Fetching instance by UUID {{(pid=116157) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:13:56.286858 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-df4e6a3d-6cf2-4ecb-8999-5f77ea38aedc tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:13:56.287317 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-df4e6a3d-6cf2-4ecb-8999-5f77ea38aedc tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:13:56.288093 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-df4e6a3d-6cf2-4ecb-8999-5f77ea38aedc tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:13:56.288530 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-df4e6a3d-6cf2-4ecb-8999-5f77ea38aedc tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:13:56.346413 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.policy [None req-df4e6a3d-6cf2-4ecb-8999-5f77ea38aedc tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97bdf19af9e34fc3886ff451cb9d7a27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '494b56bf5eae4d56a5591546f85bc32b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116157) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:13:56.353546 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: INFO nova.api.openstack.requestlog [None req-df4e6a3d-6cf2-4ecb-8999-5f77ea38aedc tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] 10.222.0.18 "GET /compute/v2.1/servers/bbb8462c-9501-4541-b67e-43ec5c5061a7" status: 200 len: 1226 microversion: 2.1 time: 0.076851 Dec 15 03:13:56.354809 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: [pid: 116157|app: 0|req: 786/1574] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 03:13:56 2021] GET /compute/v2.1/servers/bbb8462c-9501-4541-b67e-43ec5c5061a7 => generated 1226 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 03:13:56.561117 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi [None req-4cfab042-d96b-42a4-8bbf-6bf9b0cb43ff tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Calling method '>' {{(pid=116156) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:13:56.562039 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.compute.api [None req-4cfab042-d96b-42a4-8bbf-6bf9b0cb43ff tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] [instance: b89094ac-aee1-4bd6-a33d-8c4347cebfc7] Fetching instance by UUID {{(pid=116156) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:13:56.568177 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-4cfab042-d96b-42a4-8bbf-6bf9b0cb43ff tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:13:56.568625 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-4cfab042-d96b-42a4-8bbf-6bf9b0cb43ff tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:13:56.569395 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-4cfab042-d96b-42a4-8bbf-6bf9b0cb43ff tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:13:56.569827 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-4cfab042-d96b-42a4-8bbf-6bf9b0cb43ff tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:13:56.598379 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: INFO nova.api.openstack.requestlog [None req-4cfab042-d96b-42a4-8bbf-6bf9b0cb43ff tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] 10.222.0.18 "GET /compute/v2.1/servers/b89094ac-aee1-4bd6-a33d-8c4347cebfc7/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041172 Dec 15 03:13:56.598906 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: [pid: 116156|app: 0|req: 789/1575] 10.222.0.18 () {60 vars in 1342 bytes} [Wed Dec 15 03:13:56 2021] GET /compute/v2.1/servers/b89094ac-aee1-4bd6-a33d-8c4347cebfc7/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 03:13:56.640689 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi [None req-aa75d52a-81fe-457f-9752-49369df3452a tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Calling method '>' {{(pid=116157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:13:56.641298 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.compute.api [None req-aa75d52a-81fe-457f-9752-49369df3452a tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] [instance: fa7c86bc-c46f-4120-8f3d-d795f8d7c5cc] Fetching instance by UUID {{(pid=116157) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:13:56.647608 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-aa75d52a-81fe-457f-9752-49369df3452a tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:13:56.648054 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-aa75d52a-81fe-457f-9752-49369df3452a tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:13:56.648829 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-aa75d52a-81fe-457f-9752-49369df3452a tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:13:56.649259 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-aa75d52a-81fe-457f-9752-49369df3452a tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:13:56.777690 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.policy [None req-aa75d52a-81fe-457f-9752-49369df3452a tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c4c0c82448e40ba801c0b52ec44e74a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a093d0bf43046aaa845f3cc115f3f5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116157) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:13:56.784994 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: INFO nova.api.openstack.requestlog [None req-aa75d52a-81fe-457f-9752-49369df3452a tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] 10.222.0.18 "GET /compute/v2.1/servers/fa7c86bc-c46f-4120-8f3d-d795f8d7c5cc" status: 200 len: 1570 microversion: 2.1 time: 0.148006 Dec 15 03:13:56.785550 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: [pid: 116157|app: 0|req: 787/1576] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 03:13:56 2021] GET /compute/v2.1/servers/fa7c86bc-c46f-4120-8f3d-d795f8d7c5cc => generated 1570 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 03:13:57.370236 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi [None req-cb640727-3126-4678-be4c-61a9c9bf7a26 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Calling method '>' {{(pid=116156) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:13:57.370872 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.compute.api [None req-cb640727-3126-4678-be4c-61a9c9bf7a26 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] [instance: bbb8462c-9501-4541-b67e-43ec5c5061a7] Fetching instance by UUID {{(pid=116156) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:13:57.376642 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-cb640727-3126-4678-be4c-61a9c9bf7a26 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:13:57.377089 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-cb640727-3126-4678-be4c-61a9c9bf7a26 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:13:57.377855 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-cb640727-3126-4678-be4c-61a9c9bf7a26 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:13:57.378310 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-cb640727-3126-4678-be4c-61a9c9bf7a26 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:13:57.435610 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.policy [None req-cb640727-3126-4678-be4c-61a9c9bf7a26 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97bdf19af9e34fc3886ff451cb9d7a27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '494b56bf5eae4d56a5591546f85bc32b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116156) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:13:57.442703 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: INFO nova.api.openstack.requestlog [None req-cb640727-3126-4678-be4c-61a9c9bf7a26 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] 10.222.0.18 "GET /compute/v2.1/servers/bbb8462c-9501-4541-b67e-43ec5c5061a7" status: 200 len: 1226 microversion: 2.1 time: 0.076082 Dec 15 03:13:57.443250 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: [pid: 116156|app: 0|req: 790/1577] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 03:13:57 2021] GET /compute/v2.1/servers/bbb8462c-9501-4541-b67e-43ec5c5061a7 => generated 1226 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 03:13:57.609673 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi [None req-8e833a09-e109-4b12-b25b-890f8df59553 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Calling method '>' {{(pid=116157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:13:57.610876 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.compute.api [None req-8e833a09-e109-4b12-b25b-890f8df59553 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] [instance: b89094ac-aee1-4bd6-a33d-8c4347cebfc7] Fetching instance by UUID {{(pid=116157) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:13:57.616745 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-8e833a09-e109-4b12-b25b-890f8df59553 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:13:57.617193 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-8e833a09-e109-4b12-b25b-890f8df59553 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:13:57.617970 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-8e833a09-e109-4b12-b25b-890f8df59553 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:13:57.618420 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-8e833a09-e109-4b12-b25b-890f8df59553 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:13:57.647632 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: INFO nova.api.openstack.requestlog [None req-8e833a09-e109-4b12-b25b-890f8df59553 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] 10.222.0.18 "GET /compute/v2.1/servers/b89094ac-aee1-4bd6-a33d-8c4347cebfc7/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041666 Dec 15 03:13:57.648256 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: [pid: 116157|app: 0|req: 788/1578] 10.222.0.18 () {60 vars in 1342 bytes} [Wed Dec 15 03:13:57 2021] GET /compute/v2.1/servers/b89094ac-aee1-4bd6-a33d-8c4347cebfc7/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 03:13:57.802033 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi [None req-5c313b7a-727c-4b65-bb9b-0842413e7f78 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Calling method '>' {{(pid=116156) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:13:57.802647 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.compute.api [None req-5c313b7a-727c-4b65-bb9b-0842413e7f78 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] [instance: fa7c86bc-c46f-4120-8f3d-d795f8d7c5cc] Fetching instance by UUID {{(pid=116156) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:13:57.809268 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-5c313b7a-727c-4b65-bb9b-0842413e7f78 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:13:57.809709 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-5c313b7a-727c-4b65-bb9b-0842413e7f78 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:13:57.810505 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-5c313b7a-727c-4b65-bb9b-0842413e7f78 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:13:57.810937 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-5c313b7a-727c-4b65-bb9b-0842413e7f78 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:13:57.943361 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.policy [None req-5c313b7a-727c-4b65-bb9b-0842413e7f78 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c4c0c82448e40ba801c0b52ec44e74a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a093d0bf43046aaa845f3cc115f3f5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116156) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:13:57.951156 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: INFO nova.api.openstack.requestlog [None req-5c313b7a-727c-4b65-bb9b-0842413e7f78 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] 10.222.0.18 "GET /compute/v2.1/servers/fa7c86bc-c46f-4120-8f3d-d795f8d7c5cc" status: 200 len: 1570 microversion: 2.1 time: 0.152642 Dec 15 03:13:57.951713 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: [pid: 116156|app: 0|req: 791/1579] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 03:13:57 2021] GET /compute/v2.1/servers/fa7c86bc-c46f-4120-8f3d-d795f8d7c5cc => generated 1570 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 03:13:58.460367 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi [None req-46f40cf3-82c7-4ec3-9bd6-e27e28219516 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Calling method '>' {{(pid=116157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:13:58.460930 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.compute.api [None req-46f40cf3-82c7-4ec3-9bd6-e27e28219516 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] [instance: bbb8462c-9501-4541-b67e-43ec5c5061a7] Fetching instance by UUID {{(pid=116157) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:13:58.466880 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-46f40cf3-82c7-4ec3-9bd6-e27e28219516 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:13:58.467327 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-46f40cf3-82c7-4ec3-9bd6-e27e28219516 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:13:58.468101 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-46f40cf3-82c7-4ec3-9bd6-e27e28219516 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:13:58.468538 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-46f40cf3-82c7-4ec3-9bd6-e27e28219516 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:13:58.526159 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.policy [None req-46f40cf3-82c7-4ec3-9bd6-e27e28219516 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97bdf19af9e34fc3886ff451cb9d7a27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '494b56bf5eae4d56a5591546f85bc32b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116157) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:13:58.533461 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: INFO nova.api.openstack.requestlog [None req-46f40cf3-82c7-4ec3-9bd6-e27e28219516 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] 10.222.0.18 "GET /compute/v2.1/servers/bbb8462c-9501-4541-b67e-43ec5c5061a7" status: 200 len: 1226 microversion: 2.1 time: 0.076751 Dec 15 03:13:58.534083 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: [pid: 116157|app: 0|req: 789/1580] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 03:13:58 2021] GET /compute/v2.1/servers/bbb8462c-9501-4541-b67e-43ec5c5061a7 => generated 1226 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 03:13:58.658288 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi [None req-8ca8494d-9af8-46ad-a966-93d7943996e3 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Calling method '>' {{(pid=116156) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:13:58.659181 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.compute.api [None req-8ca8494d-9af8-46ad-a966-93d7943996e3 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] [instance: b89094ac-aee1-4bd6-a33d-8c4347cebfc7] Fetching instance by UUID {{(pid=116156) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:13:58.664937 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-8ca8494d-9af8-46ad-a966-93d7943996e3 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:13:58.665415 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-8ca8494d-9af8-46ad-a966-93d7943996e3 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:13:58.666210 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-8ca8494d-9af8-46ad-a966-93d7943996e3 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:13:58.666642 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-8ca8494d-9af8-46ad-a966-93d7943996e3 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:13:58.694429 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: INFO nova.api.openstack.requestlog [None req-8ca8494d-9af8-46ad-a966-93d7943996e3 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] 10.222.0.18 "GET /compute/v2.1/servers/b89094ac-aee1-4bd6-a33d-8c4347cebfc7/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.039846 Dec 15 03:13:58.694962 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: [pid: 116156|app: 0|req: 792/1581] 10.222.0.18 () {60 vars in 1342 bytes} [Wed Dec 15 03:13:58 2021] GET /compute/v2.1/servers/b89094ac-aee1-4bd6-a33d-8c4347cebfc7/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Dec 15 03:13:58.967166 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi [None req-b9daf530-6f62-4626-87c6-9fd4b4cf4c4d tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Calling method '>' {{(pid=116157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:13:58.967766 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.compute.api [None req-b9daf530-6f62-4626-87c6-9fd4b4cf4c4d tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] [instance: fa7c86bc-c46f-4120-8f3d-d795f8d7c5cc] Fetching instance by UUID {{(pid=116157) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:13:58.973950 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-b9daf530-6f62-4626-87c6-9fd4b4cf4c4d tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:13:58.974426 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-b9daf530-6f62-4626-87c6-9fd4b4cf4c4d tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:13:58.975196 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-b9daf530-6f62-4626-87c6-9fd4b4cf4c4d tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:13:58.975630 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-b9daf530-6f62-4626-87c6-9fd4b4cf4c4d tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:13:59.107551 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.policy [None req-b9daf530-6f62-4626-87c6-9fd4b4cf4c4d tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c4c0c82448e40ba801c0b52ec44e74a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a093d0bf43046aaa845f3cc115f3f5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116157) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:13:59.114998 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: INFO nova.api.openstack.requestlog [None req-b9daf530-6f62-4626-87c6-9fd4b4cf4c4d tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] 10.222.0.18 "GET /compute/v2.1/servers/fa7c86bc-c46f-4120-8f3d-d795f8d7c5cc" status: 200 len: 1570 microversion: 2.1 time: 0.151451 Dec 15 03:13:59.115559 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: [pid: 116157|app: 0|req: 790/1582] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 03:13:58 2021] GET /compute/v2.1/servers/fa7c86bc-c46f-4120-8f3d-d795f8d7c5cc => generated 1570 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 03:13:59.550279 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi [None req-10a32243-e367-4998-a7e1-b8e9b9bd3f78 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Calling method '>' {{(pid=116156) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:13:59.550891 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.compute.api [None req-10a32243-e367-4998-a7e1-b8e9b9bd3f78 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] [instance: bbb8462c-9501-4541-b67e-43ec5c5061a7] Fetching instance by UUID {{(pid=116156) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:13:59.557103 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-10a32243-e367-4998-a7e1-b8e9b9bd3f78 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:13:59.557559 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-10a32243-e367-4998-a7e1-b8e9b9bd3f78 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:13:59.558361 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-10a32243-e367-4998-a7e1-b8e9b9bd3f78 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:13:59.558800 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-10a32243-e367-4998-a7e1-b8e9b9bd3f78 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:13:59.616404 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.policy [None req-10a32243-e367-4998-a7e1-b8e9b9bd3f78 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97bdf19af9e34fc3886ff451cb9d7a27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '494b56bf5eae4d56a5591546f85bc32b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116156) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:13:59.623636 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: INFO nova.api.openstack.requestlog [None req-10a32243-e367-4998-a7e1-b8e9b9bd3f78 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] 10.222.0.18 "GET /compute/v2.1/servers/bbb8462c-9501-4541-b67e-43ec5c5061a7" status: 200 len: 1226 microversion: 2.1 time: 0.077036 Dec 15 03:13:59.624190 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: [pid: 116156|app: 0|req: 793/1583] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 03:13:59 2021] GET /compute/v2.1/servers/bbb8462c-9501-4541-b67e-43ec5c5061a7 => generated 1226 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 03:13:59.706476 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi [None req-93e4a06e-cfaa-44b0-a179-21f7f663a41d tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Calling method '>' {{(pid=116157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:13:59.707419 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.compute.api [None req-93e4a06e-cfaa-44b0-a179-21f7f663a41d tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] [instance: b89094ac-aee1-4bd6-a33d-8c4347cebfc7] Fetching instance by UUID {{(pid=116157) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:13:59.713889 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-93e4a06e-cfaa-44b0-a179-21f7f663a41d tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:13:59.714372 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-93e4a06e-cfaa-44b0-a179-21f7f663a41d tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:13:59.715159 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-93e4a06e-cfaa-44b0-a179-21f7f663a41d tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:13:59.715601 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-93e4a06e-cfaa-44b0-a179-21f7f663a41d tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:13:59.744833 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: INFO nova.api.openstack.requestlog [None req-93e4a06e-cfaa-44b0-a179-21f7f663a41d tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] 10.222.0.18 "GET /compute/v2.1/servers/b89094ac-aee1-4bd6-a33d-8c4347cebfc7/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042243 Dec 15 03:13:59.745374 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: [pid: 116157|app: 0|req: 791/1584] 10.222.0.18 () {60 vars in 1342 bytes} [Wed Dec 15 03:13:59 2021] GET /compute/v2.1/servers/b89094ac-aee1-4bd6-a33d-8c4347cebfc7/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 03:14:00.131134 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi [None req-e4ed3f06-2a8f-4e17-82db-b1b8270a2cbc tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Calling method '>' {{(pid=116156) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:14:00.131671 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.compute.api [None req-e4ed3f06-2a8f-4e17-82db-b1b8270a2cbc tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] [instance: fa7c86bc-c46f-4120-8f3d-d795f8d7c5cc] Fetching instance by UUID {{(pid=116156) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:14:00.138061 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-e4ed3f06-2a8f-4e17-82db-b1b8270a2cbc tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:14:00.138510 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-e4ed3f06-2a8f-4e17-82db-b1b8270a2cbc tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:14:00.139280 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-e4ed3f06-2a8f-4e17-82db-b1b8270a2cbc tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:14:00.139713 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-e4ed3f06-2a8f-4e17-82db-b1b8270a2cbc tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:14:00.267498 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.policy [None req-e4ed3f06-2a8f-4e17-82db-b1b8270a2cbc tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c4c0c82448e40ba801c0b52ec44e74a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a093d0bf43046aaa845f3cc115f3f5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116156) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:14:00.274650 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: INFO nova.api.openstack.requestlog [None req-e4ed3f06-2a8f-4e17-82db-b1b8270a2cbc tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] 10.222.0.18 "GET /compute/v2.1/servers/fa7c86bc-c46f-4120-8f3d-d795f8d7c5cc" status: 200 len: 1570 microversion: 2.1 time: 0.147233 Dec 15 03:14:00.275206 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: [pid: 116156|app: 0|req: 794/1585] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 03:14:00 2021] GET /compute/v2.1/servers/fa7c86bc-c46f-4120-8f3d-d795f8d7c5cc => generated 1570 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 03:14:00.640456 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi [None req-16fc9e80-1146-4369-883a-c330abc910e4 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Calling method '>' {{(pid=116157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:14:00.641057 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.compute.api [None req-16fc9e80-1146-4369-883a-c330abc910e4 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] [instance: bbb8462c-9501-4541-b67e-43ec5c5061a7] Fetching instance by UUID {{(pid=116157) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:14:00.646859 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-16fc9e80-1146-4369-883a-c330abc910e4 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:14:00.647308 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-16fc9e80-1146-4369-883a-c330abc910e4 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:14:00.648081 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-16fc9e80-1146-4369-883a-c330abc910e4 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:14:00.648513 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-16fc9e80-1146-4369-883a-c330abc910e4 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:14:00.706334 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.policy [None req-16fc9e80-1146-4369-883a-c330abc910e4 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97bdf19af9e34fc3886ff451cb9d7a27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '494b56bf5eae4d56a5591546f85bc32b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116157) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:14:00.713953 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: INFO nova.api.openstack.requestlog [None req-16fc9e80-1146-4369-883a-c330abc910e4 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] 10.222.0.18 "GET /compute/v2.1/servers/bbb8462c-9501-4541-b67e-43ec5c5061a7" status: 200 len: 1226 microversion: 2.1 time: 0.077251 Dec 15 03:14:00.714532 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: [pid: 116157|app: 0|req: 792/1586] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 03:14:00 2021] GET /compute/v2.1/servers/bbb8462c-9501-4541-b67e-43ec5c5061a7 => generated 1226 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 03:14:00.756318 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi [None req-a804bf7f-5cf6-4bc5-8aa1-1f4b0496ef57 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Calling method '>' {{(pid=116156) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:14:00.757252 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.compute.api [None req-a804bf7f-5cf6-4bc5-8aa1-1f4b0496ef57 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] [instance: b89094ac-aee1-4bd6-a33d-8c4347cebfc7] Fetching instance by UUID {{(pid=116156) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:14:00.763404 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-a804bf7f-5cf6-4bc5-8aa1-1f4b0496ef57 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:14:00.763857 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-a804bf7f-5cf6-4bc5-8aa1-1f4b0496ef57 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:14:00.764632 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-a804bf7f-5cf6-4bc5-8aa1-1f4b0496ef57 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:14:00.765074 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-a804bf7f-5cf6-4bc5-8aa1-1f4b0496ef57 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:14:00.794049 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: INFO nova.api.openstack.requestlog [None req-a804bf7f-5cf6-4bc5-8aa1-1f4b0496ef57 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] 10.222.0.18 "GET /compute/v2.1/servers/b89094ac-aee1-4bd6-a33d-8c4347cebfc7/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041559 Dec 15 03:14:00.794594 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: [pid: 116156|app: 0|req: 795/1587] 10.222.0.18 () {60 vars in 1342 bytes} [Wed Dec 15 03:14:00 2021] GET /compute/v2.1/servers/b89094ac-aee1-4bd6-a33d-8c4347cebfc7/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 03:14:01.291860 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi [None req-cf1c70f3-00ba-4cf2-b517-578c56b51acb tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Calling method '>' {{(pid=116157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:14:01.292463 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.compute.api [None req-cf1c70f3-00ba-4cf2-b517-578c56b51acb tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] [instance: fa7c86bc-c46f-4120-8f3d-d795f8d7c5cc] Fetching instance by UUID {{(pid=116157) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:14:01.298276 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-cf1c70f3-00ba-4cf2-b517-578c56b51acb tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:14:01.298722 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-cf1c70f3-00ba-4cf2-b517-578c56b51acb tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:14:01.299482 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-cf1c70f3-00ba-4cf2-b517-578c56b51acb tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:14:01.299911 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-cf1c70f3-00ba-4cf2-b517-578c56b51acb tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:14:01.427698 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.policy [None req-cf1c70f3-00ba-4cf2-b517-578c56b51acb tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c4c0c82448e40ba801c0b52ec44e74a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a093d0bf43046aaa845f3cc115f3f5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116157) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:14:01.434916 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: INFO nova.api.openstack.requestlog [None req-cf1c70f3-00ba-4cf2-b517-578c56b51acb tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] 10.222.0.18 "GET /compute/v2.1/servers/fa7c86bc-c46f-4120-8f3d-d795f8d7c5cc" status: 200 len: 1570 microversion: 2.1 time: 0.147201 Dec 15 03:14:01.435483 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: [pid: 116157|app: 0|req: 793/1588] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 03:14:01 2021] GET /compute/v2.1/servers/fa7c86bc-c46f-4120-8f3d-d795f8d7c5cc => generated 1570 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 03:14:01.732666 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi [None req-f6dfdcd6-1e5f-4818-aa39-dc17e9225f6c tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Calling method '>' {{(pid=116156) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:14:01.733277 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.compute.api [None req-f6dfdcd6-1e5f-4818-aa39-dc17e9225f6c tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] [instance: bbb8462c-9501-4541-b67e-43ec5c5061a7] Fetching instance by UUID {{(pid=116156) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:14:01.739575 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-f6dfdcd6-1e5f-4818-aa39-dc17e9225f6c tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:14:01.740023 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-f6dfdcd6-1e5f-4818-aa39-dc17e9225f6c tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:14:01.740790 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-f6dfdcd6-1e5f-4818-aa39-dc17e9225f6c tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:14:01.741227 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-f6dfdcd6-1e5f-4818-aa39-dc17e9225f6c tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:14:01.802548 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.policy [None req-f6dfdcd6-1e5f-4818-aa39-dc17e9225f6c tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97bdf19af9e34fc3886ff451cb9d7a27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '494b56bf5eae4d56a5591546f85bc32b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116156) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:14:01.804555 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi [None req-fade8786-55e6-4f52-a151-eab70c4c708e tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Calling method '>' {{(pid=116157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:14:01.805452 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.compute.api [None req-fade8786-55e6-4f52-a151-eab70c4c708e tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] [instance: b89094ac-aee1-4bd6-a33d-8c4347cebfc7] Fetching instance by UUID {{(pid=116157) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:14:01.809891 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: INFO nova.api.openstack.requestlog [None req-f6dfdcd6-1e5f-4818-aa39-dc17e9225f6c tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] 10.222.0.18 "GET /compute/v2.1/servers/bbb8462c-9501-4541-b67e-43ec5c5061a7" status: 200 len: 1226 microversion: 2.1 time: 0.083068 Dec 15 03:14:01.810482 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: [pid: 116156|app: 0|req: 796/1589] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 03:14:01 2021] GET /compute/v2.1/servers/bbb8462c-9501-4541-b67e-43ec5c5061a7 => generated 1226 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 03:14:01.811680 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-fade8786-55e6-4f52-a151-eab70c4c708e tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:14:01.812134 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-fade8786-55e6-4f52-a151-eab70c4c708e tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:14:01.812915 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-fade8786-55e6-4f52-a151-eab70c4c708e tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:14:01.813346 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-fade8786-55e6-4f52-a151-eab70c4c708e tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:14:01.842164 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: INFO nova.api.openstack.requestlog [None req-fade8786-55e6-4f52-a151-eab70c4c708e tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] 10.222.0.18 "GET /compute/v2.1/servers/b89094ac-aee1-4bd6-a33d-8c4347cebfc7/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041301 Dec 15 03:14:01.842686 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: [pid: 116157|app: 0|req: 794/1590] 10.222.0.18 () {60 vars in 1342 bytes} [Wed Dec 15 03:14:01 2021] GET /compute/v2.1/servers/b89094ac-aee1-4bd6-a33d-8c4347cebfc7/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Dec 15 03:14:02.452930 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi [None req-c4dd3767-1153-475b-b273-8fd234168536 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Calling method '>' {{(pid=116156) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:14:02.453536 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.compute.api [None req-c4dd3767-1153-475b-b273-8fd234168536 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] [instance: fa7c86bc-c46f-4120-8f3d-d795f8d7c5cc] Fetching instance by UUID {{(pid=116156) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:14:02.459479 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-c4dd3767-1153-475b-b273-8fd234168536 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:14:02.459869 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-c4dd3767-1153-475b-b273-8fd234168536 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:14:02.460632 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-c4dd3767-1153-475b-b273-8fd234168536 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:14:02.461063 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-c4dd3767-1153-475b-b273-8fd234168536 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:14:02.588250 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.policy [None req-c4dd3767-1153-475b-b273-8fd234168536 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c4c0c82448e40ba801c0b52ec44e74a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a093d0bf43046aaa845f3cc115f3f5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116156) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:14:02.595471 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: INFO nova.api.openstack.requestlog [None req-c4dd3767-1153-475b-b273-8fd234168536 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] 10.222.0.18 "GET /compute/v2.1/servers/fa7c86bc-c46f-4120-8f3d-d795f8d7c5cc" status: 200 len: 1570 microversion: 2.1 time: 0.146580 Dec 15 03:14:02.596025 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: [pid: 116156|app: 0|req: 797/1591] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 03:14:02 2021] GET /compute/v2.1/servers/fa7c86bc-c46f-4120-8f3d-d795f8d7c5cc => generated 1570 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 03:14:02.825529 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi [None req-1ca5050c-ef75-42bd-bce5-a11613fa90ee tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Calling method '>' {{(pid=116157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:14:02.826166 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.compute.api [None req-1ca5050c-ef75-42bd-bce5-a11613fa90ee tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] [instance: bbb8462c-9501-4541-b67e-43ec5c5061a7] Fetching instance by UUID {{(pid=116157) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:14:02.832409 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-1ca5050c-ef75-42bd-bce5-a11613fa90ee tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:14:02.832864 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-1ca5050c-ef75-42bd-bce5-a11613fa90ee tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:14:02.833641 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-1ca5050c-ef75-42bd-bce5-a11613fa90ee tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:14:02.834116 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-1ca5050c-ef75-42bd-bce5-a11613fa90ee tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:14:02.852353 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi [None req-95f62e79-e74d-41d3-8ae1-c8a14f1ceb49 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Calling method '>' {{(pid=116156) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:14:02.853253 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.compute.api [None req-95f62e79-e74d-41d3-8ae1-c8a14f1ceb49 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] [instance: b89094ac-aee1-4bd6-a33d-8c4347cebfc7] Fetching instance by UUID {{(pid=116156) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:14:02.860089 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-95f62e79-e74d-41d3-8ae1-c8a14f1ceb49 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:14:02.860796 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-95f62e79-e74d-41d3-8ae1-c8a14f1ceb49 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:14:02.861577 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-95f62e79-e74d-41d3-8ae1-c8a14f1ceb49 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:14:02.862027 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-95f62e79-e74d-41d3-8ae1-c8a14f1ceb49 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:14:02.890456 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: INFO nova.api.openstack.requestlog [None req-95f62e79-e74d-41d3-8ae1-c8a14f1ceb49 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] 10.222.0.18 "GET /compute/v2.1/servers/b89094ac-aee1-4bd6-a33d-8c4347cebfc7/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041662 Dec 15 03:14:02.891012 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: [pid: 116156|app: 0|req: 798/1592] 10.222.0.18 () {60 vars in 1342 bytes} [Wed Dec 15 03:14:02 2021] GET /compute/v2.1/servers/b89094ac-aee1-4bd6-a33d-8c4347cebfc7/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Dec 15 03:14:02.895503 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.policy [None req-1ca5050c-ef75-42bd-bce5-a11613fa90ee tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97bdf19af9e34fc3886ff451cb9d7a27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '494b56bf5eae4d56a5591546f85bc32b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116157) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:14:02.903248 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: INFO nova.api.openstack.requestlog [None req-1ca5050c-ef75-42bd-bce5-a11613fa90ee tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] 10.222.0.18 "GET /compute/v2.1/servers/bbb8462c-9501-4541-b67e-43ec5c5061a7" status: 200 len: 1226 microversion: 2.1 time: 0.081314 Dec 15 03:14:02.903804 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: [pid: 116157|app: 0|req: 795/1593] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 03:14:02 2021] GET /compute/v2.1/servers/bbb8462c-9501-4541-b67e-43ec5c5061a7 => generated 1226 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 03:14:03.612505 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi [None req-fe094f12-1bb4-4441-9b3d-750e4ca84736 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Calling method '>' {{(pid=116156) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:14:03.613113 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.compute.api [None req-fe094f12-1bb4-4441-9b3d-750e4ca84736 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] [instance: fa7c86bc-c46f-4120-8f3d-d795f8d7c5cc] Fetching instance by UUID {{(pid=116156) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:14:03.618987 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-fe094f12-1bb4-4441-9b3d-750e4ca84736 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:14:03.619927 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-fe094f12-1bb4-4441-9b3d-750e4ca84736 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:14:03.620693 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-fe094f12-1bb4-4441-9b3d-750e4ca84736 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:14:03.621122 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-fe094f12-1bb4-4441-9b3d-750e4ca84736 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:14:03.747883 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.policy [None req-fe094f12-1bb4-4441-9b3d-750e4ca84736 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c4c0c82448e40ba801c0b52ec44e74a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a093d0bf43046aaa845f3cc115f3f5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116156) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:14:03.755106 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: INFO nova.api.openstack.requestlog [None req-fe094f12-1bb4-4441-9b3d-750e4ca84736 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] 10.222.0.18 "GET /compute/v2.1/servers/fa7c86bc-c46f-4120-8f3d-d795f8d7c5cc" status: 200 len: 1570 microversion: 2.1 time: 0.146472 Dec 15 03:14:03.755665 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: [pid: 116156|app: 0|req: 799/1594] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 03:14:03 2021] GET /compute/v2.1/servers/fa7c86bc-c46f-4120-8f3d-d795f8d7c5cc => generated 1570 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 03:14:03.901694 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi [None req-bc075a05-7730-4de6-bc27-3a1cd5f411e9 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Calling method '>' {{(pid=116157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:14:03.902546 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.compute.api [None req-bc075a05-7730-4de6-bc27-3a1cd5f411e9 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] [instance: b89094ac-aee1-4bd6-a33d-8c4347cebfc7] Fetching instance by UUID {{(pid=116157) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:14:03.908675 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-bc075a05-7730-4de6-bc27-3a1cd5f411e9 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:14:03.909121 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-bc075a05-7730-4de6-bc27-3a1cd5f411e9 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:14:03.909890 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-bc075a05-7730-4de6-bc27-3a1cd5f411e9 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:14:03.910363 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-bc075a05-7730-4de6-bc27-3a1cd5f411e9 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:14:03.919436 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi [None req-34bf60e6-48b7-4f69-9994-b98c7e9c33a2 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Calling method '>' {{(pid=116156) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:14:03.920048 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.compute.api [None req-34bf60e6-48b7-4f69-9994-b98c7e9c33a2 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] [instance: bbb8462c-9501-4541-b67e-43ec5c5061a7] Fetching instance by UUID {{(pid=116156) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:14:03.926219 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-34bf60e6-48b7-4f69-9994-b98c7e9c33a2 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:14:03.926674 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-34bf60e6-48b7-4f69-9994-b98c7e9c33a2 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:14:03.927448 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-34bf60e6-48b7-4f69-9994-b98c7e9c33a2 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:14:03.927880 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-34bf60e6-48b7-4f69-9994-b98c7e9c33a2 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:14:03.939259 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: INFO nova.api.openstack.requestlog [None req-bc075a05-7730-4de6-bc27-3a1cd5f411e9 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] 10.222.0.18 "GET /compute/v2.1/servers/b89094ac-aee1-4bd6-a33d-8c4347cebfc7/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041315 Dec 15 03:14:03.940298 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: [pid: 116157|app: 0|req: 796/1595] 10.222.0.18 () {60 vars in 1342 bytes} [Wed Dec 15 03:14:03 2021] GET /compute/v2.1/servers/b89094ac-aee1-4bd6-a33d-8c4347cebfc7/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 03:14:03.990374 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.policy [None req-34bf60e6-48b7-4f69-9994-b98c7e9c33a2 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97bdf19af9e34fc3886ff451cb9d7a27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '494b56bf5eae4d56a5591546f85bc32b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116156) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:14:03.998189 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: INFO nova.api.openstack.requestlog [None req-34bf60e6-48b7-4f69-9994-b98c7e9c33a2 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] 10.222.0.18 "GET /compute/v2.1/servers/bbb8462c-9501-4541-b67e-43ec5c5061a7" status: 200 len: 1226 microversion: 2.1 time: 0.082417 Dec 15 03:14:03.998740 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: [pid: 116156|app: 0|req: 800/1596] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 03:14:03 2021] GET /compute/v2.1/servers/bbb8462c-9501-4541-b67e-43ec5c5061a7 => generated 1226 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 03:14:04.772920 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi [None req-ec7c614b-4721-495a-ba34-917b26be7568 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Calling method '>' {{(pid=116157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:14:04.773527 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.compute.api [None req-ec7c614b-4721-495a-ba34-917b26be7568 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] [instance: fa7c86bc-c46f-4120-8f3d-d795f8d7c5cc] Fetching instance by UUID {{(pid=116157) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:14:04.779488 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-ec7c614b-4721-495a-ba34-917b26be7568 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:14:04.779940 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-ec7c614b-4721-495a-ba34-917b26be7568 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:14:04.780708 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-ec7c614b-4721-495a-ba34-917b26be7568 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:14:04.781141 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-ec7c614b-4721-495a-ba34-917b26be7568 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:14:04.908938 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.policy [None req-ec7c614b-4721-495a-ba34-917b26be7568 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c4c0c82448e40ba801c0b52ec44e74a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a093d0bf43046aaa845f3cc115f3f5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116157) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:14:04.916230 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: INFO nova.api.openstack.requestlog [None req-ec7c614b-4721-495a-ba34-917b26be7568 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] 10.222.0.18 "GET /compute/v2.1/servers/fa7c86bc-c46f-4120-8f3d-d795f8d7c5cc" status: 200 len: 1570 microversion: 2.1 time: 0.146952 Dec 15 03:14:04.916788 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: [pid: 116157|app: 0|req: 797/1597] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 03:14:04 2021] GET /compute/v2.1/servers/fa7c86bc-c46f-4120-8f3d-d795f8d7c5cc => generated 1570 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 03:14:04.951151 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi [None req-038c2c9c-bf8e-4943-b0fd-c0b4acaa7364 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Calling method '>' {{(pid=116156) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:14:04.952087 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.compute.api [None req-038c2c9c-bf8e-4943-b0fd-c0b4acaa7364 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] [instance: b89094ac-aee1-4bd6-a33d-8c4347cebfc7] Fetching instance by UUID {{(pid=116156) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:14:04.958331 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-038c2c9c-bf8e-4943-b0fd-c0b4acaa7364 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:14:04.958786 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-038c2c9c-bf8e-4943-b0fd-c0b4acaa7364 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:14:04.959561 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-038c2c9c-bf8e-4943-b0fd-c0b4acaa7364 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:14:04.960003 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-038c2c9c-bf8e-4943-b0fd-c0b4acaa7364 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:14:04.988314 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: INFO nova.api.openstack.requestlog [None req-038c2c9c-bf8e-4943-b0fd-c0b4acaa7364 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] 10.222.0.18 "GET /compute/v2.1/servers/b89094ac-aee1-4bd6-a33d-8c4347cebfc7/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041433 Dec 15 03:14:04.988847 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: [pid: 116156|app: 0|req: 801/1598] 10.222.0.18 () {60 vars in 1342 bytes} [Wed Dec 15 03:14:04 2021] GET /compute/v2.1/servers/b89094ac-aee1-4bd6-a33d-8c4347cebfc7/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 03:14:05.015021 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi [None req-5e2ae19b-edd4-4bce-ba65-a6b371e4effa tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Calling method '>' {{(pid=116157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:14:05.015664 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.compute.api [None req-5e2ae19b-edd4-4bce-ba65-a6b371e4effa tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] [instance: bbb8462c-9501-4541-b67e-43ec5c5061a7] Fetching instance by UUID {{(pid=116157) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:14:05.021429 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-5e2ae19b-edd4-4bce-ba65-a6b371e4effa tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:14:05.021887 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-5e2ae19b-edd4-4bce-ba65-a6b371e4effa tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:14:05.022701 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-5e2ae19b-edd4-4bce-ba65-a6b371e4effa tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:14:05.023199 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-5e2ae19b-edd4-4bce-ba65-a6b371e4effa tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:14:05.080626 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.policy [None req-5e2ae19b-edd4-4bce-ba65-a6b371e4effa tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97bdf19af9e34fc3886ff451cb9d7a27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '494b56bf5eae4d56a5591546f85bc32b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116157) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:14:05.088000 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: INFO nova.api.openstack.requestlog [None req-5e2ae19b-edd4-4bce-ba65-a6b371e4effa tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] 10.222.0.18 "GET /compute/v2.1/servers/bbb8462c-9501-4541-b67e-43ec5c5061a7" status: 200 len: 1226 microversion: 2.1 time: 0.076508 Dec 15 03:14:05.089197 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: [pid: 116157|app: 0|req: 798/1599] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 03:14:05 2021] GET /compute/v2.1/servers/bbb8462c-9501-4541-b67e-43ec5c5061a7 => generated 1226 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 03:14:05.933352 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi [None req-5c127970-e35d-4cc4-8579-503025eb4211 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Calling method '>' {{(pid=116156) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:14:05.934011 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.compute.api [None req-5c127970-e35d-4cc4-8579-503025eb4211 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] [instance: fa7c86bc-c46f-4120-8f3d-d795f8d7c5cc] Fetching instance by UUID {{(pid=116156) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:14:05.939819 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-5c127970-e35d-4cc4-8579-503025eb4211 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:14:05.940266 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-5c127970-e35d-4cc4-8579-503025eb4211 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:14:05.941026 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-5c127970-e35d-4cc4-8579-503025eb4211 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:14:05.941457 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-5c127970-e35d-4cc4-8579-503025eb4211 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:14:05.999744 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi [None req-d4a95392-5594-4e39-9f98-88e73ae97d2b tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Calling method '>' {{(pid=116157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:14:06.000688 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.compute.api [None req-d4a95392-5594-4e39-9f98-88e73ae97d2b tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] [instance: b89094ac-aee1-4bd6-a33d-8c4347cebfc7] Fetching instance by UUID {{(pid=116157) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:14:06.007025 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-d4a95392-5594-4e39-9f98-88e73ae97d2b tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:14:06.007483 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-d4a95392-5594-4e39-9f98-88e73ae97d2b tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:14:06.008284 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-d4a95392-5594-4e39-9f98-88e73ae97d2b tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:14:06.008732 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-d4a95392-5594-4e39-9f98-88e73ae97d2b tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:14:06.038166 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: INFO nova.api.openstack.requestlog [None req-d4a95392-5594-4e39-9f98-88e73ae97d2b tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] 10.222.0.18 "GET /compute/v2.1/servers/b89094ac-aee1-4bd6-a33d-8c4347cebfc7/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042160 Dec 15 03:14:06.038734 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: [pid: 116157|app: 0|req: 799/1600] 10.222.0.18 () {60 vars in 1342 bytes} [Wed Dec 15 03:14:05 2021] GET /compute/v2.1/servers/b89094ac-aee1-4bd6-a33d-8c4347cebfc7/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Dec 15 03:14:06.071656 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.policy [None req-5c127970-e35d-4cc4-8579-503025eb4211 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c4c0c82448e40ba801c0b52ec44e74a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a093d0bf43046aaa845f3cc115f3f5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116156) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:14:06.079466 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: INFO nova.api.openstack.requestlog [None req-5c127970-e35d-4cc4-8579-503025eb4211 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] 10.222.0.18 "GET /compute/v2.1/servers/fa7c86bc-c46f-4120-8f3d-d795f8d7c5cc" status: 200 len: 1570 microversion: 2.1 time: 0.150227 Dec 15 03:14:06.080016 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: [pid: 116156|app: 0|req: 802/1601] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 03:14:05 2021] GET /compute/v2.1/servers/fa7c86bc-c46f-4120-8f3d-d795f8d7c5cc => generated 1570 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 03:14:06.104229 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi [None req-695c8eac-0355-4b2b-a51a-69eca547c7eb tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Calling method '>' {{(pid=116157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:14:06.104826 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.compute.api [None req-695c8eac-0355-4b2b-a51a-69eca547c7eb tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] [instance: bbb8462c-9501-4541-b67e-43ec5c5061a7] Fetching instance by UUID {{(pid=116157) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:14:06.110885 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-695c8eac-0355-4b2b-a51a-69eca547c7eb tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:14:06.111338 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-695c8eac-0355-4b2b-a51a-69eca547c7eb tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:14:06.112121 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-695c8eac-0355-4b2b-a51a-69eca547c7eb tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:14:06.112559 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-695c8eac-0355-4b2b-a51a-69eca547c7eb tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:14:06.169795 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.policy [None req-695c8eac-0355-4b2b-a51a-69eca547c7eb tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97bdf19af9e34fc3886ff451cb9d7a27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '494b56bf5eae4d56a5591546f85bc32b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116157) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:14:06.177000 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: INFO nova.api.openstack.requestlog [None req-695c8eac-0355-4b2b-a51a-69eca547c7eb tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] 10.222.0.18 "GET /compute/v2.1/servers/bbb8462c-9501-4541-b67e-43ec5c5061a7" status: 200 len: 1226 microversion: 2.1 time: 0.076395 Dec 15 03:14:06.177565 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: [pid: 116157|app: 0|req: 800/1602] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 03:14:06 2021] GET /compute/v2.1/servers/bbb8462c-9501-4541-b67e-43ec5c5061a7 => generated 1226 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 03:14:07.048643 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi [None req-83933423-921e-4c19-9c9d-598cb8c0d588 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Calling method '>' {{(pid=116156) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:14:07.049543 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.compute.api [None req-83933423-921e-4c19-9c9d-598cb8c0d588 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] [instance: b89094ac-aee1-4bd6-a33d-8c4347cebfc7] Fetching instance by UUID {{(pid=116156) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:14:07.055771 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-83933423-921e-4c19-9c9d-598cb8c0d588 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:14:07.056222 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-83933423-921e-4c19-9c9d-598cb8c0d588 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:14:07.056996 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-83933423-921e-4c19-9c9d-598cb8c0d588 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:14:07.057430 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-83933423-921e-4c19-9c9d-598cb8c0d588 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:14:07.085493 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: INFO nova.api.openstack.requestlog [None req-83933423-921e-4c19-9c9d-598cb8c0d588 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] 10.222.0.18 "GET /compute/v2.1/servers/b89094ac-aee1-4bd6-a33d-8c4347cebfc7/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.040720 Dec 15 03:14:07.086124 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: [pid: 116156|app: 0|req: 803/1603] 10.222.0.18 () {60 vars in 1342 bytes} [Wed Dec 15 03:14:07 2021] GET /compute/v2.1/servers/b89094ac-aee1-4bd6-a33d-8c4347cebfc7/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 03:14:07.095980 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi [None req-3bbe0518-96ec-4dd2-bcf5-181f20e343a9 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Calling method '>' {{(pid=116157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:14:07.096649 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.compute.api [None req-3bbe0518-96ec-4dd2-bcf5-181f20e343a9 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] [instance: fa7c86bc-c46f-4120-8f3d-d795f8d7c5cc] Fetching instance by UUID {{(pid=116157) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:14:07.102821 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-3bbe0518-96ec-4dd2-bcf5-181f20e343a9 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:14:07.103266 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-3bbe0518-96ec-4dd2-bcf5-181f20e343a9 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:14:07.104098 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-3bbe0518-96ec-4dd2-bcf5-181f20e343a9 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:14:07.104527 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-3bbe0518-96ec-4dd2-bcf5-181f20e343a9 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:14:07.193858 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi [None req-01d3391b-da62-4c2a-8531-e3d0991d6a07 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Calling method '>' {{(pid=116156) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:14:07.194508 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.compute.api [None req-01d3391b-da62-4c2a-8531-e3d0991d6a07 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] [instance: bbb8462c-9501-4541-b67e-43ec5c5061a7] Fetching instance by UUID {{(pid=116156) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:14:07.201288 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-01d3391b-da62-4c2a-8531-e3d0991d6a07 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:14:07.201743 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-01d3391b-da62-4c2a-8531-e3d0991d6a07 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:14:07.202570 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-01d3391b-da62-4c2a-8531-e3d0991d6a07 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:14:07.203015 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-01d3391b-da62-4c2a-8531-e3d0991d6a07 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:14:07.236856 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.policy [None req-3bbe0518-96ec-4dd2-bcf5-181f20e343a9 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c4c0c82448e40ba801c0b52ec44e74a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a093d0bf43046aaa845f3cc115f3f5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116157) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:14:07.244282 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: INFO nova.api.openstack.requestlog [None req-3bbe0518-96ec-4dd2-bcf5-181f20e343a9 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] 10.222.0.18 "GET /compute/v2.1/servers/fa7c86bc-c46f-4120-8f3d-d795f8d7c5cc" status: 200 len: 1570 microversion: 2.1 time: 0.151815 Dec 15 03:14:07.244855 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: [pid: 116157|app: 0|req: 801/1604] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 03:14:07 2021] GET /compute/v2.1/servers/fa7c86bc-c46f-4120-8f3d-d795f8d7c5cc => generated 1570 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 03:14:07.261721 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.policy [None req-01d3391b-da62-4c2a-8531-e3d0991d6a07 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97bdf19af9e34fc3886ff451cb9d7a27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '494b56bf5eae4d56a5591546f85bc32b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116156) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:14:07.269066 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: INFO nova.api.openstack.requestlog [None req-01d3391b-da62-4c2a-8531-e3d0991d6a07 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] 10.222.0.18 "GET /compute/v2.1/servers/bbb8462c-9501-4541-b67e-43ec5c5061a7" status: 200 len: 1226 microversion: 2.1 time: 0.078808 Dec 15 03:14:07.269623 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: [pid: 116156|app: 0|req: 804/1605] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 03:14:07 2021] GET /compute/v2.1/servers/bbb8462c-9501-4541-b67e-43ec5c5061a7 => generated 1226 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 03:14:08.096992 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi [None req-9396deea-9b81-4f65-b412-c30a3c3e290c tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Calling method '>' {{(pid=116157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:14:08.097926 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.compute.api [None req-9396deea-9b81-4f65-b412-c30a3c3e290c tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] [instance: b89094ac-aee1-4bd6-a33d-8c4347cebfc7] Fetching instance by UUID {{(pid=116157) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:14:08.104778 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-9396deea-9b81-4f65-b412-c30a3c3e290c tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:14:08.105227 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-9396deea-9b81-4f65-b412-c30a3c3e290c tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:14:08.106030 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-9396deea-9b81-4f65-b412-c30a3c3e290c tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:14:08.106467 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-9396deea-9b81-4f65-b412-c30a3c3e290c tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:14:08.135667 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: INFO nova.api.openstack.requestlog [None req-9396deea-9b81-4f65-b412-c30a3c3e290c tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] 10.222.0.18 "GET /compute/v2.1/servers/b89094ac-aee1-4bd6-a33d-8c4347cebfc7/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042473 Dec 15 03:14:08.136211 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: [pid: 116157|app: 0|req: 802/1606] 10.222.0.18 () {60 vars in 1342 bytes} [Wed Dec 15 03:14:08 2021] GET /compute/v2.1/servers/b89094ac-aee1-4bd6-a33d-8c4347cebfc7/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Dec 15 03:14:08.260363 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi [None req-d77737d0-4fb9-47ad-85c9-3cd47b73d4f2 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Calling method '>' {{(pid=116156) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:14:08.260968 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.compute.api [None req-d77737d0-4fb9-47ad-85c9-3cd47b73d4f2 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] [instance: fa7c86bc-c46f-4120-8f3d-d795f8d7c5cc] Fetching instance by UUID {{(pid=116156) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:14:08.267415 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-d77737d0-4fb9-47ad-85c9-3cd47b73d4f2 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:14:08.267866 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-d77737d0-4fb9-47ad-85c9-3cd47b73d4f2 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:14:08.268647 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-d77737d0-4fb9-47ad-85c9-3cd47b73d4f2 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:14:08.269078 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-d77737d0-4fb9-47ad-85c9-3cd47b73d4f2 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:14:08.285922 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi [None req-6b00825e-86e5-4f32-8c51-c451d7ffbe2b tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Calling method '>' {{(pid=116157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:14:08.286567 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.compute.api [None req-6b00825e-86e5-4f32-8c51-c451d7ffbe2b tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] [instance: bbb8462c-9501-4541-b67e-43ec5c5061a7] Fetching instance by UUID {{(pid=116157) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:14:08.292749 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-6b00825e-86e5-4f32-8c51-c451d7ffbe2b tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:14:08.293203 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-6b00825e-86e5-4f32-8c51-c451d7ffbe2b tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:14:08.294006 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-6b00825e-86e5-4f32-8c51-c451d7ffbe2b tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:14:08.294449 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-6b00825e-86e5-4f32-8c51-c451d7ffbe2b tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:14:08.352606 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.policy [None req-6b00825e-86e5-4f32-8c51-c451d7ffbe2b tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97bdf19af9e34fc3886ff451cb9d7a27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '494b56bf5eae4d56a5591546f85bc32b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116157) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:14:08.365907 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: INFO nova.api.openstack.requestlog [None req-6b00825e-86e5-4f32-8c51-c451d7ffbe2b tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] 10.222.0.18 "GET /compute/v2.1/servers/bbb8462c-9501-4541-b67e-43ec5c5061a7" status: 200 len: 1226 microversion: 2.1 time: 0.078393 Dec 15 03:14:08.366766 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: [pid: 116157|app: 0|req: 803/1607] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 03:14:08 2021] GET /compute/v2.1/servers/bbb8462c-9501-4541-b67e-43ec5c5061a7 => generated 1226 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 03:14:08.402575 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.policy [None req-d77737d0-4fb9-47ad-85c9-3cd47b73d4f2 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c4c0c82448e40ba801c0b52ec44e74a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a093d0bf43046aaa845f3cc115f3f5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116156) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:14:08.409719 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: INFO nova.api.openstack.requestlog [None req-d77737d0-4fb9-47ad-85c9-3cd47b73d4f2 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] 10.222.0.18 "GET /compute/v2.1/servers/fa7c86bc-c46f-4120-8f3d-d795f8d7c5cc" status: 200 len: 1570 microversion: 2.1 time: 0.153064 Dec 15 03:14:08.410308 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: [pid: 116156|app: 0|req: 805/1608] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 03:14:08 2021] GET /compute/v2.1/servers/fa7c86bc-c46f-4120-8f3d-d795f8d7c5cc => generated 1570 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 03:14:09.147309 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi [None req-3d170640-39ab-4866-8d3a-ddd93010f854 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Calling method '>' {{(pid=116157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:14:09.148213 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.compute.api [None req-3d170640-39ab-4866-8d3a-ddd93010f854 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] [instance: b89094ac-aee1-4bd6-a33d-8c4347cebfc7] Fetching instance by UUID {{(pid=116157) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:14:09.154989 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-3d170640-39ab-4866-8d3a-ddd93010f854 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:14:09.155467 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-3d170640-39ab-4866-8d3a-ddd93010f854 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:14:09.156243 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-3d170640-39ab-4866-8d3a-ddd93010f854 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:14:09.156680 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-3d170640-39ab-4866-8d3a-ddd93010f854 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:14:09.185063 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: INFO nova.api.openstack.requestlog [None req-3d170640-39ab-4866-8d3a-ddd93010f854 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] 10.222.0.18 "GET /compute/v2.1/servers/b89094ac-aee1-4bd6-a33d-8c4347cebfc7/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041509 Dec 15 03:14:09.185611 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: [pid: 116157|app: 0|req: 804/1609] 10.222.0.18 () {60 vars in 1342 bytes} [Wed Dec 15 03:14:09 2021] GET /compute/v2.1/servers/b89094ac-aee1-4bd6-a33d-8c4347cebfc7/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 03:14:09.377437 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi [None req-0a414418-8ddc-4c10-acae-3cda39672e81 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Calling method '>' {{(pid=116156) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:14:09.378079 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.compute.api [None req-0a414418-8ddc-4c10-acae-3cda39672e81 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] [instance: bbb8462c-9501-4541-b67e-43ec5c5061a7] Fetching instance by UUID {{(pid=116156) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:14:09.384280 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-0a414418-8ddc-4c10-acae-3cda39672e81 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:14:09.385212 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-0a414418-8ddc-4c10-acae-3cda39672e81 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:14:09.386009 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-0a414418-8ddc-4c10-acae-3cda39672e81 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:14:09.386449 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-0a414418-8ddc-4c10-acae-3cda39672e81 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:14:09.426774 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi [None req-a98aa5b9-034e-4486-b39b-7f70ef27cb10 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Calling method '>' {{(pid=116157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:14:09.427302 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.compute.api [None req-a98aa5b9-034e-4486-b39b-7f70ef27cb10 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] [instance: fa7c86bc-c46f-4120-8f3d-d795f8d7c5cc] Fetching instance by UUID {{(pid=116157) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:14:09.433055 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-a98aa5b9-034e-4486-b39b-7f70ef27cb10 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:14:09.433498 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-a98aa5b9-034e-4486-b39b-7f70ef27cb10 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:14:09.434329 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-a98aa5b9-034e-4486-b39b-7f70ef27cb10 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:14:09.434760 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-a98aa5b9-034e-4486-b39b-7f70ef27cb10 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:14:09.443961 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.policy [None req-0a414418-8ddc-4c10-acae-3cda39672e81 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97bdf19af9e34fc3886ff451cb9d7a27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '494b56bf5eae4d56a5591546f85bc32b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116156) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:14:09.452083 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: INFO nova.api.openstack.requestlog [None req-0a414418-8ddc-4c10-acae-3cda39672e81 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] 10.222.0.18 "GET /compute/v2.1/servers/bbb8462c-9501-4541-b67e-43ec5c5061a7" status: 200 len: 1226 microversion: 2.1 time: 0.078314 Dec 15 03:14:09.452657 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: [pid: 116156|app: 0|req: 806/1610] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 03:14:09 2021] GET /compute/v2.1/servers/bbb8462c-9501-4541-b67e-43ec5c5061a7 => generated 1226 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 03:14:09.562457 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.policy [None req-a98aa5b9-034e-4486-b39b-7f70ef27cb10 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c4c0c82448e40ba801c0b52ec44e74a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a093d0bf43046aaa845f3cc115f3f5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116157) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:14:09.569621 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: INFO nova.api.openstack.requestlog [None req-a98aa5b9-034e-4486-b39b-7f70ef27cb10 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] 10.222.0.18 "GET /compute/v2.1/servers/fa7c86bc-c46f-4120-8f3d-d795f8d7c5cc" status: 200 len: 1570 microversion: 2.1 time: 0.146570 Dec 15 03:14:09.570211 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: [pid: 116157|app: 0|req: 805/1611] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 03:14:09 2021] GET /compute/v2.1/servers/fa7c86bc-c46f-4120-8f3d-d795f8d7c5cc => generated 1570 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 03:14:10.196438 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi [None req-bf2b0e3b-d9fb-4ecb-b722-bda51474ba53 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Calling method '>' {{(pid=116156) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:14:10.197343 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.compute.api [None req-bf2b0e3b-d9fb-4ecb-b722-bda51474ba53 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] [instance: b89094ac-aee1-4bd6-a33d-8c4347cebfc7] Fetching instance by UUID {{(pid=116156) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:14:10.203521 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-bf2b0e3b-d9fb-4ecb-b722-bda51474ba53 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:14:10.204014 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-bf2b0e3b-d9fb-4ecb-b722-bda51474ba53 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:14:10.204808 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-bf2b0e3b-d9fb-4ecb-b722-bda51474ba53 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:14:10.205248 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-bf2b0e3b-d9fb-4ecb-b722-bda51474ba53 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:14:10.234309 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: INFO nova.api.openstack.requestlog [None req-bf2b0e3b-d9fb-4ecb-b722-bda51474ba53 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] 10.222.0.18 "GET /compute/v2.1/servers/b89094ac-aee1-4bd6-a33d-8c4347cebfc7/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041569 Dec 15 03:14:10.234856 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: [pid: 116156|app: 0|req: 807/1612] 10.222.0.18 () {60 vars in 1342 bytes} [Wed Dec 15 03:14:10 2021] GET /compute/v2.1/servers/b89094ac-aee1-4bd6-a33d-8c4347cebfc7/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 03:14:10.469035 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi [None req-06771364-7ce6-4dab-94f6-9bf4aa0f02e6 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Calling method '>' {{(pid=116157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:14:10.469618 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.compute.api [None req-06771364-7ce6-4dab-94f6-9bf4aa0f02e6 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] [instance: bbb8462c-9501-4541-b67e-43ec5c5061a7] Fetching instance by UUID {{(pid=116157) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:14:10.475828 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-06771364-7ce6-4dab-94f6-9bf4aa0f02e6 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:14:10.476273 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-06771364-7ce6-4dab-94f6-9bf4aa0f02e6 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:14:10.477045 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-06771364-7ce6-4dab-94f6-9bf4aa0f02e6 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:14:10.477474 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-06771364-7ce6-4dab-94f6-9bf4aa0f02e6 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:14:10.538248 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.policy [None req-06771364-7ce6-4dab-94f6-9bf4aa0f02e6 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97bdf19af9e34fc3886ff451cb9d7a27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '494b56bf5eae4d56a5591546f85bc32b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116157) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:14:10.546189 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: INFO nova.api.openstack.requestlog [None req-06771364-7ce6-4dab-94f6-9bf4aa0f02e6 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] 10.222.0.18 "GET /compute/v2.1/servers/bbb8462c-9501-4541-b67e-43ec5c5061a7" status: 200 len: 1226 microversion: 2.1 time: 0.080892 Dec 15 03:14:10.546748 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: [pid: 116157|app: 0|req: 806/1613] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 03:14:10 2021] GET /compute/v2.1/servers/bbb8462c-9501-4541-b67e-43ec5c5061a7 => generated 1226 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 03:14:10.586702 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi [None req-bbfd6bea-1b95-42ed-b98d-0ccdddc7f6af tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Calling method '>' {{(pid=116156) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:14:10.587314 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.compute.api [None req-bbfd6bea-1b95-42ed-b98d-0ccdddc7f6af tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] [instance: fa7c86bc-c46f-4120-8f3d-d795f8d7c5cc] Fetching instance by UUID {{(pid=116156) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:14:10.593677 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-bbfd6bea-1b95-42ed-b98d-0ccdddc7f6af tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:14:10.594176 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-bbfd6bea-1b95-42ed-b98d-0ccdddc7f6af tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:14:10.594954 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-bbfd6bea-1b95-42ed-b98d-0ccdddc7f6af tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:14:10.595390 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-bbfd6bea-1b95-42ed-b98d-0ccdddc7f6af tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:14:10.722731 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.policy [None req-bbfd6bea-1b95-42ed-b98d-0ccdddc7f6af tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c4c0c82448e40ba801c0b52ec44e74a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a093d0bf43046aaa845f3cc115f3f5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116156) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:14:10.729926 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: INFO nova.api.openstack.requestlog [None req-bbfd6bea-1b95-42ed-b98d-0ccdddc7f6af tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] 10.222.0.18 "GET /compute/v2.1/servers/fa7c86bc-c46f-4120-8f3d-d795f8d7c5cc" status: 200 len: 1570 microversion: 2.1 time: 0.146884 Dec 15 03:14:10.730511 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: [pid: 116156|app: 0|req: 808/1614] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 03:14:10 2021] GET /compute/v2.1/servers/fa7c86bc-c46f-4120-8f3d-d795f8d7c5cc => generated 1570 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 03:14:11.246827 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi [None req-c4fec6a4-d6bc-47a7-b2a5-4f7e5e8e9b5a tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Calling method '>' {{(pid=116157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:14:11.247776 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.compute.api [None req-c4fec6a4-d6bc-47a7-b2a5-4f7e5e8e9b5a tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] [instance: b89094ac-aee1-4bd6-a33d-8c4347cebfc7] Fetching instance by UUID {{(pid=116157) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:14:11.253573 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-c4fec6a4-d6bc-47a7-b2a5-4f7e5e8e9b5a tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:14:11.254042 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-c4fec6a4-d6bc-47a7-b2a5-4f7e5e8e9b5a tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:14:11.254814 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-c4fec6a4-d6bc-47a7-b2a5-4f7e5e8e9b5a tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:14:11.255241 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-c4fec6a4-d6bc-47a7-b2a5-4f7e5e8e9b5a tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:14:11.283489 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: INFO nova.api.openstack.requestlog [None req-c4fec6a4-d6bc-47a7-b2a5-4f7e5e8e9b5a tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] 10.222.0.18 "GET /compute/v2.1/servers/b89094ac-aee1-4bd6-a33d-8c4347cebfc7/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041097 Dec 15 03:14:11.284160 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: [pid: 116157|app: 0|req: 807/1615] 10.222.0.18 () {60 vars in 1342 bytes} [Wed Dec 15 03:14:11 2021] GET /compute/v2.1/servers/b89094ac-aee1-4bd6-a33d-8c4347cebfc7/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 03:14:11.562968 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi [None req-99dbb530-9cd4-4785-965b-b435ab0a6c48 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Calling method '>' {{(pid=116156) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:14:11.563577 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.compute.api [None req-99dbb530-9cd4-4785-965b-b435ab0a6c48 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] [instance: bbb8462c-9501-4541-b67e-43ec5c5061a7] Fetching instance by UUID {{(pid=116156) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:14:11.569606 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-99dbb530-9cd4-4785-965b-b435ab0a6c48 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:14:11.570095 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-99dbb530-9cd4-4785-965b-b435ab0a6c48 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:14:11.570910 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-99dbb530-9cd4-4785-965b-b435ab0a6c48 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:14:11.571349 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-99dbb530-9cd4-4785-965b-b435ab0a6c48 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:14:11.629844 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.policy [None req-99dbb530-9cd4-4785-965b-b435ab0a6c48 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97bdf19af9e34fc3886ff451cb9d7a27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '494b56bf5eae4d56a5591546f85bc32b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116156) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:14:11.637094 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: INFO nova.api.openstack.requestlog [None req-99dbb530-9cd4-4785-965b-b435ab0a6c48 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] 10.222.0.18 "GET /compute/v2.1/servers/bbb8462c-9501-4541-b67e-43ec5c5061a7" status: 200 len: 1226 microversion: 2.1 time: 0.077779 Dec 15 03:14:11.637650 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: [pid: 116156|app: 0|req: 809/1616] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 03:14:11 2021] GET /compute/v2.1/servers/bbb8462c-9501-4541-b67e-43ec5c5061a7 => generated 1226 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 03:14:11.747494 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi [None req-8b0a9ad2-2056-47be-8438-66d3049f4c5e tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Calling method '>' {{(pid=116157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:14:11.748127 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.compute.api [None req-8b0a9ad2-2056-47be-8438-66d3049f4c5e tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] [instance: fa7c86bc-c46f-4120-8f3d-d795f8d7c5cc] Fetching instance by UUID {{(pid=116157) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:14:11.754421 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-8b0a9ad2-2056-47be-8438-66d3049f4c5e tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:14:11.754867 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-8b0a9ad2-2056-47be-8438-66d3049f4c5e tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:14:11.755635 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-8b0a9ad2-2056-47be-8438-66d3049f4c5e tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:14:11.756067 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-8b0a9ad2-2056-47be-8438-66d3049f4c5e tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:14:11.883608 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.policy [None req-8b0a9ad2-2056-47be-8438-66d3049f4c5e tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c4c0c82448e40ba801c0b52ec44e74a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a093d0bf43046aaa845f3cc115f3f5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116157) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:14:11.890761 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: INFO nova.api.openstack.requestlog [None req-8b0a9ad2-2056-47be-8438-66d3049f4c5e tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] 10.222.0.18 "GET /compute/v2.1/servers/fa7c86bc-c46f-4120-8f3d-d795f8d7c5cc" status: 200 len: 1570 microversion: 2.1 time: 0.147627 Dec 15 03:14:11.891321 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: [pid: 116157|app: 0|req: 808/1617] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 03:14:11 2021] GET /compute/v2.1/servers/fa7c86bc-c46f-4120-8f3d-d795f8d7c5cc => generated 1570 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 03:14:12.294376 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi [None req-ddef9ab2-2d14-4bb6-97c4-b90a4d75c5a4 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Calling method '>' {{(pid=116156) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:14:12.295278 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.compute.api [None req-ddef9ab2-2d14-4bb6-97c4-b90a4d75c5a4 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] [instance: b89094ac-aee1-4bd6-a33d-8c4347cebfc7] Fetching instance by UUID {{(pid=116156) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:14:12.301109 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-ddef9ab2-2d14-4bb6-97c4-b90a4d75c5a4 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:14:12.301560 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-ddef9ab2-2d14-4bb6-97c4-b90a4d75c5a4 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:14:12.302364 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-ddef9ab2-2d14-4bb6-97c4-b90a4d75c5a4 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:14:12.302799 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-ddef9ab2-2d14-4bb6-97c4-b90a4d75c5a4 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:14:12.330718 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: INFO nova.api.openstack.requestlog [None req-ddef9ab2-2d14-4bb6-97c4-b90a4d75c5a4 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] 10.222.0.18 "GET /compute/v2.1/servers/b89094ac-aee1-4bd6-a33d-8c4347cebfc7/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.040107 Dec 15 03:14:12.331255 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: [pid: 116156|app: 0|req: 810/1618] 10.222.0.18 () {60 vars in 1342 bytes} [Wed Dec 15 03:14:12 2021] GET /compute/v2.1/servers/b89094ac-aee1-4bd6-a33d-8c4347cebfc7/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 03:14:12.653541 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi [None req-961bc40b-fca8-45a1-890e-38d848e06826 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Calling method '>' {{(pid=116157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:14:12.654180 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.compute.api [None req-961bc40b-fca8-45a1-890e-38d848e06826 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] [instance: bbb8462c-9501-4541-b67e-43ec5c5061a7] Fetching instance by UUID {{(pid=116157) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:14:12.660027 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-961bc40b-fca8-45a1-890e-38d848e06826 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:14:12.660485 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-961bc40b-fca8-45a1-890e-38d848e06826 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:14:12.661261 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-961bc40b-fca8-45a1-890e-38d848e06826 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:14:12.661700 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-961bc40b-fca8-45a1-890e-38d848e06826 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:14:12.719170 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.policy [None req-961bc40b-fca8-45a1-890e-38d848e06826 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97bdf19af9e34fc3886ff451cb9d7a27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '494b56bf5eae4d56a5591546f85bc32b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116157) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:14:12.726278 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: INFO nova.api.openstack.requestlog [None req-961bc40b-fca8-45a1-890e-38d848e06826 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] 10.222.0.18 "GET /compute/v2.1/servers/bbb8462c-9501-4541-b67e-43ec5c5061a7" status: 200 len: 1226 microversion: 2.1 time: 0.076301 Dec 15 03:14:12.726839 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: [pid: 116157|app: 0|req: 809/1619] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 03:14:12 2021] GET /compute/v2.1/servers/bbb8462c-9501-4541-b67e-43ec5c5061a7 => generated 1226 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 03:14:12.907646 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi [None req-45029b38-00b5-47d2-ba22-09eb176e6f1a tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Calling method '>' {{(pid=116156) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:14:12.908167 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.compute.api [None req-45029b38-00b5-47d2-ba22-09eb176e6f1a tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] [instance: fa7c86bc-c46f-4120-8f3d-d795f8d7c5cc] Fetching instance by UUID {{(pid=116156) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:14:12.914519 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-45029b38-00b5-47d2-ba22-09eb176e6f1a tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:14:12.914973 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-45029b38-00b5-47d2-ba22-09eb176e6f1a tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:14:12.915749 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-45029b38-00b5-47d2-ba22-09eb176e6f1a tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:14:12.916186 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-45029b38-00b5-47d2-ba22-09eb176e6f1a tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:14:13.046151 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.policy [None req-45029b38-00b5-47d2-ba22-09eb176e6f1a tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c4c0c82448e40ba801c0b52ec44e74a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a093d0bf43046aaa845f3cc115f3f5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116156) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:14:13.053303 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: INFO nova.api.openstack.requestlog [None req-45029b38-00b5-47d2-ba22-09eb176e6f1a tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] 10.222.0.18 "GET /compute/v2.1/servers/fa7c86bc-c46f-4120-8f3d-d795f8d7c5cc" status: 200 len: 1570 microversion: 2.1 time: 0.149442 Dec 15 03:14:13.053865 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: [pid: 116156|app: 0|req: 811/1620] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 03:14:12 2021] GET /compute/v2.1/servers/fa7c86bc-c46f-4120-8f3d-d795f8d7c5cc => generated 1570 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 03:14:13.342689 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi [None req-25742b7b-8563-4b7a-804c-45ff19a200f7 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 03:14:13.344634 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.compute.api [None req-25742b7b-8563-4b7a-804c-45ff19a200f7 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] [instance: b89094ac-aee1-4bd6-a33d-8c4347cebfc7] Fetching instance by UUID {{(pid=116157) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:14:13.350833 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-25742b7b-8563-4b7a-804c-45ff19a200f7 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:14:13.351280 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-25742b7b-8563-4b7a-804c-45ff19a200f7 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:14:13.352057 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-25742b7b-8563-4b7a-804c-45ff19a200f7 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:14:13.352498 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-25742b7b-8563-4b7a-804c-45ff19a200f7 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:14:13.448710 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: INFO nova.api.openstack.requestlog [None req-25742b7b-8563-4b7a-804c-45ff19a200f7 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] 10.222.0.18 "POST /compute/v2.1/servers/b89094ac-aee1-4bd6-a33d-8c4347cebfc7/action" status: 200 len: 38345 microversion: 2.20 time: 0.109559 Dec 15 03:14:13.449719 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: [pid: 116157|app: 0|req: 810/1621] 10.222.0.18 () {62 vars in 1318 bytes} [Wed Dec 15 03:14:13 2021] POST /compute/v2.1/servers/b89094ac-aee1-4bd6-a33d-8c4347cebfc7/action => generated 38345 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 15 03:14:13.742617 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi [None req-e5d7350f-02ed-43bf-a7f1-eea0da730e67 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Calling method '>' {{(pid=116156) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:14:13.743230 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.compute.api [None req-e5d7350f-02ed-43bf-a7f1-eea0da730e67 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] [instance: bbb8462c-9501-4541-b67e-43ec5c5061a7] Fetching instance by UUID {{(pid=116156) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:14:13.749017 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-e5d7350f-02ed-43bf-a7f1-eea0da730e67 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:14:13.749471 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-e5d7350f-02ed-43bf-a7f1-eea0da730e67 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:14:13.750280 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-e5d7350f-02ed-43bf-a7f1-eea0da730e67 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:14:13.750718 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-e5d7350f-02ed-43bf-a7f1-eea0da730e67 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:14:13.808006 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.policy [None req-e5d7350f-02ed-43bf-a7f1-eea0da730e67 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97bdf19af9e34fc3886ff451cb9d7a27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '494b56bf5eae4d56a5591546f85bc32b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116156) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:14:13.815110 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: INFO nova.api.openstack.requestlog [None req-e5d7350f-02ed-43bf-a7f1-eea0da730e67 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] 10.222.0.18 "GET /compute/v2.1/servers/bbb8462c-9501-4541-b67e-43ec5c5061a7" status: 200 len: 1226 microversion: 2.1 time: 0.076127 Dec 15 03:14:13.815668 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: [pid: 116156|app: 0|req: 812/1622] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 03:14:13 2021] GET /compute/v2.1/servers/bbb8462c-9501-4541-b67e-43ec5c5061a7 => generated 1226 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 03:14:14.071085 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi [None req-0f4ec1c3-e67c-4f83-8c4f-f30c89651b60 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Calling method '>' {{(pid=116157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:14:14.071804 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.compute.api [None req-0f4ec1c3-e67c-4f83-8c4f-f30c89651b60 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] [instance: fa7c86bc-c46f-4120-8f3d-d795f8d7c5cc] Fetching instance by UUID {{(pid=116157) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:14:14.079355 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-0f4ec1c3-e67c-4f83-8c4f-f30c89651b60 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:14:14.079812 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-0f4ec1c3-e67c-4f83-8c4f-f30c89651b60 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:14:14.080599 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-0f4ec1c3-e67c-4f83-8c4f-f30c89651b60 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:14:14.081041 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-0f4ec1c3-e67c-4f83-8c4f-f30c89651b60 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:14:14.216221 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.policy [None req-0f4ec1c3-e67c-4f83-8c4f-f30c89651b60 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c4c0c82448e40ba801c0b52ec44e74a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a093d0bf43046aaa845f3cc115f3f5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116157) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:14:14.223512 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: INFO nova.api.openstack.requestlog [None req-0f4ec1c3-e67c-4f83-8c4f-f30c89651b60 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] 10.222.0.18 "GET /compute/v2.1/servers/fa7c86bc-c46f-4120-8f3d-d795f8d7c5cc" status: 200 len: 1570 microversion: 2.1 time: 0.156409 Dec 15 03:14:14.224060 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: [pid: 116157|app: 0|req: 811/1623] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 03:14:14 2021] GET /compute/v2.1/servers/fa7c86bc-c46f-4120-8f3d-d795f8d7c5cc => generated 1570 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 03:14:14.832243 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi [None req-4d822d08-fd09-4539-80b6-d6565db94a1d tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Calling method '>' {{(pid=116156) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:14:14.832858 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.compute.api [None req-4d822d08-fd09-4539-80b6-d6565db94a1d tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] [instance: bbb8462c-9501-4541-b67e-43ec5c5061a7] Fetching instance by UUID {{(pid=116156) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:14:14.839683 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-4d822d08-fd09-4539-80b6-d6565db94a1d tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:14:14.840140 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-4d822d08-fd09-4539-80b6-d6565db94a1d tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:14:14.840919 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-4d822d08-fd09-4539-80b6-d6565db94a1d tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:14:14.841354 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-4d822d08-fd09-4539-80b6-d6565db94a1d tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:14:14.902329 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.policy [None req-4d822d08-fd09-4539-80b6-d6565db94a1d tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97bdf19af9e34fc3886ff451cb9d7a27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '494b56bf5eae4d56a5591546f85bc32b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116156) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:14:14.909761 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: INFO nova.api.openstack.requestlog [None req-4d822d08-fd09-4539-80b6-d6565db94a1d tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] 10.222.0.18 "GET /compute/v2.1/servers/bbb8462c-9501-4541-b67e-43ec5c5061a7" status: 200 len: 1226 microversion: 2.1 time: 0.081213 Dec 15 03:14:14.910498 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: [pid: 116156|app: 0|req: 813/1624] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 03:14:14 2021] GET /compute/v2.1/servers/bbb8462c-9501-4541-b67e-43ec5c5061a7 => generated 1226 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 03:14:15.240554 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi [None req-ad29babf-054e-423f-8e58-d527b5d6470b tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Calling method '>' {{(pid=116157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:14:15.241169 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.compute.api [None req-ad29babf-054e-423f-8e58-d527b5d6470b tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] [instance: fa7c86bc-c46f-4120-8f3d-d795f8d7c5cc] Fetching instance by UUID {{(pid=116157) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:14:15.247448 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-ad29babf-054e-423f-8e58-d527b5d6470b tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:14:15.247900 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-ad29babf-054e-423f-8e58-d527b5d6470b tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:14:15.248714 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-ad29babf-054e-423f-8e58-d527b5d6470b tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:14:15.249150 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-ad29babf-054e-423f-8e58-d527b5d6470b tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:14:15.378715 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.policy [None req-ad29babf-054e-423f-8e58-d527b5d6470b tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c4c0c82448e40ba801c0b52ec44e74a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a093d0bf43046aaa845f3cc115f3f5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116157) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:14:15.386440 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: INFO nova.api.openstack.requestlog [None req-ad29babf-054e-423f-8e58-d527b5d6470b tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] 10.222.0.18 "GET /compute/v2.1/servers/fa7c86bc-c46f-4120-8f3d-d795f8d7c5cc" status: 200 len: 1570 microversion: 2.1 time: 0.149535 Dec 15 03:14:15.387005 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: [pid: 116157|app: 0|req: 812/1625] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 03:14:15 2021] GET /compute/v2.1/servers/fa7c86bc-c46f-4120-8f3d-d795f8d7c5cc => generated 1570 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 03:14:15.927204 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi [None req-236bc8be-8456-45fe-8265-ae73b07028d5 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Calling method '>' {{(pid=116156) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:14:15.927831 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.compute.api [None req-236bc8be-8456-45fe-8265-ae73b07028d5 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] [instance: bbb8462c-9501-4541-b67e-43ec5c5061a7] Fetching instance by UUID {{(pid=116156) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:14:15.934508 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-236bc8be-8456-45fe-8265-ae73b07028d5 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:14:15.934956 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-236bc8be-8456-45fe-8265-ae73b07028d5 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:14:15.935727 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-236bc8be-8456-45fe-8265-ae73b07028d5 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:14:15.936161 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-236bc8be-8456-45fe-8265-ae73b07028d5 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:14:15.993378 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.policy [None req-236bc8be-8456-45fe-8265-ae73b07028d5 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97bdf19af9e34fc3886ff451cb9d7a27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '494b56bf5eae4d56a5591546f85bc32b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116156) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:14:16.001077 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: INFO nova.api.openstack.requestlog [None req-236bc8be-8456-45fe-8265-ae73b07028d5 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] 10.222.0.18 "GET /compute/v2.1/servers/bbb8462c-9501-4541-b67e-43ec5c5061a7" status: 200 len: 1226 microversion: 2.1 time: 0.077488 Dec 15 03:14:16.001625 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: [pid: 116156|app: 0|req: 814/1626] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 03:14:15 2021] GET /compute/v2.1/servers/bbb8462c-9501-4541-b67e-43ec5c5061a7 => generated 1226 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 03:14:16.403453 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi [None req-b267c6d5-fce7-46a2-b213-2bc2a3666dc7 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Calling method '>' {{(pid=116157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:14:16.404054 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.compute.api [None req-b267c6d5-fce7-46a2-b213-2bc2a3666dc7 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] [instance: fa7c86bc-c46f-4120-8f3d-d795f8d7c5cc] Fetching instance by UUID {{(pid=116157) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:14:16.410288 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-b267c6d5-fce7-46a2-b213-2bc2a3666dc7 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:14:16.410736 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-b267c6d5-fce7-46a2-b213-2bc2a3666dc7 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:14:16.411502 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-b267c6d5-fce7-46a2-b213-2bc2a3666dc7 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:14:16.411928 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-b267c6d5-fce7-46a2-b213-2bc2a3666dc7 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:14:16.539637 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.policy [None req-b267c6d5-fce7-46a2-b213-2bc2a3666dc7 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c4c0c82448e40ba801c0b52ec44e74a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a093d0bf43046aaa845f3cc115f3f5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116157) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:14:16.547471 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: INFO nova.api.openstack.requestlog [None req-b267c6d5-fce7-46a2-b213-2bc2a3666dc7 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] 10.222.0.18 "GET /compute/v2.1/servers/fa7c86bc-c46f-4120-8f3d-d795f8d7c5cc" status: 200 len: 1570 microversion: 2.1 time: 0.148441 Dec 15 03:14:16.548024 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: [pid: 116157|app: 0|req: 813/1627] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 03:14:16 2021] GET /compute/v2.1/servers/fa7c86bc-c46f-4120-8f3d-d795f8d7c5cc => generated 1570 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 03:14:17.017659 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi [None req-5b3be2ed-b388-48ea-8ba0-c02a7ecb48e7 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Calling method '>' {{(pid=116156) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:14:17.018312 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.compute.api [None req-5b3be2ed-b388-48ea-8ba0-c02a7ecb48e7 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] [instance: bbb8462c-9501-4541-b67e-43ec5c5061a7] Fetching instance by UUID {{(pid=116156) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:14:17.024533 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-5b3be2ed-b388-48ea-8ba0-c02a7ecb48e7 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:14:17.024989 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-5b3be2ed-b388-48ea-8ba0-c02a7ecb48e7 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:14:17.026429 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-5b3be2ed-b388-48ea-8ba0-c02a7ecb48e7 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:14:17.026869 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-5b3be2ed-b388-48ea-8ba0-c02a7ecb48e7 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:14:17.083744 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.policy [None req-5b3be2ed-b388-48ea-8ba0-c02a7ecb48e7 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97bdf19af9e34fc3886ff451cb9d7a27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '494b56bf5eae4d56a5591546f85bc32b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116156) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:14:17.091668 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: INFO nova.api.openstack.requestlog [None req-5b3be2ed-b388-48ea-8ba0-c02a7ecb48e7 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] 10.222.0.18 "GET /compute/v2.1/servers/bbb8462c-9501-4541-b67e-43ec5c5061a7" status: 200 len: 1226 microversion: 2.1 time: 0.077675 Dec 15 03:14:17.092235 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: [pid: 116156|app: 0|req: 815/1628] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 03:14:17 2021] GET /compute/v2.1/servers/bbb8462c-9501-4541-b67e-43ec5c5061a7 => generated 1226 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 03:14:17.564120 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi [None req-86caaaf0-4e66-4872-b4e3-2e6799334b53 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Calling method '>' {{(pid=116157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:14:17.564728 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.compute.api [None req-86caaaf0-4e66-4872-b4e3-2e6799334b53 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] [instance: fa7c86bc-c46f-4120-8f3d-d795f8d7c5cc] Fetching instance by UUID {{(pid=116157) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:14:17.570987 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-86caaaf0-4e66-4872-b4e3-2e6799334b53 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:14:17.571430 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-86caaaf0-4e66-4872-b4e3-2e6799334b53 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:14:17.572205 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-86caaaf0-4e66-4872-b4e3-2e6799334b53 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:14:17.572637 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-86caaaf0-4e66-4872-b4e3-2e6799334b53 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:14:17.703142 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.policy [None req-86caaaf0-4e66-4872-b4e3-2e6799334b53 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c4c0c82448e40ba801c0b52ec44e74a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a093d0bf43046aaa845f3cc115f3f5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116157) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:14:17.710220 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: INFO nova.api.openstack.requestlog [None req-86caaaf0-4e66-4872-b4e3-2e6799334b53 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] 10.222.0.18 "GET /compute/v2.1/servers/fa7c86bc-c46f-4120-8f3d-d795f8d7c5cc" status: 200 len: 1570 microversion: 2.1 time: 0.149718 Dec 15 03:14:17.710777 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: [pid: 116157|app: 0|req: 814/1629] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 03:14:17 2021] GET /compute/v2.1/servers/fa7c86bc-c46f-4120-8f3d-d795f8d7c5cc => generated 1570 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 03:14:18.108890 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi [None req-1bb93c99-634d-493d-b38c-d9d96a21489c tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Calling method '>' {{(pid=116156) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:14:18.109525 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.compute.api [None req-1bb93c99-634d-493d-b38c-d9d96a21489c tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] [instance: bbb8462c-9501-4541-b67e-43ec5c5061a7] Fetching instance by UUID {{(pid=116156) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:14:18.115921 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-1bb93c99-634d-493d-b38c-d9d96a21489c tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:14:18.116367 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-1bb93c99-634d-493d-b38c-d9d96a21489c tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:14:18.117138 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-1bb93c99-634d-493d-b38c-d9d96a21489c tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:14:18.117572 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-1bb93c99-634d-493d-b38c-d9d96a21489c tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:14:18.178486 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.policy [None req-1bb93c99-634d-493d-b38c-d9d96a21489c tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97bdf19af9e34fc3886ff451cb9d7a27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '494b56bf5eae4d56a5591546f85bc32b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116156) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:14:18.186300 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: INFO nova.api.openstack.requestlog [None req-1bb93c99-634d-493d-b38c-d9d96a21489c tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] 10.222.0.18 "GET /compute/v2.1/servers/bbb8462c-9501-4541-b67e-43ec5c5061a7" status: 200 len: 1226 microversion: 2.1 time: 0.081023 Dec 15 03:14:18.186861 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: [pid: 116156|app: 0|req: 816/1630] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 03:14:18 2021] GET /compute/v2.1/servers/bbb8462c-9501-4541-b67e-43ec5c5061a7 => generated 1226 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 03:14:18.727146 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi [None req-b02e627f-fb63-4fad-8c11-5a122b1ac8f8 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Calling method '>' {{(pid=116157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:14:18.727751 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.compute.api [None req-b02e627f-fb63-4fad-8c11-5a122b1ac8f8 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] [instance: fa7c86bc-c46f-4120-8f3d-d795f8d7c5cc] Fetching instance by UUID {{(pid=116157) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:14:18.734006 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-b02e627f-fb63-4fad-8c11-5a122b1ac8f8 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:14:18.734474 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-b02e627f-fb63-4fad-8c11-5a122b1ac8f8 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:14:18.735239 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-b02e627f-fb63-4fad-8c11-5a122b1ac8f8 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:14:18.735926 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-b02e627f-fb63-4fad-8c11-5a122b1ac8f8 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:14:18.864103 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.policy [None req-b02e627f-fb63-4fad-8c11-5a122b1ac8f8 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c4c0c82448e40ba801c0b52ec44e74a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a093d0bf43046aaa845f3cc115f3f5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116157) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:14:18.871927 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: INFO nova.api.openstack.requestlog [None req-b02e627f-fb63-4fad-8c11-5a122b1ac8f8 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] 10.222.0.18 "GET /compute/v2.1/servers/fa7c86bc-c46f-4120-8f3d-d795f8d7c5cc" status: 200 len: 1570 microversion: 2.1 time: 0.148730 Dec 15 03:14:18.872494 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: [pid: 116157|app: 0|req: 815/1631] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 03:14:18 2021] GET /compute/v2.1/servers/fa7c86bc-c46f-4120-8f3d-d795f8d7c5cc => generated 1570 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 03:14:19.203242 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi [None req-72510f49-b622-4836-9127-d8f6eea25428 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Calling method '>' {{(pid=116156) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:14:19.203859 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.compute.api [None req-72510f49-b622-4836-9127-d8f6eea25428 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] [instance: bbb8462c-9501-4541-b67e-43ec5c5061a7] Fetching instance by UUID {{(pid=116156) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:14:19.210500 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-72510f49-b622-4836-9127-d8f6eea25428 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:14:19.210869 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-72510f49-b622-4836-9127-d8f6eea25428 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:14:19.211659 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-72510f49-b622-4836-9127-d8f6eea25428 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:14:19.212097 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-72510f49-b622-4836-9127-d8f6eea25428 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:14:19.271227 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.policy [None req-72510f49-b622-4836-9127-d8f6eea25428 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97bdf19af9e34fc3886ff451cb9d7a27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '494b56bf5eae4d56a5591546f85bc32b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116156) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:14:19.278480 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: INFO nova.api.openstack.requestlog [None req-72510f49-b622-4836-9127-d8f6eea25428 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] 10.222.0.18 "GET /compute/v2.1/servers/bbb8462c-9501-4541-b67e-43ec5c5061a7" status: 200 len: 1226 microversion: 2.1 time: 0.078910 Dec 15 03:14:19.279042 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: [pid: 116156|app: 0|req: 817/1632] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 03:14:19 2021] GET /compute/v2.1/servers/bbb8462c-9501-4541-b67e-43ec5c5061a7 => generated 1226 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 03:14:19.888363 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi [None req-6b3c6db1-51fa-4a5e-8bed-867477779038 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Calling method '>' {{(pid=116157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:14:19.888974 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.compute.api [None req-6b3c6db1-51fa-4a5e-8bed-867477779038 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] [instance: fa7c86bc-c46f-4120-8f3d-d795f8d7c5cc] Fetching instance by UUID {{(pid=116157) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:14:19.895329 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-6b3c6db1-51fa-4a5e-8bed-867477779038 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:14:19.895780 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-6b3c6db1-51fa-4a5e-8bed-867477779038 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:14:19.896557 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-6b3c6db1-51fa-4a5e-8bed-867477779038 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:14:19.896995 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-6b3c6db1-51fa-4a5e-8bed-867477779038 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:14:20.027414 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.policy [None req-6b3c6db1-51fa-4a5e-8bed-867477779038 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c4c0c82448e40ba801c0b52ec44e74a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a093d0bf43046aaa845f3cc115f3f5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116157) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:14:20.034610 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: INFO nova.api.openstack.requestlog [None req-6b3c6db1-51fa-4a5e-8bed-867477779038 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] 10.222.0.18 "GET /compute/v2.1/servers/fa7c86bc-c46f-4120-8f3d-d795f8d7c5cc" status: 200 len: 1570 microversion: 2.1 time: 0.149886 Dec 15 03:14:20.035170 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: [pid: 116157|app: 0|req: 816/1633] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 03:14:19 2021] GET /compute/v2.1/servers/fa7c86bc-c46f-4120-8f3d-d795f8d7c5cc => generated 1570 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 03:14:20.295670 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi [None req-ee651341-6c4e-4583-8a55-0af67861a1bf tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Calling method '>' {{(pid=116156) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:14:20.296291 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.compute.api [None req-ee651341-6c4e-4583-8a55-0af67861a1bf tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] [instance: bbb8462c-9501-4541-b67e-43ec5c5061a7] Fetching instance by UUID {{(pid=116156) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:14:20.302680 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-ee651341-6c4e-4583-8a55-0af67861a1bf tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:14:20.303139 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-ee651341-6c4e-4583-8a55-0af67861a1bf tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:14:20.303922 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-ee651341-6c4e-4583-8a55-0af67861a1bf tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:14:20.304362 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-ee651341-6c4e-4583-8a55-0af67861a1bf tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:14:20.362057 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.policy [None req-ee651341-6c4e-4583-8a55-0af67861a1bf tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97bdf19af9e34fc3886ff451cb9d7a27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '494b56bf5eae4d56a5591546f85bc32b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116156) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:14:20.369183 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: INFO nova.api.openstack.requestlog [None req-ee651341-6c4e-4583-8a55-0af67861a1bf tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] 10.222.0.18 "GET /compute/v2.1/servers/bbb8462c-9501-4541-b67e-43ec5c5061a7" status: 200 len: 1226 microversion: 2.1 time: 0.077178 Dec 15 03:14:20.369744 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: [pid: 116156|app: 0|req: 818/1634] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 03:14:20 2021] GET /compute/v2.1/servers/bbb8462c-9501-4541-b67e-43ec5c5061a7 => generated 1226 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 03:14:21.051874 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi [None req-663fa457-2352-405b-bc29-8ed0b7f3c531 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Calling method '>' {{(pid=116157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:14:21.052476 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.compute.api [None req-663fa457-2352-405b-bc29-8ed0b7f3c531 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] [instance: fa7c86bc-c46f-4120-8f3d-d795f8d7c5cc] Fetching instance by UUID {{(pid=116157) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:14:21.058760 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-663fa457-2352-405b-bc29-8ed0b7f3c531 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:14:21.059208 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-663fa457-2352-405b-bc29-8ed0b7f3c531 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:14:21.059978 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-663fa457-2352-405b-bc29-8ed0b7f3c531 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:14:21.060411 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-663fa457-2352-405b-bc29-8ed0b7f3c531 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:14:21.187361 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.policy [None req-663fa457-2352-405b-bc29-8ed0b7f3c531 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c4c0c82448e40ba801c0b52ec44e74a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a093d0bf43046aaa845f3cc115f3f5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116157) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:14:21.194537 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: INFO nova.api.openstack.requestlog [None req-663fa457-2352-405b-bc29-8ed0b7f3c531 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] 10.222.0.18 "GET /compute/v2.1/servers/fa7c86bc-c46f-4120-8f3d-d795f8d7c5cc" status: 200 len: 1570 microversion: 2.1 time: 0.146283 Dec 15 03:14:21.195100 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: [pid: 116157|app: 0|req: 817/1635] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 03:14:21 2021] GET /compute/v2.1/servers/fa7c86bc-c46f-4120-8f3d-d795f8d7c5cc => generated 1570 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 03:14:21.386247 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi [None req-631cfada-9bf1-4bb4-9930-79b617e8de81 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Calling method '>' {{(pid=116156) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:14:21.386799 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.compute.api [None req-631cfada-9bf1-4bb4-9930-79b617e8de81 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] [instance: bbb8462c-9501-4541-b67e-43ec5c5061a7] Fetching instance by UUID {{(pid=116156) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:14:21.393001 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-631cfada-9bf1-4bb4-9930-79b617e8de81 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:14:21.393462 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-631cfada-9bf1-4bb4-9930-79b617e8de81 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:14:21.394271 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-631cfada-9bf1-4bb4-9930-79b617e8de81 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:14:21.394711 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-631cfada-9bf1-4bb4-9930-79b617e8de81 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:14:21.452888 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.policy [None req-631cfada-9bf1-4bb4-9930-79b617e8de81 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97bdf19af9e34fc3886ff451cb9d7a27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '494b56bf5eae4d56a5591546f85bc32b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116156) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:14:21.460303 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: INFO nova.api.openstack.requestlog [None req-631cfada-9bf1-4bb4-9930-79b617e8de81 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] 10.222.0.18 "GET /compute/v2.1/servers/bbb8462c-9501-4541-b67e-43ec5c5061a7" status: 200 len: 1226 microversion: 2.1 time: 0.078265 Dec 15 03:14:21.460856 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: [pid: 116156|app: 0|req: 819/1636] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 03:14:21 2021] GET /compute/v2.1/servers/bbb8462c-9501-4541-b67e-43ec5c5061a7 => generated 1226 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 03:14:22.212164 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi [None req-3c836c09-5a1b-4e67-b9b3-849c2dc59fd6 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Calling method '>' {{(pid=116157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:14:22.212803 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.compute.api [None req-3c836c09-5a1b-4e67-b9b3-849c2dc59fd6 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] [instance: fa7c86bc-c46f-4120-8f3d-d795f8d7c5cc] Fetching instance by UUID {{(pid=116157) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:14:22.219045 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-3c836c09-5a1b-4e67-b9b3-849c2dc59fd6 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:14:22.219492 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-3c836c09-5a1b-4e67-b9b3-849c2dc59fd6 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:14:22.220263 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-3c836c09-5a1b-4e67-b9b3-849c2dc59fd6 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:14:22.220691 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-3c836c09-5a1b-4e67-b9b3-849c2dc59fd6 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:14:22.348207 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.policy [None req-3c836c09-5a1b-4e67-b9b3-849c2dc59fd6 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c4c0c82448e40ba801c0b52ec44e74a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a093d0bf43046aaa845f3cc115f3f5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116157) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:14:22.355843 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: INFO nova.api.openstack.requestlog [None req-3c836c09-5a1b-4e67-b9b3-849c2dc59fd6 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] 10.222.0.18 "GET /compute/v2.1/servers/fa7c86bc-c46f-4120-8f3d-d795f8d7c5cc" status: 200 len: 1570 microversion: 2.1 time: 0.147329 Dec 15 03:14:22.356399 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: [pid: 116157|app: 0|req: 818/1637] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 03:14:22 2021] GET /compute/v2.1/servers/fa7c86bc-c46f-4120-8f3d-d795f8d7c5cc => generated 1570 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 03:14:22.476794 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi [None req-b36da8b4-9041-4187-b38b-feab4dc7fd95 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Calling method '>' {{(pid=116156) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:14:22.477335 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.compute.api [None req-b36da8b4-9041-4187-b38b-feab4dc7fd95 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] [instance: bbb8462c-9501-4541-b67e-43ec5c5061a7] Fetching instance by UUID {{(pid=116156) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:14:22.484346 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-b36da8b4-9041-4187-b38b-feab4dc7fd95 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:14:22.484798 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-b36da8b4-9041-4187-b38b-feab4dc7fd95 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:14:22.485833 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-b36da8b4-9041-4187-b38b-feab4dc7fd95 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:14:22.486295 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-b36da8b4-9041-4187-b38b-feab4dc7fd95 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:14:22.544331 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.policy [None req-b36da8b4-9041-4187-b38b-feab4dc7fd95 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97bdf19af9e34fc3886ff451cb9d7a27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '494b56bf5eae4d56a5591546f85bc32b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116156) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:14:22.551317 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: INFO nova.api.openstack.requestlog [None req-b36da8b4-9041-4187-b38b-feab4dc7fd95 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] 10.222.0.18 "GET /compute/v2.1/servers/bbb8462c-9501-4541-b67e-43ec5c5061a7" status: 200 len: 1226 microversion: 2.1 time: 0.078211 Dec 15 03:14:22.551892 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: [pid: 116156|app: 0|req: 820/1638] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 03:14:22 2021] GET /compute/v2.1/servers/bbb8462c-9501-4541-b67e-43ec5c5061a7 => generated 1226 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 03:14:23.373036 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi [None req-a6d50455-7045-410a-baa4-05c82e18e0a1 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Calling method '>' {{(pid=116157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:14:23.373643 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.compute.api [None req-a6d50455-7045-410a-baa4-05c82e18e0a1 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] [instance: fa7c86bc-c46f-4120-8f3d-d795f8d7c5cc] Fetching instance by UUID {{(pid=116157) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:14:23.379863 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-a6d50455-7045-410a-baa4-05c82e18e0a1 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:14:23.380312 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-a6d50455-7045-410a-baa4-05c82e18e0a1 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:14:23.381076 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-a6d50455-7045-410a-baa4-05c82e18e0a1 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:14:23.381511 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-a6d50455-7045-410a-baa4-05c82e18e0a1 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:14:23.515663 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.policy [None req-a6d50455-7045-410a-baa4-05c82e18e0a1 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c4c0c82448e40ba801c0b52ec44e74a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a093d0bf43046aaa845f3cc115f3f5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116157) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:14:23.522926 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: INFO nova.api.openstack.requestlog [None req-a6d50455-7045-410a-baa4-05c82e18e0a1 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] 10.222.0.18 "GET /compute/v2.1/servers/fa7c86bc-c46f-4120-8f3d-d795f8d7c5cc" status: 200 len: 1570 microversion: 2.1 time: 0.153999 Dec 15 03:14:23.523489 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: [pid: 116157|app: 0|req: 819/1639] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 03:14:23 2021] GET /compute/v2.1/servers/fa7c86bc-c46f-4120-8f3d-d795f8d7c5cc => generated 1570 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 03:14:23.567853 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi [None req-3683b44b-8bb6-4a8f-88b5-53a8e8c29ec8 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Calling method '>' {{(pid=116156) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:14:23.568457 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.compute.api [None req-3683b44b-8bb6-4a8f-88b5-53a8e8c29ec8 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] [instance: bbb8462c-9501-4541-b67e-43ec5c5061a7] Fetching instance by UUID {{(pid=116156) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:14:23.574659 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-3683b44b-8bb6-4a8f-88b5-53a8e8c29ec8 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:14:23.575108 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-3683b44b-8bb6-4a8f-88b5-53a8e8c29ec8 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:14:23.575903 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-3683b44b-8bb6-4a8f-88b5-53a8e8c29ec8 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:14:23.576333 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-3683b44b-8bb6-4a8f-88b5-53a8e8c29ec8 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:14:23.634251 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.policy [None req-3683b44b-8bb6-4a8f-88b5-53a8e8c29ec8 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97bdf19af9e34fc3886ff451cb9d7a27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '494b56bf5eae4d56a5591546f85bc32b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116156) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:14:23.641392 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: INFO nova.api.openstack.requestlog [None req-3683b44b-8bb6-4a8f-88b5-53a8e8c29ec8 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] 10.222.0.18 "GET /compute/v2.1/servers/bbb8462c-9501-4541-b67e-43ec5c5061a7" status: 200 len: 1226 microversion: 2.1 time: 0.077127 Dec 15 03:14:23.641943 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: [pid: 116156|app: 0|req: 821/1640] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 03:14:23 2021] GET /compute/v2.1/servers/bbb8462c-9501-4541-b67e-43ec5c5061a7 => generated 1226 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 03:14:24.539838 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi [None req-58d731d3-cfd8-4c0f-9463-d238276e5e17 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Calling method '>' {{(pid=116157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:14:24.540481 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.compute.api [None req-58d731d3-cfd8-4c0f-9463-d238276e5e17 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] [instance: fa7c86bc-c46f-4120-8f3d-d795f8d7c5cc] Fetching instance by UUID {{(pid=116157) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:14:24.547345 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-58d731d3-cfd8-4c0f-9463-d238276e5e17 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:14:24.547812 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-58d731d3-cfd8-4c0f-9463-d238276e5e17 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:14:24.548614 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-58d731d3-cfd8-4c0f-9463-d238276e5e17 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:14:24.549048 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-58d731d3-cfd8-4c0f-9463-d238276e5e17 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:14:24.657969 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi [None req-20205bb7-2ca2-485d-bba3-57b33c8d2315 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Calling method '>' {{(pid=116156) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:14:24.658617 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.compute.api [None req-20205bb7-2ca2-485d-bba3-57b33c8d2315 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] [instance: bbb8462c-9501-4541-b67e-43ec5c5061a7] Fetching instance by UUID {{(pid=116156) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:14:24.664842 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-20205bb7-2ca2-485d-bba3-57b33c8d2315 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:14:24.665381 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-20205bb7-2ca2-485d-bba3-57b33c8d2315 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:14:24.666834 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-20205bb7-2ca2-485d-bba3-57b33c8d2315 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:14:24.667290 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-20205bb7-2ca2-485d-bba3-57b33c8d2315 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:14:24.678351 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.policy [None req-58d731d3-cfd8-4c0f-9463-d238276e5e17 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c4c0c82448e40ba801c0b52ec44e74a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a093d0bf43046aaa845f3cc115f3f5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116157) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:14:24.685550 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: INFO nova.api.openstack.requestlog [None req-58d731d3-cfd8-4c0f-9463-d238276e5e17 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] 10.222.0.18 "GET /compute/v2.1/servers/fa7c86bc-c46f-4120-8f3d-d795f8d7c5cc" status: 200 len: 1570 microversion: 2.1 time: 0.149324 Dec 15 03:14:24.686407 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: [pid: 116157|app: 0|req: 820/1641] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 03:14:24 2021] GET /compute/v2.1/servers/fa7c86bc-c46f-4120-8f3d-d795f8d7c5cc => generated 1570 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 03:14:24.726483 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.policy [None req-20205bb7-2ca2-485d-bba3-57b33c8d2315 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97bdf19af9e34fc3886ff451cb9d7a27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '494b56bf5eae4d56a5591546f85bc32b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116156) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:14:24.734325 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: INFO nova.api.openstack.requestlog [None req-20205bb7-2ca2-485d-bba3-57b33c8d2315 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] 10.222.0.18 "GET /compute/v2.1/servers/bbb8462c-9501-4541-b67e-43ec5c5061a7" status: 200 len: 1226 microversion: 2.1 time: 0.080039 Dec 15 03:14:24.734883 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: [pid: 116156|app: 0|req: 822/1642] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 03:14:24 2021] GET /compute/v2.1/servers/bbb8462c-9501-4541-b67e-43ec5c5061a7 => generated 1226 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 03:14:25.702491 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi [None req-87a5b2b0-cad2-46ae-9fae-64b26b5f1e77 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Calling method '>' {{(pid=116157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:14:25.703098 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.compute.api [None req-87a5b2b0-cad2-46ae-9fae-64b26b5f1e77 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] [instance: fa7c86bc-c46f-4120-8f3d-d795f8d7c5cc] Fetching instance by UUID {{(pid=116157) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:14:25.709269 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-87a5b2b0-cad2-46ae-9fae-64b26b5f1e77 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:14:25.709714 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-87a5b2b0-cad2-46ae-9fae-64b26b5f1e77 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:14:25.710513 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-87a5b2b0-cad2-46ae-9fae-64b26b5f1e77 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:14:25.710945 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-87a5b2b0-cad2-46ae-9fae-64b26b5f1e77 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:14:25.751505 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi [None req-ec4f2eb0-5056-4bef-8098-4688c9bc0024 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Calling method '>' {{(pid=116156) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:14:25.752147 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.compute.api [None req-ec4f2eb0-5056-4bef-8098-4688c9bc0024 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] [instance: bbb8462c-9501-4541-b67e-43ec5c5061a7] Fetching instance by UUID {{(pid=116156) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:14:25.758394 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-ec4f2eb0-5056-4bef-8098-4688c9bc0024 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:14:25.758841 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-ec4f2eb0-5056-4bef-8098-4688c9bc0024 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:14:25.759613 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-ec4f2eb0-5056-4bef-8098-4688c9bc0024 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:14:25.760046 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-ec4f2eb0-5056-4bef-8098-4688c9bc0024 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:14:25.822941 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.policy [None req-ec4f2eb0-5056-4bef-8098-4688c9bc0024 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97bdf19af9e34fc3886ff451cb9d7a27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '494b56bf5eae4d56a5591546f85bc32b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116156) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:14:25.830582 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: INFO nova.api.openstack.requestlog [None req-ec4f2eb0-5056-4bef-8098-4688c9bc0024 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] 10.222.0.18 "GET /compute/v2.1/servers/bbb8462c-9501-4541-b67e-43ec5c5061a7" status: 200 len: 1226 microversion: 2.1 time: 0.082565 Dec 15 03:14:25.831373 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: [pid: 116156|app: 0|req: 823/1643] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 03:14:25 2021] GET /compute/v2.1/servers/bbb8462c-9501-4541-b67e-43ec5c5061a7 => generated 1226 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 03:14:25.845611 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.policy [None req-87a5b2b0-cad2-46ae-9fae-64b26b5f1e77 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c4c0c82448e40ba801c0b52ec44e74a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a093d0bf43046aaa845f3cc115f3f5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116157) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:14:25.852817 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: INFO nova.api.openstack.requestlog [None req-87a5b2b0-cad2-46ae-9fae-64b26b5f1e77 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] 10.222.0.18 "GET /compute/v2.1/servers/fa7c86bc-c46f-4120-8f3d-d795f8d7c5cc" status: 200 len: 1570 microversion: 2.1 time: 0.154633 Dec 15 03:14:25.853372 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: [pid: 116157|app: 0|req: 821/1644] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 03:14:25 2021] GET /compute/v2.1/servers/fa7c86bc-c46f-4120-8f3d-d795f8d7c5cc => generated 1570 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 03:14:26.846995 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi [None req-c2f81e2e-6527-44d1-aae6-c57043b63743 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Calling method '>' {{(pid=116156) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:14:26.847605 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.compute.api [None req-c2f81e2e-6527-44d1-aae6-c57043b63743 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] [instance: bbb8462c-9501-4541-b67e-43ec5c5061a7] Fetching instance by UUID {{(pid=116156) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:14:26.853999 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-c2f81e2e-6527-44d1-aae6-c57043b63743 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:14:26.855024 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-c2f81e2e-6527-44d1-aae6-c57043b63743 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:14:26.855789 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-c2f81e2e-6527-44d1-aae6-c57043b63743 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:14:26.856224 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-c2f81e2e-6527-44d1-aae6-c57043b63743 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:14:26.870177 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi [None req-3c8cb27e-bc98-4135-9f6c-e4b012a1e424 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Calling method '>' {{(pid=116157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:14:26.870790 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.compute.api [None req-3c8cb27e-bc98-4135-9f6c-e4b012a1e424 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] [instance: fa7c86bc-c46f-4120-8f3d-d795f8d7c5cc] Fetching instance by UUID {{(pid=116157) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:14:26.876912 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-3c8cb27e-bc98-4135-9f6c-e4b012a1e424 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:14:26.877384 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-3c8cb27e-bc98-4135-9f6c-e4b012a1e424 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:14:26.878265 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-3c8cb27e-bc98-4135-9f6c-e4b012a1e424 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:14:26.878697 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-3c8cb27e-bc98-4135-9f6c-e4b012a1e424 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:14:26.914533 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.policy [None req-c2f81e2e-6527-44d1-aae6-c57043b63743 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97bdf19af9e34fc3886ff451cb9d7a27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '494b56bf5eae4d56a5591546f85bc32b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116156) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:14:26.922550 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: INFO nova.api.openstack.requestlog [None req-c2f81e2e-6527-44d1-aae6-c57043b63743 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] 10.222.0.18 "GET /compute/v2.1/servers/bbb8462c-9501-4541-b67e-43ec5c5061a7" status: 200 len: 1226 microversion: 2.1 time: 0.079154 Dec 15 03:14:26.923108 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: [pid: 116156|app: 0|req: 824/1645] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 03:14:26 2021] GET /compute/v2.1/servers/bbb8462c-9501-4541-b67e-43ec5c5061a7 => generated 1226 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 03:14:27.007733 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.policy [None req-3c8cb27e-bc98-4135-9f6c-e4b012a1e424 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c4c0c82448e40ba801c0b52ec44e74a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a093d0bf43046aaa845f3cc115f3f5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116157) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:14:27.014953 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: INFO nova.api.openstack.requestlog [None req-3c8cb27e-bc98-4135-9f6c-e4b012a1e424 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] 10.222.0.18 "GET /compute/v2.1/servers/fa7c86bc-c46f-4120-8f3d-d795f8d7c5cc" status: 200 len: 1570 microversion: 2.1 time: 0.148505 Dec 15 03:14:27.015526 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: [pid: 116157|app: 0|req: 822/1646] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 03:14:26 2021] GET /compute/v2.1/servers/fa7c86bc-c46f-4120-8f3d-d795f8d7c5cc => generated 1570 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 03:14:27.939531 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi [None req-9e019574-0698-4a47-b783-ea35752437e0 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Calling method '>' {{(pid=116156) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:14:27.940136 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.compute.api [None req-9e019574-0698-4a47-b783-ea35752437e0 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] [instance: bbb8462c-9501-4541-b67e-43ec5c5061a7] Fetching instance by UUID {{(pid=116156) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:14:27.946373 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-9e019574-0698-4a47-b783-ea35752437e0 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:14:27.946822 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-9e019574-0698-4a47-b783-ea35752437e0 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:14:27.947591 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-9e019574-0698-4a47-b783-ea35752437e0 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:14:27.948638 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-9e019574-0698-4a47-b783-ea35752437e0 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:14:28.006821 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.policy [None req-9e019574-0698-4a47-b783-ea35752437e0 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97bdf19af9e34fc3886ff451cb9d7a27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '494b56bf5eae4d56a5591546f85bc32b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116156) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:14:28.014039 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: INFO nova.api.openstack.requestlog [None req-9e019574-0698-4a47-b783-ea35752437e0 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] 10.222.0.18 "GET /compute/v2.1/servers/bbb8462c-9501-4541-b67e-43ec5c5061a7" status: 200 len: 1226 microversion: 2.1 time: 0.078421 Dec 15 03:14:28.014605 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: [pid: 116156|app: 0|req: 825/1647] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 03:14:27 2021] GET /compute/v2.1/servers/bbb8462c-9501-4541-b67e-43ec5c5061a7 => generated 1226 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 03:14:28.031552 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi [None req-76ad29f8-7da7-457e-a3fe-be43668bd835 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Calling method '>' {{(pid=116157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:14:28.032167 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.compute.api [None req-76ad29f8-7da7-457e-a3fe-be43668bd835 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] [instance: fa7c86bc-c46f-4120-8f3d-d795f8d7c5cc] Fetching instance by UUID {{(pid=116157) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:14:28.038404 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-76ad29f8-7da7-457e-a3fe-be43668bd835 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:14:28.038855 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-76ad29f8-7da7-457e-a3fe-be43668bd835 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:14:28.039642 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-76ad29f8-7da7-457e-a3fe-be43668bd835 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:14:28.040078 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-76ad29f8-7da7-457e-a3fe-be43668bd835 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:14:28.173056 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.policy [None req-76ad29f8-7da7-457e-a3fe-be43668bd835 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c4c0c82448e40ba801c0b52ec44e74a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a093d0bf43046aaa845f3cc115f3f5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116157) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:14:28.180258 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: INFO nova.api.openstack.requestlog [None req-76ad29f8-7da7-457e-a3fe-be43668bd835 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] 10.222.0.18 "GET /compute/v2.1/servers/fa7c86bc-c46f-4120-8f3d-d795f8d7c5cc" status: 200 len: 1570 microversion: 2.1 time: 0.152320 Dec 15 03:14:28.180823 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: [pid: 116157|app: 0|req: 823/1648] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 03:14:28 2021] GET /compute/v2.1/servers/fa7c86bc-c46f-4120-8f3d-d795f8d7c5cc => generated 1570 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 03:14:29.031128 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi [None req-e729ba71-4f4d-40c3-a45c-eb627a435496 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Calling method '>' {{(pid=116156) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:14:29.031712 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.compute.api [None req-e729ba71-4f4d-40c3-a45c-eb627a435496 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] [instance: bbb8462c-9501-4541-b67e-43ec5c5061a7] Fetching instance by UUID {{(pid=116156) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:14:29.037945 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-e729ba71-4f4d-40c3-a45c-eb627a435496 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:14:29.038423 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-e729ba71-4f4d-40c3-a45c-eb627a435496 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:14:29.039194 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-e729ba71-4f4d-40c3-a45c-eb627a435496 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:14:29.039625 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-e729ba71-4f4d-40c3-a45c-eb627a435496 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:14:29.096881 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.policy [None req-e729ba71-4f4d-40c3-a45c-eb627a435496 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97bdf19af9e34fc3886ff451cb9d7a27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '494b56bf5eae4d56a5591546f85bc32b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116156) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:14:29.103932 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: INFO nova.api.openstack.requestlog [None req-e729ba71-4f4d-40c3-a45c-eb627a435496 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] 10.222.0.18 "GET /compute/v2.1/servers/bbb8462c-9501-4541-b67e-43ec5c5061a7" status: 200 len: 1226 microversion: 2.1 time: 0.076452 Dec 15 03:14:29.104543 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: [pid: 116156|app: 0|req: 826/1649] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 03:14:29 2021] GET /compute/v2.1/servers/bbb8462c-9501-4541-b67e-43ec5c5061a7 => generated 1226 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 03:14:29.197675 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi [None req-dec971cc-5a76-46c4-abfa-b0bffd9bf974 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Calling method '>' {{(pid=116157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:14:29.199408 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.compute.api [None req-dec971cc-5a76-46c4-abfa-b0bffd9bf974 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] [instance: fa7c86bc-c46f-4120-8f3d-d795f8d7c5cc] Fetching instance by UUID {{(pid=116157) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:14:29.205674 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-dec971cc-5a76-46c4-abfa-b0bffd9bf974 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:14:29.206161 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-dec971cc-5a76-46c4-abfa-b0bffd9bf974 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:14:29.206947 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-dec971cc-5a76-46c4-abfa-b0bffd9bf974 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:14:29.207386 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-dec971cc-5a76-46c4-abfa-b0bffd9bf974 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:14:29.335572 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.policy [None req-dec971cc-5a76-46c4-abfa-b0bffd9bf974 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c4c0c82448e40ba801c0b52ec44e74a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a093d0bf43046aaa845f3cc115f3f5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116157) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:14:29.342772 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: INFO nova.api.openstack.requestlog [None req-dec971cc-5a76-46c4-abfa-b0bffd9bf974 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] 10.222.0.18 "GET /compute/v2.1/servers/fa7c86bc-c46f-4120-8f3d-d795f8d7c5cc" status: 200 len: 1570 microversion: 2.1 time: 0.148787 Dec 15 03:14:29.343326 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: [pid: 116157|app: 0|req: 824/1650] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 03:14:29 2021] GET /compute/v2.1/servers/fa7c86bc-c46f-4120-8f3d-d795f8d7c5cc => generated 1570 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 03:14:30.120835 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi [None req-2db8be9b-74b4-4485-b3f5-2a5422db69cd tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Calling method '>' {{(pid=116156) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:14:30.121372 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.compute.api [None req-2db8be9b-74b4-4485-b3f5-2a5422db69cd tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] [instance: bbb8462c-9501-4541-b67e-43ec5c5061a7] Fetching instance by UUID {{(pid=116156) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:14:30.127580 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-2db8be9b-74b4-4485-b3f5-2a5422db69cd tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:14:30.128023 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-2db8be9b-74b4-4485-b3f5-2a5422db69cd tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:14:30.128791 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-2db8be9b-74b4-4485-b3f5-2a5422db69cd tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:14:30.129223 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-2db8be9b-74b4-4485-b3f5-2a5422db69cd tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:14:30.186666 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.policy [None req-2db8be9b-74b4-4485-b3f5-2a5422db69cd tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97bdf19af9e34fc3886ff451cb9d7a27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '494b56bf5eae4d56a5591546f85bc32b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116156) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:14:30.193704 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: INFO nova.api.openstack.requestlog [None req-2db8be9b-74b4-4485-b3f5-2a5422db69cd tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] 10.222.0.18 "GET /compute/v2.1/servers/bbb8462c-9501-4541-b67e-43ec5c5061a7" status: 200 len: 1226 microversion: 2.1 time: 0.077071 Dec 15 03:14:30.194290 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: [pid: 116156|app: 0|req: 827/1651] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 03:14:30 2021] GET /compute/v2.1/servers/bbb8462c-9501-4541-b67e-43ec5c5061a7 => generated 1226 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 03:14:30.360044 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi [None req-4ae87d29-4b9d-43e0-b69f-6b1710dd2921 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Calling method '>' {{(pid=116157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:14:30.360909 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.compute.api [None req-4ae87d29-4b9d-43e0-b69f-6b1710dd2921 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] [instance: fa7c86bc-c46f-4120-8f3d-d795f8d7c5cc] Fetching instance by UUID {{(pid=116157) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:14:30.367126 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-4ae87d29-4b9d-43e0-b69f-6b1710dd2921 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:14:30.367577 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-4ae87d29-4b9d-43e0-b69f-6b1710dd2921 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:14:30.368354 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-4ae87d29-4b9d-43e0-b69f-6b1710dd2921 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:14:30.368791 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-4ae87d29-4b9d-43e0-b69f-6b1710dd2921 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:14:30.496866 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.policy [None req-4ae87d29-4b9d-43e0-b69f-6b1710dd2921 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c4c0c82448e40ba801c0b52ec44e74a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a093d0bf43046aaa845f3cc115f3f5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116157) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:14:30.504103 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: INFO nova.api.openstack.requestlog [None req-4ae87d29-4b9d-43e0-b69f-6b1710dd2921 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] 10.222.0.18 "GET /compute/v2.1/servers/fa7c86bc-c46f-4120-8f3d-d795f8d7c5cc" status: 200 len: 1570 microversion: 2.1 time: 0.147719 Dec 15 03:14:30.504671 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: [pid: 116157|app: 0|req: 825/1652] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 03:14:30 2021] GET /compute/v2.1/servers/fa7c86bc-c46f-4120-8f3d-d795f8d7c5cc => generated 1570 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 03:14:31.210389 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi [None req-793f5461-1576-4e7c-abb7-ff91c753519e tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Calling method '>' {{(pid=116156) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:14:31.210996 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.compute.api [None req-793f5461-1576-4e7c-abb7-ff91c753519e tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] [instance: bbb8462c-9501-4541-b67e-43ec5c5061a7] Fetching instance by UUID {{(pid=116156) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:14:31.217817 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-793f5461-1576-4e7c-abb7-ff91c753519e tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:14:31.218297 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-793f5461-1576-4e7c-abb7-ff91c753519e tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:14:31.219078 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-793f5461-1576-4e7c-abb7-ff91c753519e tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:14:31.219510 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-793f5461-1576-4e7c-abb7-ff91c753519e tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:14:31.278331 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.policy [None req-793f5461-1576-4e7c-abb7-ff91c753519e tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97bdf19af9e34fc3886ff451cb9d7a27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '494b56bf5eae4d56a5591546f85bc32b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116156) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:14:31.285577 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: INFO nova.api.openstack.requestlog [None req-793f5461-1576-4e7c-abb7-ff91c753519e tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] 10.222.0.18 "GET /compute/v2.1/servers/bbb8462c-9501-4541-b67e-43ec5c5061a7" status: 200 len: 1226 microversion: 2.1 time: 0.078801 Dec 15 03:14:31.286174 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: [pid: 116156|app: 0|req: 828/1653] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 03:14:31 2021] GET /compute/v2.1/servers/bbb8462c-9501-4541-b67e-43ec5c5061a7 => generated 1226 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 03:14:31.520443 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi [None req-cb57d4d1-1a31-49c6-8361-7989cb8884c1 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Calling method '>' {{(pid=116157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:14:31.520978 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.compute.api [None req-cb57d4d1-1a31-49c6-8361-7989cb8884c1 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] [instance: fa7c86bc-c46f-4120-8f3d-d795f8d7c5cc] Fetching instance by UUID {{(pid=116157) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:14:31.527408 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-cb57d4d1-1a31-49c6-8361-7989cb8884c1 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:14:31.527856 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-cb57d4d1-1a31-49c6-8361-7989cb8884c1 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:14:31.528667 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-cb57d4d1-1a31-49c6-8361-7989cb8884c1 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:14:31.529115 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-cb57d4d1-1a31-49c6-8361-7989cb8884c1 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:14:31.660408 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.policy [None req-cb57d4d1-1a31-49c6-8361-7989cb8884c1 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c4c0c82448e40ba801c0b52ec44e74a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a093d0bf43046aaa845f3cc115f3f5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116157) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:14:31.667610 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: INFO nova.api.openstack.requestlog [None req-cb57d4d1-1a31-49c6-8361-7989cb8884c1 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] 10.222.0.18 "GET /compute/v2.1/servers/fa7c86bc-c46f-4120-8f3d-d795f8d7c5cc" status: 200 len: 1570 microversion: 2.1 time: 0.150941 Dec 15 03:14:31.668164 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: [pid: 116157|app: 0|req: 826/1654] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 03:14:31 2021] GET /compute/v2.1/servers/fa7c86bc-c46f-4120-8f3d-d795f8d7c5cc => generated 1570 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 03:14:32.302153 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi [None req-d107db2a-0ba1-494b-b54c-721c3a55f234 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Calling method '>' {{(pid=116156) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:14:32.302772 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.compute.api [None req-d107db2a-0ba1-494b-b54c-721c3a55f234 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] [instance: bbb8462c-9501-4541-b67e-43ec5c5061a7] Fetching instance by UUID {{(pid=116156) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:14:32.309532 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-d107db2a-0ba1-494b-b54c-721c3a55f234 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:14:32.309970 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-d107db2a-0ba1-494b-b54c-721c3a55f234 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:14:32.310773 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-d107db2a-0ba1-494b-b54c-721c3a55f234 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:14:32.311214 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-d107db2a-0ba1-494b-b54c-721c3a55f234 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:14:32.372283 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.policy [None req-d107db2a-0ba1-494b-b54c-721c3a55f234 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97bdf19af9e34fc3886ff451cb9d7a27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '494b56bf5eae4d56a5591546f85bc32b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116156) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:14:32.379479 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: INFO nova.api.openstack.requestlog [None req-d107db2a-0ba1-494b-b54c-721c3a55f234 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] 10.222.0.18 "GET /compute/v2.1/servers/bbb8462c-9501-4541-b67e-43ec5c5061a7" status: 200 len: 1226 microversion: 2.1 time: 0.081005 Dec 15 03:14:32.380035 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: [pid: 116156|app: 0|req: 829/1655] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 03:14:32 2021] GET /compute/v2.1/servers/bbb8462c-9501-4541-b67e-43ec5c5061a7 => generated 1226 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 03:14:32.684936 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi [None req-56646980-818c-4788-88ab-972c37447533 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Calling method '>' {{(pid=116157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:14:32.685553 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.compute.api [None req-56646980-818c-4788-88ab-972c37447533 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] [instance: fa7c86bc-c46f-4120-8f3d-d795f8d7c5cc] Fetching instance by UUID {{(pid=116157) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:14:32.691860 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-56646980-818c-4788-88ab-972c37447533 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:14:32.692312 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-56646980-818c-4788-88ab-972c37447533 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:14:32.693089 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-56646980-818c-4788-88ab-972c37447533 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:14:32.693562 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-56646980-818c-4788-88ab-972c37447533 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:14:32.820223 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.policy [None req-56646980-818c-4788-88ab-972c37447533 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c4c0c82448e40ba801c0b52ec44e74a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a093d0bf43046aaa845f3cc115f3f5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116157) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:14:32.827340 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: INFO nova.api.openstack.requestlog [None req-56646980-818c-4788-88ab-972c37447533 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] 10.222.0.18 "GET /compute/v2.1/servers/fa7c86bc-c46f-4120-8f3d-d795f8d7c5cc" status: 200 len: 1570 microversion: 2.1 time: 0.146724 Dec 15 03:14:32.827900 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: [pid: 116157|app: 0|req: 827/1656] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 03:14:32 2021] GET /compute/v2.1/servers/fa7c86bc-c46f-4120-8f3d-d795f8d7c5cc => generated 1570 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 03:14:33.396739 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi [None req-6318ac12-dbf2-40a6-9354-7dbe14976e5f tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Calling method '>' {{(pid=116156) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:14:33.397355 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.compute.api [None req-6318ac12-dbf2-40a6-9354-7dbe14976e5f tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] [instance: bbb8462c-9501-4541-b67e-43ec5c5061a7] Fetching instance by UUID {{(pid=116156) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:14:33.404252 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-6318ac12-dbf2-40a6-9354-7dbe14976e5f tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:14:33.404712 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-6318ac12-dbf2-40a6-9354-7dbe14976e5f tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:14:33.405495 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-6318ac12-dbf2-40a6-9354-7dbe14976e5f tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:14:33.405933 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-6318ac12-dbf2-40a6-9354-7dbe14976e5f tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:14:33.462548 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.policy [None req-6318ac12-dbf2-40a6-9354-7dbe14976e5f tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97bdf19af9e34fc3886ff451cb9d7a27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '494b56bf5eae4d56a5591546f85bc32b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116156) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:14:33.470250 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: INFO nova.api.openstack.requestlog [None req-6318ac12-dbf2-40a6-9354-7dbe14976e5f tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] 10.222.0.18 "GET /compute/v2.1/servers/bbb8462c-9501-4541-b67e-43ec5c5061a7" status: 200 len: 1226 microversion: 2.1 time: 0.077140 Dec 15 03:14:33.470813 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: [pid: 116156|app: 0|req: 830/1657] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 03:14:33 2021] GET /compute/v2.1/servers/bbb8462c-9501-4541-b67e-43ec5c5061a7 => generated 1226 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 03:14:33.844063 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi [None req-bfac081e-aad9-42de-9c74-7c950b276ecb tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Calling method '>' {{(pid=116157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:14:33.844666 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.compute.api [None req-bfac081e-aad9-42de-9c74-7c950b276ecb tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] [instance: fa7c86bc-c46f-4120-8f3d-d795f8d7c5cc] Fetching instance by UUID {{(pid=116157) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:14:33.850828 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-bfac081e-aad9-42de-9c74-7c950b276ecb tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:14:33.851273 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-bfac081e-aad9-42de-9c74-7c950b276ecb tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:14:33.852043 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-bfac081e-aad9-42de-9c74-7c950b276ecb tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:14:33.852475 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-bfac081e-aad9-42de-9c74-7c950b276ecb tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:14:33.983720 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.policy [None req-bfac081e-aad9-42de-9c74-7c950b276ecb tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c4c0c82448e40ba801c0b52ec44e74a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a093d0bf43046aaa845f3cc115f3f5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116157) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:14:33.991181 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: INFO nova.api.openstack.requestlog [None req-bfac081e-aad9-42de-9c74-7c950b276ecb tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] 10.222.0.18 "GET /compute/v2.1/servers/fa7c86bc-c46f-4120-8f3d-d795f8d7c5cc" status: 200 len: 1570 microversion: 2.1 time: 0.150775 Dec 15 03:14:33.991743 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: [pid: 116157|app: 0|req: 828/1658] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 03:14:33 2021] GET /compute/v2.1/servers/fa7c86bc-c46f-4120-8f3d-d795f8d7c5cc => generated 1570 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 03:14:34.487136 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi [None req-b180a897-a606-4bc2-a899-5420983b9cb1 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Calling method '>' {{(pid=116156) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:14:34.487695 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.compute.api [None req-b180a897-a606-4bc2-a899-5420983b9cb1 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] [instance: bbb8462c-9501-4541-b67e-43ec5c5061a7] Fetching instance by UUID {{(pid=116156) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:14:34.493920 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-b180a897-a606-4bc2-a899-5420983b9cb1 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:14:34.494413 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-b180a897-a606-4bc2-a899-5420983b9cb1 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:14:34.495191 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-b180a897-a606-4bc2-a899-5420983b9cb1 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:14:34.495629 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-b180a897-a606-4bc2-a899-5420983b9cb1 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:14:34.560185 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.policy [None req-b180a897-a606-4bc2-a899-5420983b9cb1 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97bdf19af9e34fc3886ff451cb9d7a27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '494b56bf5eae4d56a5591546f85bc32b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116156) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:14:34.567410 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: INFO nova.api.openstack.requestlog [None req-b180a897-a606-4bc2-a899-5420983b9cb1 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] 10.222.0.18 "GET /compute/v2.1/servers/bbb8462c-9501-4541-b67e-43ec5c5061a7" status: 200 len: 1226 microversion: 2.1 time: 0.084228 Dec 15 03:14:34.567964 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: [pid: 116156|app: 0|req: 831/1659] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 03:14:34 2021] GET /compute/v2.1/servers/bbb8462c-9501-4541-b67e-43ec5c5061a7 => generated 1226 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 03:14:35.008598 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi [None req-1100f176-d2cf-4aa4-a5b2-64d3574adb72 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Calling method '>' {{(pid=116157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:14:35.009209 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.compute.api [None req-1100f176-d2cf-4aa4-a5b2-64d3574adb72 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] [instance: fa7c86bc-c46f-4120-8f3d-d795f8d7c5cc] Fetching instance by UUID {{(pid=116157) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:14:35.015975 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-1100f176-d2cf-4aa4-a5b2-64d3574adb72 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:14:35.016423 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-1100f176-d2cf-4aa4-a5b2-64d3574adb72 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:14:35.017199 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-1100f176-d2cf-4aa4-a5b2-64d3574adb72 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:14:35.017635 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-1100f176-d2cf-4aa4-a5b2-64d3574adb72 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:14:35.146522 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.policy [None req-1100f176-d2cf-4aa4-a5b2-64d3574adb72 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c4c0c82448e40ba801c0b52ec44e74a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a093d0bf43046aaa845f3cc115f3f5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116157) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:14:35.153732 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: INFO nova.api.openstack.requestlog [None req-1100f176-d2cf-4aa4-a5b2-64d3574adb72 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] 10.222.0.18 "GET /compute/v2.1/servers/fa7c86bc-c46f-4120-8f3d-d795f8d7c5cc" status: 200 len: 1570 microversion: 2.1 time: 0.148878 Dec 15 03:14:35.154328 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: [pid: 116157|app: 0|req: 829/1660] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 03:14:35 2021] GET /compute/v2.1/servers/fa7c86bc-c46f-4120-8f3d-d795f8d7c5cc => generated 1570 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 03:14:35.583299 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi [None req-ae4cff33-0518-453a-a25f-67e593d6ef99 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Calling method '>' {{(pid=116156) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:14:35.583912 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.compute.api [None req-ae4cff33-0518-453a-a25f-67e593d6ef99 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] [instance: bbb8462c-9501-4541-b67e-43ec5c5061a7] Fetching instance by UUID {{(pid=116156) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:14:35.590201 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-ae4cff33-0518-453a-a25f-67e593d6ef99 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:14:35.590663 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-ae4cff33-0518-453a-a25f-67e593d6ef99 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:14:35.591474 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-ae4cff33-0518-453a-a25f-67e593d6ef99 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:14:35.591911 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-ae4cff33-0518-453a-a25f-67e593d6ef99 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:14:35.651154 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.policy [None req-ae4cff33-0518-453a-a25f-67e593d6ef99 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97bdf19af9e34fc3886ff451cb9d7a27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '494b56bf5eae4d56a5591546f85bc32b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116156) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:14:35.658321 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: INFO nova.api.openstack.requestlog [None req-ae4cff33-0518-453a-a25f-67e593d6ef99 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] 10.222.0.18 "GET /compute/v2.1/servers/bbb8462c-9501-4541-b67e-43ec5c5061a7" status: 200 len: 1226 microversion: 2.1 time: 0.078700 Dec 15 03:14:35.658875 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: [pid: 116156|app: 0|req: 832/1661] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 03:14:35 2021] GET /compute/v2.1/servers/bbb8462c-9501-4541-b67e-43ec5c5061a7 => generated 1226 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 03:14:36.172071 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi [None req-291aa10b-632d-4250-9d84-15c035aec44f tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Calling method '>' {{(pid=116157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:14:36.172685 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.compute.api [None req-291aa10b-632d-4250-9d84-15c035aec44f tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] [instance: fa7c86bc-c46f-4120-8f3d-d795f8d7c5cc] Fetching instance by UUID {{(pid=116157) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:14:36.179050 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-291aa10b-632d-4250-9d84-15c035aec44f tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:14:36.179510 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-291aa10b-632d-4250-9d84-15c035aec44f tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:14:36.180301 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-291aa10b-632d-4250-9d84-15c035aec44f tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:14:36.180746 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-291aa10b-632d-4250-9d84-15c035aec44f tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:14:36.326056 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.policy [None req-291aa10b-632d-4250-9d84-15c035aec44f tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c4c0c82448e40ba801c0b52ec44e74a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a093d0bf43046aaa845f3cc115f3f5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116157) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:14:36.333794 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: INFO nova.api.openstack.requestlog [None req-291aa10b-632d-4250-9d84-15c035aec44f tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] 10.222.0.18 "GET /compute/v2.1/servers/fa7c86bc-c46f-4120-8f3d-d795f8d7c5cc" status: 200 len: 1570 microversion: 2.1 time: 0.166781 Dec 15 03:14:36.334399 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: [pid: 116157|app: 0|req: 830/1662] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 03:14:36 2021] GET /compute/v2.1/servers/fa7c86bc-c46f-4120-8f3d-d795f8d7c5cc => generated 1570 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 03:14:36.675346 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi [None req-c233c705-b0de-496b-ab17-986f0b226dc7 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Calling method '>' {{(pid=116156) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:14:36.675958 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.compute.api [None req-c233c705-b0de-496b-ab17-986f0b226dc7 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] [instance: bbb8462c-9501-4541-b67e-43ec5c5061a7] Fetching instance by UUID {{(pid=116156) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:14:36.682219 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-c233c705-b0de-496b-ab17-986f0b226dc7 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:14:36.683160 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-c233c705-b0de-496b-ab17-986f0b226dc7 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:14:36.683940 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-c233c705-b0de-496b-ab17-986f0b226dc7 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:14:36.684375 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-c233c705-b0de-496b-ab17-986f0b226dc7 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:14:36.742393 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.policy [None req-c233c705-b0de-496b-ab17-986f0b226dc7 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97bdf19af9e34fc3886ff451cb9d7a27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '494b56bf5eae4d56a5591546f85bc32b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116156) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:14:36.750231 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: INFO nova.api.openstack.requestlog [None req-c233c705-b0de-496b-ab17-986f0b226dc7 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] 10.222.0.18 "GET /compute/v2.1/servers/bbb8462c-9501-4541-b67e-43ec5c5061a7" status: 200 len: 1226 microversion: 2.1 time: 0.078580 Dec 15 03:14:36.750793 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: [pid: 116156|app: 0|req: 833/1663] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 03:14:36 2021] GET /compute/v2.1/servers/bbb8462c-9501-4541-b67e-43ec5c5061a7 => generated 1226 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 03:14:37.350961 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi [None req-668a61aa-5f98-4ac3-b6b8-6dadeb87526d tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Calling method '>' {{(pid=116157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:14:37.351573 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.compute.api [None req-668a61aa-5f98-4ac3-b6b8-6dadeb87526d tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] [instance: fa7c86bc-c46f-4120-8f3d-d795f8d7c5cc] Fetching instance by UUID {{(pid=116157) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:14:37.358589 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-668a61aa-5f98-4ac3-b6b8-6dadeb87526d tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:14:37.359046 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-668a61aa-5f98-4ac3-b6b8-6dadeb87526d tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:14:37.359832 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-668a61aa-5f98-4ac3-b6b8-6dadeb87526d tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:14:37.360273 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-668a61aa-5f98-4ac3-b6b8-6dadeb87526d tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:14:37.491699 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.policy [None req-668a61aa-5f98-4ac3-b6b8-6dadeb87526d tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c4c0c82448e40ba801c0b52ec44e74a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a093d0bf43046aaa845f3cc115f3f5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116157) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:14:37.499011 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: INFO nova.api.openstack.requestlog [None req-668a61aa-5f98-4ac3-b6b8-6dadeb87526d tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] 10.222.0.18 "GET /compute/v2.1/servers/fa7c86bc-c46f-4120-8f3d-d795f8d7c5cc" status: 200 len: 1570 microversion: 2.1 time: 0.151658 Dec 15 03:14:37.499577 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: [pid: 116157|app: 0|req: 831/1664] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 03:14:37 2021] GET /compute/v2.1/servers/fa7c86bc-c46f-4120-8f3d-d795f8d7c5cc => generated 1570 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 03:14:37.767281 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi [None req-2a4384a8-f8c1-4188-ba9f-37f41c5302b2 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Calling method '>' {{(pid=116156) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:14:37.767891 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.compute.api [None req-2a4384a8-f8c1-4188-ba9f-37f41c5302b2 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] [instance: bbb8462c-9501-4541-b67e-43ec5c5061a7] Fetching instance by UUID {{(pid=116156) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:14:37.774144 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-2a4384a8-f8c1-4188-ba9f-37f41c5302b2 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:14:37.774602 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-2a4384a8-f8c1-4188-ba9f-37f41c5302b2 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:14:37.775384 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-2a4384a8-f8c1-4188-ba9f-37f41c5302b2 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:14:37.775821 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-2a4384a8-f8c1-4188-ba9f-37f41c5302b2 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:14:37.833408 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.policy [None req-2a4384a8-f8c1-4188-ba9f-37f41c5302b2 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97bdf19af9e34fc3886ff451cb9d7a27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '494b56bf5eae4d56a5591546f85bc32b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116156) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:14:37.841053 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: INFO nova.api.openstack.requestlog [None req-2a4384a8-f8c1-4188-ba9f-37f41c5302b2 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] 10.222.0.18 "GET /compute/v2.1/servers/bbb8462c-9501-4541-b67e-43ec5c5061a7" status: 200 len: 1226 microversion: 2.1 time: 0.077504 Dec 15 03:14:37.841609 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: [pid: 116156|app: 0|req: 834/1665] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 03:14:37 2021] GET /compute/v2.1/servers/bbb8462c-9501-4541-b67e-43ec5c5061a7 => generated 1226 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 03:14:38.519351 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi [None req-0b51e075-7214-421a-8371-5bd35b949ab9 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Calling method '>' {{(pid=116157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:14:38.519896 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.compute.api [None req-0b51e075-7214-421a-8371-5bd35b949ab9 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] [instance: fa7c86bc-c46f-4120-8f3d-d795f8d7c5cc] Fetching instance by UUID {{(pid=116157) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:14:38.526079 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-0b51e075-7214-421a-8371-5bd35b949ab9 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:14:38.526527 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-0b51e075-7214-421a-8371-5bd35b949ab9 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:14:38.527299 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-0b51e075-7214-421a-8371-5bd35b949ab9 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:14:38.527733 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-0b51e075-7214-421a-8371-5bd35b949ab9 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:14:38.655449 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.policy [None req-0b51e075-7214-421a-8371-5bd35b949ab9 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c4c0c82448e40ba801c0b52ec44e74a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a093d0bf43046aaa845f3cc115f3f5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116157) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:14:38.662682 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: INFO nova.api.openstack.requestlog [None req-0b51e075-7214-421a-8371-5bd35b949ab9 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] 10.222.0.18 "GET /compute/v2.1/servers/fa7c86bc-c46f-4120-8f3d-d795f8d7c5cc" status: 200 len: 1570 microversion: 2.1 time: 0.147099 Dec 15 03:14:38.663269 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: [pid: 116157|app: 0|req: 832/1666] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 03:14:38 2021] GET /compute/v2.1/servers/fa7c86bc-c46f-4120-8f3d-d795f8d7c5cc => generated 1570 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 03:14:38.857939 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi [None req-ba45e0fe-15bb-4477-a4a2-62f6b92c973d tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Calling method '>' {{(pid=116156) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:14:38.858569 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.compute.api [None req-ba45e0fe-15bb-4477-a4a2-62f6b92c973d tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] [instance: bbb8462c-9501-4541-b67e-43ec5c5061a7] Fetching instance by UUID {{(pid=116156) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:14:38.865100 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-ba45e0fe-15bb-4477-a4a2-62f6b92c973d tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:14:38.865548 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-ba45e0fe-15bb-4477-a4a2-62f6b92c973d tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:14:38.866380 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-ba45e0fe-15bb-4477-a4a2-62f6b92c973d tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:14:38.866812 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-ba45e0fe-15bb-4477-a4a2-62f6b92c973d tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:14:38.927949 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.policy [None req-ba45e0fe-15bb-4477-a4a2-62f6b92c973d tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97bdf19af9e34fc3886ff451cb9d7a27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '494b56bf5eae4d56a5591546f85bc32b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116156) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:14:38.935195 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: INFO nova.api.openstack.requestlog [None req-ba45e0fe-15bb-4477-a4a2-62f6b92c973d tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] 10.222.0.18 "GET /compute/v2.1/servers/bbb8462c-9501-4541-b67e-43ec5c5061a7" status: 200 len: 1226 microversion: 2.1 time: 0.081418 Dec 15 03:14:38.935742 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: [pid: 116156|app: 0|req: 835/1667] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 03:14:38 2021] GET /compute/v2.1/servers/bbb8462c-9501-4541-b67e-43ec5c5061a7 => generated 1226 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 03:14:39.679467 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi [None req-2b08e9d8-bbdb-429a-a005-35880f4e524e tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Calling method '>' {{(pid=116157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:14:39.680103 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.compute.api [None req-2b08e9d8-bbdb-429a-a005-35880f4e524e tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] [instance: fa7c86bc-c46f-4120-8f3d-d795f8d7c5cc] Fetching instance by UUID {{(pid=116157) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:14:39.686945 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-2b08e9d8-bbdb-429a-a005-35880f4e524e tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:14:39.687395 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-2b08e9d8-bbdb-429a-a005-35880f4e524e tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:14:39.688176 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-2b08e9d8-bbdb-429a-a005-35880f4e524e tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:14:39.688643 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-2b08e9d8-bbdb-429a-a005-35880f4e524e tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:14:39.820179 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.policy [None req-2b08e9d8-bbdb-429a-a005-35880f4e524e tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c4c0c82448e40ba801c0b52ec44e74a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a093d0bf43046aaa845f3cc115f3f5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116157) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:14:39.828020 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: INFO nova.api.openstack.requestlog [None req-2b08e9d8-bbdb-429a-a005-35880f4e524e tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] 10.222.0.18 "GET /compute/v2.1/servers/fa7c86bc-c46f-4120-8f3d-d795f8d7c5cc" status: 200 len: 1570 microversion: 2.1 time: 0.152264 Dec 15 03:14:39.828591 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: [pid: 116157|app: 0|req: 833/1668] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 03:14:39 2021] GET /compute/v2.1/servers/fa7c86bc-c46f-4120-8f3d-d795f8d7c5cc => generated 1570 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 03:14:39.951836 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi [None req-ba806bbe-d390-4e51-9175-deaf7765874c tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Calling method '>' {{(pid=116156) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:14:39.952373 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.compute.api [None req-ba806bbe-d390-4e51-9175-deaf7765874c tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] [instance: bbb8462c-9501-4541-b67e-43ec5c5061a7] Fetching instance by UUID {{(pid=116156) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:14:39.958547 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-ba806bbe-d390-4e51-9175-deaf7765874c tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:14:39.958993 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-ba806bbe-d390-4e51-9175-deaf7765874c tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:14:39.959762 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-ba806bbe-d390-4e51-9175-deaf7765874c tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:14:39.960191 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-ba806bbe-d390-4e51-9175-deaf7765874c tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:14:40.017700 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.policy [None req-ba806bbe-d390-4e51-9175-deaf7765874c tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97bdf19af9e34fc3886ff451cb9d7a27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '494b56bf5eae4d56a5591546f85bc32b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116156) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:14:40.024762 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: INFO nova.api.openstack.requestlog [None req-ba806bbe-d390-4e51-9175-deaf7765874c tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] 10.222.0.18 "GET /compute/v2.1/servers/bbb8462c-9501-4541-b67e-43ec5c5061a7" status: 200 len: 1226 microversion: 2.1 time: 0.076914 Dec 15 03:14:40.025312 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: [pid: 116156|app: 0|req: 836/1669] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 03:14:39 2021] GET /compute/v2.1/servers/bbb8462c-9501-4541-b67e-43ec5c5061a7 => generated 1226 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 03:14:40.844545 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi [None req-820baea6-910d-424c-9bb9-d89eb4f42221 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Calling method '>' {{(pid=116157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:14:40.845161 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.compute.api [None req-820baea6-910d-424c-9bb9-d89eb4f42221 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] [instance: fa7c86bc-c46f-4120-8f3d-d795f8d7c5cc] Fetching instance by UUID {{(pid=116157) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:14:40.851678 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-820baea6-910d-424c-9bb9-d89eb4f42221 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:14:40.852158 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-820baea6-910d-424c-9bb9-d89eb4f42221 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:14:40.852944 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-820baea6-910d-424c-9bb9-d89eb4f42221 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:14:40.853382 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-820baea6-910d-424c-9bb9-d89eb4f42221 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:14:40.980719 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.policy [None req-820baea6-910d-424c-9bb9-d89eb4f42221 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c4c0c82448e40ba801c0b52ec44e74a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a093d0bf43046aaa845f3cc115f3f5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116157) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:14:40.988316 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: INFO nova.api.openstack.requestlog [None req-820baea6-910d-424c-9bb9-d89eb4f42221 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] 10.222.0.18 "GET /compute/v2.1/servers/fa7c86bc-c46f-4120-8f3d-d795f8d7c5cc" status: 200 len: 1570 microversion: 2.1 time: 0.147259 Dec 15 03:14:40.988725 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: [pid: 116157|app: 0|req: 834/1670] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 03:14:40 2021] GET /compute/v2.1/servers/fa7c86bc-c46f-4120-8f3d-d795f8d7c5cc => generated 1570 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 03:14:41.041188 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi [None req-894a639b-fd90-4f1f-86be-77ef9ac1aa61 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Calling method '>' {{(pid=116156) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:14:41.042330 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.compute.api [None req-894a639b-fd90-4f1f-86be-77ef9ac1aa61 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] [instance: bbb8462c-9501-4541-b67e-43ec5c5061a7] Fetching instance by UUID {{(pid=116156) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:14:41.048043 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-894a639b-fd90-4f1f-86be-77ef9ac1aa61 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:14:41.048506 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-894a639b-fd90-4f1f-86be-77ef9ac1aa61 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:14:41.049281 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-894a639b-fd90-4f1f-86be-77ef9ac1aa61 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:14:41.049721 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-894a639b-fd90-4f1f-86be-77ef9ac1aa61 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:14:41.108364 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.policy [None req-894a639b-fd90-4f1f-86be-77ef9ac1aa61 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97bdf19af9e34fc3886ff451cb9d7a27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '494b56bf5eae4d56a5591546f85bc32b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116156) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:14:41.115730 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: INFO nova.api.openstack.requestlog [None req-894a639b-fd90-4f1f-86be-77ef9ac1aa61 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] 10.222.0.18 "GET /compute/v2.1/servers/bbb8462c-9501-4541-b67e-43ec5c5061a7" status: 200 len: 1226 microversion: 2.1 time: 0.078332 Dec 15 03:14:41.116294 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: [pid: 116156|app: 0|req: 837/1671] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 03:14:41 2021] GET /compute/v2.1/servers/bbb8462c-9501-4541-b67e-43ec5c5061a7 => generated 1226 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 03:14:42.005565 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi [None req-d4e1be82-575d-4b81-80dc-007df50b1069 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Calling method '>' {{(pid=116157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:14:42.006220 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.compute.api [None req-d4e1be82-575d-4b81-80dc-007df50b1069 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] [instance: fa7c86bc-c46f-4120-8f3d-d795f8d7c5cc] Fetching instance by UUID {{(pid=116157) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:14:42.012478 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-d4e1be82-575d-4b81-80dc-007df50b1069 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:14:42.012941 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-d4e1be82-575d-4b81-80dc-007df50b1069 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:14:42.013715 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-d4e1be82-575d-4b81-80dc-007df50b1069 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:14:42.014185 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-d4e1be82-575d-4b81-80dc-007df50b1069 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:14:42.131505 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi [None req-f545d424-6a4d-413c-a6bc-f4c6d224dc9c tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Calling method '>' {{(pid=116156) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:14:42.132195 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.compute.api [None req-f545d424-6a4d-413c-a6bc-f4c6d224dc9c tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] [instance: bbb8462c-9501-4541-b67e-43ec5c5061a7] Fetching instance by UUID {{(pid=116156) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:14:42.138561 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-f545d424-6a4d-413c-a6bc-f4c6d224dc9c tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:14:42.139018 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-f545d424-6a4d-413c-a6bc-f4c6d224dc9c tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:14:42.139803 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-f545d424-6a4d-413c-a6bc-f4c6d224dc9c tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:14:42.140239 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-f545d424-6a4d-413c-a6bc-f4c6d224dc9c tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:14:42.145139 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.policy [None req-d4e1be82-575d-4b81-80dc-007df50b1069 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c4c0c82448e40ba801c0b52ec44e74a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a093d0bf43046aaa845f3cc115f3f5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116157) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:14:42.153070 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: INFO nova.api.openstack.requestlog [None req-d4e1be82-575d-4b81-80dc-007df50b1069 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] 10.222.0.18 "GET /compute/v2.1/servers/fa7c86bc-c46f-4120-8f3d-d795f8d7c5cc" status: 200 len: 1570 microversion: 2.1 time: 0.151174 Dec 15 03:14:42.153639 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: [pid: 116157|app: 0|req: 835/1672] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 03:14:42 2021] GET /compute/v2.1/servers/fa7c86bc-c46f-4120-8f3d-d795f8d7c5cc => generated 1570 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 03:14:42.199083 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.policy [None req-f545d424-6a4d-413c-a6bc-f4c6d224dc9c tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97bdf19af9e34fc3886ff451cb9d7a27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '494b56bf5eae4d56a5591546f85bc32b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116156) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:14:42.206318 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: INFO nova.api.openstack.requestlog [None req-f545d424-6a4d-413c-a6bc-f4c6d224dc9c tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] 10.222.0.18 "GET /compute/v2.1/servers/bbb8462c-9501-4541-b67e-43ec5c5061a7" status: 200 len: 1226 microversion: 2.1 time: 0.078488 Dec 15 03:14:42.206875 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: [pid: 116156|app: 0|req: 838/1673] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 03:14:42 2021] GET /compute/v2.1/servers/bbb8462c-9501-4541-b67e-43ec5c5061a7 => generated 1226 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 03:14:43.170357 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi [None req-29b47327-a424-44c2-a487-ce19dfbae209 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Calling method '>' {{(pid=116157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:14:43.170962 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.compute.api [None req-29b47327-a424-44c2-a487-ce19dfbae209 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] [instance: fa7c86bc-c46f-4120-8f3d-d795f8d7c5cc] Fetching instance by UUID {{(pid=116157) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:14:43.177184 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-29b47327-a424-44c2-a487-ce19dfbae209 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:14:43.177634 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-29b47327-a424-44c2-a487-ce19dfbae209 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:14:43.178431 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-29b47327-a424-44c2-a487-ce19dfbae209 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:14:43.178864 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-29b47327-a424-44c2-a487-ce19dfbae209 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:14:43.223583 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi [None req-cfd4b302-0641-4a79-b254-728470907c81 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Calling method '>' {{(pid=116156) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:14:43.224193 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.compute.api [None req-cfd4b302-0641-4a79-b254-728470907c81 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] [instance: bbb8462c-9501-4541-b67e-43ec5c5061a7] Fetching instance by UUID {{(pid=116156) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:14:43.230901 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-cfd4b302-0641-4a79-b254-728470907c81 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:14:43.231349 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-cfd4b302-0641-4a79-b254-728470907c81 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:14:43.232131 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-cfd4b302-0641-4a79-b254-728470907c81 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:14:43.232561 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-cfd4b302-0641-4a79-b254-728470907c81 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:14:43.290149 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.policy [None req-cfd4b302-0641-4a79-b254-728470907c81 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97bdf19af9e34fc3886ff451cb9d7a27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '494b56bf5eae4d56a5591546f85bc32b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116156) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:14:43.298007 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: INFO nova.api.openstack.requestlog [None req-cfd4b302-0641-4a79-b254-728470907c81 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] 10.222.0.18 "GET /compute/v2.1/servers/bbb8462c-9501-4541-b67e-43ec5c5061a7" status: 200 len: 1226 microversion: 2.1 time: 0.077957 Dec 15 03:14:43.298856 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: [pid: 116156|app: 0|req: 839/1674] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 03:14:43 2021] GET /compute/v2.1/servers/bbb8462c-9501-4541-b67e-43ec5c5061a7 => generated 1226 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 03:14:43.309937 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.policy [None req-29b47327-a424-44c2-a487-ce19dfbae209 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c4c0c82448e40ba801c0b52ec44e74a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a093d0bf43046aaa845f3cc115f3f5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116157) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:14:43.317157 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: INFO nova.api.openstack.requestlog [None req-29b47327-a424-44c2-a487-ce19dfbae209 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] 10.222.0.18 "GET /compute/v2.1/servers/fa7c86bc-c46f-4120-8f3d-d795f8d7c5cc" status: 200 len: 1570 microversion: 2.1 time: 0.150970 Dec 15 03:14:43.317720 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: [pid: 116157|app: 0|req: 836/1675] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 03:14:43 2021] GET /compute/v2.1/servers/fa7c86bc-c46f-4120-8f3d-d795f8d7c5cc => generated 1570 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 03:14:44.314656 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi [None req-9cdc32c3-1c5e-44b7-9f5e-3176f82d39f8 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Calling method '>' {{(pid=116156) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:14:44.315263 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.compute.api [None req-9cdc32c3-1c5e-44b7-9f5e-3176f82d39f8 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] [instance: bbb8462c-9501-4541-b67e-43ec5c5061a7] Fetching instance by UUID {{(pid=116156) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:14:44.321462 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-9cdc32c3-1c5e-44b7-9f5e-3176f82d39f8 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:14:44.321907 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-9cdc32c3-1c5e-44b7-9f5e-3176f82d39f8 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:14:44.322771 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-9cdc32c3-1c5e-44b7-9f5e-3176f82d39f8 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:14:44.323814 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-9cdc32c3-1c5e-44b7-9f5e-3176f82d39f8 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:14:44.333816 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi [None req-f3e80ed3-10cc-4ecf-8d93-f46bc11e310c tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Calling method '>' {{(pid=116157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:14:44.334502 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.compute.api [None req-f3e80ed3-10cc-4ecf-8d93-f46bc11e310c tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] [instance: fa7c86bc-c46f-4120-8f3d-d795f8d7c5cc] Fetching instance by UUID {{(pid=116157) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:14:44.340765 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-f3e80ed3-10cc-4ecf-8d93-f46bc11e310c tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:14:44.341224 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-f3e80ed3-10cc-4ecf-8d93-f46bc11e310c tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:14:44.342021 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-f3e80ed3-10cc-4ecf-8d93-f46bc11e310c tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:14:44.342455 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-f3e80ed3-10cc-4ecf-8d93-f46bc11e310c tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:14:44.382331 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.policy [None req-9cdc32c3-1c5e-44b7-9f5e-3176f82d39f8 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97bdf19af9e34fc3886ff451cb9d7a27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '494b56bf5eae4d56a5591546f85bc32b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116156) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:14:44.390246 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: INFO nova.api.openstack.requestlog [None req-9cdc32c3-1c5e-44b7-9f5e-3176f82d39f8 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] 10.222.0.18 "GET /compute/v2.1/servers/bbb8462c-9501-4541-b67e-43ec5c5061a7" status: 200 len: 1226 microversion: 2.1 time: 0.079171 Dec 15 03:14:44.390820 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: [pid: 116156|app: 0|req: 840/1676] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 03:14:44 2021] GET /compute/v2.1/servers/bbb8462c-9501-4541-b67e-43ec5c5061a7 => generated 1226 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 03:14:44.471841 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.policy [None req-f3e80ed3-10cc-4ecf-8d93-f46bc11e310c tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c4c0c82448e40ba801c0b52ec44e74a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a093d0bf43046aaa845f3cc115f3f5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116157) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:14:44.479770 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: INFO nova.api.openstack.requestlog [None req-f3e80ed3-10cc-4ecf-8d93-f46bc11e310c tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] 10.222.0.18 "GET /compute/v2.1/servers/fa7c86bc-c46f-4120-8f3d-d795f8d7c5cc" status: 200 len: 1570 microversion: 2.1 time: 0.149076 Dec 15 03:14:44.480343 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: [pid: 116157|app: 0|req: 837/1677] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 03:14:44 2021] GET /compute/v2.1/servers/fa7c86bc-c46f-4120-8f3d-d795f8d7c5cc => generated 1570 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 03:14:45.407007 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi [None req-86b51e01-18e8-483f-ba42-4d7cde5648ea tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Calling method '>' {{(pid=116156) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:14:45.407615 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.compute.api [None req-86b51e01-18e8-483f-ba42-4d7cde5648ea tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] [instance: bbb8462c-9501-4541-b67e-43ec5c5061a7] Fetching instance by UUID {{(pid=116156) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:14:45.413868 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-86b51e01-18e8-483f-ba42-4d7cde5648ea tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:14:45.414353 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-86b51e01-18e8-483f-ba42-4d7cde5648ea tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:14:45.415127 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-86b51e01-18e8-483f-ba42-4d7cde5648ea tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:14:45.415566 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-86b51e01-18e8-483f-ba42-4d7cde5648ea tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:14:45.476795 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.policy [None req-86b51e01-18e8-483f-ba42-4d7cde5648ea tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97bdf19af9e34fc3886ff451cb9d7a27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '494b56bf5eae4d56a5591546f85bc32b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116156) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:14:45.484493 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: INFO nova.api.openstack.requestlog [None req-86b51e01-18e8-483f-ba42-4d7cde5648ea tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] 10.222.0.18 "GET /compute/v2.1/servers/bbb8462c-9501-4541-b67e-43ec5c5061a7" status: 200 len: 1226 microversion: 2.1 time: 0.081165 Dec 15 03:14:45.485048 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: [pid: 116156|app: 0|req: 841/1678] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 03:14:45 2021] GET /compute/v2.1/servers/bbb8462c-9501-4541-b67e-43ec5c5061a7 => generated 1226 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 03:14:45.496981 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi [None req-64ed206d-2156-4909-8539-daaa9c38095e tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Calling method '>' {{(pid=116157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:14:45.497600 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.compute.api [None req-64ed206d-2156-4909-8539-daaa9c38095e tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] [instance: fa7c86bc-c46f-4120-8f3d-d795f8d7c5cc] Fetching instance by UUID {{(pid=116157) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:14:45.503869 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-64ed206d-2156-4909-8539-daaa9c38095e tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:14:45.504317 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-64ed206d-2156-4909-8539-daaa9c38095e tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:14:45.505097 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-64ed206d-2156-4909-8539-daaa9c38095e tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:14:45.505538 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-64ed206d-2156-4909-8539-daaa9c38095e tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:14:45.638130 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.policy [None req-64ed206d-2156-4909-8539-daaa9c38095e tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c4c0c82448e40ba801c0b52ec44e74a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a093d0bf43046aaa845f3cc115f3f5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116157) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:14:45.645335 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: INFO nova.api.openstack.requestlog [None req-64ed206d-2156-4909-8539-daaa9c38095e tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] 10.222.0.18 "GET /compute/v2.1/servers/fa7c86bc-c46f-4120-8f3d-d795f8d7c5cc" status: 200 len: 1570 microversion: 2.1 time: 0.152741 Dec 15 03:14:45.645901 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: [pid: 116157|app: 0|req: 838/1679] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 03:14:45 2021] GET /compute/v2.1/servers/fa7c86bc-c46f-4120-8f3d-d795f8d7c5cc => generated 1570 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 03:14:46.501333 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi [None req-12b89261-39e3-4350-b303-ac28cc12da37 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Calling method '>' {{(pid=116156) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:14:46.501881 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.compute.api [None req-12b89261-39e3-4350-b303-ac28cc12da37 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] [instance: bbb8462c-9501-4541-b67e-43ec5c5061a7] Fetching instance by UUID {{(pid=116156) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:14:46.508200 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-12b89261-39e3-4350-b303-ac28cc12da37 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:14:46.508657 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-12b89261-39e3-4350-b303-ac28cc12da37 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:14:46.509435 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-12b89261-39e3-4350-b303-ac28cc12da37 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:14:46.509872 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-12b89261-39e3-4350-b303-ac28cc12da37 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:14:46.567223 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.policy [None req-12b89261-39e3-4350-b303-ac28cc12da37 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97bdf19af9e34fc3886ff451cb9d7a27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '494b56bf5eae4d56a5591546f85bc32b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116156) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:14:46.574389 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: INFO nova.api.openstack.requestlog [None req-12b89261-39e3-4350-b303-ac28cc12da37 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] 10.222.0.18 "GET /compute/v2.1/servers/bbb8462c-9501-4541-b67e-43ec5c5061a7" status: 200 len: 1226 microversion: 2.1 time: 0.076778 Dec 15 03:14:46.574948 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: [pid: 116156|app: 0|req: 842/1680] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 03:14:46 2021] GET /compute/v2.1/servers/bbb8462c-9501-4541-b67e-43ec5c5061a7 => generated 1226 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 03:14:46.662459 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi [None req-46526fef-87d8-4035-ada5-bf72946cf8af tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Calling method '>' {{(pid=116157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:14:46.663074 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.compute.api [None req-46526fef-87d8-4035-ada5-bf72946cf8af tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] [instance: fa7c86bc-c46f-4120-8f3d-d795f8d7c5cc] Fetching instance by UUID {{(pid=116157) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:14:46.669916 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-46526fef-87d8-4035-ada5-bf72946cf8af tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:14:46.670395 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-46526fef-87d8-4035-ada5-bf72946cf8af tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:14:46.671173 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-46526fef-87d8-4035-ada5-bf72946cf8af tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:14:46.671611 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-46526fef-87d8-4035-ada5-bf72946cf8af tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:14:46.798640 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.policy [None req-46526fef-87d8-4035-ada5-bf72946cf8af tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c4c0c82448e40ba801c0b52ec44e74a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a093d0bf43046aaa845f3cc115f3f5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116157) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:14:46.805881 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: INFO nova.api.openstack.requestlog [None req-46526fef-87d8-4035-ada5-bf72946cf8af tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] 10.222.0.18 "GET /compute/v2.1/servers/fa7c86bc-c46f-4120-8f3d-d795f8d7c5cc" status: 200 len: 1570 microversion: 2.1 time: 0.147031 Dec 15 03:14:46.806465 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: [pid: 116157|app: 0|req: 839/1681] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 03:14:46 2021] GET /compute/v2.1/servers/fa7c86bc-c46f-4120-8f3d-d795f8d7c5cc => generated 1570 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 03:14:47.593670 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi [None req-d16a1c9b-e838-4c10-9894-6cb4a7799e72 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Calling method '>' {{(pid=116156) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:14:47.594311 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.compute.api [None req-d16a1c9b-e838-4c10-9894-6cb4a7799e72 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] [instance: bbb8462c-9501-4541-b67e-43ec5c5061a7] Fetching instance by UUID {{(pid=116156) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:14:47.600662 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-d16a1c9b-e838-4c10-9894-6cb4a7799e72 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:14:47.601115 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-d16a1c9b-e838-4c10-9894-6cb4a7799e72 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:14:47.601897 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-d16a1c9b-e838-4c10-9894-6cb4a7799e72 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:14:47.602359 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-d16a1c9b-e838-4c10-9894-6cb4a7799e72 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:14:47.663576 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.policy [None req-d16a1c9b-e838-4c10-9894-6cb4a7799e72 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97bdf19af9e34fc3886ff451cb9d7a27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '494b56bf5eae4d56a5591546f85bc32b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116156) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:14:47.670757 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: INFO nova.api.openstack.requestlog [None req-d16a1c9b-e838-4c10-9894-6cb4a7799e72 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] 10.222.0.18 "GET /compute/v2.1/servers/bbb8462c-9501-4541-b67e-43ec5c5061a7" status: 200 len: 1226 microversion: 2.1 time: 0.083458 Dec 15 03:14:47.671315 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: [pid: 116156|app: 0|req: 843/1682] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 03:14:47 2021] GET /compute/v2.1/servers/bbb8462c-9501-4541-b67e-43ec5c5061a7 => generated 1226 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 03:14:47.822559 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi [None req-99840081-61a2-4183-b15e-08e351e214bd tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Calling method '>' {{(pid=116157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:14:47.823770 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.compute.api [None req-99840081-61a2-4183-b15e-08e351e214bd tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] [instance: fa7c86bc-c46f-4120-8f3d-d795f8d7c5cc] Fetching instance by UUID {{(pid=116157) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:14:47.830006 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-99840081-61a2-4183-b15e-08e351e214bd tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:14:47.830469 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-99840081-61a2-4183-b15e-08e351e214bd tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:14:47.831249 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-99840081-61a2-4183-b15e-08e351e214bd tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:14:47.831689 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-99840081-61a2-4183-b15e-08e351e214bd tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:14:47.962477 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.policy [None req-99840081-61a2-4183-b15e-08e351e214bd tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c4c0c82448e40ba801c0b52ec44e74a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a093d0bf43046aaa845f3cc115f3f5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116157) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:14:47.969747 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: INFO nova.api.openstack.requestlog [None req-99840081-61a2-4183-b15e-08e351e214bd tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] 10.222.0.18 "GET /compute/v2.1/servers/fa7c86bc-c46f-4120-8f3d-d795f8d7c5cc" status: 200 len: 1570 microversion: 2.1 time: 0.150809 Dec 15 03:14:47.970341 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: [pid: 116157|app: 0|req: 840/1683] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 03:14:47 2021] GET /compute/v2.1/servers/fa7c86bc-c46f-4120-8f3d-d795f8d7c5cc => generated 1570 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 03:14:48.687326 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi [None req-c1f7313f-9a2c-46a3-9e72-c813a0fd92e8 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Calling method '>' {{(pid=116156) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:14:48.687934 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.compute.api [None req-c1f7313f-9a2c-46a3-9e72-c813a0fd92e8 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] [instance: bbb8462c-9501-4541-b67e-43ec5c5061a7] Fetching instance by UUID {{(pid=116156) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:14:48.694180 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-c1f7313f-9a2c-46a3-9e72-c813a0fd92e8 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:14:48.694632 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-c1f7313f-9a2c-46a3-9e72-c813a0fd92e8 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:14:48.695398 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-c1f7313f-9a2c-46a3-9e72-c813a0fd92e8 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:14:48.695831 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-c1f7313f-9a2c-46a3-9e72-c813a0fd92e8 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:14:48.753893 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.policy [None req-c1f7313f-9a2c-46a3-9e72-c813a0fd92e8 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97bdf19af9e34fc3886ff451cb9d7a27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '494b56bf5eae4d56a5591546f85bc32b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116156) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:14:48.761646 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: INFO nova.api.openstack.requestlog [None req-c1f7313f-9a2c-46a3-9e72-c813a0fd92e8 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] 10.222.0.18 "GET /compute/v2.1/servers/bbb8462c-9501-4541-b67e-43ec5c5061a7" status: 200 len: 1226 microversion: 2.1 time: 0.078002 Dec 15 03:14:48.762237 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: [pid: 116156|app: 0|req: 844/1684] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 03:14:48 2021] GET /compute/v2.1/servers/bbb8462c-9501-4541-b67e-43ec5c5061a7 => generated 1226 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 03:14:48.986363 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi [None req-04c42d23-2ecd-4bae-8afc-a1cd4f9822ff tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Calling method '>' {{(pid=116157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:14:48.986898 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.compute.api [None req-04c42d23-2ecd-4bae-8afc-a1cd4f9822ff tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] [instance: fa7c86bc-c46f-4120-8f3d-d795f8d7c5cc] Fetching instance by UUID {{(pid=116157) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:14:48.993121 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-04c42d23-2ecd-4bae-8afc-a1cd4f9822ff tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:14:48.993570 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-04c42d23-2ecd-4bae-8afc-a1cd4f9822ff tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:14:48.994384 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-04c42d23-2ecd-4bae-8afc-a1cd4f9822ff tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:14:48.994825 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-04c42d23-2ecd-4bae-8afc-a1cd4f9822ff tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:14:49.122140 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.policy [None req-04c42d23-2ecd-4bae-8afc-a1cd4f9822ff tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c4c0c82448e40ba801c0b52ec44e74a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a093d0bf43046aaa845f3cc115f3f5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116157) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:14:49.129259 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: INFO nova.api.openstack.requestlog [None req-04c42d23-2ecd-4bae-8afc-a1cd4f9822ff tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] 10.222.0.18 "GET /compute/v2.1/servers/fa7c86bc-c46f-4120-8f3d-d795f8d7c5cc" status: 200 len: 1570 microversion: 2.1 time: 0.146958 Dec 15 03:14:49.129818 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: [pid: 116157|app: 0|req: 841/1685] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 03:14:48 2021] GET /compute/v2.1/servers/fa7c86bc-c46f-4120-8f3d-d795f8d7c5cc => generated 1570 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 03:14:49.778996 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi [None req-4977236a-f7b3-4f66-ba61-09a3af818c67 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Calling method '>' {{(pid=116156) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:14:49.779672 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.compute.api [None req-4977236a-f7b3-4f66-ba61-09a3af818c67 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] [instance: bbb8462c-9501-4541-b67e-43ec5c5061a7] Fetching instance by UUID {{(pid=116156) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:14:49.786172 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-4977236a-f7b3-4f66-ba61-09a3af818c67 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:14:49.786625 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-4977236a-f7b3-4f66-ba61-09a3af818c67 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:14:49.787402 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-4977236a-f7b3-4f66-ba61-09a3af818c67 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:14:49.787839 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-4977236a-f7b3-4f66-ba61-09a3af818c67 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:14:49.845159 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.policy [None req-4977236a-f7b3-4f66-ba61-09a3af818c67 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97bdf19af9e34fc3886ff451cb9d7a27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '494b56bf5eae4d56a5591546f85bc32b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116156) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:14:49.852281 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: INFO nova.api.openstack.requestlog [None req-4977236a-f7b3-4f66-ba61-09a3af818c67 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] 10.222.0.18 "GET /compute/v2.1/servers/bbb8462c-9501-4541-b67e-43ec5c5061a7" status: 200 len: 1226 microversion: 2.1 time: 0.077606 Dec 15 03:14:49.852834 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: [pid: 116156|app: 0|req: 845/1686] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 03:14:49 2021] GET /compute/v2.1/servers/bbb8462c-9501-4541-b67e-43ec5c5061a7 => generated 1226 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 03:14:50.146824 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi [None req-401f3a32-c755-4166-a158-b43552037e68 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Calling method '>' {{(pid=116157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:14:50.147474 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.compute.api [None req-401f3a32-c755-4166-a158-b43552037e68 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] [instance: fa7c86bc-c46f-4120-8f3d-d795f8d7c5cc] Fetching instance by UUID {{(pid=116157) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:14:50.154305 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-401f3a32-c755-4166-a158-b43552037e68 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:14:50.154760 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-401f3a32-c755-4166-a158-b43552037e68 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:14:50.155541 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-401f3a32-c755-4166-a158-b43552037e68 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:14:50.155988 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-401f3a32-c755-4166-a158-b43552037e68 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:14:50.284409 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.policy [None req-401f3a32-c755-4166-a158-b43552037e68 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c4c0c82448e40ba801c0b52ec44e74a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a093d0bf43046aaa845f3cc115f3f5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116157) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:14:50.292322 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: INFO nova.api.openstack.requestlog [None req-401f3a32-c755-4166-a158-b43552037e68 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] 10.222.0.18 "GET /compute/v2.1/servers/fa7c86bc-c46f-4120-8f3d-d795f8d7c5cc" status: 200 len: 1570 microversion: 2.1 time: 0.148501 Dec 15 03:14:50.292889 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: [pid: 116157|app: 0|req: 842/1687] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 03:14:50 2021] GET /compute/v2.1/servers/fa7c86bc-c46f-4120-8f3d-d795f8d7c5cc => generated 1570 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 03:14:50.869068 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi [None req-f8e64d0f-4115-452f-aa22-7af04300e4f3 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Calling method '>' {{(pid=116156) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:14:50.870316 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.compute.api [None req-f8e64d0f-4115-452f-aa22-7af04300e4f3 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] [instance: bbb8462c-9501-4541-b67e-43ec5c5061a7] Fetching instance by UUID {{(pid=116156) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:14:50.876527 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-f8e64d0f-4115-452f-aa22-7af04300e4f3 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:14:50.876973 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-f8e64d0f-4115-452f-aa22-7af04300e4f3 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:14:50.877743 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-f8e64d0f-4115-452f-aa22-7af04300e4f3 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:14:50.878219 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-f8e64d0f-4115-452f-aa22-7af04300e4f3 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:14:50.935372 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.policy [None req-f8e64d0f-4115-452f-aa22-7af04300e4f3 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97bdf19af9e34fc3886ff451cb9d7a27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '494b56bf5eae4d56a5591546f85bc32b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116156) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:14:50.942332 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: INFO nova.api.openstack.requestlog [None req-f8e64d0f-4115-452f-aa22-7af04300e4f3 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] 10.222.0.18 "GET /compute/v2.1/servers/bbb8462c-9501-4541-b67e-43ec5c5061a7" status: 200 len: 1226 microversion: 2.1 time: 0.076893 Dec 15 03:14:50.942885 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: [pid: 116156|app: 0|req: 846/1688] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 03:14:50 2021] GET /compute/v2.1/servers/bbb8462c-9501-4541-b67e-43ec5c5061a7 => generated 1226 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 03:14:51.309171 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi [None req-1aa9206f-05dc-438f-b243-c8ea7880496a tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Calling method '>' {{(pid=116157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:14:51.309780 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.compute.api [None req-1aa9206f-05dc-438f-b243-c8ea7880496a tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] [instance: fa7c86bc-c46f-4120-8f3d-d795f8d7c5cc] Fetching instance by UUID {{(pid=116157) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:14:51.316083 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-1aa9206f-05dc-438f-b243-c8ea7880496a tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:14:51.316533 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-1aa9206f-05dc-438f-b243-c8ea7880496a tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:14:51.317307 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-1aa9206f-05dc-438f-b243-c8ea7880496a tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:14:51.317742 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-1aa9206f-05dc-438f-b243-c8ea7880496a tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:14:51.449740 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.policy [None req-1aa9206f-05dc-438f-b243-c8ea7880496a tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c4c0c82448e40ba801c0b52ec44e74a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a093d0bf43046aaa845f3cc115f3f5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116157) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:14:51.457115 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: INFO nova.api.openstack.requestlog [None req-1aa9206f-05dc-438f-b243-c8ea7880496a tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] 10.222.0.18 "GET /compute/v2.1/servers/fa7c86bc-c46f-4120-8f3d-d795f8d7c5cc" status: 200 len: 1570 microversion: 2.1 time: 0.151578 Dec 15 03:14:51.457749 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: [pid: 116157|app: 0|req: 843/1689] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 03:14:51 2021] GET /compute/v2.1/servers/fa7c86bc-c46f-4120-8f3d-d795f8d7c5cc => generated 1570 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 03:14:51.959205 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi [None req-0c573af4-5383-4fcb-a59d-8bab4fb4cebe tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Calling method '>' {{(pid=116156) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:14:51.959816 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.compute.api [None req-0c573af4-5383-4fcb-a59d-8bab4fb4cebe tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] [instance: bbb8462c-9501-4541-b67e-43ec5c5061a7] Fetching instance by UUID {{(pid=116156) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:14:51.966278 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-0c573af4-5383-4fcb-a59d-8bab4fb4cebe tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:14:51.966732 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-0c573af4-5383-4fcb-a59d-8bab4fb4cebe tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:14:51.967511 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-0c573af4-5383-4fcb-a59d-8bab4fb4cebe tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:14:51.967973 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-0c573af4-5383-4fcb-a59d-8bab4fb4cebe tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:14:52.028816 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.policy [None req-0c573af4-5383-4fcb-a59d-8bab4fb4cebe tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97bdf19af9e34fc3886ff451cb9d7a27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '494b56bf5eae4d56a5591546f85bc32b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116156) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:14:52.036034 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: INFO nova.api.openstack.requestlog [None req-0c573af4-5383-4fcb-a59d-8bab4fb4cebe tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] 10.222.0.18 "GET /compute/v2.1/servers/bbb8462c-9501-4541-b67e-43ec5c5061a7" status: 200 len: 1226 microversion: 2.1 time: 0.080464 Dec 15 03:14:52.036590 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: [pid: 116156|app: 0|req: 847/1690] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 03:14:51 2021] GET /compute/v2.1/servers/bbb8462c-9501-4541-b67e-43ec5c5061a7 => generated 1226 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 03:14:52.474108 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi [None req-13933955-244b-4bb8-87ae-fd553a2af0cb tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Calling method '>' {{(pid=116157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:14:52.474734 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.compute.api [None req-13933955-244b-4bb8-87ae-fd553a2af0cb tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] [instance: fa7c86bc-c46f-4120-8f3d-d795f8d7c5cc] Fetching instance by UUID {{(pid=116157) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:14:52.481545 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-13933955-244b-4bb8-87ae-fd553a2af0cb tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:14:52.482103 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-13933955-244b-4bb8-87ae-fd553a2af0cb tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:14:52.483119 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-13933955-244b-4bb8-87ae-fd553a2af0cb tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:14:52.483554 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-13933955-244b-4bb8-87ae-fd553a2af0cb tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:14:52.610269 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.policy [None req-13933955-244b-4bb8-87ae-fd553a2af0cb tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c4c0c82448e40ba801c0b52ec44e74a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a093d0bf43046aaa845f3cc115f3f5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116157) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:14:52.617737 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: INFO nova.api.openstack.requestlog [None req-13933955-244b-4bb8-87ae-fd553a2af0cb tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] 10.222.0.18 "GET /compute/v2.1/servers/fa7c86bc-c46f-4120-8f3d-d795f8d7c5cc" status: 200 len: 1570 microversion: 2.1 time: 0.147239 Dec 15 03:14:52.618333 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: [pid: 116157|app: 0|req: 844/1691] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 03:14:52 2021] GET /compute/v2.1/servers/fa7c86bc-c46f-4120-8f3d-d795f8d7c5cc => generated 1570 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 03:14:53.053019 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi [None req-08f88267-d4aa-4603-9033-7912fbfc1516 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Calling method '>' {{(pid=116156) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:14:53.053677 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.compute.api [None req-08f88267-d4aa-4603-9033-7912fbfc1516 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] [instance: bbb8462c-9501-4541-b67e-43ec5c5061a7] Fetching instance by UUID {{(pid=116156) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:14:53.060414 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-08f88267-d4aa-4603-9033-7912fbfc1516 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:14:53.060860 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-08f88267-d4aa-4603-9033-7912fbfc1516 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:14:53.061630 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-08f88267-d4aa-4603-9033-7912fbfc1516 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:14:53.062087 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-08f88267-d4aa-4603-9033-7912fbfc1516 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:14:53.120702 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.policy [None req-08f88267-d4aa-4603-9033-7912fbfc1516 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97bdf19af9e34fc3886ff451cb9d7a27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '494b56bf5eae4d56a5591546f85bc32b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116156) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:14:53.127882 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: INFO nova.api.openstack.requestlog [None req-08f88267-d4aa-4603-9033-7912fbfc1516 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] 10.222.0.18 "GET /compute/v2.1/servers/bbb8462c-9501-4541-b67e-43ec5c5061a7" status: 200 len: 1226 microversion: 2.1 time: 0.078537 Dec 15 03:14:53.128589 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: [pid: 116156|app: 0|req: 848/1692] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 03:14:53 2021] GET /compute/v2.1/servers/bbb8462c-9501-4541-b67e-43ec5c5061a7 => generated 1226 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 03:14:53.634515 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi [None req-96fc332f-1d79-4743-82f8-03033c32b976 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Calling method '>' {{(pid=116157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:14:53.635042 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.compute.api [None req-96fc332f-1d79-4743-82f8-03033c32b976 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] [instance: fa7c86bc-c46f-4120-8f3d-d795f8d7c5cc] Fetching instance by UUID {{(pid=116157) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:14:53.641789 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-96fc332f-1d79-4743-82f8-03033c32b976 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:14:53.642262 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-96fc332f-1d79-4743-82f8-03033c32b976 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:14:53.643037 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-96fc332f-1d79-4743-82f8-03033c32b976 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:14:53.643467 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-96fc332f-1d79-4743-82f8-03033c32b976 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:14:53.774074 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.policy [None req-96fc332f-1d79-4743-82f8-03033c32b976 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c4c0c82448e40ba801c0b52ec44e74a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a093d0bf43046aaa845f3cc115f3f5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116157) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:14:53.782451 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: INFO nova.api.openstack.requestlog [None req-96fc332f-1d79-4743-82f8-03033c32b976 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] 10.222.0.18 "GET /compute/v2.1/servers/fa7c86bc-c46f-4120-8f3d-d795f8d7c5cc" status: 200 len: 1570 microversion: 2.1 time: 0.151725 Dec 15 03:14:53.783007 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: [pid: 116157|app: 0|req: 845/1693] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 03:14:53 2021] GET /compute/v2.1/servers/fa7c86bc-c46f-4120-8f3d-d795f8d7c5cc => generated 1570 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 03:14:54.144375 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi [None req-15198652-2a39-4f3e-b63c-9f29f261e28a tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Calling method '>' {{(pid=116156) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:14:54.144985 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.compute.api [None req-15198652-2a39-4f3e-b63c-9f29f261e28a tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] [instance: bbb8462c-9501-4541-b67e-43ec5c5061a7] Fetching instance by UUID {{(pid=116156) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:14:54.151224 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-15198652-2a39-4f3e-b63c-9f29f261e28a tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:14:54.151677 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-15198652-2a39-4f3e-b63c-9f29f261e28a tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:14:54.152468 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-15198652-2a39-4f3e-b63c-9f29f261e28a tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:14:54.152958 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-15198652-2a39-4f3e-b63c-9f29f261e28a tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:14:54.216511 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.policy [None req-15198652-2a39-4f3e-b63c-9f29f261e28a tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97bdf19af9e34fc3886ff451cb9d7a27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '494b56bf5eae4d56a5591546f85bc32b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116156) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:14:54.224828 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: INFO nova.api.openstack.requestlog [None req-15198652-2a39-4f3e-b63c-9f29f261e28a tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] 10.222.0.18 "GET /compute/v2.1/servers/bbb8462c-9501-4541-b67e-43ec5c5061a7" status: 200 len: 1226 microversion: 2.1 time: 0.083927 Dec 15 03:14:54.225768 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: [pid: 116156|app: 0|req: 849/1694] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 03:14:54 2021] GET /compute/v2.1/servers/bbb8462c-9501-4541-b67e-43ec5c5061a7 => generated 1226 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 03:14:54.662695 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi [None req-67252b03-b2a2-4f9e-ad64-7e5c77d5636a tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Calling method '>' {{(pid=116157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:14:54.663197 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.compute.api [None req-67252b03-b2a2-4f9e-ad64-7e5c77d5636a tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] [instance: fa7c86bc-c46f-4120-8f3d-d795f8d7c5cc] Fetching instance by UUID {{(pid=116157) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:14:54.670702 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-67252b03-b2a2-4f9e-ad64-7e5c77d5636a tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:14:54.671155 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-67252b03-b2a2-4f9e-ad64-7e5c77d5636a tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:14:54.671949 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-67252b03-b2a2-4f9e-ad64-7e5c77d5636a tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:14:54.672388 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-67252b03-b2a2-4f9e-ad64-7e5c77d5636a tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:14:54.697653 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.compute.api [None req-67252b03-b2a2-4f9e-ad64-7e5c77d5636a tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] [instance: fa7c86bc-c46f-4120-8f3d-d795f8d7c5cc] Going to try to terminate instance {{(pid=116157) delete /opt/stack/nova/nova/compute/api.py:2614}} Dec 15 03:14:54.730458 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi [req-f1ed6acb-ec12-429e-9eb4-b1cbeb6adbc0 req-c338ade7-0924-43cc-88ff-7c4b36b6faa9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fa7c86bc-c46f-4120-8f3d-d795f8d7c5cc", "tag": "6bbc39c5-40bb-4350-a006-fae5a1ef78a6"}]} {{(pid=116156) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 03:14:54.732164 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 15 03:14:54.732164 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: warnings.warn(msg) Dec 15 03:14:54.740571 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [req-f1ed6acb-ec12-429e-9eb4-b1cbeb6adbc0 req-c338ade7-0924-43cc-88ff-7c4b36b6faa9 service nova] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:14:54.741117 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [req-f1ed6acb-ec12-429e-9eb4-b1cbeb6adbc0 req-c338ade7-0924-43cc-88ff-7c4b36b6faa9 service nova] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:14:54.753171 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: INFO nova.api.openstack.compute.server_external_events [req-f1ed6acb-ec12-429e-9eb4-b1cbeb6adbc0 req-c338ade7-0924-43cc-88ff-7c4b36b6faa9 service nova] Creating event network-changed:6bbc39c5-40bb-4350-a006-fae5a1ef78a6 for instance fa7c86bc-c46f-4120-8f3d-d795f8d7c5cc on hv-cinder-81803 Dec 15 03:14:54.757098 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: ERROR oslo.messaging._drivers.impl_rabbit [req-f1ed6acb-ec12-429e-9eb4-b1cbeb6adbc0 req-c338ade7-0924-43cc-88ff-7c4b36b6faa9 service nova] [c8a134cd-574d-4606-b1e0-1ba11bcd2772] AMQP server on 10.222.0.18:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Dec 15 03:14:54.779403 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: INFO nova.api.openstack.requestlog [None req-67252b03-b2a2-4f9e-ad64-7e5c77d5636a tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] 10.222.0.18 "DELETE /compute/v2.1/servers/fa7c86bc-c46f-4120-8f3d-d795f8d7c5cc" status: 204 len: 0 microversion: 2.1 time: 0.120315 Dec 15 03:14:54.780341 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: [pid: 116157|app: 0|req: 846/1695] 10.222.0.18 () {58 vars in 1238 bytes} [Wed Dec 15 03:14:54 2021] DELETE /compute/v2.1/servers/fa7c86bc-c46f-4120-8f3d-d795f8d7c5cc => generated 0 bytes in 122 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Dec 15 03:14:54.788336 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi [None req-6fc93c7e-9067-473b-9195-90146936159c tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Calling method '>' {{(pid=116157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:14:54.789169 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.compute.api [None req-6fc93c7e-9067-473b-9195-90146936159c tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] [instance: fa7c86bc-c46f-4120-8f3d-d795f8d7c5cc] Fetching instance by UUID {{(pid=116157) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:14:54.795665 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-6fc93c7e-9067-473b-9195-90146936159c tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:14:54.796221 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-6fc93c7e-9067-473b-9195-90146936159c tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:14:54.797110 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-6fc93c7e-9067-473b-9195-90146936159c tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:14:54.797649 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-6fc93c7e-9067-473b-9195-90146936159c tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:14:54.932098 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.policy [None req-6fc93c7e-9067-473b-9195-90146936159c tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c4c0c82448e40ba801c0b52ec44e74a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a093d0bf43046aaa845f3cc115f3f5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116157) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:14:54.939465 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: INFO nova.api.openstack.requestlog [None req-6fc93c7e-9067-473b-9195-90146936159c tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] 10.222.0.18 "GET /compute/v2.1/servers/fa7c86bc-c46f-4120-8f3d-d795f8d7c5cc" status: 200 len: 1570 microversion: 2.1 time: 0.155052 Dec 15 03:14:54.940035 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: [pid: 116157|app: 0|req: 847/1696] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 03:14:54 2021] GET /compute/v2.1/servers/fa7c86bc-c46f-4120-8f3d-d795f8d7c5cc => generated 1570 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 03:14:55.242557 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi [None req-4e9be6b6-ef73-4357-84c2-524d1ebcf463 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Calling method '>' {{(pid=116157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:14:55.243164 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.compute.api [None req-4e9be6b6-ef73-4357-84c2-524d1ebcf463 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] [instance: bbb8462c-9501-4541-b67e-43ec5c5061a7] Fetching instance by UUID {{(pid=116157) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:14:55.248977 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-4e9be6b6-ef73-4357-84c2-524d1ebcf463 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:14:55.249435 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-4e9be6b6-ef73-4357-84c2-524d1ebcf463 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:14:55.250245 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-4e9be6b6-ef73-4357-84c2-524d1ebcf463 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:14:55.250689 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-4e9be6b6-ef73-4357-84c2-524d1ebcf463 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:14:55.316554 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.policy [None req-4e9be6b6-ef73-4357-84c2-524d1ebcf463 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97bdf19af9e34fc3886ff451cb9d7a27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '494b56bf5eae4d56a5591546f85bc32b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116157) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:14:55.325173 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: INFO nova.api.openstack.requestlog [None req-4e9be6b6-ef73-4357-84c2-524d1ebcf463 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] 10.222.0.18 "GET /compute/v2.1/servers/bbb8462c-9501-4541-b67e-43ec5c5061a7" status: 200 len: 1226 microversion: 2.1 time: 0.086208 Dec 15 03:14:55.325757 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: [pid: 116157|app: 0|req: 848/1697] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 03:14:55 2021] GET /compute/v2.1/servers/bbb8462c-9501-4541-b67e-43ec5c5061a7 => generated 1226 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 03:14:55.774282 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: INFO oslo.messaging._drivers.impl_rabbit [req-f1ed6acb-ec12-429e-9eb4-b1cbeb6adbc0 req-c338ade7-0924-43cc-88ff-7c4b36b6faa9 service nova] [c8a134cd-574d-4606-b1e0-1ba11bcd2772] Reconnected to AMQP server on 10.222.0.18:5672 via [amqp] client with port 60080. Dec 15 03:14:55.778146 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: INFO nova.api.openstack.requestlog [req-f1ed6acb-ec12-429e-9eb4-b1cbeb6adbc0 req-c338ade7-0924-43cc-88ff-7c4b36b6faa9 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 1.109753 Dec 15 03:14:55.778756 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: [pid: 116156|app: 0|req: 850/1698] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Dec 15 03:14:54 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 1112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 03:14:55.958201 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi [None req-114adf1a-efbf-4793-8ac8-4542652f3e30 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Calling method '>' {{(pid=116157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:14:55.958812 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.compute.api [None req-114adf1a-efbf-4793-8ac8-4542652f3e30 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] [instance: fa7c86bc-c46f-4120-8f3d-d795f8d7c5cc] Fetching instance by UUID {{(pid=116157) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:14:55.965044 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-114adf1a-efbf-4793-8ac8-4542652f3e30 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:14:55.965489 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-114adf1a-efbf-4793-8ac8-4542652f3e30 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:14:55.966360 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-114adf1a-efbf-4793-8ac8-4542652f3e30 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:14:55.966795 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-114adf1a-efbf-4793-8ac8-4542652f3e30 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:14:56.098065 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.policy [None req-114adf1a-efbf-4793-8ac8-4542652f3e30 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c4c0c82448e40ba801c0b52ec44e74a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a093d0bf43046aaa845f3cc115f3f5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116157) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:14:56.106012 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: INFO nova.api.openstack.requestlog [None req-114adf1a-efbf-4793-8ac8-4542652f3e30 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] 10.222.0.18 "GET /compute/v2.1/servers/fa7c86bc-c46f-4120-8f3d-d795f8d7c5cc" status: 200 len: 1570 microversion: 2.1 time: 0.151417 Dec 15 03:14:56.106720 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: [pid: 116157|app: 0|req: 849/1699] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 03:14:55 2021] GET /compute/v2.1/servers/fa7c86bc-c46f-4120-8f3d-d795f8d7c5cc => generated 1570 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 03:14:56.343678 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi [None req-3227fe23-2ace-4eb3-91f0-0e89c4457976 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Calling method '>' {{(pid=116156) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:14:56.344367 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.compute.api [None req-3227fe23-2ace-4eb3-91f0-0e89c4457976 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] [instance: bbb8462c-9501-4541-b67e-43ec5c5061a7] Fetching instance by UUID {{(pid=116156) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:14:56.350450 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-3227fe23-2ace-4eb3-91f0-0e89c4457976 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:14:56.350897 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-3227fe23-2ace-4eb3-91f0-0e89c4457976 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:14:56.351662 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-3227fe23-2ace-4eb3-91f0-0e89c4457976 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:14:56.352092 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-3227fe23-2ace-4eb3-91f0-0e89c4457976 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:14:56.411825 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.policy [None req-3227fe23-2ace-4eb3-91f0-0e89c4457976 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97bdf19af9e34fc3886ff451cb9d7a27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '494b56bf5eae4d56a5591546f85bc32b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116156) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:14:56.419619 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: INFO nova.api.openstack.requestlog [None req-3227fe23-2ace-4eb3-91f0-0e89c4457976 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] 10.222.0.18 "GET /compute/v2.1/servers/bbb8462c-9501-4541-b67e-43ec5c5061a7" status: 200 len: 1226 microversion: 2.1 time: 0.080973 Dec 15 03:14:56.420171 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: [pid: 116156|app: 0|req: 851/1700] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 03:14:56 2021] GET /compute/v2.1/servers/bbb8462c-9501-4541-b67e-43ec5c5061a7 => generated 1226 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 03:14:57.123601 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi [None req-ae0f09c8-a959-43d7-a4f9-2b49a5f1c35a tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Calling method '>' {{(pid=116157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:14:57.124216 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.compute.api [None req-ae0f09c8-a959-43d7-a4f9-2b49a5f1c35a tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] [instance: fa7c86bc-c46f-4120-8f3d-d795f8d7c5cc] Fetching instance by UUID {{(pid=116157) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:14:57.130543 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-ae0f09c8-a959-43d7-a4f9-2b49a5f1c35a tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:14:57.130992 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-ae0f09c8-a959-43d7-a4f9-2b49a5f1c35a tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:14:57.131764 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-ae0f09c8-a959-43d7-a4f9-2b49a5f1c35a tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:14:57.132230 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-ae0f09c8-a959-43d7-a4f9-2b49a5f1c35a tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:14:57.261962 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.policy [None req-ae0f09c8-a959-43d7-a4f9-2b49a5f1c35a tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c4c0c82448e40ba801c0b52ec44e74a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a093d0bf43046aaa845f3cc115f3f5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116157) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:14:57.269214 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: INFO nova.api.openstack.requestlog [None req-ae0f09c8-a959-43d7-a4f9-2b49a5f1c35a tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] 10.222.0.18 "GET /compute/v2.1/servers/fa7c86bc-c46f-4120-8f3d-d795f8d7c5cc" status: 200 len: 1451 microversion: 2.1 time: 0.149778 Dec 15 03:14:57.269775 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: [pid: 116157|app: 0|req: 850/1701] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 03:14:57 2021] GET /compute/v2.1/servers/fa7c86bc-c46f-4120-8f3d-d795f8d7c5cc => generated 1451 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 03:14:57.436358 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi [None req-2c6924cc-3c8a-429f-8ad8-e871baa80520 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Calling method '>' {{(pid=116156) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:14:57.437538 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.compute.api [None req-2c6924cc-3c8a-429f-8ad8-e871baa80520 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] [instance: bbb8462c-9501-4541-b67e-43ec5c5061a7] Fetching instance by UUID {{(pid=116156) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:14:57.443906 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-2c6924cc-3c8a-429f-8ad8-e871baa80520 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:14:57.444355 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-2c6924cc-3c8a-429f-8ad8-e871baa80520 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:14:57.445129 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-2c6924cc-3c8a-429f-8ad8-e871baa80520 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:14:57.445562 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-2c6924cc-3c8a-429f-8ad8-e871baa80520 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:14:57.504025 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.policy [None req-2c6924cc-3c8a-429f-8ad8-e871baa80520 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97bdf19af9e34fc3886ff451cb9d7a27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '494b56bf5eae4d56a5591546f85bc32b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116156) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:14:57.511232 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: INFO nova.api.openstack.requestlog [None req-2c6924cc-3c8a-429f-8ad8-e871baa80520 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] 10.222.0.18 "GET /compute/v2.1/servers/bbb8462c-9501-4541-b67e-43ec5c5061a7" status: 200 len: 1226 microversion: 2.1 time: 0.078684 Dec 15 03:14:57.511791 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: [pid: 116156|app: 0|req: 852/1702] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 03:14:57 2021] GET /compute/v2.1/servers/bbb8462c-9501-4541-b67e-43ec5c5061a7 => generated 1226 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 03:14:58.287796 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi [None req-2babbc7a-4bf0-45c9-9023-03c7fc1e8463 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Calling method '>' {{(pid=116157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:14:58.288419 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.compute.api [None req-2babbc7a-4bf0-45c9-9023-03c7fc1e8463 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] [instance: fa7c86bc-c46f-4120-8f3d-d795f8d7c5cc] Fetching instance by UUID {{(pid=116157) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:14:58.294806 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-2babbc7a-4bf0-45c9-9023-03c7fc1e8463 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:14:58.295259 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-2babbc7a-4bf0-45c9-9023-03c7fc1e8463 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:14:58.296084 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-2babbc7a-4bf0-45c9-9023-03c7fc1e8463 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:14:58.296511 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-2babbc7a-4bf0-45c9-9023-03c7fc1e8463 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:14:58.427440 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.policy [None req-2babbc7a-4bf0-45c9-9023-03c7fc1e8463 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c4c0c82448e40ba801c0b52ec44e74a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a093d0bf43046aaa845f3cc115f3f5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116157) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:14:58.435178 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: INFO nova.api.openstack.requestlog [None req-2babbc7a-4bf0-45c9-9023-03c7fc1e8463 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] 10.222.0.18 "GET /compute/v2.1/servers/fa7c86bc-c46f-4120-8f3d-d795f8d7c5cc" status: 200 len: 1451 microversion: 2.1 time: 0.152764 Dec 15 03:14:58.435735 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: [pid: 116157|app: 0|req: 851/1703] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 03:14:58 2021] GET /compute/v2.1/servers/fa7c86bc-c46f-4120-8f3d-d795f8d7c5cc => generated 1451 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 03:14:58.527875 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi [None req-282b49c4-5749-4893-a886-13ae1c080a32 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Calling method '>' {{(pid=116156) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:14:58.528393 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.compute.api [None req-282b49c4-5749-4893-a886-13ae1c080a32 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] [instance: bbb8462c-9501-4541-b67e-43ec5c5061a7] Fetching instance by UUID {{(pid=116156) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:14:58.539692 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-282b49c4-5749-4893-a886-13ae1c080a32 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:14:58.540149 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-282b49c4-5749-4893-a886-13ae1c080a32 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:14:58.540970 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-282b49c4-5749-4893-a886-13ae1c080a32 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:14:58.541512 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-282b49c4-5749-4893-a886-13ae1c080a32 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:14:58.600202 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.policy [None req-282b49c4-5749-4893-a886-13ae1c080a32 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97bdf19af9e34fc3886ff451cb9d7a27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '494b56bf5eae4d56a5591546f85bc32b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116156) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:14:58.607267 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: INFO nova.api.openstack.requestlog [None req-282b49c4-5749-4893-a886-13ae1c080a32 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] 10.222.0.18 "GET /compute/v2.1/servers/bbb8462c-9501-4541-b67e-43ec5c5061a7" status: 200 len: 1226 microversion: 2.1 time: 0.083250 Dec 15 03:14:58.607827 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: [pid: 116156|app: 0|req: 853/1704] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 03:14:58 2021] GET /compute/v2.1/servers/bbb8462c-9501-4541-b67e-43ec5c5061a7 => generated 1226 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 03:14:59.452212 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi [None req-269ad616-c300-44ed-974d-130832a192af tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Calling method '>' {{(pid=116157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:14:59.452965 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.compute.api [None req-269ad616-c300-44ed-974d-130832a192af tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] [instance: fa7c86bc-c46f-4120-8f3d-d795f8d7c5cc] Fetching instance by UUID {{(pid=116157) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:14:59.459688 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-269ad616-c300-44ed-974d-130832a192af tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:14:59.460141 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-269ad616-c300-44ed-974d-130832a192af tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:14:59.460926 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-269ad616-c300-44ed-974d-130832a192af tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:14:59.461361 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-269ad616-c300-44ed-974d-130832a192af tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:14:59.587837 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.policy [None req-269ad616-c300-44ed-974d-130832a192af tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c4c0c82448e40ba801c0b52ec44e74a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a093d0bf43046aaa845f3cc115f3f5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116157) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:14:59.595626 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: INFO nova.api.openstack.requestlog [None req-269ad616-c300-44ed-974d-130832a192af tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] 10.222.0.18 "GET /compute/v2.1/servers/fa7c86bc-c46f-4120-8f3d-d795f8d7c5cc" status: 200 len: 1451 microversion: 2.1 time: 0.147584 Dec 15 03:14:59.596189 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: [pid: 116157|app: 0|req: 852/1705] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 03:14:59 2021] GET /compute/v2.1/servers/fa7c86bc-c46f-4120-8f3d-d795f8d7c5cc => generated 1451 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 03:14:59.623828 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi [None req-164e0fd4-5e97-46e2-8403-076dc59700ee tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Calling method '>' {{(pid=116156) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:14:59.624432 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.compute.api [None req-164e0fd4-5e97-46e2-8403-076dc59700ee tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] [instance: bbb8462c-9501-4541-b67e-43ec5c5061a7] Fetching instance by UUID {{(pid=116156) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:14:59.630644 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-164e0fd4-5e97-46e2-8403-076dc59700ee tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:14:59.631094 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-164e0fd4-5e97-46e2-8403-076dc59700ee tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:14:59.631860 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-164e0fd4-5e97-46e2-8403-076dc59700ee tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:14:59.632293 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-164e0fd4-5e97-46e2-8403-076dc59700ee tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:14:59.689773 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.policy [None req-164e0fd4-5e97-46e2-8403-076dc59700ee tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97bdf19af9e34fc3886ff451cb9d7a27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '494b56bf5eae4d56a5591546f85bc32b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116156) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:14:59.696898 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: INFO nova.api.openstack.requestlog [None req-164e0fd4-5e97-46e2-8403-076dc59700ee tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] 10.222.0.18 "GET /compute/v2.1/servers/bbb8462c-9501-4541-b67e-43ec5c5061a7" status: 200 len: 1226 microversion: 2.1 time: 0.076625 Dec 15 03:14:59.697456 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: [pid: 116156|app: 0|req: 854/1706] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 03:14:59 2021] GET /compute/v2.1/servers/bbb8462c-9501-4541-b67e-43ec5c5061a7 => generated 1226 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 03:15:00.614299 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi [None req-c2cc7a59-b330-4289-b778-80999cd7e2e2 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Calling method '>' {{(pid=116157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:15:00.614912 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.compute.api [None req-c2cc7a59-b330-4289-b778-80999cd7e2e2 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] [instance: fa7c86bc-c46f-4120-8f3d-d795f8d7c5cc] Fetching instance by UUID {{(pid=116157) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:15:00.620687 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-c2cc7a59-b330-4289-b778-80999cd7e2e2 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:15:00.621139 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-c2cc7a59-b330-4289-b778-80999cd7e2e2 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:15:00.621920 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-c2cc7a59-b330-4289-b778-80999cd7e2e2 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:15:00.622391 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-c2cc7a59-b330-4289-b778-80999cd7e2e2 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:15:00.713495 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi [None req-bf1f160b-a9e2-4e28-811a-8bd98686e03a tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Calling method '>' {{(pid=116156) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:15:00.714260 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.compute.api [None req-bf1f160b-a9e2-4e28-811a-8bd98686e03a tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] [instance: bbb8462c-9501-4541-b67e-43ec5c5061a7] Fetching instance by UUID {{(pid=116156) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:15:00.721055 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-bf1f160b-a9e2-4e28-811a-8bd98686e03a tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:15:00.721593 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-bf1f160b-a9e2-4e28-811a-8bd98686e03a tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:15:00.722520 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-bf1f160b-a9e2-4e28-811a-8bd98686e03a tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:15:00.723029 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-bf1f160b-a9e2-4e28-811a-8bd98686e03a tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:15:00.756860 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.policy [None req-c2cc7a59-b330-4289-b778-80999cd7e2e2 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c4c0c82448e40ba801c0b52ec44e74a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a093d0bf43046aaa845f3cc115f3f5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116157) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:15:00.764117 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: INFO nova.api.openstack.requestlog [None req-c2cc7a59-b330-4289-b778-80999cd7e2e2 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] 10.222.0.18 "GET /compute/v2.1/servers/fa7c86bc-c46f-4120-8f3d-d795f8d7c5cc" status: 200 len: 1451 microversion: 2.1 time: 0.155246 Dec 15 03:15:00.764705 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: [pid: 116157|app: 0|req: 853/1707] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 03:15:00 2021] GET /compute/v2.1/servers/fa7c86bc-c46f-4120-8f3d-d795f8d7c5cc => generated 1451 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 03:15:00.782464 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.policy [None req-bf1f160b-a9e2-4e28-811a-8bd98686e03a tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97bdf19af9e34fc3886ff451cb9d7a27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '494b56bf5eae4d56a5591546f85bc32b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116156) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:15:00.789756 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: INFO nova.api.openstack.requestlog [None req-bf1f160b-a9e2-4e28-811a-8bd98686e03a tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] 10.222.0.18 "GET /compute/v2.1/servers/bbb8462c-9501-4541-b67e-43ec5c5061a7" status: 200 len: 1226 microversion: 2.1 time: 0.079970 Dec 15 03:15:00.790345 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: [pid: 116156|app: 0|req: 855/1708] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 03:15:00 2021] GET /compute/v2.1/servers/bbb8462c-9501-4541-b67e-43ec5c5061a7 => generated 1226 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 03:15:01.780448 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi [None req-fa00bd90-929b-42d5-930d-10b43ef37bf7 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Calling method '>' {{(pid=116157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:15:01.781056 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.compute.api [None req-fa00bd90-929b-42d5-930d-10b43ef37bf7 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] [instance: fa7c86bc-c46f-4120-8f3d-d795f8d7c5cc] Fetching instance by UUID {{(pid=116157) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:15:01.787352 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-fa00bd90-929b-42d5-930d-10b43ef37bf7 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:15:01.787804 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-fa00bd90-929b-42d5-930d-10b43ef37bf7 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:15:01.788581 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-fa00bd90-929b-42d5-930d-10b43ef37bf7 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:15:01.789018 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-fa00bd90-929b-42d5-930d-10b43ef37bf7 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:15:01.806915 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi [None req-bd167e59-4f44-4fff-95b3-67d099947d2a tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Calling method '>' {{(pid=116156) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:15:01.807531 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.compute.api [None req-bd167e59-4f44-4fff-95b3-67d099947d2a tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] [instance: bbb8462c-9501-4541-b67e-43ec5c5061a7] Fetching instance by UUID {{(pid=116156) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:15:01.814290 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-bd167e59-4f44-4fff-95b3-67d099947d2a tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:15:01.814751 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-bd167e59-4f44-4fff-95b3-67d099947d2a tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:15:01.815550 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-bd167e59-4f44-4fff-95b3-67d099947d2a tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:15:01.815993 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-bd167e59-4f44-4fff-95b3-67d099947d2a tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:15:01.877583 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.policy [None req-bd167e59-4f44-4fff-95b3-67d099947d2a tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97bdf19af9e34fc3886ff451cb9d7a27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '494b56bf5eae4d56a5591546f85bc32b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116156) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:15:01.885112 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: INFO nova.api.openstack.requestlog [None req-bd167e59-4f44-4fff-95b3-67d099947d2a tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] 10.222.0.18 "GET /compute/v2.1/servers/bbb8462c-9501-4541-b67e-43ec5c5061a7" status: 200 len: 1226 microversion: 2.1 time: 0.081804 Dec 15 03:15:01.885685 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: [pid: 116156|app: 0|req: 856/1709] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 03:15:01 2021] GET /compute/v2.1/servers/bbb8462c-9501-4541-b67e-43ec5c5061a7 => generated 1226 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 03:15:01.920284 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.policy [None req-fa00bd90-929b-42d5-930d-10b43ef37bf7 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c4c0c82448e40ba801c0b52ec44e74a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a093d0bf43046aaa845f3cc115f3f5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116157) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:15:01.927495 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: INFO nova.api.openstack.requestlog [None req-fa00bd90-929b-42d5-930d-10b43ef37bf7 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] 10.222.0.18 "GET /compute/v2.1/servers/fa7c86bc-c46f-4120-8f3d-d795f8d7c5cc" status: 200 len: 1451 microversion: 2.1 time: 0.150748 Dec 15 03:15:01.928052 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: [pid: 116157|app: 0|req: 854/1710] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 03:15:01 2021] GET /compute/v2.1/servers/fa7c86bc-c46f-4120-8f3d-d795f8d7c5cc => generated 1451 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 03:15:02.901633 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi [None req-585fce96-8337-4634-90e1-3dbeb0b8e98b tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Calling method '>' {{(pid=116156) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:15:02.902288 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.compute.api [None req-585fce96-8337-4634-90e1-3dbeb0b8e98b tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] [instance: bbb8462c-9501-4541-b67e-43ec5c5061a7] Fetching instance by UUID {{(pid=116156) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:15:02.908528 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-585fce96-8337-4634-90e1-3dbeb0b8e98b tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:15:02.908973 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-585fce96-8337-4634-90e1-3dbeb0b8e98b tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:15:02.909767 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-585fce96-8337-4634-90e1-3dbeb0b8e98b tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:15:02.910233 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-585fce96-8337-4634-90e1-3dbeb0b8e98b tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:15:02.944135 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi [None req-137adf7c-fee5-440c-833b-cba5f270f586 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Calling method '>' {{(pid=116157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:15:02.944739 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.compute.api [None req-137adf7c-fee5-440c-833b-cba5f270f586 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] [instance: fa7c86bc-c46f-4120-8f3d-d795f8d7c5cc] Fetching instance by UUID {{(pid=116157) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:15:02.951658 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-137adf7c-fee5-440c-833b-cba5f270f586 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:15:02.952108 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-137adf7c-fee5-440c-833b-cba5f270f586 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:15:02.952888 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-137adf7c-fee5-440c-833b-cba5f270f586 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:15:02.953319 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-137adf7c-fee5-440c-833b-cba5f270f586 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:15:02.967888 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.policy [None req-585fce96-8337-4634-90e1-3dbeb0b8e98b tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97bdf19af9e34fc3886ff451cb9d7a27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '494b56bf5eae4d56a5591546f85bc32b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116156) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:15:02.975051 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: INFO nova.api.openstack.requestlog [None req-585fce96-8337-4634-90e1-3dbeb0b8e98b tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] 10.222.0.18 "GET /compute/v2.1/servers/bbb8462c-9501-4541-b67e-43ec5c5061a7" status: 200 len: 1226 microversion: 2.1 time: 0.076991 Dec 15 03:15:02.975618 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: [pid: 116156|app: 0|req: 857/1711] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 03:15:02 2021] GET /compute/v2.1/servers/bbb8462c-9501-4541-b67e-43ec5c5061a7 => generated 1226 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 03:15:03.081380 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.policy [None req-137adf7c-fee5-440c-833b-cba5f270f586 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c4c0c82448e40ba801c0b52ec44e74a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a093d0bf43046aaa845f3cc115f3f5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116157) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:15:03.088637 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: INFO nova.api.openstack.requestlog [None req-137adf7c-fee5-440c-833b-cba5f270f586 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] 10.222.0.18 "GET /compute/v2.1/servers/fa7c86bc-c46f-4120-8f3d-d795f8d7c5cc" status: 200 len: 1451 microversion: 2.1 time: 0.148032 Dec 15 03:15:03.089202 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: [pid: 116157|app: 0|req: 855/1712] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 03:15:02 2021] GET /compute/v2.1/servers/fa7c86bc-c46f-4120-8f3d-d795f8d7c5cc => generated 1451 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 03:15:03.991859 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi [None req-81363864-63f1-43af-ae02-7e930617323a tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Calling method '>' {{(pid=116156) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:15:03.992479 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.compute.api [None req-81363864-63f1-43af-ae02-7e930617323a tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] [instance: bbb8462c-9501-4541-b67e-43ec5c5061a7] Fetching instance by UUID {{(pid=116156) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:15:03.998695 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-81363864-63f1-43af-ae02-7e930617323a tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:15:03.999148 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-81363864-63f1-43af-ae02-7e930617323a tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:15:03.999929 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-81363864-63f1-43af-ae02-7e930617323a tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:15:04.000366 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-81363864-63f1-43af-ae02-7e930617323a tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:15:04.057922 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.policy [None req-81363864-63f1-43af-ae02-7e930617323a tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97bdf19af9e34fc3886ff451cb9d7a27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '494b56bf5eae4d56a5591546f85bc32b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116156) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:15:04.065072 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: INFO nova.api.openstack.requestlog [None req-81363864-63f1-43af-ae02-7e930617323a tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] 10.222.0.18 "GET /compute/v2.1/servers/bbb8462c-9501-4541-b67e-43ec5c5061a7" status: 200 len: 1226 microversion: 2.1 time: 0.076832 Dec 15 03:15:04.065628 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: [pid: 116156|app: 0|req: 858/1713] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 03:15:03 2021] GET /compute/v2.1/servers/bbb8462c-9501-4541-b67e-43ec5c5061a7 => generated 1226 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 03:15:04.105125 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi [None req-5cc261dc-3b9f-4777-9bea-d16764d8df28 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Calling method '>' {{(pid=116157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:15:04.105847 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.compute.api [None req-5cc261dc-3b9f-4777-9bea-d16764d8df28 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] [instance: fa7c86bc-c46f-4120-8f3d-d795f8d7c5cc] Fetching instance by UUID {{(pid=116157) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:15:04.112334 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-5cc261dc-3b9f-4777-9bea-d16764d8df28 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:15:04.112786 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-5cc261dc-3b9f-4777-9bea-d16764d8df28 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:15:04.113562 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-5cc261dc-3b9f-4777-9bea-d16764d8df28 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:15:04.114022 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-5cc261dc-3b9f-4777-9bea-d16764d8df28 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:15:04.247499 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.policy [None req-5cc261dc-3b9f-4777-9bea-d16764d8df28 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c4c0c82448e40ba801c0b52ec44e74a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a093d0bf43046aaa845f3cc115f3f5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116157) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:15:04.254695 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: INFO nova.api.openstack.requestlog [None req-5cc261dc-3b9f-4777-9bea-d16764d8df28 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] 10.222.0.18 "GET /compute/v2.1/servers/fa7c86bc-c46f-4120-8f3d-d795f8d7c5cc" status: 200 len: 1451 microversion: 2.1 time: 0.153173 Dec 15 03:15:04.255259 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: [pid: 116157|app: 0|req: 856/1714] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 03:15:04 2021] GET /compute/v2.1/servers/fa7c86bc-c46f-4120-8f3d-d795f8d7c5cc => generated 1451 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 03:15:05.082259 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi [None req-534ad1f4-23c3-4198-b466-494c69567ce1 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Calling method '>' {{(pid=116156) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:15:05.082872 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.compute.api [None req-534ad1f4-23c3-4198-b466-494c69567ce1 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] [instance: bbb8462c-9501-4541-b67e-43ec5c5061a7] Fetching instance by UUID {{(pid=116156) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:15:05.089117 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-534ad1f4-23c3-4198-b466-494c69567ce1 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:15:05.090154 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-534ad1f4-23c3-4198-b466-494c69567ce1 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:15:05.090928 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-534ad1f4-23c3-4198-b466-494c69567ce1 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:15:05.091362 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-534ad1f4-23c3-4198-b466-494c69567ce1 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:15:05.148718 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.policy [None req-534ad1f4-23c3-4198-b466-494c69567ce1 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97bdf19af9e34fc3886ff451cb9d7a27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '494b56bf5eae4d56a5591546f85bc32b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116156) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:15:05.156466 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: INFO nova.api.openstack.requestlog [None req-534ad1f4-23c3-4198-b466-494c69567ce1 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] 10.222.0.18 "GET /compute/v2.1/servers/bbb8462c-9501-4541-b67e-43ec5c5061a7" status: 200 len: 1226 microversion: 2.1 time: 0.077899 Dec 15 03:15:05.157020 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: [pid: 116156|app: 0|req: 859/1715] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 03:15:05 2021] GET /compute/v2.1/servers/bbb8462c-9501-4541-b67e-43ec5c5061a7 => generated 1226 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 03:15:05.271888 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi [None req-2cfc601c-2616-4dd6-b0a7-93dfc656cbbf tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Calling method '>' {{(pid=116157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:15:05.272494 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.compute.api [None req-2cfc601c-2616-4dd6-b0a7-93dfc656cbbf tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] [instance: fa7c86bc-c46f-4120-8f3d-d795f8d7c5cc] Fetching instance by UUID {{(pid=116157) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:15:05.278727 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-2cfc601c-2616-4dd6-b0a7-93dfc656cbbf tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:15:05.279175 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-2cfc601c-2616-4dd6-b0a7-93dfc656cbbf tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:15:05.279949 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-2cfc601c-2616-4dd6-b0a7-93dfc656cbbf tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:15:05.280385 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-2cfc601c-2616-4dd6-b0a7-93dfc656cbbf tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:15:05.408695 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.policy [None req-2cfc601c-2616-4dd6-b0a7-93dfc656cbbf tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c4c0c82448e40ba801c0b52ec44e74a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a093d0bf43046aaa845f3cc115f3f5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116157) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:15:05.415830 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: INFO nova.api.openstack.requestlog [None req-2cfc601c-2616-4dd6-b0a7-93dfc656cbbf tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] 10.222.0.18 "GET /compute/v2.1/servers/fa7c86bc-c46f-4120-8f3d-d795f8d7c5cc" status: 200 len: 1451 microversion: 2.1 time: 0.147629 Dec 15 03:15:05.416378 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: [pid: 116157|app: 0|req: 857/1716] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 03:15:05 2021] GET /compute/v2.1/servers/fa7c86bc-c46f-4120-8f3d-d795f8d7c5cc => generated 1451 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 03:15:06.172639 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi [None req-44ba7111-ef1d-44b6-a95b-ae77088a7f31 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Calling method '>' {{(pid=116156) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:15:06.173275 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.compute.api [None req-44ba7111-ef1d-44b6-a95b-ae77088a7f31 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] [instance: bbb8462c-9501-4541-b67e-43ec5c5061a7] Fetching instance by UUID {{(pid=116156) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:15:06.179558 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-44ba7111-ef1d-44b6-a95b-ae77088a7f31 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:15:06.180011 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-44ba7111-ef1d-44b6-a95b-ae77088a7f31 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:15:06.180786 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-44ba7111-ef1d-44b6-a95b-ae77088a7f31 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:15:06.181223 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-44ba7111-ef1d-44b6-a95b-ae77088a7f31 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:15:06.239884 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.policy [None req-44ba7111-ef1d-44b6-a95b-ae77088a7f31 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97bdf19af9e34fc3886ff451cb9d7a27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '494b56bf5eae4d56a5591546f85bc32b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116156) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:15:06.247112 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: INFO nova.api.openstack.requestlog [None req-44ba7111-ef1d-44b6-a95b-ae77088a7f31 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] 10.222.0.18 "GET /compute/v2.1/servers/bbb8462c-9501-4541-b67e-43ec5c5061a7" status: 200 len: 1226 microversion: 2.1 time: 0.078119 Dec 15 03:15:06.247677 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: [pid: 116156|app: 0|req: 860/1717] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 03:15:06 2021] GET /compute/v2.1/servers/bbb8462c-9501-4541-b67e-43ec5c5061a7 => generated 1226 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 03:15:06.431733 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi [None req-5681db5f-c1df-418a-bdb0-648046414d39 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Calling method '>' {{(pid=116157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:15:06.432262 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.compute.api [None req-5681db5f-c1df-418a-bdb0-648046414d39 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] [instance: fa7c86bc-c46f-4120-8f3d-d795f8d7c5cc] Fetching instance by UUID {{(pid=116157) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:15:06.438444 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-5681db5f-c1df-418a-bdb0-648046414d39 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:15:06.438895 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-5681db5f-c1df-418a-bdb0-648046414d39 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:15:06.439989 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-5681db5f-c1df-418a-bdb0-648046414d39 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:15:06.440429 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-5681db5f-c1df-418a-bdb0-648046414d39 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:15:06.571613 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.policy [None req-5681db5f-c1df-418a-bdb0-648046414d39 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c4c0c82448e40ba801c0b52ec44e74a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a093d0bf43046aaa845f3cc115f3f5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116157) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:15:06.579427 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: INFO nova.api.openstack.requestlog [None req-5681db5f-c1df-418a-bdb0-648046414d39 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] 10.222.0.18 "GET /compute/v2.1/servers/fa7c86bc-c46f-4120-8f3d-d795f8d7c5cc" status: 200 len: 1451 microversion: 2.1 time: 0.151414 Dec 15 03:15:06.579988 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: [pid: 116157|app: 0|req: 858/1718] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 03:15:06 2021] GET /compute/v2.1/servers/fa7c86bc-c46f-4120-8f3d-d795f8d7c5cc => generated 1451 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 03:15:07.263725 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi [None req-caa04a34-e4d5-44b7-8abf-70b9c80fc7b8 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Calling method '>' {{(pid=116156) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:15:07.264341 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.compute.api [None req-caa04a34-e4d5-44b7-8abf-70b9c80fc7b8 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] [instance: bbb8462c-9501-4541-b67e-43ec5c5061a7] Fetching instance by UUID {{(pid=116156) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:15:07.270589 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-caa04a34-e4d5-44b7-8abf-70b9c80fc7b8 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:15:07.271063 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-caa04a34-e4d5-44b7-8abf-70b9c80fc7b8 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:15:07.271826 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-caa04a34-e4d5-44b7-8abf-70b9c80fc7b8 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:15:07.272265 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-caa04a34-e4d5-44b7-8abf-70b9c80fc7b8 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:15:07.330817 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.policy [None req-caa04a34-e4d5-44b7-8abf-70b9c80fc7b8 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97bdf19af9e34fc3886ff451cb9d7a27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '494b56bf5eae4d56a5591546f85bc32b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116156) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:15:07.338164 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: INFO nova.api.openstack.requestlog [None req-caa04a34-e4d5-44b7-8abf-70b9c80fc7b8 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] 10.222.0.18 "GET /compute/v2.1/servers/bbb8462c-9501-4541-b67e-43ec5c5061a7" status: 200 len: 1226 microversion: 2.1 time: 0.078019 Dec 15 03:15:07.338723 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: [pid: 116156|app: 0|req: 861/1719] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 03:15:07 2021] GET /compute/v2.1/servers/bbb8462c-9501-4541-b67e-43ec5c5061a7 => generated 1226 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 03:15:07.596176 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi [None req-8ffefd8f-1fec-48af-8647-f5ef22c299c1 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Calling method '>' {{(pid=116157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:15:07.596809 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.compute.api [None req-8ffefd8f-1fec-48af-8647-f5ef22c299c1 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] [instance: fa7c86bc-c46f-4120-8f3d-d795f8d7c5cc] Fetching instance by UUID {{(pid=116157) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:15:07.603023 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-8ffefd8f-1fec-48af-8647-f5ef22c299c1 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:15:07.603474 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-8ffefd8f-1fec-48af-8647-f5ef22c299c1 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:15:07.604248 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-8ffefd8f-1fec-48af-8647-f5ef22c299c1 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:15:07.604689 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-8ffefd8f-1fec-48af-8647-f5ef22c299c1 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:15:07.732716 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.policy [None req-8ffefd8f-1fec-48af-8647-f5ef22c299c1 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c4c0c82448e40ba801c0b52ec44e74a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a093d0bf43046aaa845f3cc115f3f5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116157) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:15:07.740253 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: INFO nova.api.openstack.requestlog [None req-8ffefd8f-1fec-48af-8647-f5ef22c299c1 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] 10.222.0.18 "GET /compute/v2.1/servers/fa7c86bc-c46f-4120-8f3d-d795f8d7c5cc" status: 200 len: 1451 microversion: 2.1 time: 0.147768 Dec 15 03:15:07.740812 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: [pid: 116157|app: 0|req: 859/1720] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 03:15:07 2021] GET /compute/v2.1/servers/fa7c86bc-c46f-4120-8f3d-d795f8d7c5cc => generated 1451 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 03:15:08.354543 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi [None req-d476b8fc-908c-46bb-856c-5e9324e06b03 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Calling method '>' {{(pid=116156) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:15:08.355194 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.compute.api [None req-d476b8fc-908c-46bb-856c-5e9324e06b03 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] [instance: bbb8462c-9501-4541-b67e-43ec5c5061a7] Fetching instance by UUID {{(pid=116156) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:15:08.361498 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-d476b8fc-908c-46bb-856c-5e9324e06b03 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:15:08.361947 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-d476b8fc-908c-46bb-856c-5e9324e06b03 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:15:08.362742 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-d476b8fc-908c-46bb-856c-5e9324e06b03 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:15:08.363173 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-d476b8fc-908c-46bb-856c-5e9324e06b03 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:15:08.424381 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.policy [None req-d476b8fc-908c-46bb-856c-5e9324e06b03 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97bdf19af9e34fc3886ff451cb9d7a27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '494b56bf5eae4d56a5591546f85bc32b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116156) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:15:08.431553 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: INFO nova.api.openstack.requestlog [None req-d476b8fc-908c-46bb-856c-5e9324e06b03 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] 10.222.0.18 "GET /compute/v2.1/servers/bbb8462c-9501-4541-b67e-43ec5c5061a7" status: 200 len: 1226 microversion: 2.1 time: 0.080732 Dec 15 03:15:08.432115 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: [pid: 116156|app: 0|req: 862/1721] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 03:15:08 2021] GET /compute/v2.1/servers/bbb8462c-9501-4541-b67e-43ec5c5061a7 => generated 1226 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 03:15:08.756784 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi [None req-f0093f43-5ca0-44db-85b6-9697ea995162 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Calling method '>' {{(pid=116157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:15:08.757430 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.compute.api [None req-f0093f43-5ca0-44db-85b6-9697ea995162 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] [instance: fa7c86bc-c46f-4120-8f3d-d795f8d7c5cc] Fetching instance by UUID {{(pid=116157) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:15:08.763738 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-f0093f43-5ca0-44db-85b6-9697ea995162 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:15:08.764190 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-f0093f43-5ca0-44db-85b6-9697ea995162 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:15:08.764973 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-f0093f43-5ca0-44db-85b6-9697ea995162 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:15:08.765413 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-f0093f43-5ca0-44db-85b6-9697ea995162 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:15:08.895595 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.policy [None req-f0093f43-5ca0-44db-85b6-9697ea995162 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c4c0c82448e40ba801c0b52ec44e74a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a093d0bf43046aaa845f3cc115f3f5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116157) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:15:08.903324 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: INFO nova.api.openstack.requestlog [None req-f0093f43-5ca0-44db-85b6-9697ea995162 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] 10.222.0.18 "GET /compute/v2.1/servers/fa7c86bc-c46f-4120-8f3d-d795f8d7c5cc" status: 200 len: 1451 microversion: 2.1 time: 0.150587 Dec 15 03:15:08.903883 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: [pid: 116157|app: 0|req: 860/1722] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 03:15:08 2021] GET /compute/v2.1/servers/fa7c86bc-c46f-4120-8f3d-d795f8d7c5cc => generated 1451 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 03:15:09.448737 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi [None req-c792a3e2-ab50-4c41-938f-a749ecd860e0 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Calling method '>' {{(pid=116156) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:15:09.449869 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.compute.api [None req-c792a3e2-ab50-4c41-938f-a749ecd860e0 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] [instance: bbb8462c-9501-4541-b67e-43ec5c5061a7] Fetching instance by UUID {{(pid=116156) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:15:09.456072 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-c792a3e2-ab50-4c41-938f-a749ecd860e0 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:15:09.456550 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-c792a3e2-ab50-4c41-938f-a749ecd860e0 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:15:09.457462 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-c792a3e2-ab50-4c41-938f-a749ecd860e0 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:15:09.458001 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-c792a3e2-ab50-4c41-938f-a749ecd860e0 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:15:09.517409 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.policy [None req-c792a3e2-ab50-4c41-938f-a749ecd860e0 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97bdf19af9e34fc3886ff451cb9d7a27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '494b56bf5eae4d56a5591546f85bc32b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116156) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:15:09.524561 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: INFO nova.api.openstack.requestlog [None req-c792a3e2-ab50-4c41-938f-a749ecd860e0 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] 10.222.0.18 "GET /compute/v2.1/servers/bbb8462c-9501-4541-b67e-43ec5c5061a7" status: 200 len: 1226 microversion: 2.1 time: 0.079532 Dec 15 03:15:09.525111 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: [pid: 116156|app: 0|req: 863/1723] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 03:15:09 2021] GET /compute/v2.1/servers/bbb8462c-9501-4541-b67e-43ec5c5061a7 => generated 1226 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 03:15:09.920720 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi [None req-e0292619-3f56-4096-a198-8d55b80c508a tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Calling method '>' {{(pid=116157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:15:09.921366 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.compute.api [None req-e0292619-3f56-4096-a198-8d55b80c508a tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] [instance: fa7c86bc-c46f-4120-8f3d-d795f8d7c5cc] Fetching instance by UUID {{(pid=116157) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:15:09.928946 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-e0292619-3f56-4096-a198-8d55b80c508a tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:15:09.929401 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-e0292619-3f56-4096-a198-8d55b80c508a tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:15:09.930225 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-e0292619-3f56-4096-a198-8d55b80c508a tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:15:09.930666 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-e0292619-3f56-4096-a198-8d55b80c508a tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:15:10.057760 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.policy [None req-e0292619-3f56-4096-a198-8d55b80c508a tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c4c0c82448e40ba801c0b52ec44e74a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a093d0bf43046aaa845f3cc115f3f5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116157) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:15:10.065538 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: INFO nova.api.openstack.requestlog [None req-e0292619-3f56-4096-a198-8d55b80c508a tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] 10.222.0.18 "GET /compute/v2.1/servers/fa7c86bc-c46f-4120-8f3d-d795f8d7c5cc" status: 200 len: 1451 microversion: 2.1 time: 0.149190 Dec 15 03:15:10.066134 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: [pid: 116157|app: 0|req: 861/1724] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 03:15:09 2021] GET /compute/v2.1/servers/fa7c86bc-c46f-4120-8f3d-d795f8d7c5cc => generated 1451 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 03:15:10.542053 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi [None req-75de3a7d-1d03-4ba4-b078-f5095a42dcf6 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Calling method '>' {{(pid=116156) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:15:10.542637 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.compute.api [None req-75de3a7d-1d03-4ba4-b078-f5095a42dcf6 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] [instance: bbb8462c-9501-4541-b67e-43ec5c5061a7] Fetching instance by UUID {{(pid=116156) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:15:10.549172 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-75de3a7d-1d03-4ba4-b078-f5095a42dcf6 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:15:10.549625 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-75de3a7d-1d03-4ba4-b078-f5095a42dcf6 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:15:10.550447 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-75de3a7d-1d03-4ba4-b078-f5095a42dcf6 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:15:10.550887 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-75de3a7d-1d03-4ba4-b078-f5095a42dcf6 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:15:10.610306 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.policy [None req-75de3a7d-1d03-4ba4-b078-f5095a42dcf6 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97bdf19af9e34fc3886ff451cb9d7a27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '494b56bf5eae4d56a5591546f85bc32b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116156) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:15:10.618169 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: INFO nova.api.openstack.requestlog [None req-75de3a7d-1d03-4ba4-b078-f5095a42dcf6 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] 10.222.0.18 "GET /compute/v2.1/servers/bbb8462c-9501-4541-b67e-43ec5c5061a7" status: 200 len: 1226 microversion: 2.1 time: 0.079888 Dec 15 03:15:10.618611 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: [pid: 116156|app: 0|req: 864/1725] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 03:15:10 2021] GET /compute/v2.1/servers/bbb8462c-9501-4541-b67e-43ec5c5061a7 => generated 1226 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 03:15:10.988927 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi [None req-f0161299-4fe2-42f8-9129-ab9ed2e683c4 tempest-VolumesSnapshotTestJSON-925980516 tempest-VolumesSnapshotTestJSON-925980516-project] Calling method '>' {{(pid=116157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:15:10.989748 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.compute.api [None req-f0161299-4fe2-42f8-9129-ab9ed2e683c4 tempest-VolumesSnapshotTestJSON-925980516 tempest-VolumesSnapshotTestJSON-925980516-project] [instance: a0097d88-6613-416a-9f4d-1bb285e53291] Fetching instance by UUID {{(pid=116157) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:15:10.996047 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-f0161299-4fe2-42f8-9129-ab9ed2e683c4 tempest-VolumesSnapshotTestJSON-925980516 tempest-VolumesSnapshotTestJSON-925980516-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:15:10.996497 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-f0161299-4fe2-42f8-9129-ab9ed2e683c4 tempest-VolumesSnapshotTestJSON-925980516 tempest-VolumesSnapshotTestJSON-925980516-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:15:10.997272 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-f0161299-4fe2-42f8-9129-ab9ed2e683c4 tempest-VolumesSnapshotTestJSON-925980516 tempest-VolumesSnapshotTestJSON-925980516-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:15:10.997706 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-f0161299-4fe2-42f8-9129-ab9ed2e683c4 tempest-VolumesSnapshotTestJSON-925980516 tempest-VolumesSnapshotTestJSON-925980516-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:15:11.082347 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi [None req-f8ed8572-9087-4256-9737-e261bf6b7147 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Calling method '>' {{(pid=116156) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:15:11.082980 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.compute.api [None req-f8ed8572-9087-4256-9737-e261bf6b7147 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] [instance: fa7c86bc-c46f-4120-8f3d-d795f8d7c5cc] Fetching instance by UUID {{(pid=116156) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:15:11.088647 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-f8ed8572-9087-4256-9737-e261bf6b7147 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:15:11.089095 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-f8ed8572-9087-4256-9737-e261bf6b7147 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:15:11.089928 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-f8ed8572-9087-4256-9737-e261bf6b7147 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:15:11.090395 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-f8ed8572-9087-4256-9737-e261bf6b7147 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:15:11.218062 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.policy [None req-f8ed8572-9087-4256-9737-e261bf6b7147 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c4c0c82448e40ba801c0b52ec44e74a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a093d0bf43046aaa845f3cc115f3f5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116156) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:15:11.225195 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: INFO nova.api.openstack.requestlog [None req-f8ed8572-9087-4256-9737-e261bf6b7147 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] 10.222.0.18 "GET /compute/v2.1/servers/fa7c86bc-c46f-4120-8f3d-d795f8d7c5cc" status: 200 len: 1451 microversion: 2.1 time: 0.146556 Dec 15 03:15:11.225751 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: [pid: 116156|app: 0|req: 865/1726] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 03:15:11 2021] GET /compute/v2.1/servers/fa7c86bc-c46f-4120-8f3d-d795f8d7c5cc => generated 1451 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 03:15:11.633846 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi [None req-45f4305c-5c97-4400-9009-e2bea537b9f9 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Calling method '>' {{(pid=116156) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:15:11.634533 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.compute.api [None req-45f4305c-5c97-4400-9009-e2bea537b9f9 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] [instance: bbb8462c-9501-4541-b67e-43ec5c5061a7] Fetching instance by UUID {{(pid=116156) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:15:11.640787 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-45f4305c-5c97-4400-9009-e2bea537b9f9 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:15:11.641235 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-45f4305c-5c97-4400-9009-e2bea537b9f9 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:15:11.642030 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-45f4305c-5c97-4400-9009-e2bea537b9f9 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:15:11.642470 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-45f4305c-5c97-4400-9009-e2bea537b9f9 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:15:11.702948 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.policy [None req-45f4305c-5c97-4400-9009-e2bea537b9f9 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97bdf19af9e34fc3886ff451cb9d7a27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '494b56bf5eae4d56a5591546f85bc32b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116156) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:15:11.710121 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: INFO nova.api.openstack.requestlog [None req-45f4305c-5c97-4400-9009-e2bea537b9f9 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] 10.222.0.18 "GET /compute/v2.1/servers/bbb8462c-9501-4541-b67e-43ec5c5061a7" status: 200 len: 1226 microversion: 2.1 time: 0.079790 Dec 15 03:15:11.710675 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: [pid: 116156|app: 0|req: 866/1727] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 03:15:11 2021] GET /compute/v2.1/servers/bbb8462c-9501-4541-b67e-43ec5c5061a7 => generated 1226 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 03:15:12.241925 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi [None req-52985c66-5e6c-44a2-a7a4-cc319a5f0d92 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Calling method '>' {{(pid=116156) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:15:12.242560 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.compute.api [None req-52985c66-5e6c-44a2-a7a4-cc319a5f0d92 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] [instance: fa7c86bc-c46f-4120-8f3d-d795f8d7c5cc] Fetching instance by UUID {{(pid=116156) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:15:12.248385 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-52985c66-5e6c-44a2-a7a4-cc319a5f0d92 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:15:12.248834 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-52985c66-5e6c-44a2-a7a4-cc319a5f0d92 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:15:12.249614 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-52985c66-5e6c-44a2-a7a4-cc319a5f0d92 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:15:12.250107 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-52985c66-5e6c-44a2-a7a4-cc319a5f0d92 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:15:12.376434 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.policy [None req-52985c66-5e6c-44a2-a7a4-cc319a5f0d92 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c4c0c82448e40ba801c0b52ec44e74a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a093d0bf43046aaa845f3cc115f3f5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116156) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:15:12.383747 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: INFO nova.api.openstack.requestlog [None req-52985c66-5e6c-44a2-a7a4-cc319a5f0d92 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] 10.222.0.18 "GET /compute/v2.1/servers/fa7c86bc-c46f-4120-8f3d-d795f8d7c5cc" status: 200 len: 1451 microversion: 2.1 time: 0.145468 Dec 15 03:15:12.384315 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: [pid: 116156|app: 0|req: 867/1728] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 03:15:12 2021] GET /compute/v2.1/servers/fa7c86bc-c46f-4120-8f3d-d795f8d7c5cc => generated 1451 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 03:15:12.726544 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi [None req-568076a5-d16d-43a8-871b-3b47af5d92be tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Calling method '>' {{(pid=116156) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:15:12.727206 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.compute.api [None req-568076a5-d16d-43a8-871b-3b47af5d92be tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] [instance: bbb8462c-9501-4541-b67e-43ec5c5061a7] Fetching instance by UUID {{(pid=116156) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:15:12.734015 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-568076a5-d16d-43a8-871b-3b47af5d92be tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:15:12.734470 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-568076a5-d16d-43a8-871b-3b47af5d92be tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:15:12.735250 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-568076a5-d16d-43a8-871b-3b47af5d92be tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:15:12.735951 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-568076a5-d16d-43a8-871b-3b47af5d92be tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:15:12.793615 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.policy [None req-568076a5-d16d-43a8-871b-3b47af5d92be tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97bdf19af9e34fc3886ff451cb9d7a27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '494b56bf5eae4d56a5591546f85bc32b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116156) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:15:12.800801 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: INFO nova.api.openstack.requestlog [None req-568076a5-d16d-43a8-871b-3b47af5d92be tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] 10.222.0.18 "GET /compute/v2.1/servers/bbb8462c-9501-4541-b67e-43ec5c5061a7" status: 200 len: 1226 microversion: 2.1 time: 0.077873 Dec 15 03:15:12.801360 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: [pid: 116156|app: 0|req: 868/1729] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 03:15:12 2021] GET /compute/v2.1/servers/bbb8462c-9501-4541-b67e-43ec5c5061a7 => generated 1226 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 03:15:13.401297 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi [None req-08e701a2-5f0b-4375-8b48-7279c5afecdb tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Calling method '>' {{(pid=116156) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:15:13.401910 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.compute.api [None req-08e701a2-5f0b-4375-8b48-7279c5afecdb tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] [instance: fa7c86bc-c46f-4120-8f3d-d795f8d7c5cc] Fetching instance by UUID {{(pid=116156) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:15:13.407781 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-08e701a2-5f0b-4375-8b48-7279c5afecdb tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:15:13.408231 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-08e701a2-5f0b-4375-8b48-7279c5afecdb tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:15:13.409007 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-08e701a2-5f0b-4375-8b48-7279c5afecdb tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:15:13.409442 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-08e701a2-5f0b-4375-8b48-7279c5afecdb tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:15:13.540136 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.policy [None req-08e701a2-5f0b-4375-8b48-7279c5afecdb tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c4c0c82448e40ba801c0b52ec44e74a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a093d0bf43046aaa845f3cc115f3f5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116156) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:15:13.547377 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: INFO nova.api.openstack.requestlog [None req-08e701a2-5f0b-4375-8b48-7279c5afecdb tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] 10.222.0.18 "GET /compute/v2.1/servers/fa7c86bc-c46f-4120-8f3d-d795f8d7c5cc" status: 200 len: 1451 microversion: 2.1 time: 0.149719 Dec 15 03:15:13.547934 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: [pid: 116156|app: 0|req: 869/1730] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 03:15:13 2021] GET /compute/v2.1/servers/fa7c86bc-c46f-4120-8f3d-d795f8d7c5cc => generated 1451 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 03:15:13.816537 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi [None req-385f3494-a03e-4264-ae53-3911aa1795dd tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Calling method '>' {{(pid=116156) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:15:13.817186 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.compute.api [None req-385f3494-a03e-4264-ae53-3911aa1795dd tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] [instance: bbb8462c-9501-4541-b67e-43ec5c5061a7] Fetching instance by UUID {{(pid=116156) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:15:13.825093 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-385f3494-a03e-4264-ae53-3911aa1795dd tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:15:13.825546 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-385f3494-a03e-4264-ae53-3911aa1795dd tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:15:13.826356 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-385f3494-a03e-4264-ae53-3911aa1795dd tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:15:13.826792 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-385f3494-a03e-4264-ae53-3911aa1795dd tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:15:13.885093 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.policy [None req-385f3494-a03e-4264-ae53-3911aa1795dd tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97bdf19af9e34fc3886ff451cb9d7a27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '494b56bf5eae4d56a5591546f85bc32b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116156) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:15:13.892335 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: INFO nova.api.openstack.requestlog [None req-385f3494-a03e-4264-ae53-3911aa1795dd tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] 10.222.0.18 "GET /compute/v2.1/servers/bbb8462c-9501-4541-b67e-43ec5c5061a7" status: 200 len: 1226 microversion: 2.1 time: 0.079359 Dec 15 03:15:13.892896 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: [pid: 116156|app: 0|req: 870/1731] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 03:15:13 2021] GET /compute/v2.1/servers/bbb8462c-9501-4541-b67e-43ec5c5061a7 => generated 1226 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 03:15:14.564706 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi [None req-c265500f-daba-474f-9daf-0838a92b276d tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Calling method '>' {{(pid=116156) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:15:14.565310 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.compute.api [None req-c265500f-daba-474f-9daf-0838a92b276d tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] [instance: fa7c86bc-c46f-4120-8f3d-d795f8d7c5cc] Fetching instance by UUID {{(pid=116156) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:15:14.571129 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-c265500f-daba-474f-9daf-0838a92b276d tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:15:14.571576 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-c265500f-daba-474f-9daf-0838a92b276d tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:15:14.572341 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-c265500f-daba-474f-9daf-0838a92b276d tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:15:14.572776 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-c265500f-daba-474f-9daf-0838a92b276d tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:15:14.700901 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.policy [None req-c265500f-daba-474f-9daf-0838a92b276d tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c4c0c82448e40ba801c0b52ec44e74a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a093d0bf43046aaa845f3cc115f3f5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116156) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:15:14.708101 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: INFO nova.api.openstack.requestlog [None req-c265500f-daba-474f-9daf-0838a92b276d tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] 10.222.0.18 "GET /compute/v2.1/servers/fa7c86bc-c46f-4120-8f3d-d795f8d7c5cc" status: 200 len: 1451 microversion: 2.1 time: 0.147031 Dec 15 03:15:14.708657 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: [pid: 116156|app: 0|req: 871/1732] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 03:15:14 2021] GET /compute/v2.1/servers/fa7c86bc-c46f-4120-8f3d-d795f8d7c5cc => generated 1451 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 03:15:14.908197 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi [None req-5e27bcb6-251c-4415-9ca4-eb1341efd64a tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Calling method '>' {{(pid=116156) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:15:14.908904 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.compute.api [None req-5e27bcb6-251c-4415-9ca4-eb1341efd64a tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] [instance: bbb8462c-9501-4541-b67e-43ec5c5061a7] Fetching instance by UUID {{(pid=116156) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:15:14.914931 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-5e27bcb6-251c-4415-9ca4-eb1341efd64a tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:15:14.915380 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-5e27bcb6-251c-4415-9ca4-eb1341efd64a tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:15:14.916152 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-5e27bcb6-251c-4415-9ca4-eb1341efd64a tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:15:14.916589 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-5e27bcb6-251c-4415-9ca4-eb1341efd64a tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:15:14.973918 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.policy [None req-5e27bcb6-251c-4415-9ca4-eb1341efd64a tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97bdf19af9e34fc3886ff451cb9d7a27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '494b56bf5eae4d56a5591546f85bc32b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116156) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:15:14.981011 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: INFO nova.api.openstack.requestlog [None req-5e27bcb6-251c-4415-9ca4-eb1341efd64a tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] 10.222.0.18 "GET /compute/v2.1/servers/bbb8462c-9501-4541-b67e-43ec5c5061a7" status: 200 len: 1226 microversion: 2.1 time: 0.076453 Dec 15 03:15:14.981563 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: [pid: 116156|app: 0|req: 872/1733] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 03:15:14 2021] GET /compute/v2.1/servers/bbb8462c-9501-4541-b67e-43ec5c5061a7 => generated 1226 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 03:15:15.725328 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi [None req-d76be83b-96ee-4e77-b06c-f3a535a33f4b tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Calling method '>' {{(pid=116156) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:15:15.725944 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.compute.api [None req-d76be83b-96ee-4e77-b06c-f3a535a33f4b tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] [instance: fa7c86bc-c46f-4120-8f3d-d795f8d7c5cc] Fetching instance by UUID {{(pid=116156) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:15:15.732440 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-d76be83b-96ee-4e77-b06c-f3a535a33f4b tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:15:15.732924 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-d76be83b-96ee-4e77-b06c-f3a535a33f4b tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:15:15.733703 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-d76be83b-96ee-4e77-b06c-f3a535a33f4b tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:15:15.734175 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-d76be83b-96ee-4e77-b06c-f3a535a33f4b tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:15:15.865932 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.policy [None req-d76be83b-96ee-4e77-b06c-f3a535a33f4b tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c4c0c82448e40ba801c0b52ec44e74a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a093d0bf43046aaa845f3cc115f3f5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116156) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:15:15.873151 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: INFO nova.api.openstack.requestlog [None req-d76be83b-96ee-4e77-b06c-f3a535a33f4b tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] 10.222.0.18 "GET /compute/v2.1/servers/fa7c86bc-c46f-4120-8f3d-d795f8d7c5cc" status: 200 len: 1451 microversion: 2.1 time: 0.151443 Dec 15 03:15:15.873709 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: [pid: 116156|app: 0|req: 873/1734] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 03:15:15 2021] GET /compute/v2.1/servers/fa7c86bc-c46f-4120-8f3d-d795f8d7c5cc => generated 1451 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 03:15:15.997253 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi [None req-1cb288d4-ab17-4f51-8c74-9cab36141f7a tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Calling method '>' {{(pid=116156) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:15:15.997871 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.compute.api [None req-1cb288d4-ab17-4f51-8c74-9cab36141f7a tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] [instance: bbb8462c-9501-4541-b67e-43ec5c5061a7] Fetching instance by UUID {{(pid=116156) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:15:16.004002 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-1cb288d4-ab17-4f51-8c74-9cab36141f7a tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:15:16.004451 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-1cb288d4-ab17-4f51-8c74-9cab36141f7a tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:15:16.005219 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-1cb288d4-ab17-4f51-8c74-9cab36141f7a tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:15:16.005655 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-1cb288d4-ab17-4f51-8c74-9cab36141f7a tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:15:16.062766 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.policy [None req-1cb288d4-ab17-4f51-8c74-9cab36141f7a tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97bdf19af9e34fc3886ff451cb9d7a27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '494b56bf5eae4d56a5591546f85bc32b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116156) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:15:16.069745 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: INFO nova.api.openstack.requestlog [None req-1cb288d4-ab17-4f51-8c74-9cab36141f7a tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] 10.222.0.18 "GET /compute/v2.1/servers/bbb8462c-9501-4541-b67e-43ec5c5061a7" status: 200 len: 1226 microversion: 2.1 time: 0.076074 Dec 15 03:15:16.070338 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: [pid: 116156|app: 0|req: 874/1735] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 03:15:15 2021] GET /compute/v2.1/servers/bbb8462c-9501-4541-b67e-43ec5c5061a7 => generated 1226 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 03:15:16.889917 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi [None req-0497dd27-ab2a-4432-8066-9910975aeb04 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Calling method '>' {{(pid=116156) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:15:16.890554 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.compute.api [None req-0497dd27-ab2a-4432-8066-9910975aeb04 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] [instance: fa7c86bc-c46f-4120-8f3d-d795f8d7c5cc] Fetching instance by UUID {{(pid=116156) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:15:16.896348 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-0497dd27-ab2a-4432-8066-9910975aeb04 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:15:16.896794 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-0497dd27-ab2a-4432-8066-9910975aeb04 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:15:16.897562 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-0497dd27-ab2a-4432-8066-9910975aeb04 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:15:16.898004 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-0497dd27-ab2a-4432-8066-9910975aeb04 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:15:17.028962 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.policy [None req-0497dd27-ab2a-4432-8066-9910975aeb04 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c4c0c82448e40ba801c0b52ec44e74a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a093d0bf43046aaa845f3cc115f3f5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116156) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:15:17.036139 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: INFO nova.api.openstack.requestlog [None req-0497dd27-ab2a-4432-8066-9910975aeb04 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] 10.222.0.18 "GET /compute/v2.1/servers/fa7c86bc-c46f-4120-8f3d-d795f8d7c5cc" status: 200 len: 1451 microversion: 2.1 time: 0.150035 Dec 15 03:15:17.036690 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: [pid: 116156|app: 0|req: 875/1736] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 03:15:16 2021] GET /compute/v2.1/servers/fa7c86bc-c46f-4120-8f3d-d795f8d7c5cc => generated 1451 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 03:15:17.086336 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi [None req-395ef6fc-24c6-4831-a8c4-46f86fd0a9d5 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Calling method '>' {{(pid=116156) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:15:17.086946 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.compute.api [None req-395ef6fc-24c6-4831-a8c4-46f86fd0a9d5 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] [instance: bbb8462c-9501-4541-b67e-43ec5c5061a7] Fetching instance by UUID {{(pid=116156) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:15:17.093143 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-395ef6fc-24c6-4831-a8c4-46f86fd0a9d5 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:15:17.093674 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-395ef6fc-24c6-4831-a8c4-46f86fd0a9d5 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:15:17.094488 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-395ef6fc-24c6-4831-a8c4-46f86fd0a9d5 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:15:17.094927 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-395ef6fc-24c6-4831-a8c4-46f86fd0a9d5 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:15:17.156463 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.policy [None req-395ef6fc-24c6-4831-a8c4-46f86fd0a9d5 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97bdf19af9e34fc3886ff451cb9d7a27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '494b56bf5eae4d56a5591546f85bc32b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116156) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:15:17.163649 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: INFO nova.api.openstack.requestlog [None req-395ef6fc-24c6-4831-a8c4-46f86fd0a9d5 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] 10.222.0.18 "GET /compute/v2.1/servers/bbb8462c-9501-4541-b67e-43ec5c5061a7" status: 200 len: 1226 microversion: 2.1 time: 0.080713 Dec 15 03:15:17.164210 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: [pid: 116156|app: 0|req: 876/1737] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 03:15:17 2021] GET /compute/v2.1/servers/bbb8462c-9501-4541-b67e-43ec5c5061a7 => generated 1226 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 03:15:18.052479 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi [None req-1f56d05b-1622-48fe-93ed-4545d7365be4 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Calling method '>' {{(pid=116156) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:15:18.053199 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.compute.api [None req-1f56d05b-1622-48fe-93ed-4545d7365be4 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] [instance: fa7c86bc-c46f-4120-8f3d-d795f8d7c5cc] Fetching instance by UUID {{(pid=116156) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:15:18.059858 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-1f56d05b-1622-48fe-93ed-4545d7365be4 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:15:18.060304 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-1f56d05b-1622-48fe-93ed-4545d7365be4 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:15:18.061072 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-1f56d05b-1622-48fe-93ed-4545d7365be4 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:15:18.061504 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-1f56d05b-1622-48fe-93ed-4545d7365be4 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:15:18.189180 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.policy [None req-1f56d05b-1622-48fe-93ed-4545d7365be4 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c4c0c82448e40ba801c0b52ec44e74a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a093d0bf43046aaa845f3cc115f3f5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116156) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:15:18.196338 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: INFO nova.api.openstack.requestlog [None req-1f56d05b-1622-48fe-93ed-4545d7365be4 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] 10.222.0.18 "GET /compute/v2.1/servers/fa7c86bc-c46f-4120-8f3d-d795f8d7c5cc" status: 200 len: 1451 microversion: 2.1 time: 0.147486 Dec 15 03:15:18.196894 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: [pid: 116156|app: 0|req: 877/1738] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 03:15:18 2021] GET /compute/v2.1/servers/fa7c86bc-c46f-4120-8f3d-d795f8d7c5cc => generated 1451 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 03:15:18.201225 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi [None req-d1996e66-72c9-4419-a37d-657a0dded1b0 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Calling method '>' {{(pid=116156) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:15:18.201825 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.compute.api [None req-d1996e66-72c9-4419-a37d-657a0dded1b0 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] [instance: bbb8462c-9501-4541-b67e-43ec5c5061a7] Fetching instance by UUID {{(pid=116156) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:15:18.207447 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-d1996e66-72c9-4419-a37d-657a0dded1b0 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:15:18.207897 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-d1996e66-72c9-4419-a37d-657a0dded1b0 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:15:18.208665 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-d1996e66-72c9-4419-a37d-657a0dded1b0 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:15:18.209094 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-d1996e66-72c9-4419-a37d-657a0dded1b0 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:15:18.267708 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.policy [None req-d1996e66-72c9-4419-a37d-657a0dded1b0 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97bdf19af9e34fc3886ff451cb9d7a27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '494b56bf5eae4d56a5591546f85bc32b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116156) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:15:18.275049 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: INFO nova.api.openstack.requestlog [None req-d1996e66-72c9-4419-a37d-657a0dded1b0 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] 10.222.0.18 "GET /compute/v2.1/servers/bbb8462c-9501-4541-b67e-43ec5c5061a7" status: 200 len: 1226 microversion: 2.1 time: 0.077172 Dec 15 03:15:18.275609 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: [pid: 116156|app: 0|req: 878/1739] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 03:15:18 2021] GET /compute/v2.1/servers/bbb8462c-9501-4541-b67e-43ec5c5061a7 => generated 1226 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 03:15:19.212737 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi [None req-97191eba-56be-4381-85e9-7db23e74f78a tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Calling method '>' {{(pid=116156) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:15:19.213343 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.compute.api [None req-97191eba-56be-4381-85e9-7db23e74f78a tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] [instance: fa7c86bc-c46f-4120-8f3d-d795f8d7c5cc] Fetching instance by UUID {{(pid=116156) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:15:19.220348 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-97191eba-56be-4381-85e9-7db23e74f78a tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:15:19.220800 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-97191eba-56be-4381-85e9-7db23e74f78a tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:15:19.221578 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-97191eba-56be-4381-85e9-7db23e74f78a tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:15:19.222038 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-97191eba-56be-4381-85e9-7db23e74f78a tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:15:19.354742 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.policy [None req-97191eba-56be-4381-85e9-7db23e74f78a tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c4c0c82448e40ba801c0b52ec44e74a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a093d0bf43046aaa845f3cc115f3f5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116156) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:15:19.362315 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: INFO nova.api.openstack.requestlog [None req-97191eba-56be-4381-85e9-7db23e74f78a tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] 10.222.0.18 "GET /compute/v2.1/servers/fa7c86bc-c46f-4120-8f3d-d795f8d7c5cc" status: 200 len: 1451 microversion: 2.1 time: 0.153136 Dec 15 03:15:19.362881 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: [pid: 116156|app: 0|req: 879/1740] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 03:15:19 2021] GET /compute/v2.1/servers/fa7c86bc-c46f-4120-8f3d-d795f8d7c5cc => generated 1451 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 03:15:19.367081 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi [None req-99f9943a-828f-43d2-8c8b-f49d38d4b63e tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Calling method '>' {{(pid=116156) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:15:19.367683 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.compute.api [None req-99f9943a-828f-43d2-8c8b-f49d38d4b63e tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] [instance: bbb8462c-9501-4541-b67e-43ec5c5061a7] Fetching instance by UUID {{(pid=116156) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:15:19.373420 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-99f9943a-828f-43d2-8c8b-f49d38d4b63e tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:15:19.373872 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-99f9943a-828f-43d2-8c8b-f49d38d4b63e tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:15:19.374672 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-99f9943a-828f-43d2-8c8b-f49d38d4b63e tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:15:19.375111 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-99f9943a-828f-43d2-8c8b-f49d38d4b63e tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:15:19.431837 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.policy [None req-99f9943a-828f-43d2-8c8b-f49d38d4b63e tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97bdf19af9e34fc3886ff451cb9d7a27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '494b56bf5eae4d56a5591546f85bc32b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116156) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:15:19.439414 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: INFO nova.api.openstack.requestlog [None req-99f9943a-828f-43d2-8c8b-f49d38d4b63e tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] 10.222.0.18 "GET /compute/v2.1/servers/bbb8462c-9501-4541-b67e-43ec5c5061a7" status: 200 len: 1226 microversion: 2.1 time: 0.075601 Dec 15 03:15:19.439973 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: [pid: 116156|app: 0|req: 880/1741] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 03:15:19 2021] GET /compute/v2.1/servers/bbb8462c-9501-4541-b67e-43ec5c5061a7 => generated 1226 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 03:15:20.379535 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi [None req-16f70957-c647-41cd-ae0a-3080c3ee86c6 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Calling method '>' {{(pid=116156) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:15:20.380159 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.compute.api [None req-16f70957-c647-41cd-ae0a-3080c3ee86c6 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] [instance: fa7c86bc-c46f-4120-8f3d-d795f8d7c5cc] Fetching instance by UUID {{(pid=116156) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:15:20.386829 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-16f70957-c647-41cd-ae0a-3080c3ee86c6 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:15:20.387275 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-16f70957-c647-41cd-ae0a-3080c3ee86c6 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:15:20.388042 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-16f70957-c647-41cd-ae0a-3080c3ee86c6 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:15:20.388473 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-16f70957-c647-41cd-ae0a-3080c3ee86c6 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:15:20.518208 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.policy [None req-16f70957-c647-41cd-ae0a-3080c3ee86c6 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c4c0c82448e40ba801c0b52ec44e74a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a093d0bf43046aaa845f3cc115f3f5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116156) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:15:20.525451 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: INFO nova.api.openstack.requestlog [None req-16f70957-c647-41cd-ae0a-3080c3ee86c6 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] 10.222.0.18 "GET /compute/v2.1/servers/fa7c86bc-c46f-4120-8f3d-d795f8d7c5cc" status: 200 len: 1451 microversion: 2.1 time: 0.149570 Dec 15 03:15:20.526028 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: [pid: 116156|app: 0|req: 881/1742] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 03:15:20 2021] GET /compute/v2.1/servers/fa7c86bc-c46f-4120-8f3d-d795f8d7c5cc => generated 1451 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 03:15:20.530741 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi [None req-eb0e215c-3504-47e1-ac6c-1f1d5caf414d tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Calling method '>' {{(pid=116156) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:15:20.531336 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.compute.api [None req-eb0e215c-3504-47e1-ac6c-1f1d5caf414d tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] [instance: bbb8462c-9501-4541-b67e-43ec5c5061a7] Fetching instance by UUID {{(pid=116156) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:15:20.536572 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-eb0e215c-3504-47e1-ac6c-1f1d5caf414d tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:15:20.537019 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-eb0e215c-3504-47e1-ac6c-1f1d5caf414d tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:15:20.537785 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-eb0e215c-3504-47e1-ac6c-1f1d5caf414d tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:15:20.538273 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-eb0e215c-3504-47e1-ac6c-1f1d5caf414d tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:15:20.594948 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.policy [None req-eb0e215c-3504-47e1-ac6c-1f1d5caf414d tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97bdf19af9e34fc3886ff451cb9d7a27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '494b56bf5eae4d56a5591546f85bc32b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116156) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:15:20.602191 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: INFO nova.api.openstack.requestlog [None req-eb0e215c-3504-47e1-ac6c-1f1d5caf414d tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] 10.222.0.18 "GET /compute/v2.1/servers/bbb8462c-9501-4541-b67e-43ec5c5061a7" status: 200 len: 1226 microversion: 2.1 time: 0.075192 Dec 15 03:15:20.602755 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: [pid: 116156|app: 0|req: 882/1743] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 03:15:20 2021] GET /compute/v2.1/servers/bbb8462c-9501-4541-b67e-43ec5c5061a7 => generated 1226 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 03:15:21.543589 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi [None req-f1dde950-e288-46e3-a47a-d13737a86a81 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Calling method '>' {{(pid=116156) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:15:21.544200 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.compute.api [None req-f1dde950-e288-46e3-a47a-d13737a86a81 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] [instance: fa7c86bc-c46f-4120-8f3d-d795f8d7c5cc] Fetching instance by UUID {{(pid=116156) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:15:21.550408 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-f1dde950-e288-46e3-a47a-d13737a86a81 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:15:21.550866 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-f1dde950-e288-46e3-a47a-d13737a86a81 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:15:21.551656 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-f1dde950-e288-46e3-a47a-d13737a86a81 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:15:21.552095 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-f1dde950-e288-46e3-a47a-d13737a86a81 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:15:21.682826 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.policy [None req-f1dde950-e288-46e3-a47a-d13737a86a81 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c4c0c82448e40ba801c0b52ec44e74a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a093d0bf43046aaa845f3cc115f3f5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116156) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:15:21.690108 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: INFO nova.api.openstack.requestlog [None req-f1dde950-e288-46e3-a47a-d13737a86a81 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] 10.222.0.18 "GET /compute/v2.1/servers/fa7c86bc-c46f-4120-8f3d-d795f8d7c5cc" status: 200 len: 1451 microversion: 2.1 time: 0.150799 Dec 15 03:15:21.690681 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: [pid: 116156|app: 0|req: 883/1744] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 03:15:21 2021] GET /compute/v2.1/servers/fa7c86bc-c46f-4120-8f3d-d795f8d7c5cc => generated 1451 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 03:15:21.694842 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi [None req-1c65bf49-6868-43aa-a05f-c6277d666c20 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Calling method '>' {{(pid=116156) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:15:21.695449 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.compute.api [None req-1c65bf49-6868-43aa-a05f-c6277d666c20 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] [instance: bbb8462c-9501-4541-b67e-43ec5c5061a7] Fetching instance by UUID {{(pid=116156) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:15:21.700763 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-1c65bf49-6868-43aa-a05f-c6277d666c20 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:15:21.701220 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-1c65bf49-6868-43aa-a05f-c6277d666c20 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:15:21.702016 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-1c65bf49-6868-43aa-a05f-c6277d666c20 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:15:21.702460 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-1c65bf49-6868-43aa-a05f-c6277d666c20 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:15:21.760354 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.policy [None req-1c65bf49-6868-43aa-a05f-c6277d666c20 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97bdf19af9e34fc3886ff451cb9d7a27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '494b56bf5eae4d56a5591546f85bc32b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116156) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:15:21.767705 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: INFO nova.api.openstack.requestlog [None req-1c65bf49-6868-43aa-a05f-c6277d666c20 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] 10.222.0.18 "GET /compute/v2.1/servers/bbb8462c-9501-4541-b67e-43ec5c5061a7" status: 200 len: 1226 microversion: 2.1 time: 0.076082 Dec 15 03:15:21.768277 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: [pid: 116156|app: 0|req: 884/1745] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 03:15:21 2021] GET /compute/v2.1/servers/bbb8462c-9501-4541-b67e-43ec5c5061a7 => generated 1226 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 03:15:22.706815 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi [None req-c52c55de-f4cf-49a3-bdd7-111a1821ee3c tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Calling method '>' {{(pid=116156) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:15:22.707468 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.compute.api [None req-c52c55de-f4cf-49a3-bdd7-111a1821ee3c tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] [instance: fa7c86bc-c46f-4120-8f3d-d795f8d7c5cc] Fetching instance by UUID {{(pid=116156) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:15:22.713564 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-c52c55de-f4cf-49a3-bdd7-111a1821ee3c tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:15:22.714032 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-c52c55de-f4cf-49a3-bdd7-111a1821ee3c tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:15:22.714803 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-c52c55de-f4cf-49a3-bdd7-111a1821ee3c tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:15:22.715233 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-c52c55de-f4cf-49a3-bdd7-111a1821ee3c tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:15:22.843677 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.policy [None req-c52c55de-f4cf-49a3-bdd7-111a1821ee3c tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c4c0c82448e40ba801c0b52ec44e74a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a093d0bf43046aaa845f3cc115f3f5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116156) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:15:22.850881 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: INFO nova.api.openstack.requestlog [None req-c52c55de-f4cf-49a3-bdd7-111a1821ee3c tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] 10.222.0.18 "GET /compute/v2.1/servers/fa7c86bc-c46f-4120-8f3d-d795f8d7c5cc" status: 200 len: 1451 microversion: 2.1 time: 0.147793 Dec 15 03:15:22.851445 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: [pid: 116156|app: 0|req: 885/1746] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 03:15:22 2021] GET /compute/v2.1/servers/fa7c86bc-c46f-4120-8f3d-d795f8d7c5cc => generated 1451 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 03:15:22.856102 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi [None req-bb9f5283-7da0-4f73-ab8a-9154e7bf242f tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Calling method '>' {{(pid=116156) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:15:22.856691 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.compute.api [None req-bb9f5283-7da0-4f73-ab8a-9154e7bf242f tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] [instance: bbb8462c-9501-4541-b67e-43ec5c5061a7] Fetching instance by UUID {{(pid=116156) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:15:22.862258 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-bb9f5283-7da0-4f73-ab8a-9154e7bf242f tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:15:22.862710 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-bb9f5283-7da0-4f73-ab8a-9154e7bf242f tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:15:22.863475 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-bb9f5283-7da0-4f73-ab8a-9154e7bf242f tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:15:22.863908 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-bb9f5283-7da0-4f73-ab8a-9154e7bf242f tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:15:22.924454 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.policy [None req-bb9f5283-7da0-4f73-ab8a-9154e7bf242f tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97bdf19af9e34fc3886ff451cb9d7a27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '494b56bf5eae4d56a5591546f85bc32b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116156) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:15:22.931654 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: INFO nova.api.openstack.requestlog [None req-bb9f5283-7da0-4f73-ab8a-9154e7bf242f tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] 10.222.0.18 "GET /compute/v2.1/servers/bbb8462c-9501-4541-b67e-43ec5c5061a7" status: 200 len: 1226 microversion: 2.1 time: 0.079285 Dec 15 03:15:22.932209 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: [pid: 116156|app: 0|req: 886/1747] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 03:15:22 2021] GET /compute/v2.1/servers/bbb8462c-9501-4541-b67e-43ec5c5061a7 => generated 1226 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 03:15:23.868297 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi [None req-e08202ec-8330-41c1-9471-e53551730edc tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Calling method '>' {{(pid=116156) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:15:23.868930 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.compute.api [None req-e08202ec-8330-41c1-9471-e53551730edc tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] [instance: fa7c86bc-c46f-4120-8f3d-d795f8d7c5cc] Fetching instance by UUID {{(pid=116156) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:15:23.875689 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-e08202ec-8330-41c1-9471-e53551730edc tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:15:23.876142 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-e08202ec-8330-41c1-9471-e53551730edc tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:15:23.876920 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-e08202ec-8330-41c1-9471-e53551730edc tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:15:23.877388 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-e08202ec-8330-41c1-9471-e53551730edc tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:15:24.005520 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.policy [None req-e08202ec-8330-41c1-9471-e53551730edc tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c4c0c82448e40ba801c0b52ec44e74a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a093d0bf43046aaa845f3cc115f3f5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116156) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:15:24.013383 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: INFO nova.api.openstack.requestlog [None req-e08202ec-8330-41c1-9471-e53551730edc tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] 10.222.0.18 "GET /compute/v2.1/servers/fa7c86bc-c46f-4120-8f3d-d795f8d7c5cc" status: 200 len: 1451 microversion: 2.1 time: 0.148717 Dec 15 03:15:24.013941 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: [pid: 116156|app: 0|req: 887/1748] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 03:15:23 2021] GET /compute/v2.1/servers/fa7c86bc-c46f-4120-8f3d-d795f8d7c5cc => generated 1451 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 03:15:24.018086 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi [None req-4f3e7c7e-c641-4396-b995-32d3114986db tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Calling method '>' {{(pid=116156) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:15:24.018725 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.compute.api [None req-4f3e7c7e-c641-4396-b995-32d3114986db tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] [instance: bbb8462c-9501-4541-b67e-43ec5c5061a7] Fetching instance by UUID {{(pid=116156) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:15:24.024015 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-4f3e7c7e-c641-4396-b995-32d3114986db tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:15:24.024466 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-4f3e7c7e-c641-4396-b995-32d3114986db tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:15:24.025241 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-4f3e7c7e-c641-4396-b995-32d3114986db tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:15:24.025678 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-4f3e7c7e-c641-4396-b995-32d3114986db tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:15:24.082824 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.policy [None req-4f3e7c7e-c641-4396-b995-32d3114986db tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97bdf19af9e34fc3886ff451cb9d7a27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '494b56bf5eae4d56a5591546f85bc32b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116156) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:15:24.089969 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: INFO nova.api.openstack.requestlog [None req-4f3e7c7e-c641-4396-b995-32d3114986db tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] 10.222.0.18 "GET /compute/v2.1/servers/bbb8462c-9501-4541-b67e-43ec5c5061a7" status: 200 len: 1226 microversion: 2.1 time: 0.075064 Dec 15 03:15:24.090548 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: [pid: 116156|app: 0|req: 888/1749] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 03:15:24 2021] GET /compute/v2.1/servers/bbb8462c-9501-4541-b67e-43ec5c5061a7 => generated 1226 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 03:15:25.030711 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi [None req-aa5a3302-967c-4e2e-aa87-a15ca43746ff tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Calling method '>' {{(pid=116156) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:15:25.031325 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.compute.api [None req-aa5a3302-967c-4e2e-aa87-a15ca43746ff tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] [instance: fa7c86bc-c46f-4120-8f3d-d795f8d7c5cc] Fetching instance by UUID {{(pid=116156) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:15:25.037555 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-aa5a3302-967c-4e2e-aa87-a15ca43746ff tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:15:25.038037 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-aa5a3302-967c-4e2e-aa87-a15ca43746ff tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:15:25.038824 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-aa5a3302-967c-4e2e-aa87-a15ca43746ff tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:15:25.039259 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-aa5a3302-967c-4e2e-aa87-a15ca43746ff tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:15:25.168896 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.policy [None req-aa5a3302-967c-4e2e-aa87-a15ca43746ff tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c4c0c82448e40ba801c0b52ec44e74a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a093d0bf43046aaa845f3cc115f3f5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116156) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:15:25.176244 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: INFO nova.api.openstack.requestlog [None req-aa5a3302-967c-4e2e-aa87-a15ca43746ff tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] 10.222.0.18 "GET /compute/v2.1/servers/fa7c86bc-c46f-4120-8f3d-d795f8d7c5cc" status: 200 len: 1451 microversion: 2.1 time: 0.149863 Dec 15 03:15:25.176744 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: [pid: 116156|app: 0|req: 889/1750] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 03:15:25 2021] GET /compute/v2.1/servers/fa7c86bc-c46f-4120-8f3d-d795f8d7c5cc => generated 1451 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 03:15:25.180895 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi [None req-75140946-4b4b-4624-ac64-32feef31fc73 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Calling method '>' {{(pid=116156) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:15:25.181496 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.compute.api [None req-75140946-4b4b-4624-ac64-32feef31fc73 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] [instance: bbb8462c-9501-4541-b67e-43ec5c5061a7] Fetching instance by UUID {{(pid=116156) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:15:25.186773 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-75140946-4b4b-4624-ac64-32feef31fc73 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:15:25.187227 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-75140946-4b4b-4624-ac64-32feef31fc73 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:15:25.188008 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-75140946-4b4b-4624-ac64-32feef31fc73 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:15:25.188446 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-75140946-4b4b-4624-ac64-32feef31fc73 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:15:25.248659 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.policy [None req-75140946-4b4b-4624-ac64-32feef31fc73 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97bdf19af9e34fc3886ff451cb9d7a27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '494b56bf5eae4d56a5591546f85bc32b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116156) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:15:25.255919 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: INFO nova.api.openstack.requestlog [None req-75140946-4b4b-4624-ac64-32feef31fc73 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] 10.222.0.18 "GET /compute/v2.1/servers/bbb8462c-9501-4541-b67e-43ec5c5061a7" status: 200 len: 1226 microversion: 2.1 time: 0.078217 Dec 15 03:15:25.256481 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: [pid: 116156|app: 0|req: 890/1751] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 03:15:25 2021] GET /compute/v2.1/servers/bbb8462c-9501-4541-b67e-43ec5c5061a7 => generated 1226 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 03:15:25.921767 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi [None req-9bff39ba-ebcf-4f70-915d-b5d3e4be1a0f tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Calling method '>' {{(pid=116156) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:15:25.922294 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.compute.api [None req-9bff39ba-ebcf-4f70-915d-b5d3e4be1a0f tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] [instance: bbb8462c-9501-4541-b67e-43ec5c5061a7] Fetching instance by UUID {{(pid=116156) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:15:25.928209 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-9bff39ba-ebcf-4f70-915d-b5d3e4be1a0f tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:15:25.928676 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-9bff39ba-ebcf-4f70-915d-b5d3e4be1a0f tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:15:25.929477 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-9bff39ba-ebcf-4f70-915d-b5d3e4be1a0f tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:15:25.929914 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-9bff39ba-ebcf-4f70-915d-b5d3e4be1a0f tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:15:25.954332 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.compute.api [None req-9bff39ba-ebcf-4f70-915d-b5d3e4be1a0f tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] [instance: bbb8462c-9501-4541-b67e-43ec5c5061a7] Going to try to terminate instance {{(pid=116156) delete /opt/stack/nova/nova/compute/api.py:2614}} Dec 15 03:15:26.002280 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: INFO nova.compute.api [None req-9bff39ba-ebcf-4f70-915d-b5d3e4be1a0f tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] [instance: bbb8462c-9501-4541-b67e-43ec5c5061a7] Instance is already in deleting state, ignoring this request Dec 15 03:15:26.003108 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: INFO nova.api.openstack.requestlog [None req-9bff39ba-ebcf-4f70-915d-b5d3e4be1a0f tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] 10.222.0.18 "DELETE /compute/v2.1/servers/bbb8462c-9501-4541-b67e-43ec5c5061a7" status: 204 len: 0 microversion: 2.1 time: 0.085586 Dec 15 03:15:26.003667 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: [pid: 116156|app: 0|req: 891/1752] 10.222.0.18 () {58 vars in 1238 bytes} [Wed Dec 15 03:15:25 2021] DELETE /compute/v2.1/servers/bbb8462c-9501-4541-b67e-43ec5c5061a7 => generated 0 bytes in 87 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Dec 15 03:15:26.011698 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi [None req-fa49979a-bf6a-4408-a2c9-ba3b5af15913 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Calling method '>' {{(pid=116156) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:15:26.012306 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.compute.api [None req-fa49979a-bf6a-4408-a2c9-ba3b5af15913 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] [instance: bbb8462c-9501-4541-b67e-43ec5c5061a7] Fetching instance by UUID {{(pid=116156) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:15:26.018371 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-fa49979a-bf6a-4408-a2c9-ba3b5af15913 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:15:26.018831 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-fa49979a-bf6a-4408-a2c9-ba3b5af15913 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:15:26.019619 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-fa49979a-bf6a-4408-a2c9-ba3b5af15913 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:15:26.020089 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-fa49979a-bf6a-4408-a2c9-ba3b5af15913 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:15:26.095142 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.policy [None req-fa49979a-bf6a-4408-a2c9-ba3b5af15913 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97bdf19af9e34fc3886ff451cb9d7a27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '494b56bf5eae4d56a5591546f85bc32b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116156) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:15:26.102398 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: INFO nova.api.openstack.requestlog [None req-fa49979a-bf6a-4408-a2c9-ba3b5af15913 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] 10.222.0.18 "GET /compute/v2.1/servers/bbb8462c-9501-4541-b67e-43ec5c5061a7" status: 200 len: 1226 microversion: 2.1 time: 0.094683 Dec 15 03:15:26.103192 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: [pid: 116156|app: 0|req: 892/1753] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 03:15:26 2021] GET /compute/v2.1/servers/bbb8462c-9501-4541-b67e-43ec5c5061a7 => generated 1226 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 03:15:26.192375 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi [None req-23d7314c-6f29-4afd-9505-e02bd1c26a5a tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Calling method '>' {{(pid=116156) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:15:26.192991 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.compute.api [None req-23d7314c-6f29-4afd-9505-e02bd1c26a5a tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] [instance: fa7c86bc-c46f-4120-8f3d-d795f8d7c5cc] Fetching instance by UUID {{(pid=116156) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:15:26.198716 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-23d7314c-6f29-4afd-9505-e02bd1c26a5a tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:15:26.202923 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-23d7314c-6f29-4afd-9505-e02bd1c26a5a tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:15:26.202923 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-23d7314c-6f29-4afd-9505-e02bd1c26a5a tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:15:26.202923 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-23d7314c-6f29-4afd-9505-e02bd1c26a5a tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:15:26.413637 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.policy [None req-23d7314c-6f29-4afd-9505-e02bd1c26a5a tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c4c0c82448e40ba801c0b52ec44e74a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a093d0bf43046aaa845f3cc115f3f5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116156) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:15:26.420913 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: INFO nova.api.openstack.requestlog [None req-23d7314c-6f29-4afd-9505-e02bd1c26a5a tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] 10.222.0.18 "GET /compute/v2.1/servers/fa7c86bc-c46f-4120-8f3d-d795f8d7c5cc" status: 200 len: 1451 microversion: 2.1 time: 0.232143 Dec 15 03:15:26.421472 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: [pid: 116156|app: 0|req: 893/1754] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 03:15:26 2021] GET /compute/v2.1/servers/fa7c86bc-c46f-4120-8f3d-d795f8d7c5cc => generated 1451 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 03:15:27.120092 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi [None req-e0d3783d-6029-47c0-9242-d72797401fd4 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Calling method '>' {{(pid=116156) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:15:27.120718 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.compute.api [None req-e0d3783d-6029-47c0-9242-d72797401fd4 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] [instance: bbb8462c-9501-4541-b67e-43ec5c5061a7] Fetching instance by UUID {{(pid=116156) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:15:27.127343 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-e0d3783d-6029-47c0-9242-d72797401fd4 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:15:27.127788 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-e0d3783d-6029-47c0-9242-d72797401fd4 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:15:27.128560 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-e0d3783d-6029-47c0-9242-d72797401fd4 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:15:27.128992 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-e0d3783d-6029-47c0-9242-d72797401fd4 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:15:27.188243 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.policy [None req-e0d3783d-6029-47c0-9242-d72797401fd4 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97bdf19af9e34fc3886ff451cb9d7a27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '494b56bf5eae4d56a5591546f85bc32b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116156) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:15:27.195358 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: INFO nova.api.openstack.requestlog [None req-e0d3783d-6029-47c0-9242-d72797401fd4 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] 10.222.0.18 "GET /compute/v2.1/servers/bbb8462c-9501-4541-b67e-43ec5c5061a7" status: 200 len: 1226 microversion: 2.1 time: 0.078969 Dec 15 03:15:27.195920 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: [pid: 116156|app: 0|req: 894/1755] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 03:15:27 2021] GET /compute/v2.1/servers/bbb8462c-9501-4541-b67e-43ec5c5061a7 => generated 1226 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 03:15:27.438492 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi [None req-9197cb7b-009a-46b8-954b-efc44b5dde8f tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Calling method '>' {{(pid=116156) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:15:27.439039 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.compute.api [None req-9197cb7b-009a-46b8-954b-efc44b5dde8f tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] [instance: fa7c86bc-c46f-4120-8f3d-d795f8d7c5cc] Fetching instance by UUID {{(pid=116156) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:15:27.444828 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-9197cb7b-009a-46b8-954b-efc44b5dde8f tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:15:27.445274 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-9197cb7b-009a-46b8-954b-efc44b5dde8f tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:15:27.446070 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-9197cb7b-009a-46b8-954b-efc44b5dde8f tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:15:27.446507 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-9197cb7b-009a-46b8-954b-efc44b5dde8f tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:15:27.572982 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.policy [None req-9197cb7b-009a-46b8-954b-efc44b5dde8f tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c4c0c82448e40ba801c0b52ec44e74a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a093d0bf43046aaa845f3cc115f3f5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116156) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:15:27.580110 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: INFO nova.api.openstack.requestlog [None req-9197cb7b-009a-46b8-954b-efc44b5dde8f tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] 10.222.0.18 "GET /compute/v2.1/servers/fa7c86bc-c46f-4120-8f3d-d795f8d7c5cc" status: 200 len: 1451 microversion: 2.1 time: 0.145385 Dec 15 03:15:27.580662 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: [pid: 116156|app: 0|req: 895/1756] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 03:15:27 2021] GET /compute/v2.1/servers/fa7c86bc-c46f-4120-8f3d-d795f8d7c5cc => generated 1451 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 03:15:28.212024 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi [None req-cf690abe-3f6c-4284-a89d-577bc6c95840 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Calling method '>' {{(pid=116156) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:15:28.212753 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.compute.api [None req-cf690abe-3f6c-4284-a89d-577bc6c95840 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] [instance: bbb8462c-9501-4541-b67e-43ec5c5061a7] Fetching instance by UUID {{(pid=116156) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:15:28.219855 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-cf690abe-3f6c-4284-a89d-577bc6c95840 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:15:28.220307 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-cf690abe-3f6c-4284-a89d-577bc6c95840 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:15:28.221083 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-cf690abe-3f6c-4284-a89d-577bc6c95840 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:15:28.221626 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-cf690abe-3f6c-4284-a89d-577bc6c95840 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:15:28.280458 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.policy [None req-cf690abe-3f6c-4284-a89d-577bc6c95840 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97bdf19af9e34fc3886ff451cb9d7a27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '494b56bf5eae4d56a5591546f85bc32b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116156) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:15:28.287694 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: INFO nova.api.openstack.requestlog [None req-cf690abe-3f6c-4284-a89d-577bc6c95840 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] 10.222.0.18 "GET /compute/v2.1/servers/bbb8462c-9501-4541-b67e-43ec5c5061a7" status: 200 len: 1226 microversion: 2.1 time: 0.079316 Dec 15 03:15:28.288285 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: [pid: 116156|app: 0|req: 896/1757] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 03:15:28 2021] GET /compute/v2.1/servers/bbb8462c-9501-4541-b67e-43ec5c5061a7 => generated 1226 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 03:15:28.596312 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi [None req-0bc0132e-61b1-41d5-b92e-080576df86e6 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Calling method '>' {{(pid=116156) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:15:28.596924 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.compute.api [None req-0bc0132e-61b1-41d5-b92e-080576df86e6 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] [instance: fa7c86bc-c46f-4120-8f3d-d795f8d7c5cc] Fetching instance by UUID {{(pid=116156) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:15:28.602744 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-0bc0132e-61b1-41d5-b92e-080576df86e6 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:15:28.603189 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-0bc0132e-61b1-41d5-b92e-080576df86e6 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:15:28.603956 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-0bc0132e-61b1-41d5-b92e-080576df86e6 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:15:28.604385 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-0bc0132e-61b1-41d5-b92e-080576df86e6 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:15:28.948753 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.policy [None req-0bc0132e-61b1-41d5-b92e-080576df86e6 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c4c0c82448e40ba801c0b52ec44e74a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a093d0bf43046aaa845f3cc115f3f5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116156) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:15:28.956180 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: INFO nova.api.openstack.requestlog [None req-0bc0132e-61b1-41d5-b92e-080576df86e6 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] 10.222.0.18 "GET /compute/v2.1/servers/fa7c86bc-c46f-4120-8f3d-d795f8d7c5cc" status: 200 len: 1451 microversion: 2.1 time: 0.363479 Dec 15 03:15:28.956749 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: [pid: 116156|app: 0|req: 897/1758] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 03:15:28 2021] GET /compute/v2.1/servers/fa7c86bc-c46f-4120-8f3d-d795f8d7c5cc => generated 1451 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 03:15:29.304282 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi [None req-6eee60f5-d152-49fb-8679-c018c3da101d tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Calling method '>' {{(pid=116156) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:15:29.304962 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.compute.api [None req-6eee60f5-d152-49fb-8679-c018c3da101d tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] [instance: bbb8462c-9501-4541-b67e-43ec5c5061a7] Fetching instance by UUID {{(pid=116156) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:15:29.311262 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-6eee60f5-d152-49fb-8679-c018c3da101d tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:15:29.311719 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-6eee60f5-d152-49fb-8679-c018c3da101d tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:15:29.312502 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-6eee60f5-d152-49fb-8679-c018c3da101d tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:15:29.312945 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-6eee60f5-d152-49fb-8679-c018c3da101d tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:15:29.371494 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.policy [None req-6eee60f5-d152-49fb-8679-c018c3da101d tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97bdf19af9e34fc3886ff451cb9d7a27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '494b56bf5eae4d56a5591546f85bc32b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116156) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:15:29.378682 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: INFO nova.api.openstack.requestlog [None req-6eee60f5-d152-49fb-8679-c018c3da101d tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] 10.222.0.18 "GET /compute/v2.1/servers/bbb8462c-9501-4541-b67e-43ec5c5061a7" status: 200 len: 1226 microversion: 2.1 time: 0.078064 Dec 15 03:15:29.379244 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: [pid: 116156|app: 0|req: 898/1759] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 03:15:29 2021] GET /compute/v2.1/servers/bbb8462c-9501-4541-b67e-43ec5c5061a7 => generated 1226 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 03:15:29.973128 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi [None req-bc74faba-6806-4a85-942c-d5f3f1767d35 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Calling method '>' {{(pid=116156) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:15:29.973724 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.compute.api [None req-bc74faba-6806-4a85-942c-d5f3f1767d35 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] [instance: fa7c86bc-c46f-4120-8f3d-d795f8d7c5cc] Fetching instance by UUID {{(pid=116156) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:15:29.979492 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-bc74faba-6806-4a85-942c-d5f3f1767d35 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:15:29.979939 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-bc74faba-6806-4a85-942c-d5f3f1767d35 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:15:29.980708 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-bc74faba-6806-4a85-942c-d5f3f1767d35 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:15:29.981136 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-bc74faba-6806-4a85-942c-d5f3f1767d35 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:15:30.109186 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.policy [None req-bc74faba-6806-4a85-942c-d5f3f1767d35 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c4c0c82448e40ba801c0b52ec44e74a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a093d0bf43046aaa845f3cc115f3f5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116156) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:15:30.116767 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: INFO nova.api.openstack.requestlog [None req-bc74faba-6806-4a85-942c-d5f3f1767d35 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] 10.222.0.18 "GET /compute/v2.1/servers/fa7c86bc-c46f-4120-8f3d-d795f8d7c5cc" status: 200 len: 1451 microversion: 2.1 time: 0.147276 Dec 15 03:15:30.117268 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: [pid: 116156|app: 0|req: 899/1760] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 03:15:29 2021] GET /compute/v2.1/servers/fa7c86bc-c46f-4120-8f3d-d795f8d7c5cc => generated 1451 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 03:15:30.395447 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi [None req-9eced5be-f3de-47a0-8589-e613f9d1c1e0 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Calling method '>' {{(pid=116156) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:15:30.396019 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.compute.api [None req-9eced5be-f3de-47a0-8589-e613f9d1c1e0 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] [instance: bbb8462c-9501-4541-b67e-43ec5c5061a7] Fetching instance by UUID {{(pid=116156) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:15:30.402806 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-9eced5be-f3de-47a0-8589-e613f9d1c1e0 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:15:30.403259 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-9eced5be-f3de-47a0-8589-e613f9d1c1e0 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:15:30.404033 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-9eced5be-f3de-47a0-8589-e613f9d1c1e0 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:15:30.404468 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-9eced5be-f3de-47a0-8589-e613f9d1c1e0 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:15:30.465645 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.policy [None req-9eced5be-f3de-47a0-8589-e613f9d1c1e0 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97bdf19af9e34fc3886ff451cb9d7a27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '494b56bf5eae4d56a5591546f85bc32b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116156) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:15:30.472948 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: INFO nova.api.openstack.requestlog [None req-9eced5be-f3de-47a0-8589-e613f9d1c1e0 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] 10.222.0.18 "GET /compute/v2.1/servers/bbb8462c-9501-4541-b67e-43ec5c5061a7" status: 200 len: 1226 microversion: 2.1 time: 0.081173 Dec 15 03:15:30.473522 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: [pid: 116156|app: 0|req: 900/1761] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 03:15:30 2021] GET /compute/v2.1/servers/bbb8462c-9501-4541-b67e-43ec5c5061a7 => generated 1226 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 03:15:31.133414 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi [None req-4bedc94e-a1a3-4b17-915d-68c4c6126aec tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Calling method '>' {{(pid=116156) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:15:31.134039 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.compute.api [None req-4bedc94e-a1a3-4b17-915d-68c4c6126aec tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] [instance: fa7c86bc-c46f-4120-8f3d-d795f8d7c5cc] Fetching instance by UUID {{(pid=116156) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:15:31.139865 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-4bedc94e-a1a3-4b17-915d-68c4c6126aec tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:15:31.140313 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-4bedc94e-a1a3-4b17-915d-68c4c6126aec tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:15:31.141079 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-4bedc94e-a1a3-4b17-915d-68c4c6126aec tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:15:31.141509 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-4bedc94e-a1a3-4b17-915d-68c4c6126aec tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:15:31.268395 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.policy [None req-4bedc94e-a1a3-4b17-915d-68c4c6126aec tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c4c0c82448e40ba801c0b52ec44e74a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a093d0bf43046aaa845f3cc115f3f5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116156) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:15:31.275514 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: INFO nova.api.openstack.requestlog [None req-4bedc94e-a1a3-4b17-915d-68c4c6126aec tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] 10.222.0.18 "GET /compute/v2.1/servers/fa7c86bc-c46f-4120-8f3d-d795f8d7c5cc" status: 200 len: 1451 microversion: 2.1 time: 0.145762 Dec 15 03:15:31.276070 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: [pid: 116156|app: 0|req: 901/1762] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 03:15:31 2021] GET /compute/v2.1/servers/fa7c86bc-c46f-4120-8f3d-d795f8d7c5cc => generated 1451 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 03:15:31.489272 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi [None req-e94bf9c7-d742-4bab-8b75-f19243c17226 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Calling method '>' {{(pid=116156) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:15:31.489844 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.compute.api [None req-e94bf9c7-d742-4bab-8b75-f19243c17226 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] [instance: bbb8462c-9501-4541-b67e-43ec5c5061a7] Fetching instance by UUID {{(pid=116156) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:15:31.495903 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-e94bf9c7-d742-4bab-8b75-f19243c17226 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:15:31.496405 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-e94bf9c7-d742-4bab-8b75-f19243c17226 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:15:31.497176 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-e94bf9c7-d742-4bab-8b75-f19243c17226 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:15:31.497609 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-e94bf9c7-d742-4bab-8b75-f19243c17226 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:15:31.554780 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.policy [None req-e94bf9c7-d742-4bab-8b75-f19243c17226 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97bdf19af9e34fc3886ff451cb9d7a27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '494b56bf5eae4d56a5591546f85bc32b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116156) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:15:31.561866 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: INFO nova.api.openstack.requestlog [None req-e94bf9c7-d742-4bab-8b75-f19243c17226 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] 10.222.0.18 "GET /compute/v2.1/servers/bbb8462c-9501-4541-b67e-43ec5c5061a7" status: 200 len: 1226 microversion: 2.1 time: 0.076595 Dec 15 03:15:31.562448 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: [pid: 116156|app: 0|req: 902/1763] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 03:15:31 2021] GET /compute/v2.1/servers/bbb8462c-9501-4541-b67e-43ec5c5061a7 => generated 1226 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 03:15:32.292555 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi [None req-b3b7dd7e-aadf-4a2d-8c3d-aeed08f440b9 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Calling method '>' {{(pid=116156) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:15:32.293170 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.compute.api [None req-b3b7dd7e-aadf-4a2d-8c3d-aeed08f440b9 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] [instance: fa7c86bc-c46f-4120-8f3d-d795f8d7c5cc] Fetching instance by UUID {{(pid=116156) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:15:32.298951 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-b3b7dd7e-aadf-4a2d-8c3d-aeed08f440b9 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:15:32.299402 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-b3b7dd7e-aadf-4a2d-8c3d-aeed08f440b9 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:15:32.300179 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-b3b7dd7e-aadf-4a2d-8c3d-aeed08f440b9 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:15:32.300613 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-b3b7dd7e-aadf-4a2d-8c3d-aeed08f440b9 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:15:32.438582 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.policy [None req-b3b7dd7e-aadf-4a2d-8c3d-aeed08f440b9 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c4c0c82448e40ba801c0b52ec44e74a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a093d0bf43046aaa845f3cc115f3f5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116156) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:15:32.445801 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: INFO nova.api.openstack.requestlog [None req-b3b7dd7e-aadf-4a2d-8c3d-aeed08f440b9 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] 10.222.0.18 "GET /compute/v2.1/servers/fa7c86bc-c46f-4120-8f3d-d795f8d7c5cc" status: 200 len: 1451 microversion: 2.1 time: 0.156997 Dec 15 03:15:32.446387 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: [pid: 116156|app: 0|req: 903/1764] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 03:15:32 2021] GET /compute/v2.1/servers/fa7c86bc-c46f-4120-8f3d-d795f8d7c5cc => generated 1451 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 03:15:32.578127 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi [None req-636d9738-008c-4eee-8626-1a4a6714876b tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Calling method '>' {{(pid=116156) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:15:32.578748 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.compute.api [None req-636d9738-008c-4eee-8626-1a4a6714876b tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] [instance: bbb8462c-9501-4541-b67e-43ec5c5061a7] Fetching instance by UUID {{(pid=116156) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:15:32.584853 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-636d9738-008c-4eee-8626-1a4a6714876b tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:15:32.585305 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-636d9738-008c-4eee-8626-1a4a6714876b tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:15:32.586123 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-636d9738-008c-4eee-8626-1a4a6714876b tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:15:32.586561 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-636d9738-008c-4eee-8626-1a4a6714876b tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:15:32.644814 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.policy [None req-636d9738-008c-4eee-8626-1a4a6714876b tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97bdf19af9e34fc3886ff451cb9d7a27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '494b56bf5eae4d56a5591546f85bc32b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116156) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:15:32.652080 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: INFO nova.api.openstack.requestlog [None req-636d9738-008c-4eee-8626-1a4a6714876b tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] 10.222.0.18 "GET /compute/v2.1/servers/bbb8462c-9501-4541-b67e-43ec5c5061a7" status: 200 len: 1226 microversion: 2.1 time: 0.077526 Dec 15 03:15:32.652650 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: [pid: 116156|app: 0|req: 904/1765] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 03:15:32 2021] GET /compute/v2.1/servers/bbb8462c-9501-4541-b67e-43ec5c5061a7 => generated 1226 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 03:15:33.463132 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi [None req-f56b9b14-11d6-41f6-a958-0306268de8cd tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Calling method '>' {{(pid=116156) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:15:33.463683 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.compute.api [None req-f56b9b14-11d6-41f6-a958-0306268de8cd tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] [instance: fa7c86bc-c46f-4120-8f3d-d795f8d7c5cc] Fetching instance by UUID {{(pid=116156) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:15:33.470191 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-f56b9b14-11d6-41f6-a958-0306268de8cd tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:15:33.470652 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-f56b9b14-11d6-41f6-a958-0306268de8cd tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:15:33.471436 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-f56b9b14-11d6-41f6-a958-0306268de8cd tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:15:33.471880 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-f56b9b14-11d6-41f6-a958-0306268de8cd tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:15:33.600180 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.policy [None req-f56b9b14-11d6-41f6-a958-0306268de8cd tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c4c0c82448e40ba801c0b52ec44e74a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a093d0bf43046aaa845f3cc115f3f5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116156) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:15:33.607376 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: INFO nova.api.openstack.requestlog [None req-f56b9b14-11d6-41f6-a958-0306268de8cd tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] 10.222.0.18 "GET /compute/v2.1/servers/fa7c86bc-c46f-4120-8f3d-d795f8d7c5cc" status: 200 len: 1451 microversion: 2.1 time: 0.148388 Dec 15 03:15:33.607938 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: [pid: 116156|app: 0|req: 905/1766] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 03:15:33 2021] GET /compute/v2.1/servers/fa7c86bc-c46f-4120-8f3d-d795f8d7c5cc => generated 1451 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 03:15:33.668406 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi [None req-6a72e7cf-0091-43ea-b372-7d081bb7ff13 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Calling method '>' {{(pid=116156) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:15:33.669014 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.compute.api [None req-6a72e7cf-0091-43ea-b372-7d081bb7ff13 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] [instance: bbb8462c-9501-4541-b67e-43ec5c5061a7] Fetching instance by UUID {{(pid=116156) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:15:33.674774 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-6a72e7cf-0091-43ea-b372-7d081bb7ff13 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:15:33.675228 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-6a72e7cf-0091-43ea-b372-7d081bb7ff13 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:15:33.676008 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-6a72e7cf-0091-43ea-b372-7d081bb7ff13 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:15:33.676445 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-6a72e7cf-0091-43ea-b372-7d081bb7ff13 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:15:33.734803 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.policy [None req-6a72e7cf-0091-43ea-b372-7d081bb7ff13 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97bdf19af9e34fc3886ff451cb9d7a27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '494b56bf5eae4d56a5591546f85bc32b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116156) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:15:33.742236 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: INFO nova.api.openstack.requestlog [None req-6a72e7cf-0091-43ea-b372-7d081bb7ff13 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] 10.222.0.18 "GET /compute/v2.1/servers/bbb8462c-9501-4541-b67e-43ec5c5061a7" status: 200 len: 1226 microversion: 2.1 time: 0.077332 Dec 15 03:15:33.742799 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: [pid: 116156|app: 0|req: 906/1767] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 03:15:33 2021] GET /compute/v2.1/servers/bbb8462c-9501-4541-b67e-43ec5c5061a7 => generated 1226 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 03:15:34.624402 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi [None req-0fc028c7-8f98-4fd3-87ef-d036331fbaf5 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Calling method '>' {{(pid=116156) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:15:34.625072 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.compute.api [None req-0fc028c7-8f98-4fd3-87ef-d036331fbaf5 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] [instance: fa7c86bc-c46f-4120-8f3d-d795f8d7c5cc] Fetching instance by UUID {{(pid=116156) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:15:34.631577 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-0fc028c7-8f98-4fd3-87ef-d036331fbaf5 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:15:34.632029 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-0fc028c7-8f98-4fd3-87ef-d036331fbaf5 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:15:34.632848 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-0fc028c7-8f98-4fd3-87ef-d036331fbaf5 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:15:34.633285 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-0fc028c7-8f98-4fd3-87ef-d036331fbaf5 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:15:34.765105 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.policy [None req-0fc028c7-8f98-4fd3-87ef-d036331fbaf5 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c4c0c82448e40ba801c0b52ec44e74a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a093d0bf43046aaa845f3cc115f3f5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116156) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:15:34.772396 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: INFO nova.api.openstack.requestlog [None req-0fc028c7-8f98-4fd3-87ef-d036331fbaf5 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] 10.222.0.18 "GET /compute/v2.1/servers/fa7c86bc-c46f-4120-8f3d-d795f8d7c5cc" status: 200 len: 1451 microversion: 2.1 time: 0.151678 Dec 15 03:15:34.772961 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: [pid: 116156|app: 0|req: 907/1768] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 03:15:34 2021] GET /compute/v2.1/servers/fa7c86bc-c46f-4120-8f3d-d795f8d7c5cc => generated 1451 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 03:15:34.777090 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi [None req-56f821aa-7a9c-4cb7-880a-d8d60090f576 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Calling method '>' {{(pid=116156) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:15:34.778267 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.compute.api [None req-56f821aa-7a9c-4cb7-880a-d8d60090f576 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] [instance: bbb8462c-9501-4541-b67e-43ec5c5061a7] Fetching instance by UUID {{(pid=116156) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:15:34.783526 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-56f821aa-7a9c-4cb7-880a-d8d60090f576 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:15:34.783975 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-56f821aa-7a9c-4cb7-880a-d8d60090f576 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:15:34.784776 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-56f821aa-7a9c-4cb7-880a-d8d60090f576 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:15:34.785216 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-56f821aa-7a9c-4cb7-880a-d8d60090f576 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:15:34.842837 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.policy [None req-56f821aa-7a9c-4cb7-880a-d8d60090f576 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97bdf19af9e34fc3886ff451cb9d7a27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '494b56bf5eae4d56a5591546f85bc32b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116156) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:15:34.850001 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: INFO nova.api.openstack.requestlog [None req-56f821aa-7a9c-4cb7-880a-d8d60090f576 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] 10.222.0.18 "GET /compute/v2.1/servers/bbb8462c-9501-4541-b67e-43ec5c5061a7" status: 200 len: 1226 microversion: 2.1 time: 0.076098 Dec 15 03:15:34.850564 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: [pid: 116156|app: 0|req: 908/1769] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 03:15:34 2021] GET /compute/v2.1/servers/bbb8462c-9501-4541-b67e-43ec5c5061a7 => generated 1226 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 03:15:35.789737 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi [None req-65197f38-3c44-48e5-a90c-22066be776d1 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Calling method '>' {{(pid=116156) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:15:35.790454 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.compute.api [None req-65197f38-3c44-48e5-a90c-22066be776d1 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] [instance: fa7c86bc-c46f-4120-8f3d-d795f8d7c5cc] Fetching instance by UUID {{(pid=116156) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:15:35.796582 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-65197f38-3c44-48e5-a90c-22066be776d1 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:15:35.797042 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-65197f38-3c44-48e5-a90c-22066be776d1 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:15:35.797823 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-65197f38-3c44-48e5-a90c-22066be776d1 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:15:35.798291 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-65197f38-3c44-48e5-a90c-22066be776d1 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:15:35.925446 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.policy [None req-65197f38-3c44-48e5-a90c-22066be776d1 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c4c0c82448e40ba801c0b52ec44e74a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a093d0bf43046aaa845f3cc115f3f5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116156) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:15:35.932730 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: INFO nova.api.openstack.requestlog [None req-65197f38-3c44-48e5-a90c-22066be776d1 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] 10.222.0.18 "GET /compute/v2.1/servers/fa7c86bc-c46f-4120-8f3d-d795f8d7c5cc" status: 200 len: 1451 microversion: 2.1 time: 0.146716 Dec 15 03:15:35.933314 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: [pid: 116156|app: 0|req: 909/1770] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 03:15:35 2021] GET /compute/v2.1/servers/fa7c86bc-c46f-4120-8f3d-d795f8d7c5cc => generated 1451 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 03:15:35.937919 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi [None req-4d223f3d-a5ce-46d5-a164-e2c4831620a9 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Calling method '>' {{(pid=116156) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:15:35.938571 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.compute.api [None req-4d223f3d-a5ce-46d5-a164-e2c4831620a9 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] [instance: bbb8462c-9501-4541-b67e-43ec5c5061a7] Fetching instance by UUID {{(pid=116156) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:15:35.943835 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-4d223f3d-a5ce-46d5-a164-e2c4831620a9 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:15:35.944287 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-4d223f3d-a5ce-46d5-a164-e2c4831620a9 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:15:35.945064 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-4d223f3d-a5ce-46d5-a164-e2c4831620a9 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:15:35.945501 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-4d223f3d-a5ce-46d5-a164-e2c4831620a9 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:15:36.011523 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.policy [None req-4d223f3d-a5ce-46d5-a164-e2c4831620a9 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97bdf19af9e34fc3886ff451cb9d7a27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '494b56bf5eae4d56a5591546f85bc32b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116156) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:15:36.019396 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: INFO nova.api.openstack.requestlog [None req-4d223f3d-a5ce-46d5-a164-e2c4831620a9 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] 10.222.0.18 "GET /compute/v2.1/servers/bbb8462c-9501-4541-b67e-43ec5c5061a7" status: 200 len: 1226 microversion: 2.1 time: 0.084621 Dec 15 03:15:36.019956 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: [pid: 116156|app: 0|req: 910/1771] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 03:15:35 2021] GET /compute/v2.1/servers/bbb8462c-9501-4541-b67e-43ec5c5061a7 => generated 1226 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 03:15:36.949893 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi [None req-31e68698-6cb5-41d2-a5de-295d6d42c1cf tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Calling method '>' {{(pid=116156) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:15:36.950597 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.compute.api [None req-31e68698-6cb5-41d2-a5de-295d6d42c1cf tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] [instance: fa7c86bc-c46f-4120-8f3d-d795f8d7c5cc] Fetching instance by UUID {{(pid=116156) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:15:36.956791 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-31e68698-6cb5-41d2-a5de-295d6d42c1cf tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:15:36.957248 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-31e68698-6cb5-41d2-a5de-295d6d42c1cf tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:15:36.958057 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-31e68698-6cb5-41d2-a5de-295d6d42c1cf tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:15:36.958496 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-31e68698-6cb5-41d2-a5de-295d6d42c1cf tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:15:37.086153 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.policy [None req-31e68698-6cb5-41d2-a5de-295d6d42c1cf tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c4c0c82448e40ba801c0b52ec44e74a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a093d0bf43046aaa845f3cc115f3f5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116156) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:15:37.093491 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: INFO nova.api.openstack.requestlog [None req-31e68698-6cb5-41d2-a5de-295d6d42c1cf tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] 10.222.0.18 "GET /compute/v2.1/servers/fa7c86bc-c46f-4120-8f3d-d795f8d7c5cc" status: 200 len: 1451 microversion: 2.1 time: 0.147281 Dec 15 03:15:37.094071 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: [pid: 116156|app: 0|req: 911/1772] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 03:15:36 2021] GET /compute/v2.1/servers/fa7c86bc-c46f-4120-8f3d-d795f8d7c5cc => generated 1451 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 03:15:37.098253 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi [None req-4bd3edfe-3e2a-43a2-b4fd-c2ebef3334f7 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Calling method '>' {{(pid=116156) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:15:37.098859 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.compute.api [None req-4bd3edfe-3e2a-43a2-b4fd-c2ebef3334f7 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] [instance: bbb8462c-9501-4541-b67e-43ec5c5061a7] Fetching instance by UUID {{(pid=116156) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:15:37.104162 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-4bd3edfe-3e2a-43a2-b4fd-c2ebef3334f7 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:15:37.104627 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-4bd3edfe-3e2a-43a2-b4fd-c2ebef3334f7 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:15:37.105421 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-4bd3edfe-3e2a-43a2-b4fd-c2ebef3334f7 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:15:37.106394 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-4bd3edfe-3e2a-43a2-b4fd-c2ebef3334f7 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:15:37.163498 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.policy [None req-4bd3edfe-3e2a-43a2-b4fd-c2ebef3334f7 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97bdf19af9e34fc3886ff451cb9d7a27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '494b56bf5eae4d56a5591546f85bc32b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116156) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:15:37.171101 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: INFO nova.api.openstack.requestlog [None req-4bd3edfe-3e2a-43a2-b4fd-c2ebef3334f7 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] 10.222.0.18 "GET /compute/v2.1/servers/bbb8462c-9501-4541-b67e-43ec5c5061a7" status: 200 len: 1226 microversion: 2.1 time: 0.076082 Dec 15 03:15:37.171664 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: [pid: 116156|app: 0|req: 912/1773] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 03:15:37 2021] GET /compute/v2.1/servers/bbb8462c-9501-4541-b67e-43ec5c5061a7 => generated 1226 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 03:15:38.111109 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi [None req-2d72d530-2f44-4535-89fa-4b6045149a2b tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Calling method '>' {{(pid=116156) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:15:38.111751 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.compute.api [None req-2d72d530-2f44-4535-89fa-4b6045149a2b tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] [instance: fa7c86bc-c46f-4120-8f3d-d795f8d7c5cc] Fetching instance by UUID {{(pid=116156) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:15:38.117941 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-2d72d530-2f44-4535-89fa-4b6045149a2b tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:15:38.118428 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-2d72d530-2f44-4535-89fa-4b6045149a2b tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:15:38.119211 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-2d72d530-2f44-4535-89fa-4b6045149a2b tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:15:38.119651 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-2d72d530-2f44-4535-89fa-4b6045149a2b tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:15:38.252205 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.policy [None req-2d72d530-2f44-4535-89fa-4b6045149a2b tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c4c0c82448e40ba801c0b52ec44e74a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a093d0bf43046aaa845f3cc115f3f5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116156) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:15:38.259619 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: INFO nova.api.openstack.requestlog [None req-2d72d530-2f44-4535-89fa-4b6045149a2b tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] 10.222.0.18 "GET /compute/v2.1/servers/fa7c86bc-c46f-4120-8f3d-d795f8d7c5cc" status: 200 len: 1451 microversion: 2.1 time: 0.152404 Dec 15 03:15:38.260250 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: [pid: 116156|app: 0|req: 913/1774] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 03:15:38 2021] GET /compute/v2.1/servers/fa7c86bc-c46f-4120-8f3d-d795f8d7c5cc => generated 1451 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 03:15:38.265115 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi [None req-76c4d509-0be6-4355-b75f-07fec1a84723 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Calling method '>' {{(pid=116156) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:15:38.265727 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.compute.api [None req-76c4d509-0be6-4355-b75f-07fec1a84723 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] [instance: bbb8462c-9501-4541-b67e-43ec5c5061a7] Fetching instance by UUID {{(pid=116156) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:15:38.271233 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-76c4d509-0be6-4355-b75f-07fec1a84723 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:15:38.271689 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-76c4d509-0be6-4355-b75f-07fec1a84723 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:15:38.272473 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-76c4d509-0be6-4355-b75f-07fec1a84723 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:15:38.272918 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-76c4d509-0be6-4355-b75f-07fec1a84723 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:15:38.330517 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.policy [None req-76c4d509-0be6-4355-b75f-07fec1a84723 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97bdf19af9e34fc3886ff451cb9d7a27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '494b56bf5eae4d56a5591546f85bc32b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116156) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:15:38.337665 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: INFO nova.api.openstack.requestlog [None req-76c4d509-0be6-4355-b75f-07fec1a84723 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] 10.222.0.18 "GET /compute/v2.1/servers/bbb8462c-9501-4541-b67e-43ec5c5061a7" status: 200 len: 1226 microversion: 2.1 time: 0.076277 Dec 15 03:15:38.338261 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: [pid: 116156|app: 0|req: 914/1775] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 03:15:38 2021] GET /compute/v2.1/servers/bbb8462c-9501-4541-b67e-43ec5c5061a7 => generated 1226 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 03:15:39.275800 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi [None req-206b7ea0-4114-4540-a500-4f3d187999a1 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Calling method '>' {{(pid=116156) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:15:39.276463 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.compute.api [None req-206b7ea0-4114-4540-a500-4f3d187999a1 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] [instance: fa7c86bc-c46f-4120-8f3d-d795f8d7c5cc] Fetching instance by UUID {{(pid=116156) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:15:39.283330 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-206b7ea0-4114-4540-a500-4f3d187999a1 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:15:39.283779 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-206b7ea0-4114-4540-a500-4f3d187999a1 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:15:39.284554 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-206b7ea0-4114-4540-a500-4f3d187999a1 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:15:39.284988 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-206b7ea0-4114-4540-a500-4f3d187999a1 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:15:39.413759 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.policy [None req-206b7ea0-4114-4540-a500-4f3d187999a1 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c4c0c82448e40ba801c0b52ec44e74a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a093d0bf43046aaa845f3cc115f3f5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116156) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:15:39.421442 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: INFO nova.api.openstack.requestlog [None req-206b7ea0-4114-4540-a500-4f3d187999a1 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] 10.222.0.18 "GET /compute/v2.1/servers/fa7c86bc-c46f-4120-8f3d-d795f8d7c5cc" status: 200 len: 1451 microversion: 2.1 time: 0.149346 Dec 15 03:15:39.422016 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: [pid: 116156|app: 0|req: 915/1776] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 03:15:39 2021] GET /compute/v2.1/servers/fa7c86bc-c46f-4120-8f3d-d795f8d7c5cc => generated 1451 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 03:15:39.426147 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi [None req-776bdd33-5a9d-4549-b2dc-f1c243ca0896 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Calling method '>' {{(pid=116156) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:15:39.426776 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.compute.api [None req-776bdd33-5a9d-4549-b2dc-f1c243ca0896 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] [instance: bbb8462c-9501-4541-b67e-43ec5c5061a7] Fetching instance by UUID {{(pid=116156) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:15:39.432021 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-776bdd33-5a9d-4549-b2dc-f1c243ca0896 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:15:39.432475 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-776bdd33-5a9d-4549-b2dc-f1c243ca0896 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:15:39.433253 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-776bdd33-5a9d-4549-b2dc-f1c243ca0896 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:15:39.433730 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-776bdd33-5a9d-4549-b2dc-f1c243ca0896 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:15:39.491880 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.policy [None req-776bdd33-5a9d-4549-b2dc-f1c243ca0896 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97bdf19af9e34fc3886ff451cb9d7a27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '494b56bf5eae4d56a5591546f85bc32b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116156) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:15:39.499603 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: INFO nova.api.openstack.requestlog [None req-776bdd33-5a9d-4549-b2dc-f1c243ca0896 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] 10.222.0.18 "GET /compute/v2.1/servers/bbb8462c-9501-4541-b67e-43ec5c5061a7" status: 200 len: 1226 microversion: 2.1 time: 0.076652 Dec 15 03:15:39.500164 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: [pid: 116156|app: 0|req: 916/1777] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 03:15:39 2021] GET /compute/v2.1/servers/bbb8462c-9501-4541-b67e-43ec5c5061a7 => generated 1226 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 03:15:40.437931 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi [None req-8a0ad61a-90e2-434e-b4f1-eac97ca392a7 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Calling method '>' {{(pid=116156) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:15:40.438567 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.compute.api [None req-8a0ad61a-90e2-434e-b4f1-eac97ca392a7 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] [instance: fa7c86bc-c46f-4120-8f3d-d795f8d7c5cc] Fetching instance by UUID {{(pid=116156) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:15:40.444406 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-8a0ad61a-90e2-434e-b4f1-eac97ca392a7 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:15:40.444858 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-8a0ad61a-90e2-434e-b4f1-eac97ca392a7 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:15:40.445639 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-8a0ad61a-90e2-434e-b4f1-eac97ca392a7 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:15:40.446106 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-8a0ad61a-90e2-434e-b4f1-eac97ca392a7 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:15:40.577462 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.policy [None req-8a0ad61a-90e2-434e-b4f1-eac97ca392a7 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c4c0c82448e40ba801c0b52ec44e74a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a093d0bf43046aaa845f3cc115f3f5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116156) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:15:40.584648 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: INFO nova.api.openstack.requestlog [None req-8a0ad61a-90e2-434e-b4f1-eac97ca392a7 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] 10.222.0.18 "GET /compute/v2.1/servers/fa7c86bc-c46f-4120-8f3d-d795f8d7c5cc" status: 200 len: 1451 microversion: 2.1 time: 0.150553 Dec 15 03:15:40.585224 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: [pid: 116156|app: 0|req: 917/1778] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 03:15:40 2021] GET /compute/v2.1/servers/fa7c86bc-c46f-4120-8f3d-d795f8d7c5cc => generated 1451 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 03:15:40.589310 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi [None req-e8ed9a61-1900-4b71-a48a-775415304630 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Calling method '>' {{(pid=116156) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:15:40.590420 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.compute.api [None req-e8ed9a61-1900-4b71-a48a-775415304630 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] [instance: bbb8462c-9501-4541-b67e-43ec5c5061a7] Fetching instance by UUID {{(pid=116156) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:15:40.595604 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-e8ed9a61-1900-4b71-a48a-775415304630 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:15:40.596052 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-e8ed9a61-1900-4b71-a48a-775415304630 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:15:40.596817 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-e8ed9a61-1900-4b71-a48a-775415304630 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:15:40.597251 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-e8ed9a61-1900-4b71-a48a-775415304630 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:15:40.656032 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.policy [None req-e8ed9a61-1900-4b71-a48a-775415304630 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97bdf19af9e34fc3886ff451cb9d7a27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '494b56bf5eae4d56a5591546f85bc32b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116156) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:15:40.663204 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: INFO nova.api.openstack.requestlog [None req-e8ed9a61-1900-4b71-a48a-775415304630 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] 10.222.0.18 "GET /compute/v2.1/servers/bbb8462c-9501-4541-b67e-43ec5c5061a7" status: 200 len: 1226 microversion: 2.1 time: 0.077041 Dec 15 03:15:40.663750 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: [pid: 116156|app: 0|req: 918/1779] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 03:15:40 2021] GET /compute/v2.1/servers/bbb8462c-9501-4541-b67e-43ec5c5061a7 => generated 1226 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 03:15:41.601904 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi [None req-f5c59f35-fcbf-473c-86e2-dba2e6cc6445 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Calling method '>' {{(pid=116156) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:15:41.602528 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.compute.api [None req-f5c59f35-fcbf-473c-86e2-dba2e6cc6445 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] [instance: fa7c86bc-c46f-4120-8f3d-d795f8d7c5cc] Fetching instance by UUID {{(pid=116156) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:15:41.609224 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-f5c59f35-fcbf-473c-86e2-dba2e6cc6445 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:15:41.609674 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-f5c59f35-fcbf-473c-86e2-dba2e6cc6445 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:15:41.610748 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-f5c59f35-fcbf-473c-86e2-dba2e6cc6445 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:15:41.611182 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-f5c59f35-fcbf-473c-86e2-dba2e6cc6445 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:15:41.741677 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.policy [None req-f5c59f35-fcbf-473c-86e2-dba2e6cc6445 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c4c0c82448e40ba801c0b52ec44e74a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a093d0bf43046aaa845f3cc115f3f5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116156) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:15:41.749493 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: INFO nova.api.openstack.requestlog [None req-f5c59f35-fcbf-473c-86e2-dba2e6cc6445 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] 10.222.0.18 "GET /compute/v2.1/servers/fa7c86bc-c46f-4120-8f3d-d795f8d7c5cc" status: 200 len: 1451 microversion: 2.1 time: 0.151294 Dec 15 03:15:41.750073 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: [pid: 116156|app: 0|req: 919/1780] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 03:15:41 2021] GET /compute/v2.1/servers/fa7c86bc-c46f-4120-8f3d-d795f8d7c5cc => generated 1451 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 03:15:41.754332 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi [None req-b79478f5-f48f-4709-9a40-07b102547f5b tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Calling method '>' {{(pid=116156) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:15:41.754928 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.compute.api [None req-b79478f5-f48f-4709-9a40-07b102547f5b tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] [instance: bbb8462c-9501-4541-b67e-43ec5c5061a7] Fetching instance by UUID {{(pid=116156) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:15:41.760210 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-b79478f5-f48f-4709-9a40-07b102547f5b tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:15:41.760661 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-b79478f5-f48f-4709-9a40-07b102547f5b tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:15:41.761437 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-b79478f5-f48f-4709-9a40-07b102547f5b tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:15:41.761871 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-b79478f5-f48f-4709-9a40-07b102547f5b tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:15:41.822362 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.policy [None req-b79478f5-f48f-4709-9a40-07b102547f5b tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97bdf19af9e34fc3886ff451cb9d7a27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '494b56bf5eae4d56a5591546f85bc32b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116156) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:15:41.829512 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: INFO nova.api.openstack.requestlog [None req-b79478f5-f48f-4709-9a40-07b102547f5b tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] 10.222.0.18 "GET /compute/v2.1/servers/bbb8462c-9501-4541-b67e-43ec5c5061a7" status: 200 len: 1226 microversion: 2.1 time: 0.078508 Dec 15 03:15:41.830094 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: [pid: 116156|app: 0|req: 920/1781] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 03:15:41 2021] GET /compute/v2.1/servers/bbb8462c-9501-4541-b67e-43ec5c5061a7 => generated 1226 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 03:15:42.766749 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi [None req-50ffa23e-0820-4136-b6d6-cfdadee20387 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Calling method '>' {{(pid=116156) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:15:42.767411 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.compute.api [None req-50ffa23e-0820-4136-b6d6-cfdadee20387 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] [instance: fa7c86bc-c46f-4120-8f3d-d795f8d7c5cc] Fetching instance by UUID {{(pid=116156) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:15:42.773537 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-50ffa23e-0820-4136-b6d6-cfdadee20387 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:15:42.774002 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-50ffa23e-0820-4136-b6d6-cfdadee20387 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:15:42.774792 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-50ffa23e-0820-4136-b6d6-cfdadee20387 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:15:42.775227 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-50ffa23e-0820-4136-b6d6-cfdadee20387 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:15:42.902958 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.policy [None req-50ffa23e-0820-4136-b6d6-cfdadee20387 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c4c0c82448e40ba801c0b52ec44e74a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a093d0bf43046aaa845f3cc115f3f5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116156) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:15:42.910120 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: INFO nova.api.openstack.requestlog [None req-50ffa23e-0820-4136-b6d6-cfdadee20387 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] 10.222.0.18 "GET /compute/v2.1/servers/fa7c86bc-c46f-4120-8f3d-d795f8d7c5cc" status: 200 len: 1451 microversion: 2.1 time: 0.147023 Dec 15 03:15:42.910698 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: [pid: 116156|app: 0|req: 921/1782] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 03:15:42 2021] GET /compute/v2.1/servers/fa7c86bc-c46f-4120-8f3d-d795f8d7c5cc => generated 1451 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 03:15:42.914899 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi [None req-1a52d987-ead7-4dbe-b0ce-69092fa595dd tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Calling method '>' {{(pid=116156) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:15:42.915498 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.compute.api [None req-1a52d987-ead7-4dbe-b0ce-69092fa595dd tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] [instance: bbb8462c-9501-4541-b67e-43ec5c5061a7] Fetching instance by UUID {{(pid=116156) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:15:42.921502 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-1a52d987-ead7-4dbe-b0ce-69092fa595dd tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:15:42.921950 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-1a52d987-ead7-4dbe-b0ce-69092fa595dd tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:15:42.922764 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-1a52d987-ead7-4dbe-b0ce-69092fa595dd tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:15:42.923199 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-1a52d987-ead7-4dbe-b0ce-69092fa595dd tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:15:42.980351 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.policy [None req-1a52d987-ead7-4dbe-b0ce-69092fa595dd tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97bdf19af9e34fc3886ff451cb9d7a27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '494b56bf5eae4d56a5591546f85bc32b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116156) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:15:42.988157 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: INFO nova.api.openstack.requestlog [None req-1a52d987-ead7-4dbe-b0ce-69092fa595dd tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] 10.222.0.18 "GET /compute/v2.1/servers/bbb8462c-9501-4541-b67e-43ec5c5061a7" status: 200 len: 1226 microversion: 2.1 time: 0.076521 Dec 15 03:15:42.988719 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: [pid: 116156|app: 0|req: 922/1783] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 03:15:42 2021] GET /compute/v2.1/servers/bbb8462c-9501-4541-b67e-43ec5c5061a7 => generated 1226 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 03:15:43.927376 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi [None req-c62043bc-5f37-4718-9db8-a7e5d7f8269f tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Calling method '>' {{(pid=116156) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:15:43.928032 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.compute.api [None req-c62043bc-5f37-4718-9db8-a7e5d7f8269f tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] [instance: fa7c86bc-c46f-4120-8f3d-d795f8d7c5cc] Fetching instance by UUID {{(pid=116156) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:15:43.934842 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-c62043bc-5f37-4718-9db8-a7e5d7f8269f tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:15:43.935294 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-c62043bc-5f37-4718-9db8-a7e5d7f8269f tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:15:43.936061 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-c62043bc-5f37-4718-9db8-a7e5d7f8269f tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:15:43.936493 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-c62043bc-5f37-4718-9db8-a7e5d7f8269f tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:15:44.069187 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.policy [None req-c62043bc-5f37-4718-9db8-a7e5d7f8269f tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c4c0c82448e40ba801c0b52ec44e74a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a093d0bf43046aaa845f3cc115f3f5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116156) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:15:44.076361 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: INFO nova.api.openstack.requestlog [None req-c62043bc-5f37-4718-9db8-a7e5d7f8269f tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] 10.222.0.18 "GET /compute/v2.1/servers/fa7c86bc-c46f-4120-8f3d-d795f8d7c5cc" status: 200 len: 1451 microversion: 2.1 time: 0.152664 Dec 15 03:15:44.076917 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: [pid: 116156|app: 0|req: 923/1784] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 03:15:43 2021] GET /compute/v2.1/servers/fa7c86bc-c46f-4120-8f3d-d795f8d7c5cc => generated 1451 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 03:15:44.081063 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi [None req-5787bab6-68b9-4a0b-a8ee-63c459e1bcd1 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Calling method '>' {{(pid=116156) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:15:44.081662 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.compute.api [None req-5787bab6-68b9-4a0b-a8ee-63c459e1bcd1 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] [instance: bbb8462c-9501-4541-b67e-43ec5c5061a7] Fetching instance by UUID {{(pid=116156) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:15:44.086986 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-5787bab6-68b9-4a0b-a8ee-63c459e1bcd1 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:15:44.087437 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-5787bab6-68b9-4a0b-a8ee-63c459e1bcd1 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:15:44.088210 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-5787bab6-68b9-4a0b-a8ee-63c459e1bcd1 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:15:44.088641 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-5787bab6-68b9-4a0b-a8ee-63c459e1bcd1 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:15:44.146251 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.policy [None req-5787bab6-68b9-4a0b-a8ee-63c459e1bcd1 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97bdf19af9e34fc3886ff451cb9d7a27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '494b56bf5eae4d56a5591546f85bc32b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116156) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:15:44.153790 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: INFO nova.api.openstack.requestlog [None req-5787bab6-68b9-4a0b-a8ee-63c459e1bcd1 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] 10.222.0.18 "GET /compute/v2.1/servers/bbb8462c-9501-4541-b67e-43ec5c5061a7" status: 200 len: 1226 microversion: 2.1 time: 0.075945 Dec 15 03:15:44.154372 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: [pid: 116156|app: 0|req: 924/1785] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 03:15:44 2021] GET /compute/v2.1/servers/bbb8462c-9501-4541-b67e-43ec5c5061a7 => generated 1226 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 03:15:45.093097 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi [None req-82d3f509-b136-4efd-9a32-67dc8bc5e258 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Calling method '>' {{(pid=116156) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:15:45.093771 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.compute.api [None req-82d3f509-b136-4efd-9a32-67dc8bc5e258 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] [instance: fa7c86bc-c46f-4120-8f3d-d795f8d7c5cc] Fetching instance by UUID {{(pid=116156) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:15:45.099977 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-82d3f509-b136-4efd-9a32-67dc8bc5e258 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:15:45.100431 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-82d3f509-b136-4efd-9a32-67dc8bc5e258 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:15:45.101204 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-82d3f509-b136-4efd-9a32-67dc8bc5e258 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:15:45.101639 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-82d3f509-b136-4efd-9a32-67dc8bc5e258 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:15:45.230294 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.policy [None req-82d3f509-b136-4efd-9a32-67dc8bc5e258 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c4c0c82448e40ba801c0b52ec44e74a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a093d0bf43046aaa845f3cc115f3f5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116156) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:15:45.239809 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: INFO nova.api.openstack.requestlog [None req-82d3f509-b136-4efd-9a32-67dc8bc5e258 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] 10.222.0.18 "GET /compute/v2.1/servers/fa7c86bc-c46f-4120-8f3d-d795f8d7c5cc" status: 200 len: 1451 microversion: 2.1 time: 0.150363 Dec 15 03:15:45.240379 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: [pid: 116156|app: 0|req: 925/1786] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 03:15:45 2021] GET /compute/v2.1/servers/fa7c86bc-c46f-4120-8f3d-d795f8d7c5cc => generated 1451 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 03:15:45.244580 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi [None req-732a00f9-3a9d-48b4-b10e-8251c0c8ac9e tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Calling method '>' {{(pid=116156) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:15:45.245191 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.compute.api [None req-732a00f9-3a9d-48b4-b10e-8251c0c8ac9e tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] [instance: bbb8462c-9501-4541-b67e-43ec5c5061a7] Fetching instance by UUID {{(pid=116156) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:15:45.251220 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-732a00f9-3a9d-48b4-b10e-8251c0c8ac9e tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:15:45.251676 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-732a00f9-3a9d-48b4-b10e-8251c0c8ac9e tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:15:45.252460 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-732a00f9-3a9d-48b4-b10e-8251c0c8ac9e tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:15:45.252901 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-732a00f9-3a9d-48b4-b10e-8251c0c8ac9e tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:15:45.310172 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.policy [None req-732a00f9-3a9d-48b4-b10e-8251c0c8ac9e tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97bdf19af9e34fc3886ff451cb9d7a27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '494b56bf5eae4d56a5591546f85bc32b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116156) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:15:45.317312 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: INFO nova.api.openstack.requestlog [None req-732a00f9-3a9d-48b4-b10e-8251c0c8ac9e tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] 10.222.0.18 "GET /compute/v2.1/servers/bbb8462c-9501-4541-b67e-43ec5c5061a7" status: 200 len: 1226 microversion: 2.1 time: 0.075985 Dec 15 03:15:45.317870 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: [pid: 116156|app: 0|req: 926/1787] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 03:15:45 2021] GET /compute/v2.1/servers/bbb8462c-9501-4541-b67e-43ec5c5061a7 => generated 1226 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 03:15:46.257219 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi [None req-03ba49bf-e06d-45d6-850d-c5699ff70a71 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Calling method '>' {{(pid=116156) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:15:46.257853 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.compute.api [None req-03ba49bf-e06d-45d6-850d-c5699ff70a71 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] [instance: fa7c86bc-c46f-4120-8f3d-d795f8d7c5cc] Fetching instance by UUID {{(pid=116156) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:15:46.264047 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-03ba49bf-e06d-45d6-850d-c5699ff70a71 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:15:46.264492 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-03ba49bf-e06d-45d6-850d-c5699ff70a71 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:15:46.265265 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-03ba49bf-e06d-45d6-850d-c5699ff70a71 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:15:46.265694 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-03ba49bf-e06d-45d6-850d-c5699ff70a71 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:15:46.395777 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.policy [None req-03ba49bf-e06d-45d6-850d-c5699ff70a71 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c4c0c82448e40ba801c0b52ec44e74a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a093d0bf43046aaa845f3cc115f3f5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116156) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:15:46.403446 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: INFO nova.api.openstack.requestlog [None req-03ba49bf-e06d-45d6-850d-c5699ff70a71 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] 10.222.0.18 "GET /compute/v2.1/servers/fa7c86bc-c46f-4120-8f3d-d795f8d7c5cc" status: 200 len: 1451 microversion: 2.1 time: 0.149872 Dec 15 03:15:46.404007 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: [pid: 116156|app: 0|req: 927/1788] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 03:15:46 2021] GET /compute/v2.1/servers/fa7c86bc-c46f-4120-8f3d-d795f8d7c5cc => generated 1451 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 03:15:46.408109 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi [None req-cad66724-52bd-494f-a089-22cebe75e5cb tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Calling method '>' {{(pid=116156) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:15:46.408707 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.compute.api [None req-cad66724-52bd-494f-a089-22cebe75e5cb tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] [instance: bbb8462c-9501-4541-b67e-43ec5c5061a7] Fetching instance by UUID {{(pid=116156) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:15:46.414047 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-cad66724-52bd-494f-a089-22cebe75e5cb tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:15:46.414502 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-cad66724-52bd-494f-a089-22cebe75e5cb tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:15:46.415281 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-cad66724-52bd-494f-a089-22cebe75e5cb tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:15:46.415718 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-cad66724-52bd-494f-a089-22cebe75e5cb tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:15:46.473008 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.policy [None req-cad66724-52bd-494f-a089-22cebe75e5cb tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97bdf19af9e34fc3886ff451cb9d7a27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '494b56bf5eae4d56a5591546f85bc32b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116156) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:15:46.480348 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: INFO nova.api.openstack.requestlog [None req-cad66724-52bd-494f-a089-22cebe75e5cb tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] 10.222.0.18 "GET /compute/v2.1/servers/bbb8462c-9501-4541-b67e-43ec5c5061a7" status: 200 len: 1226 microversion: 2.1 time: 0.075386 Dec 15 03:15:46.481565 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: [pid: 116156|app: 0|req: 928/1789] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 03:15:46 2021] GET /compute/v2.1/servers/bbb8462c-9501-4541-b67e-43ec5c5061a7 => generated 1226 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 03:15:47.420172 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi [None req-59ad45f9-d067-42ed-8939-4d895e5e49ca tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Calling method '>' {{(pid=116156) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:15:47.420781 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.compute.api [None req-59ad45f9-d067-42ed-8939-4d895e5e49ca tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] [instance: fa7c86bc-c46f-4120-8f3d-d795f8d7c5cc] Fetching instance by UUID {{(pid=116156) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:15:47.427249 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-59ad45f9-d067-42ed-8939-4d895e5e49ca tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:15:47.427696 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-59ad45f9-d067-42ed-8939-4d895e5e49ca tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:15:47.428468 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-59ad45f9-d067-42ed-8939-4d895e5e49ca tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:15:47.428904 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-59ad45f9-d067-42ed-8939-4d895e5e49ca tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:15:47.556532 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.policy [None req-59ad45f9-d067-42ed-8939-4d895e5e49ca tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c4c0c82448e40ba801c0b52ec44e74a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a093d0bf43046aaa845f3cc115f3f5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116156) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:15:47.563669 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: INFO nova.api.openstack.requestlog [None req-59ad45f9-d067-42ed-8939-4d895e5e49ca tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] 10.222.0.18 "GET /compute/v2.1/servers/fa7c86bc-c46f-4120-8f3d-d795f8d7c5cc" status: 200 len: 1451 microversion: 2.1 time: 0.147138 Dec 15 03:15:47.564234 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: [pid: 116156|app: 0|req: 929/1790] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 03:15:47 2021] GET /compute/v2.1/servers/fa7c86bc-c46f-4120-8f3d-d795f8d7c5cc => generated 1451 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 03:15:47.568327 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi [None req-11e95bef-c9d3-40ad-b929-d6c0f262ef55 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Calling method '>' {{(pid=116156) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:15:47.568924 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.compute.api [None req-11e95bef-c9d3-40ad-b929-d6c0f262ef55 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] [instance: bbb8462c-9501-4541-b67e-43ec5c5061a7] Fetching instance by UUID {{(pid=116156) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:15:47.574611 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-11e95bef-c9d3-40ad-b929-d6c0f262ef55 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:15:47.575064 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-11e95bef-c9d3-40ad-b929-d6c0f262ef55 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:15:47.575832 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-11e95bef-c9d3-40ad-b929-d6c0f262ef55 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:15:47.576263 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-11e95bef-c9d3-40ad-b929-d6c0f262ef55 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:15:47.636324 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.policy [None req-11e95bef-c9d3-40ad-b929-d6c0f262ef55 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97bdf19af9e34fc3886ff451cb9d7a27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '494b56bf5eae4d56a5591546f85bc32b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116156) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:15:47.643878 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: INFO nova.api.openstack.requestlog [None req-11e95bef-c9d3-40ad-b929-d6c0f262ef55 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] 10.222.0.18 "GET /compute/v2.1/servers/bbb8462c-9501-4541-b67e-43ec5c5061a7" status: 200 len: 1226 microversion: 2.1 time: 0.078721 Dec 15 03:15:47.644426 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: [pid: 116156|app: 0|req: 930/1791] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 03:15:47 2021] GET /compute/v2.1/servers/bbb8462c-9501-4541-b67e-43ec5c5061a7 => generated 1226 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 03:15:48.580968 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi [None req-7a2d5a96-8ce5-4b0e-9177-aa6702847761 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Calling method '>' {{(pid=116156) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:15:48.581622 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.compute.api [None req-7a2d5a96-8ce5-4b0e-9177-aa6702847761 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] [instance: fa7c86bc-c46f-4120-8f3d-d795f8d7c5cc] Fetching instance by UUID {{(pid=116156) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:15:48.587734 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-7a2d5a96-8ce5-4b0e-9177-aa6702847761 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:15:48.588177 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-7a2d5a96-8ce5-4b0e-9177-aa6702847761 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:15:48.588947 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-7a2d5a96-8ce5-4b0e-9177-aa6702847761 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:15:48.589376 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-7a2d5a96-8ce5-4b0e-9177-aa6702847761 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:15:48.717558 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.policy [None req-7a2d5a96-8ce5-4b0e-9177-aa6702847761 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c4c0c82448e40ba801c0b52ec44e74a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a093d0bf43046aaa845f3cc115f3f5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116156) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:15:48.724782 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: INFO nova.api.openstack.requestlog [None req-7a2d5a96-8ce5-4b0e-9177-aa6702847761 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] 10.222.0.18 "GET /compute/v2.1/servers/fa7c86bc-c46f-4120-8f3d-d795f8d7c5cc" status: 200 len: 1451 microversion: 2.1 time: 0.147428 Dec 15 03:15:48.725344 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: [pid: 116156|app: 0|req: 931/1792] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 03:15:48 2021] GET /compute/v2.1/servers/fa7c86bc-c46f-4120-8f3d-d795f8d7c5cc => generated 1451 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 03:15:48.729521 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi [None req-84694c76-4fc1-402b-b204-c4929b1a3843 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Calling method '>' {{(pid=116156) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:15:48.730196 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.compute.api [None req-84694c76-4fc1-402b-b204-c4929b1a3843 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] [instance: bbb8462c-9501-4541-b67e-43ec5c5061a7] Fetching instance by UUID {{(pid=116156) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:15:48.735750 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-84694c76-4fc1-402b-b204-c4929b1a3843 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:15:48.736199 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-84694c76-4fc1-402b-b204-c4929b1a3843 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:15:48.736967 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-84694c76-4fc1-402b-b204-c4929b1a3843 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:15:48.737399 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-84694c76-4fc1-402b-b204-c4929b1a3843 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:15:48.795218 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.policy [None req-84694c76-4fc1-402b-b204-c4929b1a3843 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97bdf19af9e34fc3886ff451cb9d7a27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '494b56bf5eae4d56a5591546f85bc32b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116156) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:15:48.802341 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: INFO nova.api.openstack.requestlog [None req-84694c76-4fc1-402b-b204-c4929b1a3843 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] 10.222.0.18 "GET /compute/v2.1/servers/bbb8462c-9501-4541-b67e-43ec5c5061a7" status: 200 len: 1226 microversion: 2.1 time: 0.076034 Dec 15 03:15:48.802898 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: [pid: 116156|app: 0|req: 932/1793] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 03:15:48 2021] GET /compute/v2.1/servers/bbb8462c-9501-4541-b67e-43ec5c5061a7 => generated 1226 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 03:15:49.741641 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi [None req-869b0e59-9d05-4872-ba22-46cafbc44fae tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Calling method '>' {{(pid=116156) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:15:49.742298 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.compute.api [None req-869b0e59-9d05-4872-ba22-46cafbc44fae tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] [instance: fa7c86bc-c46f-4120-8f3d-d795f8d7c5cc] Fetching instance by UUID {{(pid=116156) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:15:49.748630 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-869b0e59-9d05-4872-ba22-46cafbc44fae tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:15:49.749074 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-869b0e59-9d05-4872-ba22-46cafbc44fae tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:15:49.749844 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-869b0e59-9d05-4872-ba22-46cafbc44fae tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:15:49.750305 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-869b0e59-9d05-4872-ba22-46cafbc44fae tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:15:49.880866 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.policy [None req-869b0e59-9d05-4872-ba22-46cafbc44fae tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c4c0c82448e40ba801c0b52ec44e74a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a093d0bf43046aaa845f3cc115f3f5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116156) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:15:49.888568 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: INFO nova.api.openstack.requestlog [None req-869b0e59-9d05-4872-ba22-46cafbc44fae tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] 10.222.0.18 "GET /compute/v2.1/servers/fa7c86bc-c46f-4120-8f3d-d795f8d7c5cc" status: 200 len: 1451 microversion: 2.1 time: 0.150542 Dec 15 03:15:49.889129 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: [pid: 116156|app: 0|req: 933/1794] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 03:15:49 2021] GET /compute/v2.1/servers/fa7c86bc-c46f-4120-8f3d-d795f8d7c5cc => generated 1451 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 03:15:49.893303 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi [None req-7c5b8f9f-424f-43fc-bffb-e3c229995b89 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Calling method '>' {{(pid=116156) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:15:49.893894 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.compute.api [None req-7c5b8f9f-424f-43fc-bffb-e3c229995b89 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] [instance: bbb8462c-9501-4541-b67e-43ec5c5061a7] Fetching instance by UUID {{(pid=116156) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:15:49.899222 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-7c5b8f9f-424f-43fc-bffb-e3c229995b89 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:15:49.899672 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-7c5b8f9f-424f-43fc-bffb-e3c229995b89 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:15:49.900440 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-7c5b8f9f-424f-43fc-bffb-e3c229995b89 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:15:49.900873 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-7c5b8f9f-424f-43fc-bffb-e3c229995b89 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:15:49.959423 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.policy [None req-7c5b8f9f-424f-43fc-bffb-e3c229995b89 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97bdf19af9e34fc3886ff451cb9d7a27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '494b56bf5eae4d56a5591546f85bc32b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116156) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:15:49.967057 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: INFO nova.api.openstack.requestlog [None req-7c5b8f9f-424f-43fc-bffb-e3c229995b89 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] 10.222.0.18 "GET /compute/v2.1/servers/bbb8462c-9501-4541-b67e-43ec5c5061a7" status: 200 len: 1226 microversion: 2.1 time: 0.076999 Dec 15 03:15:49.967607 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: [pid: 116156|app: 0|req: 934/1795] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 03:15:49 2021] GET /compute/v2.1/servers/bbb8462c-9501-4541-b67e-43ec5c5061a7 => generated 1226 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 03:15:50.905936 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi [None req-e5ea91d9-6565-4ff4-97c7-59e53929c69d tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Calling method '>' {{(pid=116156) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:15:50.906634 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.compute.api [None req-e5ea91d9-6565-4ff4-97c7-59e53929c69d tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] [instance: fa7c86bc-c46f-4120-8f3d-d795f8d7c5cc] Fetching instance by UUID {{(pid=116156) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:15:50.912836 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-e5ea91d9-6565-4ff4-97c7-59e53929c69d tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:15:50.913290 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-e5ea91d9-6565-4ff4-97c7-59e53929c69d tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:15:50.914093 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-e5ea91d9-6565-4ff4-97c7-59e53929c69d tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:15:50.914535 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-e5ea91d9-6565-4ff4-97c7-59e53929c69d tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:15:51.043548 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.policy [None req-e5ea91d9-6565-4ff4-97c7-59e53929c69d tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c4c0c82448e40ba801c0b52ec44e74a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a093d0bf43046aaa845f3cc115f3f5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116156) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:15:51.050794 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: INFO nova.api.openstack.requestlog [None req-e5ea91d9-6565-4ff4-97c7-59e53929c69d tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] 10.222.0.18 "GET /compute/v2.1/servers/fa7c86bc-c46f-4120-8f3d-d795f8d7c5cc" status: 200 len: 1451 microversion: 2.1 time: 0.148505 Dec 15 03:15:51.051353 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: [pid: 116156|app: 0|req: 935/1796] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 03:15:50 2021] GET /compute/v2.1/servers/fa7c86bc-c46f-4120-8f3d-d795f8d7c5cc => generated 1451 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 03:15:51.055475 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi [None req-c5f686df-3433-42ee-a178-91a0afb23513 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Calling method '>' {{(pid=116156) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:15:51.056075 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.compute.api [None req-c5f686df-3433-42ee-a178-91a0afb23513 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] [instance: bbb8462c-9501-4541-b67e-43ec5c5061a7] Fetching instance by UUID {{(pid=116156) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:15:51.061757 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-c5f686df-3433-42ee-a178-91a0afb23513 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:15:51.062234 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-c5f686df-3433-42ee-a178-91a0afb23513 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:15:51.063007 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-c5f686df-3433-42ee-a178-91a0afb23513 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:15:51.063437 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-c5f686df-3433-42ee-a178-91a0afb23513 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:15:51.122517 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.policy [None req-c5f686df-3433-42ee-a178-91a0afb23513 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97bdf19af9e34fc3886ff451cb9d7a27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '494b56bf5eae4d56a5591546f85bc32b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116156) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:15:51.129658 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: INFO nova.api.openstack.requestlog [None req-c5f686df-3433-42ee-a178-91a0afb23513 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] 10.222.0.18 "GET /compute/v2.1/servers/bbb8462c-9501-4541-b67e-43ec5c5061a7" status: 200 len: 1226 microversion: 2.1 time: 0.077382 Dec 15 03:15:51.130242 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: [pid: 116156|app: 0|req: 936/1797] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 03:15:51 2021] GET /compute/v2.1/servers/bbb8462c-9501-4541-b67e-43ec5c5061a7 => generated 1226 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 03:15:52.068043 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi [None req-93988aa3-bb18-4500-8e0a-6d87b7a6062a tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Calling method '>' {{(pid=116156) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:15:52.068741 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.compute.api [None req-93988aa3-bb18-4500-8e0a-6d87b7a6062a tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] [instance: fa7c86bc-c46f-4120-8f3d-d795f8d7c5cc] Fetching instance by UUID {{(pid=116156) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:15:52.075579 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-93988aa3-bb18-4500-8e0a-6d87b7a6062a tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:15:52.076033 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-93988aa3-bb18-4500-8e0a-6d87b7a6062a tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:15:52.076816 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-93988aa3-bb18-4500-8e0a-6d87b7a6062a tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:15:52.077253 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-93988aa3-bb18-4500-8e0a-6d87b7a6062a tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:15:52.211173 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.policy [None req-93988aa3-bb18-4500-8e0a-6d87b7a6062a tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c4c0c82448e40ba801c0b52ec44e74a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a093d0bf43046aaa845f3cc115f3f5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116156) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:15:52.219260 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: INFO nova.api.openstack.requestlog [None req-93988aa3-bb18-4500-8e0a-6d87b7a6062a tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] 10.222.0.18 "GET /compute/v2.1/servers/fa7c86bc-c46f-4120-8f3d-d795f8d7c5cc" status: 200 len: 1451 microversion: 2.1 time: 0.154799 Dec 15 03:15:52.219828 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: [pid: 116156|app: 0|req: 937/1798] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 03:15:52 2021] GET /compute/v2.1/servers/fa7c86bc-c46f-4120-8f3d-d795f8d7c5cc => generated 1451 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 03:15:52.224110 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi [None req-5fdfb3d1-1b29-4f0c-8506-ef0419bb1ca2 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Calling method '>' {{(pid=116156) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:15:52.224714 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.compute.api [None req-5fdfb3d1-1b29-4f0c-8506-ef0419bb1ca2 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] [instance: bbb8462c-9501-4541-b67e-43ec5c5061a7] Fetching instance by UUID {{(pid=116156) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:15:52.230858 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-5fdfb3d1-1b29-4f0c-8506-ef0419bb1ca2 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:15:52.231360 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-5fdfb3d1-1b29-4f0c-8506-ef0419bb1ca2 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:15:52.232179 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-5fdfb3d1-1b29-4f0c-8506-ef0419bb1ca2 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:15:52.232799 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-5fdfb3d1-1b29-4f0c-8506-ef0419bb1ca2 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:15:52.297360 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.policy [None req-5fdfb3d1-1b29-4f0c-8506-ef0419bb1ca2 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97bdf19af9e34fc3886ff451cb9d7a27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '494b56bf5eae4d56a5591546f85bc32b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116156) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:15:52.305539 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: INFO nova.api.openstack.requestlog [None req-5fdfb3d1-1b29-4f0c-8506-ef0419bb1ca2 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] 10.222.0.18 "GET /compute/v2.1/servers/bbb8462c-9501-4541-b67e-43ec5c5061a7" status: 200 len: 1226 microversion: 2.1 time: 0.084710 Dec 15 03:15:52.306136 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: [pid: 116156|app: 0|req: 938/1799] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 03:15:52 2021] GET /compute/v2.1/servers/bbb8462c-9501-4541-b67e-43ec5c5061a7 => generated 1226 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 03:15:53.237607 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi [None req-a6fbdd7b-a559-44f3-8ad3-809fbdfc4ea0 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Calling method '>' {{(pid=116156) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:15:53.238422 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.compute.api [None req-a6fbdd7b-a559-44f3-8ad3-809fbdfc4ea0 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] [instance: fa7c86bc-c46f-4120-8f3d-d795f8d7c5cc] Fetching instance by UUID {{(pid=116156) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:15:53.244659 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-a6fbdd7b-a559-44f3-8ad3-809fbdfc4ea0 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:15:53.245103 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-a6fbdd7b-a559-44f3-8ad3-809fbdfc4ea0 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:15:53.245872 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-a6fbdd7b-a559-44f3-8ad3-809fbdfc4ea0 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:15:53.246330 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-a6fbdd7b-a559-44f3-8ad3-809fbdfc4ea0 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:15:53.376953 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.policy [None req-a6fbdd7b-a559-44f3-8ad3-809fbdfc4ea0 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c4c0c82448e40ba801c0b52ec44e74a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a093d0bf43046aaa845f3cc115f3f5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116156) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:15:53.384197 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: INFO nova.api.openstack.requestlog [None req-a6fbdd7b-a559-44f3-8ad3-809fbdfc4ea0 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] 10.222.0.18 "GET /compute/v2.1/servers/fa7c86bc-c46f-4120-8f3d-d795f8d7c5cc" status: 200 len: 1451 microversion: 2.1 time: 0.151313 Dec 15 03:15:53.384758 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: [pid: 116156|app: 0|req: 939/1800] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 03:15:53 2021] GET /compute/v2.1/servers/fa7c86bc-c46f-4120-8f3d-d795f8d7c5cc => generated 1451 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 03:15:53.389424 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi [None req-22a53cb2-5cb5-44eb-b175-e8d4a9654be3 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Calling method '>' {{(pid=116156) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:15:53.390044 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.compute.api [None req-22a53cb2-5cb5-44eb-b175-e8d4a9654be3 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] [instance: bbb8462c-9501-4541-b67e-43ec5c5061a7] Fetching instance by UUID {{(pid=116156) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:15:53.395312 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-22a53cb2-5cb5-44eb-b175-e8d4a9654be3 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:15:53.395756 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-22a53cb2-5cb5-44eb-b175-e8d4a9654be3 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:15:53.396523 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-22a53cb2-5cb5-44eb-b175-e8d4a9654be3 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:15:53.396956 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-22a53cb2-5cb5-44eb-b175-e8d4a9654be3 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:15:53.458551 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.policy [None req-22a53cb2-5cb5-44eb-b175-e8d4a9654be3 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97bdf19af9e34fc3886ff451cb9d7a27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '494b56bf5eae4d56a5591546f85bc32b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116156) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:15:53.467092 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: INFO nova.api.openstack.requestlog [None req-22a53cb2-5cb5-44eb-b175-e8d4a9654be3 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] 10.222.0.18 "GET /compute/v2.1/servers/bbb8462c-9501-4541-b67e-43ec5c5061a7" status: 200 len: 1226 microversion: 2.1 time: 0.081371 Dec 15 03:15:53.467657 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: [pid: 116156|app: 0|req: 940/1801] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 03:15:53 2021] GET /compute/v2.1/servers/bbb8462c-9501-4541-b67e-43ec5c5061a7 => generated 1226 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 03:15:54.401498 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi [None req-8b9aa90d-0837-4667-8b14-96f59a42394d tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Calling method '>' {{(pid=116156) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:15:54.402169 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.compute.api [None req-8b9aa90d-0837-4667-8b14-96f59a42394d tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] [instance: fa7c86bc-c46f-4120-8f3d-d795f8d7c5cc] Fetching instance by UUID {{(pid=116156) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:15:54.408952 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-8b9aa90d-0837-4667-8b14-96f59a42394d tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:15:54.409406 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-8b9aa90d-0837-4667-8b14-96f59a42394d tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:15:54.410215 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-8b9aa90d-0837-4667-8b14-96f59a42394d tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:15:54.410655 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-8b9aa90d-0837-4667-8b14-96f59a42394d tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:15:54.539802 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.policy [None req-8b9aa90d-0837-4667-8b14-96f59a42394d tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c4c0c82448e40ba801c0b52ec44e74a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a093d0bf43046aaa845f3cc115f3f5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116156) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:15:54.547060 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: INFO nova.api.openstack.requestlog [None req-8b9aa90d-0837-4667-8b14-96f59a42394d tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] 10.222.0.18 "GET /compute/v2.1/servers/fa7c86bc-c46f-4120-8f3d-d795f8d7c5cc" status: 200 len: 1451 microversion: 2.1 time: 0.149231 Dec 15 03:15:54.547628 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: [pid: 116156|app: 0|req: 941/1802] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 03:15:54 2021] GET /compute/v2.1/servers/fa7c86bc-c46f-4120-8f3d-d795f8d7c5cc => generated 1451 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 03:15:54.551722 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi [None req-205414e0-25c4-4d1b-8cd7-2fb35749ad8a tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Calling method '>' {{(pid=116156) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:15:54.552325 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.compute.api [None req-205414e0-25c4-4d1b-8cd7-2fb35749ad8a tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] [instance: bbb8462c-9501-4541-b67e-43ec5c5061a7] Fetching instance by UUID {{(pid=116156) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:15:54.557598 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-205414e0-25c4-4d1b-8cd7-2fb35749ad8a tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:15:54.558083 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-205414e0-25c4-4d1b-8cd7-2fb35749ad8a tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:15:54.558860 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-205414e0-25c4-4d1b-8cd7-2fb35749ad8a tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:15:54.559788 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-205414e0-25c4-4d1b-8cd7-2fb35749ad8a tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:15:54.617228 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.policy [None req-205414e0-25c4-4d1b-8cd7-2fb35749ad8a tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97bdf19af9e34fc3886ff451cb9d7a27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '494b56bf5eae4d56a5591546f85bc32b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116156) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:15:54.624878 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: INFO nova.api.openstack.requestlog [None req-205414e0-25c4-4d1b-8cd7-2fb35749ad8a tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] 10.222.0.18 "GET /compute/v2.1/servers/bbb8462c-9501-4541-b67e-43ec5c5061a7" status: 200 len: 1226 microversion: 2.1 time: 0.076323 Dec 15 03:15:54.625447 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: [pid: 116156|app: 0|req: 942/1803] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 03:15:54 2021] GET /compute/v2.1/servers/bbb8462c-9501-4541-b67e-43ec5c5061a7 => generated 1226 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 03:15:55.626422 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi [None req-a47b8355-f123-4911-a175-3f49b9b259b0 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Calling method '>' {{(pid=116156) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:15:55.627014 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.compute.api [None req-a47b8355-f123-4911-a175-3f49b9b259b0 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] [instance: fa7c86bc-c46f-4120-8f3d-d795f8d7c5cc] Fetching instance by UUID {{(pid=116156) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:15:55.632859 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-a47b8355-f123-4911-a175-3f49b9b259b0 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:15:55.633307 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-a47b8355-f123-4911-a175-3f49b9b259b0 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:15:55.634098 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-a47b8355-f123-4911-a175-3f49b9b259b0 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:15:55.634530 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-a47b8355-f123-4911-a175-3f49b9b259b0 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:15:55.766271 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.policy [None req-a47b8355-f123-4911-a175-3f49b9b259b0 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c4c0c82448e40ba801c0b52ec44e74a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a093d0bf43046aaa845f3cc115f3f5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116156) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:15:55.773696 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: INFO nova.api.openstack.requestlog [None req-a47b8355-f123-4911-a175-3f49b9b259b0 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] 10.222.0.18 "GET /compute/v2.1/servers/fa7c86bc-c46f-4120-8f3d-d795f8d7c5cc" status: 200 len: 1451 microversion: 2.1 time: 0.213452 Dec 15 03:15:55.774302 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: [pid: 116156|app: 0|req: 943/1804] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 03:15:55 2021] GET /compute/v2.1/servers/fa7c86bc-c46f-4120-8f3d-d795f8d7c5cc => generated 1451 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 03:15:55.779146 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi [None req-e177f152-56c8-43be-a715-68239b4d270b tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Calling method '>' {{(pid=116156) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:15:55.779745 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.compute.api [None req-e177f152-56c8-43be-a715-68239b4d270b tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] [instance: bbb8462c-9501-4541-b67e-43ec5c5061a7] Fetching instance by UUID {{(pid=116156) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:15:55.785091 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-e177f152-56c8-43be-a715-68239b4d270b tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:15:55.785548 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-e177f152-56c8-43be-a715-68239b4d270b tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:15:55.786377 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-e177f152-56c8-43be-a715-68239b4d270b tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:15:55.786793 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-e177f152-56c8-43be-a715-68239b4d270b tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:15:55.844626 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.policy [None req-e177f152-56c8-43be-a715-68239b4d270b tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97bdf19af9e34fc3886ff451cb9d7a27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '494b56bf5eae4d56a5591546f85bc32b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116156) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:15:55.851886 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: INFO nova.api.openstack.requestlog [None req-e177f152-56c8-43be-a715-68239b4d270b tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] 10.222.0.18 "GET /compute/v2.1/servers/bbb8462c-9501-4541-b67e-43ec5c5061a7" status: 200 len: 1226 microversion: 2.1 time: 0.076632 Dec 15 03:15:55.852447 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: [pid: 116156|app: 0|req: 944/1805] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 03:15:55 2021] GET /compute/v2.1/servers/bbb8462c-9501-4541-b67e-43ec5c5061a7 => generated 1226 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 03:15:56.790888 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi [None req-e1b64812-02f2-4b05-8faf-fe3e00f82d6d tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Calling method '>' {{(pid=116156) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:15:56.791574 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.compute.api [None req-e1b64812-02f2-4b05-8faf-fe3e00f82d6d tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] [instance: fa7c86bc-c46f-4120-8f3d-d795f8d7c5cc] Fetching instance by UUID {{(pid=116156) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:15:56.797634 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-e1b64812-02f2-4b05-8faf-fe3e00f82d6d tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:15:56.798111 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-e1b64812-02f2-4b05-8faf-fe3e00f82d6d tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:15:56.799486 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-e1b64812-02f2-4b05-8faf-fe3e00f82d6d tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:15:56.799921 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-e1b64812-02f2-4b05-8faf-fe3e00f82d6d tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:15:56.927291 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.policy [None req-e1b64812-02f2-4b05-8faf-fe3e00f82d6d tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c4c0c82448e40ba801c0b52ec44e74a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a093d0bf43046aaa845f3cc115f3f5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116156) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:15:56.935075 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: INFO nova.api.openstack.requestlog [None req-e1b64812-02f2-4b05-8faf-fe3e00f82d6d tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] 10.222.0.18 "GET /compute/v2.1/servers/fa7c86bc-c46f-4120-8f3d-d795f8d7c5cc" status: 200 len: 1451 microversion: 2.1 time: 0.147833 Dec 15 03:15:56.935635 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: [pid: 116156|app: 0|req: 945/1806] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 03:15:56 2021] GET /compute/v2.1/servers/fa7c86bc-c46f-4120-8f3d-d795f8d7c5cc => generated 1451 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 03:15:56.939712 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi [None req-e06c2ed5-aa46-44d5-aefc-0e2732b5da29 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Calling method '>' {{(pid=116156) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:15:56.940307 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.compute.api [None req-e06c2ed5-aa46-44d5-aefc-0e2732b5da29 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] [instance: bbb8462c-9501-4541-b67e-43ec5c5061a7] Fetching instance by UUID {{(pid=116156) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:15:56.945504 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-e06c2ed5-aa46-44d5-aefc-0e2732b5da29 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:15:56.945953 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-e06c2ed5-aa46-44d5-aefc-0e2732b5da29 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:15:56.946747 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-e06c2ed5-aa46-44d5-aefc-0e2732b5da29 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:15:56.947177 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-e06c2ed5-aa46-44d5-aefc-0e2732b5da29 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:15:57.004243 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.policy [None req-e06c2ed5-aa46-44d5-aefc-0e2732b5da29 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97bdf19af9e34fc3886ff451cb9d7a27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '494b56bf5eae4d56a5591546f85bc32b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116156) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:15:57.011272 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: INFO nova.api.openstack.requestlog [None req-e06c2ed5-aa46-44d5-aefc-0e2732b5da29 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] 10.222.0.18 "GET /compute/v2.1/servers/bbb8462c-9501-4541-b67e-43ec5c5061a7" status: 200 len: 1226 microversion: 2.1 time: 0.074719 Dec 15 03:15:57.011830 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: [pid: 116156|app: 0|req: 946/1807] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 03:15:56 2021] GET /compute/v2.1/servers/bbb8462c-9501-4541-b67e-43ec5c5061a7 => generated 1226 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 03:15:57.952316 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi [None req-6029f30e-71e1-44c0-ae35-9d6360a69607 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Calling method '>' {{(pid=116156) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:15:57.952981 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.compute.api [None req-6029f30e-71e1-44c0-ae35-9d6360a69607 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] [instance: fa7c86bc-c46f-4120-8f3d-d795f8d7c5cc] Fetching instance by UUID {{(pid=116156) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:15:57.959439 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-6029f30e-71e1-44c0-ae35-9d6360a69607 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:15:57.959885 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-6029f30e-71e1-44c0-ae35-9d6360a69607 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:15:57.960651 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-6029f30e-71e1-44c0-ae35-9d6360a69607 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:15:57.961082 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-6029f30e-71e1-44c0-ae35-9d6360a69607 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:15:58.093724 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.policy [None req-6029f30e-71e1-44c0-ae35-9d6360a69607 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c4c0c82448e40ba801c0b52ec44e74a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a093d0bf43046aaa845f3cc115f3f5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116156) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:15:58.100902 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: INFO nova.api.openstack.requestlog [None req-6029f30e-71e1-44c0-ae35-9d6360a69607 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] 10.222.0.18 "GET /compute/v2.1/servers/fa7c86bc-c46f-4120-8f3d-d795f8d7c5cc" status: 200 len: 1451 microversion: 2.1 time: 0.152826 Dec 15 03:15:58.101465 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: [pid: 116156|app: 0|req: 947/1808] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 03:15:57 2021] GET /compute/v2.1/servers/fa7c86bc-c46f-4120-8f3d-d795f8d7c5cc => generated 1451 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 03:15:58.105553 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi [None req-2f4ec2f8-8e86-4b1e-9204-1e44e9984484 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Calling method '>' {{(pid=116156) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:15:58.106180 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.compute.api [None req-2f4ec2f8-8e86-4b1e-9204-1e44e9984484 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] [instance: bbb8462c-9501-4541-b67e-43ec5c5061a7] Fetching instance by UUID {{(pid=116156) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:15:58.111669 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-2f4ec2f8-8e86-4b1e-9204-1e44e9984484 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:15:58.112113 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-2f4ec2f8-8e86-4b1e-9204-1e44e9984484 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:15:58.112878 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-2f4ec2f8-8e86-4b1e-9204-1e44e9984484 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:15:58.113313 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-2f4ec2f8-8e86-4b1e-9204-1e44e9984484 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:15:58.171031 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.policy [None req-2f4ec2f8-8e86-4b1e-9204-1e44e9984484 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97bdf19af9e34fc3886ff451cb9d7a27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '494b56bf5eae4d56a5591546f85bc32b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116156) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:15:58.179796 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: INFO nova.api.openstack.requestlog [None req-2f4ec2f8-8e86-4b1e-9204-1e44e9984484 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] 10.222.0.18 "GET /compute/v2.1/servers/bbb8462c-9501-4541-b67e-43ec5c5061a7" status: 200 len: 1226 microversion: 2.1 time: 0.077386 Dec 15 03:15:58.180352 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: [pid: 116156|app: 0|req: 948/1809] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 03:15:58 2021] GET /compute/v2.1/servers/bbb8462c-9501-4541-b67e-43ec5c5061a7 => generated 1226 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 03:15:59.117541 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi [None req-cbc74710-ab7e-43be-8345-84e6bec67532 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Calling method '>' {{(pid=116156) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:15:59.118233 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.compute.api [None req-cbc74710-ab7e-43be-8345-84e6bec67532 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] [instance: fa7c86bc-c46f-4120-8f3d-d795f8d7c5cc] Fetching instance by UUID {{(pid=116156) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:15:59.124499 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-cbc74710-ab7e-43be-8345-84e6bec67532 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:15:59.124953 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-cbc74710-ab7e-43be-8345-84e6bec67532 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:15:59.125734 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-cbc74710-ab7e-43be-8345-84e6bec67532 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:15:59.126200 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-cbc74710-ab7e-43be-8345-84e6bec67532 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:15:59.258961 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.policy [None req-cbc74710-ab7e-43be-8345-84e6bec67532 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c4c0c82448e40ba801c0b52ec44e74a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a093d0bf43046aaa845f3cc115f3f5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116156) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:15:59.266379 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: INFO nova.api.openstack.requestlog [None req-cbc74710-ab7e-43be-8345-84e6bec67532 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] 10.222.0.18 "GET /compute/v2.1/servers/fa7c86bc-c46f-4120-8f3d-d795f8d7c5cc" status: 200 len: 1451 microversion: 2.1 time: 0.152386 Dec 15 03:15:59.266958 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: [pid: 116156|app: 0|req: 949/1810] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 03:15:59 2021] GET /compute/v2.1/servers/fa7c86bc-c46f-4120-8f3d-d795f8d7c5cc => generated 1451 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 03:15:59.271128 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi [None req-c8f4b8ad-eb95-4cf1-819e-206d694192ac tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Calling method '>' {{(pid=116156) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:15:59.271772 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.compute.api [None req-c8f4b8ad-eb95-4cf1-819e-206d694192ac tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] [instance: bbb8462c-9501-4541-b67e-43ec5c5061a7] Fetching instance by UUID {{(pid=116156) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:15:59.277270 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-c8f4b8ad-eb95-4cf1-819e-206d694192ac tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:15:59.277728 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-c8f4b8ad-eb95-4cf1-819e-206d694192ac tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:15:59.279053 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-c8f4b8ad-eb95-4cf1-819e-206d694192ac tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:15:59.279491 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-c8f4b8ad-eb95-4cf1-819e-206d694192ac tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:15:59.340127 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.policy [None req-c8f4b8ad-eb95-4cf1-819e-206d694192ac tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97bdf19af9e34fc3886ff451cb9d7a27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '494b56bf5eae4d56a5591546f85bc32b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116156) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:15:59.347968 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: INFO nova.api.openstack.requestlog [None req-c8f4b8ad-eb95-4cf1-819e-206d694192ac tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] 10.222.0.18 "GET /compute/v2.1/servers/bbb8462c-9501-4541-b67e-43ec5c5061a7" status: 200 len: 1226 microversion: 2.1 time: 0.080071 Dec 15 03:15:59.348534 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: [pid: 116156|app: 0|req: 950/1811] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 03:15:59 2021] GET /compute/v2.1/servers/bbb8462c-9501-4541-b67e-43ec5c5061a7 => generated 1226 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 03:16:00.283898 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi [None req-9ebb7fa1-d580-487a-b065-0a2a4490d70c tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Calling method '>' {{(pid=116156) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:16:00.284507 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.compute.api [None req-9ebb7fa1-d580-487a-b065-0a2a4490d70c tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] [instance: fa7c86bc-c46f-4120-8f3d-d795f8d7c5cc] Fetching instance by UUID {{(pid=116156) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:16:00.290724 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-9ebb7fa1-d580-487a-b065-0a2a4490d70c tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:16:00.291169 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-9ebb7fa1-d580-487a-b065-0a2a4490d70c tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:16:00.291937 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-9ebb7fa1-d580-487a-b065-0a2a4490d70c tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:16:00.292365 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-9ebb7fa1-d580-487a-b065-0a2a4490d70c tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:16:00.418862 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.policy [None req-9ebb7fa1-d580-487a-b065-0a2a4490d70c tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c4c0c82448e40ba801c0b52ec44e74a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a093d0bf43046aaa845f3cc115f3f5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116156) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:16:00.425940 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: INFO nova.api.openstack.requestlog [None req-9ebb7fa1-d580-487a-b065-0a2a4490d70c tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] 10.222.0.18 "GET /compute/v2.1/servers/fa7c86bc-c46f-4120-8f3d-d795f8d7c5cc" status: 200 len: 1451 microversion: 2.1 time: 0.145699 Dec 15 03:16:00.426520 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: [pid: 116156|app: 0|req: 951/1812] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 03:16:00 2021] GET /compute/v2.1/servers/fa7c86bc-c46f-4120-8f3d-d795f8d7c5cc => generated 1451 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 03:16:00.430634 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi [None req-fed1ff43-1bdf-422c-b5b0-bdc2b84d2f68 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Calling method '>' {{(pid=116156) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:16:00.431226 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.compute.api [None req-fed1ff43-1bdf-422c-b5b0-bdc2b84d2f68 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] [instance: bbb8462c-9501-4541-b67e-43ec5c5061a7] Fetching instance by UUID {{(pid=116156) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:16:00.436658 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-fed1ff43-1bdf-422c-b5b0-bdc2b84d2f68 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:16:00.437105 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-fed1ff43-1bdf-422c-b5b0-bdc2b84d2f68 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:16:00.437873 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-fed1ff43-1bdf-422c-b5b0-bdc2b84d2f68 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:16:00.438346 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-fed1ff43-1bdf-422c-b5b0-bdc2b84d2f68 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:16:00.497840 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.policy [None req-fed1ff43-1bdf-422c-b5b0-bdc2b84d2f68 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97bdf19af9e34fc3886ff451cb9d7a27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '494b56bf5eae4d56a5591546f85bc32b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116156) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:16:00.505005 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: INFO nova.api.openstack.requestlog [None req-fed1ff43-1bdf-422c-b5b0-bdc2b84d2f68 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] 10.222.0.18 "GET /compute/v2.1/servers/bbb8462c-9501-4541-b67e-43ec5c5061a7" status: 200 len: 1226 microversion: 2.1 time: 0.077559 Dec 15 03:16:00.505560 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: [pid: 116156|app: 0|req: 952/1813] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 03:16:00 2021] GET /compute/v2.1/servers/bbb8462c-9501-4541-b67e-43ec5c5061a7 => generated 1226 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 03:16:01.442645 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi [None req-b35e46c6-193a-4e48-933c-3875d8c44aa0 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Calling method '>' {{(pid=116156) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:16:01.443252 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.compute.api [None req-b35e46c6-193a-4e48-933c-3875d8c44aa0 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] [instance: fa7c86bc-c46f-4120-8f3d-d795f8d7c5cc] Fetching instance by UUID {{(pid=116156) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:16:01.449426 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-b35e46c6-193a-4e48-933c-3875d8c44aa0 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:16:01.449876 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-b35e46c6-193a-4e48-933c-3875d8c44aa0 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:16:01.450700 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-b35e46c6-193a-4e48-933c-3875d8c44aa0 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:16:01.451131 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-b35e46c6-193a-4e48-933c-3875d8c44aa0 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:16:01.583633 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.policy [None req-b35e46c6-193a-4e48-933c-3875d8c44aa0 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c4c0c82448e40ba801c0b52ec44e74a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a093d0bf43046aaa845f3cc115f3f5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116156) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:16:01.591270 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: INFO nova.api.openstack.requestlog [None req-b35e46c6-193a-4e48-933c-3875d8c44aa0 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] 10.222.0.18 "GET /compute/v2.1/servers/fa7c86bc-c46f-4120-8f3d-d795f8d7c5cc" status: 200 len: 1451 microversion: 2.1 time: 0.152293 Dec 15 03:16:01.591834 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: [pid: 116156|app: 0|req: 953/1814] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 03:16:01 2021] GET /compute/v2.1/servers/fa7c86bc-c46f-4120-8f3d-d795f8d7c5cc => generated 1451 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 03:16:01.595924 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi [None req-792aa77c-8782-4d61-97e3-1d920502aa1e tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Calling method '>' {{(pid=116156) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:16:01.596517 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.compute.api [None req-792aa77c-8782-4d61-97e3-1d920502aa1e tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] [instance: bbb8462c-9501-4541-b67e-43ec5c5061a7] Fetching instance by UUID {{(pid=116156) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:16:01.601797 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-792aa77c-8782-4d61-97e3-1d920502aa1e tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:16:01.602264 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-792aa77c-8782-4d61-97e3-1d920502aa1e tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:16:01.603040 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-792aa77c-8782-4d61-97e3-1d920502aa1e tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:16:01.603470 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-792aa77c-8782-4d61-97e3-1d920502aa1e tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:16:01.662061 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.policy [None req-792aa77c-8782-4d61-97e3-1d920502aa1e tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97bdf19af9e34fc3886ff451cb9d7a27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '494b56bf5eae4d56a5591546f85bc32b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116156) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:16:01.669251 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: INFO nova.api.openstack.requestlog [None req-792aa77c-8782-4d61-97e3-1d920502aa1e tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] 10.222.0.18 "GET /compute/v2.1/servers/bbb8462c-9501-4541-b67e-43ec5c5061a7" status: 200 len: 1226 microversion: 2.1 time: 0.076476 Dec 15 03:16:01.669810 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: [pid: 116156|app: 0|req: 954/1815] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 03:16:01 2021] GET /compute/v2.1/servers/bbb8462c-9501-4541-b67e-43ec5c5061a7 => generated 1226 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 03:16:02.607979 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi [None req-5e06df02-4817-47d0-a7ee-b4fba2985ddb tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Calling method '>' {{(pid=116156) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:16:02.608585 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.compute.api [None req-5e06df02-4817-47d0-a7ee-b4fba2985ddb tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] [instance: fa7c86bc-c46f-4120-8f3d-d795f8d7c5cc] Fetching instance by UUID {{(pid=116156) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:16:02.615051 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-5e06df02-4817-47d0-a7ee-b4fba2985ddb tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:16:02.615504 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-5e06df02-4817-47d0-a7ee-b4fba2985ddb tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:16:02.616283 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-5e06df02-4817-47d0-a7ee-b4fba2985ddb tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:16:02.616719 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-5e06df02-4817-47d0-a7ee-b4fba2985ddb tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:16:02.744526 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.policy [None req-5e06df02-4817-47d0-a7ee-b4fba2985ddb tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c4c0c82448e40ba801c0b52ec44e74a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a093d0bf43046aaa845f3cc115f3f5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116156) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:16:02.752312 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: INFO nova.api.openstack.requestlog [None req-5e06df02-4817-47d0-a7ee-b4fba2985ddb tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] 10.222.0.18 "GET /compute/v2.1/servers/fa7c86bc-c46f-4120-8f3d-d795f8d7c5cc" status: 200 len: 1451 microversion: 2.1 time: 0.147974 Dec 15 03:16:02.752877 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: [pid: 116156|app: 0|req: 955/1816] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 03:16:02 2021] GET /compute/v2.1/servers/fa7c86bc-c46f-4120-8f3d-d795f8d7c5cc => generated 1451 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 03:16:02.756963 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi [None req-f70a88f6-aff9-4db0-abcb-676ad9a86585 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Calling method '>' {{(pid=116156) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:16:02.757566 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.compute.api [None req-f70a88f6-aff9-4db0-abcb-676ad9a86585 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] [instance: bbb8462c-9501-4541-b67e-43ec5c5061a7] Fetching instance by UUID {{(pid=116156) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:16:02.763527 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-f70a88f6-aff9-4db0-abcb-676ad9a86585 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:16:02.763979 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-f70a88f6-aff9-4db0-abcb-676ad9a86585 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:16:02.764757 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-f70a88f6-aff9-4db0-abcb-676ad9a86585 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:16:02.765194 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-f70a88f6-aff9-4db0-abcb-676ad9a86585 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:16:02.822173 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.policy [None req-f70a88f6-aff9-4db0-abcb-676ad9a86585 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97bdf19af9e34fc3886ff451cb9d7a27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '494b56bf5eae4d56a5591546f85bc32b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116156) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:16:02.829767 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: INFO nova.api.openstack.requestlog [None req-f70a88f6-aff9-4db0-abcb-676ad9a86585 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] 10.222.0.18 "GET /compute/v2.1/servers/bbb8462c-9501-4541-b67e-43ec5c5061a7" status: 200 len: 1226 microversion: 2.1 time: 0.075962 Dec 15 03:16:02.830362 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: [pid: 116156|app: 0|req: 956/1817] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 03:16:02 2021] GET /compute/v2.1/servers/bbb8462c-9501-4541-b67e-43ec5c5061a7 => generated 1226 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 03:16:03.768827 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi [None req-f9a2f813-9517-43fa-b757-87abb60b0f06 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Calling method '>' {{(pid=116156) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:16:03.769492 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.compute.api [None req-f9a2f813-9517-43fa-b757-87abb60b0f06 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] [instance: fa7c86bc-c46f-4120-8f3d-d795f8d7c5cc] Fetching instance by UUID {{(pid=116156) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:16:03.775851 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-f9a2f813-9517-43fa-b757-87abb60b0f06 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:16:03.776316 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-f9a2f813-9517-43fa-b757-87abb60b0f06 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:16:03.777091 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-f9a2f813-9517-43fa-b757-87abb60b0f06 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:16:03.777530 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-f9a2f813-9517-43fa-b757-87abb60b0f06 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:16:03.911833 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.policy [None req-f9a2f813-9517-43fa-b757-87abb60b0f06 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c4c0c82448e40ba801c0b52ec44e74a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a093d0bf43046aaa845f3cc115f3f5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116156) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:16:03.919105 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: INFO nova.api.openstack.requestlog [None req-f9a2f813-9517-43fa-b757-87abb60b0f06 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] 10.222.0.18 "GET /compute/v2.1/servers/fa7c86bc-c46f-4120-8f3d-d795f8d7c5cc" status: 200 len: 1451 microversion: 2.1 time: 0.153900 Dec 15 03:16:03.919658 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: [pid: 116156|app: 0|req: 957/1818] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 03:16:03 2021] GET /compute/v2.1/servers/fa7c86bc-c46f-4120-8f3d-d795f8d7c5cc => generated 1451 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 03:16:03.923823 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi [None req-07a91778-731a-4610-8383-91ff85db0b32 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Calling method '>' {{(pid=116156) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:16:03.924417 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.compute.api [None req-07a91778-731a-4610-8383-91ff85db0b32 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] [instance: bbb8462c-9501-4541-b67e-43ec5c5061a7] Fetching instance by UUID {{(pid=116156) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:16:03.929933 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-07a91778-731a-4610-8383-91ff85db0b32 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:16:03.930399 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-07a91778-731a-4610-8383-91ff85db0b32 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:16:03.931211 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-07a91778-731a-4610-8383-91ff85db0b32 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:16:03.931659 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-07a91778-731a-4610-8383-91ff85db0b32 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:16:03.989873 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.policy [None req-07a91778-731a-4610-8383-91ff85db0b32 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97bdf19af9e34fc3886ff451cb9d7a27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '494b56bf5eae4d56a5591546f85bc32b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116156) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:16:03.997211 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: INFO nova.api.openstack.requestlog [None req-07a91778-731a-4610-8383-91ff85db0b32 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] 10.222.0.18 "GET /compute/v2.1/servers/bbb8462c-9501-4541-b67e-43ec5c5061a7" status: 200 len: 1226 microversion: 2.1 time: 0.076616 Dec 15 03:16:03.997786 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: [pid: 116156|app: 0|req: 958/1819] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 03:16:03 2021] GET /compute/v2.1/servers/bbb8462c-9501-4541-b67e-43ec5c5061a7 => generated 1226 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 03:16:04.935890 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi [None req-fbf3762b-82b4-4d49-b586-7c50980114af tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Calling method '>' {{(pid=116156) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:16:04.936537 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.compute.api [None req-fbf3762b-82b4-4d49-b586-7c50980114af tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] [instance: fa7c86bc-c46f-4120-8f3d-d795f8d7c5cc] Fetching instance by UUID {{(pid=116156) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:16:04.942825 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-fbf3762b-82b4-4d49-b586-7c50980114af tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:16:04.943283 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-fbf3762b-82b4-4d49-b586-7c50980114af tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:16:04.944084 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-fbf3762b-82b4-4d49-b586-7c50980114af tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:16:04.944511 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-fbf3762b-82b4-4d49-b586-7c50980114af tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:16:05.072536 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.policy [None req-fbf3762b-82b4-4d49-b586-7c50980114af tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c4c0c82448e40ba801c0b52ec44e74a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a093d0bf43046aaa845f3cc115f3f5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116156) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:16:05.079802 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: INFO nova.api.openstack.requestlog [None req-fbf3762b-82b4-4d49-b586-7c50980114af tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] 10.222.0.18 "GET /compute/v2.1/servers/fa7c86bc-c46f-4120-8f3d-d795f8d7c5cc" status: 200 len: 1451 microversion: 2.1 time: 0.148145 Dec 15 03:16:05.080367 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: [pid: 116156|app: 0|req: 959/1820] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 03:16:04 2021] GET /compute/v2.1/servers/fa7c86bc-c46f-4120-8f3d-d795f8d7c5cc => generated 1451 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 03:16:05.084525 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi [None req-e0962c8d-cc75-4ff9-8fc7-5664bd29b369 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Calling method '>' {{(pid=116156) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:16:05.085133 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.compute.api [None req-e0962c8d-cc75-4ff9-8fc7-5664bd29b369 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] [instance: bbb8462c-9501-4541-b67e-43ec5c5061a7] Fetching instance by UUID {{(pid=116156) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:16:05.091097 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-e0962c8d-cc75-4ff9-8fc7-5664bd29b369 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:16:05.091551 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-e0962c8d-cc75-4ff9-8fc7-5664bd29b369 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:16:05.092337 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-e0962c8d-cc75-4ff9-8fc7-5664bd29b369 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:16:05.092775 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-e0962c8d-cc75-4ff9-8fc7-5664bd29b369 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:16:05.154184 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.policy [None req-e0962c8d-cc75-4ff9-8fc7-5664bd29b369 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97bdf19af9e34fc3886ff451cb9d7a27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '494b56bf5eae4d56a5591546f85bc32b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116156) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:16:05.161276 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: INFO nova.api.openstack.requestlog [None req-e0962c8d-cc75-4ff9-8fc7-5664bd29b369 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] 10.222.0.18 "GET /compute/v2.1/servers/bbb8462c-9501-4541-b67e-43ec5c5061a7" status: 200 len: 1226 microversion: 2.1 time: 0.079966 Dec 15 03:16:05.161842 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: [pid: 116156|app: 0|req: 960/1821] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 03:16:05 2021] GET /compute/v2.1/servers/bbb8462c-9501-4541-b67e-43ec5c5061a7 => generated 1226 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 03:16:06.096614 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi [None req-4a081103-fc2a-4ed8-8ba1-494799ef7cc5 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Calling method '>' {{(pid=116156) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:16:06.097285 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.compute.api [None req-4a081103-fc2a-4ed8-8ba1-494799ef7cc5 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] [instance: fa7c86bc-c46f-4120-8f3d-d795f8d7c5cc] Fetching instance by UUID {{(pid=116156) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:16:06.103687 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-4a081103-fc2a-4ed8-8ba1-494799ef7cc5 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:16:06.104141 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-4a081103-fc2a-4ed8-8ba1-494799ef7cc5 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:16:06.104923 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-4a081103-fc2a-4ed8-8ba1-494799ef7cc5 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:16:06.105361 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-4a081103-fc2a-4ed8-8ba1-494799ef7cc5 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:16:06.234241 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.policy [None req-4a081103-fc2a-4ed8-8ba1-494799ef7cc5 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c4c0c82448e40ba801c0b52ec44e74a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a093d0bf43046aaa845f3cc115f3f5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116156) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:16:06.241802 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: INFO nova.api.openstack.requestlog [None req-4a081103-fc2a-4ed8-8ba1-494799ef7cc5 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] 10.222.0.18 "GET /compute/v2.1/servers/fa7c86bc-c46f-4120-8f3d-d795f8d7c5cc" status: 200 len: 1451 microversion: 2.1 time: 0.148880 Dec 15 03:16:06.242397 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: [pid: 116156|app: 0|req: 961/1822] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 03:16:06 2021] GET /compute/v2.1/servers/fa7c86bc-c46f-4120-8f3d-d795f8d7c5cc => generated 1451 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 03:16:06.246668 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi [None req-c45bb25e-5789-424f-93b0-4ef74ea29029 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Calling method '>' {{(pid=116156) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:16:06.247275 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.compute.api [None req-c45bb25e-5789-424f-93b0-4ef74ea29029 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] [instance: bbb8462c-9501-4541-b67e-43ec5c5061a7] Fetching instance by UUID {{(pid=116156) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:16:06.252761 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-c45bb25e-5789-424f-93b0-4ef74ea29029 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:16:06.253211 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-c45bb25e-5789-424f-93b0-4ef74ea29029 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:16:06.254034 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-c45bb25e-5789-424f-93b0-4ef74ea29029 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:16:06.254469 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-c45bb25e-5789-424f-93b0-4ef74ea29029 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:16:06.311817 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.policy [None req-c45bb25e-5789-424f-93b0-4ef74ea29029 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97bdf19af9e34fc3886ff451cb9d7a27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '494b56bf5eae4d56a5591546f85bc32b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116156) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:16:06.319178 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: INFO nova.api.openstack.requestlog [None req-c45bb25e-5789-424f-93b0-4ef74ea29029 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] 10.222.0.18 "GET /compute/v2.1/servers/bbb8462c-9501-4541-b67e-43ec5c5061a7" status: 200 len: 1226 microversion: 2.1 time: 0.075854 Dec 15 03:16:06.319739 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: [pid: 116156|app: 0|req: 962/1823] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 03:16:06 2021] GET /compute/v2.1/servers/bbb8462c-9501-4541-b67e-43ec5c5061a7 => generated 1226 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 03:16:07.258835 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi [None req-06a51e0b-21c8-47ab-b103-23baa3e8cbfe tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Calling method '>' {{(pid=116156) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:16:07.259514 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.compute.api [None req-06a51e0b-21c8-47ab-b103-23baa3e8cbfe tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] [instance: fa7c86bc-c46f-4120-8f3d-d795f8d7c5cc] Fetching instance by UUID {{(pid=116156) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:16:07.265809 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-06a51e0b-21c8-47ab-b103-23baa3e8cbfe tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:16:07.266296 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-06a51e0b-21c8-47ab-b103-23baa3e8cbfe tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:16:07.267087 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-06a51e0b-21c8-47ab-b103-23baa3e8cbfe tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:16:07.267528 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-06a51e0b-21c8-47ab-b103-23baa3e8cbfe tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:16:07.403497 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.policy [None req-06a51e0b-21c8-47ab-b103-23baa3e8cbfe tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c4c0c82448e40ba801c0b52ec44e74a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a093d0bf43046aaa845f3cc115f3f5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116156) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:16:07.410682 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: INFO nova.api.openstack.requestlog [None req-06a51e0b-21c8-47ab-b103-23baa3e8cbfe tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] 10.222.0.18 "GET /compute/v2.1/servers/fa7c86bc-c46f-4120-8f3d-d795f8d7c5cc" status: 200 len: 1451 microversion: 2.1 time: 0.155534 Dec 15 03:16:07.411235 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: [pid: 116156|app: 0|req: 963/1824] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 03:16:07 2021] GET /compute/v2.1/servers/fa7c86bc-c46f-4120-8f3d-d795f8d7c5cc => generated 1451 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 03:16:07.415469 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi [None req-df21b26f-cb03-4457-9b23-b62698ea9178 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Calling method '>' {{(pid=116156) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:16:07.416067 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.compute.api [None req-df21b26f-cb03-4457-9b23-b62698ea9178 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] [instance: bbb8462c-9501-4541-b67e-43ec5c5061a7] Fetching instance by UUID {{(pid=116156) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:16:07.421317 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-df21b26f-cb03-4457-9b23-b62698ea9178 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:16:07.421762 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-df21b26f-cb03-4457-9b23-b62698ea9178 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:16:07.422643 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-df21b26f-cb03-4457-9b23-b62698ea9178 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:16:07.423073 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-df21b26f-cb03-4457-9b23-b62698ea9178 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:16:07.481339 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.policy [None req-df21b26f-cb03-4457-9b23-b62698ea9178 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97bdf19af9e34fc3886ff451cb9d7a27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '494b56bf5eae4d56a5591546f85bc32b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116156) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:16:07.488767 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: INFO nova.api.openstack.requestlog [None req-df21b26f-cb03-4457-9b23-b62698ea9178 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] 10.222.0.18 "GET /compute/v2.1/servers/bbb8462c-9501-4541-b67e-43ec5c5061a7" status: 200 len: 1226 microversion: 2.1 time: 0.076585 Dec 15 03:16:07.489312 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: [pid: 116156|app: 0|req: 964/1825] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 03:16:07 2021] GET /compute/v2.1/servers/bbb8462c-9501-4541-b67e-43ec5c5061a7 => generated 1226 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 03:16:08.427539 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi [None req-5074c73e-cc5c-4a09-9581-c050bac0c3e7 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Calling method '>' {{(pid=116156) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:16:08.428187 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.compute.api [None req-5074c73e-cc5c-4a09-9581-c050bac0c3e7 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] [instance: fa7c86bc-c46f-4120-8f3d-d795f8d7c5cc] Fetching instance by UUID {{(pid=116156) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:16:08.434343 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-5074c73e-cc5c-4a09-9581-c050bac0c3e7 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:16:08.434794 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-5074c73e-cc5c-4a09-9581-c050bac0c3e7 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:16:08.435563 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-5074c73e-cc5c-4a09-9581-c050bac0c3e7 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:16:08.435996 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-5074c73e-cc5c-4a09-9581-c050bac0c3e7 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:16:08.566901 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.policy [None req-5074c73e-cc5c-4a09-9581-c050bac0c3e7 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c4c0c82448e40ba801c0b52ec44e74a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a093d0bf43046aaa845f3cc115f3f5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116156) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:16:08.574133 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: INFO nova.api.openstack.requestlog [None req-5074c73e-cc5c-4a09-9581-c050bac0c3e7 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] 10.222.0.18 "GET /compute/v2.1/servers/fa7c86bc-c46f-4120-8f3d-d795f8d7c5cc" status: 200 len: 1451 microversion: 2.1 time: 0.150177 Dec 15 03:16:08.575184 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: [pid: 116156|app: 0|req: 965/1826] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 03:16:08 2021] GET /compute/v2.1/servers/fa7c86bc-c46f-4120-8f3d-d795f8d7c5cc => generated 1451 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 03:16:08.579294 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi [None req-9b42212b-f220-4f7a-8e50-83ac36b14159 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Calling method '>' {{(pid=116156) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:16:08.579885 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.compute.api [None req-9b42212b-f220-4f7a-8e50-83ac36b14159 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] [instance: bbb8462c-9501-4541-b67e-43ec5c5061a7] Fetching instance by UUID {{(pid=116156) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:16:08.585117 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-9b42212b-f220-4f7a-8e50-83ac36b14159 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:16:08.585564 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-9b42212b-f220-4f7a-8e50-83ac36b14159 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:16:08.586366 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-9b42212b-f220-4f7a-8e50-83ac36b14159 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:16:08.586801 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-9b42212b-f220-4f7a-8e50-83ac36b14159 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:16:08.644564 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.policy [None req-9b42212b-f220-4f7a-8e50-83ac36b14159 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97bdf19af9e34fc3886ff451cb9d7a27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '494b56bf5eae4d56a5591546f85bc32b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116156) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:16:08.651598 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: INFO nova.api.openstack.requestlog [None req-9b42212b-f220-4f7a-8e50-83ac36b14159 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] 10.222.0.18 "GET /compute/v2.1/servers/bbb8462c-9501-4541-b67e-43ec5c5061a7" status: 200 len: 1226 microversion: 2.1 time: 0.075490 Dec 15 03:16:08.652160 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: [pid: 116156|app: 0|req: 966/1827] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 03:16:08 2021] GET /compute/v2.1/servers/bbb8462c-9501-4541-b67e-43ec5c5061a7 => generated 1226 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 03:16:09.591922 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi [None req-d8472a25-38e6-4791-b91a-bbf0b157b1a7 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Calling method '>' {{(pid=116156) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:16:09.592556 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.compute.api [None req-d8472a25-38e6-4791-b91a-bbf0b157b1a7 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] [instance: fa7c86bc-c46f-4120-8f3d-d795f8d7c5cc] Fetching instance by UUID {{(pid=116156) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:16:09.598876 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-d8472a25-38e6-4791-b91a-bbf0b157b1a7 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:16:09.599332 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-d8472a25-38e6-4791-b91a-bbf0b157b1a7 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:16:09.600113 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-d8472a25-38e6-4791-b91a-bbf0b157b1a7 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:16:09.600551 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-d8472a25-38e6-4791-b91a-bbf0b157b1a7 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:16:09.735747 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.policy [None req-d8472a25-38e6-4791-b91a-bbf0b157b1a7 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c4c0c82448e40ba801c0b52ec44e74a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a093d0bf43046aaa845f3cc115f3f5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116156) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:16:09.743005 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: INFO nova.api.openstack.requestlog [None req-d8472a25-38e6-4791-b91a-bbf0b157b1a7 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] 10.222.0.18 "GET /compute/v2.1/servers/fa7c86bc-c46f-4120-8f3d-d795f8d7c5cc" status: 200 len: 1451 microversion: 2.1 time: 0.154742 Dec 15 03:16:09.743573 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: [pid: 116156|app: 0|req: 967/1828] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 03:16:09 2021] GET /compute/v2.1/servers/fa7c86bc-c46f-4120-8f3d-d795f8d7c5cc => generated 1451 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 03:16:09.748250 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi [None req-31588289-694e-4bd5-8c23-959dea7703b4 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Calling method '>' {{(pid=116156) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:16:09.748855 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.compute.api [None req-31588289-694e-4bd5-8c23-959dea7703b4 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] [instance: bbb8462c-9501-4541-b67e-43ec5c5061a7] Fetching instance by UUID {{(pid=116156) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:16:09.754133 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-31588289-694e-4bd5-8c23-959dea7703b4 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:16:09.754604 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-31588289-694e-4bd5-8c23-959dea7703b4 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:16:09.755374 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-31588289-694e-4bd5-8c23-959dea7703b4 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:16:09.755813 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-31588289-694e-4bd5-8c23-959dea7703b4 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:16:09.813479 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.policy [None req-31588289-694e-4bd5-8c23-959dea7703b4 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97bdf19af9e34fc3886ff451cb9d7a27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '494b56bf5eae4d56a5591546f85bc32b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116156) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:16:09.820657 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: INFO nova.api.openstack.requestlog [None req-31588289-694e-4bd5-8c23-959dea7703b4 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] 10.222.0.18 "GET /compute/v2.1/servers/bbb8462c-9501-4541-b67e-43ec5c5061a7" status: 200 len: 1226 microversion: 2.1 time: 0.076138 Dec 15 03:16:09.821204 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: [pid: 116156|app: 0|req: 968/1829] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 03:16:09 2021] GET /compute/v2.1/servers/bbb8462c-9501-4541-b67e-43ec5c5061a7 => generated 1226 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 03:16:10.760010 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi [None req-fca7afff-ac8e-472d-8525-31bd6176bd55 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Calling method '>' {{(pid=116156) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:16:10.760683 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.compute.api [None req-fca7afff-ac8e-472d-8525-31bd6176bd55 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] [instance: fa7c86bc-c46f-4120-8f3d-d795f8d7c5cc] Fetching instance by UUID {{(pid=116156) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:16:10.766884 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-fca7afff-ac8e-472d-8525-31bd6176bd55 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:16:10.767335 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-fca7afff-ac8e-472d-8525-31bd6176bd55 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:16:10.768107 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-fca7afff-ac8e-472d-8525-31bd6176bd55 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:16:10.768541 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-fca7afff-ac8e-472d-8525-31bd6176bd55 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:16:10.896707 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.policy [None req-fca7afff-ac8e-472d-8525-31bd6176bd55 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c4c0c82448e40ba801c0b52ec44e74a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a093d0bf43046aaa845f3cc115f3f5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116156) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:16:10.904417 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: INFO nova.api.openstack.requestlog [None req-fca7afff-ac8e-472d-8525-31bd6176bd55 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] 10.222.0.18 "GET /compute/v2.1/servers/fa7c86bc-c46f-4120-8f3d-d795f8d7c5cc" status: 200 len: 1451 microversion: 2.1 time: 0.148234 Dec 15 03:16:10.904977 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: [pid: 116156|app: 0|req: 969/1830] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 03:16:10 2021] GET /compute/v2.1/servers/fa7c86bc-c46f-4120-8f3d-d795f8d7c5cc => generated 1451 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 03:16:10.909142 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi [None req-9a85bb02-b646-4a72-bcb1-0aee5c4572d9 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Calling method '>' {{(pid=116156) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:16:10.909737 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.compute.api [None req-9a85bb02-b646-4a72-bcb1-0aee5c4572d9 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] [instance: bbb8462c-9501-4541-b67e-43ec5c5061a7] Fetching instance by UUID {{(pid=116156) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:16:10.915074 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-9a85bb02-b646-4a72-bcb1-0aee5c4572d9 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:16:10.915524 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-9a85bb02-b646-4a72-bcb1-0aee5c4572d9 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:16:10.916320 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-9a85bb02-b646-4a72-bcb1-0aee5c4572d9 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:16:10.916733 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-9a85bb02-b646-4a72-bcb1-0aee5c4572d9 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:16:10.977248 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.policy [None req-9a85bb02-b646-4a72-bcb1-0aee5c4572d9 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97bdf19af9e34fc3886ff451cb9d7a27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '494b56bf5eae4d56a5591546f85bc32b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116156) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:16:10.984357 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: INFO nova.api.openstack.requestlog [None req-9a85bb02-b646-4a72-bcb1-0aee5c4572d9 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] 10.222.0.18 "GET /compute/v2.1/servers/bbb8462c-9501-4541-b67e-43ec5c5061a7" status: 200 len: 1226 microversion: 2.1 time: 0.078457 Dec 15 03:16:10.984908 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: [pid: 116156|app: 0|req: 970/1831] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 03:16:10 2021] GET /compute/v2.1/servers/bbb8462c-9501-4541-b67e-43ec5c5061a7 => generated 1226 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 03:16:11.048215 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi [None req-db7294c7-536d-4242-ac02-29b26e00bbe1 tempest-VolumesSnapshotTestJSON-925980516 tempest-VolumesSnapshotTestJSON-925980516-project] Calling method '>' {{(pid=116156) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:16:11.048703 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.compute.api [None req-db7294c7-536d-4242-ac02-29b26e00bbe1 tempest-VolumesSnapshotTestJSON-925980516 tempest-VolumesSnapshotTestJSON-925980516-project] [instance: a0097d88-6613-416a-9f4d-1bb285e53291] Fetching instance by UUID {{(pid=116156) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:16:11.054454 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-db7294c7-536d-4242-ac02-29b26e00bbe1 tempest-VolumesSnapshotTestJSON-925980516 tempest-VolumesSnapshotTestJSON-925980516-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:16:11.054899 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-db7294c7-536d-4242-ac02-29b26e00bbe1 tempest-VolumesSnapshotTestJSON-925980516 tempest-VolumesSnapshotTestJSON-925980516-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:16:11.055668 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-db7294c7-536d-4242-ac02-29b26e00bbe1 tempest-VolumesSnapshotTestJSON-925980516 tempest-VolumesSnapshotTestJSON-925980516-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:16:11.056102 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-db7294c7-536d-4242-ac02-29b26e00bbe1 tempest-VolumesSnapshotTestJSON-925980516 tempest-VolumesSnapshotTestJSON-925980516-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:16:16.170765 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Dec 15 03:16:16.171347 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: Wed Dec 15 03:16:16 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/a0097d88-6613-416a-9f4d-1bb285e53291/os-volume_attachments/d681224a-3344-47c8-8df0-0379a5a8f296 (ip 10.222.0.18) !!! Dec 15 03:16:28.757137 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Dec 15 03:16:28.757710 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: Wed Dec 15 03:16:28 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/a0097d88-6613-416a-9f4d-1bb285e53291/os-volume_attachments/d681224a-3344-47c8-8df0-0379a5a8f296 (ip 10.222.0.18) !!! Dec 15 03:16:29.502088 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Dec 15 03:16:29.502526 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: Wed Dec 15 03:16:29 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/a0097d88-6613-416a-9f4d-1bb285e53291/os-volume_attachments/d681224a-3344-47c8-8df0-0379a5a8f296 (ip 10.222.0.18) !!! Dec 15 03:16:38.450741 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Dec 15 03:16:38.451238 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: Wed Dec 15 03:16:38 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/a0097d88-6613-416a-9f4d-1bb285e53291/os-volume_attachments/d681224a-3344-47c8-8df0-0379a5a8f296 (ip 10.222.0.18) !!! Dec 15 03:17:11.160985 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.objects.instance [None req-f0161299-4fe2-42f8-9129-ab9ed2e683c4 tempest-VolumesSnapshotTestJSON-925980516 tempest-VolumesSnapshotTestJSON-925980516-project] Lazy-loading 'services' on Instance uuid a0097d88-6613-416a-9f4d-1bb285e53291 {{(pid=116157) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Dec 15 03:17:11.271416 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.objects.instance [None req-db7294c7-536d-4242-ac02-29b26e00bbe1 tempest-VolumesSnapshotTestJSON-925980516 tempest-VolumesSnapshotTestJSON-925980516-project] Lazy-loading 'services' on Instance uuid a0097d88-6613-416a-9f4d-1bb285e53291 {{(pid=116156) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Dec 15 03:19:11.770302 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: INFO nova.api.openstack.requestlog [None req-f0161299-4fe2-42f8-9129-ab9ed2e683c4 tempest-VolumesSnapshotTestJSON-925980516 tempest-VolumesSnapshotTestJSON-925980516-project] 10.222.0.18 "DELETE /compute/v2.1/servers/a0097d88-6613-416a-9f4d-1bb285e53291/os-volume_attachments/d681224a-3344-47c8-8df0-0379a5a8f296" status: 202 len: 0 microversion: 2.1 time: 240.785109 Dec 15 03:19:11.771121 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: [pid: 116157|app: 0|req: 862/1832] 10.222.0.18 () {58 vars in 1415 bytes} [Wed Dec 15 03:15:10 2021] DELETE /compute/v2.1/servers/a0097d88-6613-416a-9f4d-1bb285e53291/os-volume_attachments/d681224a-3344-47c8-8df0-0379a5a8f296 => generated 0 bytes in 240788 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Dec 15 03:19:11.776595 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi [None req-8546e40f-7927-43f7-b599-7fb94b37b879 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Calling method '>' {{(pid=116157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:19:11.777296 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.compute.api [None req-8546e40f-7927-43f7-b599-7fb94b37b879 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] [instance: fa7c86bc-c46f-4120-8f3d-d795f8d7c5cc] Fetching instance by UUID {{(pid=116157) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:19:11.784218 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-8546e40f-7927-43f7-b599-7fb94b37b879 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:19:11.784499 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-8546e40f-7927-43f7-b599-7fb94b37b879 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:19:11.785285 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-8546e40f-7927-43f7-b599-7fb94b37b879 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:19:11.785728 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-8546e40f-7927-43f7-b599-7fb94b37b879 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:19:11.845709 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: INFO nova.api.openstack.wsgi [None req-db7294c7-536d-4242-ac02-29b26e00bbe1 tempest-VolumesSnapshotTestJSON-925980516 tempest-VolumesSnapshotTestJSON-925980516-project] HTTP exception thrown: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-56ec485e-6ae6-45d0-baf0-1a3888e6a1b4) Dec 15 03:19:11.846474 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi [None req-db7294c7-536d-4242-ac02-29b26e00bbe1 tempest-VolumesSnapshotTestJSON-925980516 tempest-VolumesSnapshotTestJSON-925980516-project] Returning 400 to user: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-56ec485e-6ae6-45d0-baf0-1a3888e6a1b4) {{(pid=116156) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 15 03:19:11.847317 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: INFO nova.api.openstack.requestlog [None req-db7294c7-536d-4242-ac02-29b26e00bbe1 tempest-VolumesSnapshotTestJSON-925980516 tempest-VolumesSnapshotTestJSON-925980516-project] 10.222.0.18 "DELETE /compute/v2.1/servers/a0097d88-6613-416a-9f4d-1bb285e53291/os-volume_attachments/d681224a-3344-47c8-8df0-0379a5a8f296" status: 400 len: 269 microversion: 2.1 time: 180.802691 Dec 15 03:19:11.848382 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: [pid: 116156|app: 0|req: 971/1833] 10.222.0.18 () {58 vars in 1415 bytes} [Wed Dec 15 03:16:11 2021] DELETE /compute/v2.1/servers/a0097d88-6613-416a-9f4d-1bb285e53291/os-volume_attachments/d681224a-3344-47c8-8df0-0379a5a8f296 => generated 269 bytes in 180804 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Dec 15 03:19:11.853711 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi [None req-a7fec06d-a32f-4103-aafc-3cbe8a19f784 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Calling method '>' {{(pid=116156) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:19:11.854350 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.compute.api [None req-a7fec06d-a32f-4103-aafc-3cbe8a19f784 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] [instance: bbb8462c-9501-4541-b67e-43ec5c5061a7] Fetching instance by UUID {{(pid=116156) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:19:11.862095 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-a7fec06d-a32f-4103-aafc-3cbe8a19f784 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:19:11.862548 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-a7fec06d-a32f-4103-aafc-3cbe8a19f784 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:19:11.863342 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-a7fec06d-a32f-4103-aafc-3cbe8a19f784 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:19:11.863780 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-a7fec06d-a32f-4103-aafc-3cbe8a19f784 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:19:11.925469 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.policy [None req-8546e40f-7927-43f7-b599-7fb94b37b879 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c4c0c82448e40ba801c0b52ec44e74a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a093d0bf43046aaa845f3cc115f3f5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116157) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:19:11.931279 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.policy [None req-a7fec06d-a32f-4103-aafc-3cbe8a19f784 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97bdf19af9e34fc3886ff451cb9d7a27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '494b56bf5eae4d56a5591546f85bc32b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116156) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:19:11.935471 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: INFO nova.api.openstack.requestlog [None req-8546e40f-7927-43f7-b599-7fb94b37b879 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] 10.222.0.18 "GET /compute/v2.1/servers/fa7c86bc-c46f-4120-8f3d-d795f8d7c5cc" status: 200 len: 1451 microversion: 2.1 time: 0.163218 Dec 15 03:19:11.936726 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: [pid: 116157|app: 0|req: 863/1834] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 03:19:11 2021] GET /compute/v2.1/servers/fa7c86bc-c46f-4120-8f3d-d795f8d7c5cc => generated 1451 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 03:19:11.939222 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: INFO nova.api.openstack.requestlog [None req-a7fec06d-a32f-4103-aafc-3cbe8a19f784 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] 10.222.0.18 "GET /compute/v2.1/servers/bbb8462c-9501-4541-b67e-43ec5c5061a7" status: 200 len: 1226 microversion: 2.1 time: 0.089740 Dec 15 03:19:11.940839 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: [pid: 116156|app: 0|req: 972/1835] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 03:19:11 2021] GET /compute/v2.1/servers/bbb8462c-9501-4541-b67e-43ec5c5061a7 => generated 1226 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 03:19:11.941964 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi [None req-caa13b06-9646-4730-808e-3e8dc42598df tempest-VolumesSnapshotTestJSON-925980516 tempest-VolumesSnapshotTestJSON-925980516-project] Calling method '>' {{(pid=116157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:19:11.942496 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.compute.api [None req-caa13b06-9646-4730-808e-3e8dc42598df tempest-VolumesSnapshotTestJSON-925980516 tempest-VolumesSnapshotTestJSON-925980516-project] [instance: a0097d88-6613-416a-9f4d-1bb285e53291] Fetching instance by UUID {{(pid=116157) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:19:11.944367 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi [None req-71506367-221e-490d-bf02-d9523a016bf4 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Calling method '>' {{(pid=116156) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:19:11.944998 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.compute.api [None req-71506367-221e-490d-bf02-d9523a016bf4 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] [instance: fa7c86bc-c46f-4120-8f3d-d795f8d7c5cc] Fetching instance by UUID {{(pid=116156) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:19:11.948236 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-caa13b06-9646-4730-808e-3e8dc42598df tempest-VolumesSnapshotTestJSON-925980516 tempest-VolumesSnapshotTestJSON-925980516-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:19:11.948688 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-caa13b06-9646-4730-808e-3e8dc42598df tempest-VolumesSnapshotTestJSON-925980516 tempest-VolumesSnapshotTestJSON-925980516-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:19:11.949472 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-caa13b06-9646-4730-808e-3e8dc42598df tempest-VolumesSnapshotTestJSON-925980516 tempest-VolumesSnapshotTestJSON-925980516-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:19:11.950116 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-caa13b06-9646-4730-808e-3e8dc42598df tempest-VolumesSnapshotTestJSON-925980516 tempest-VolumesSnapshotTestJSON-925980516-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:19:11.950719 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-71506367-221e-490d-bf02-d9523a016bf4 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:19:11.951164 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-71506367-221e-490d-bf02-d9523a016bf4 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:19:11.951940 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-71506367-221e-490d-bf02-d9523a016bf4 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:19:11.952933 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-71506367-221e-490d-bf02-d9523a016bf4 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:19:12.082310 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.policy [None req-71506367-221e-490d-bf02-d9523a016bf4 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c4c0c82448e40ba801c0b52ec44e74a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a093d0bf43046aaa845f3cc115f3f5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116156) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:19:12.089517 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: INFO nova.api.openstack.requestlog [None req-71506367-221e-490d-bf02-d9523a016bf4 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] 10.222.0.18 "GET /compute/v2.1/servers/fa7c86bc-c46f-4120-8f3d-d795f8d7c5cc" status: 200 len: 1451 microversion: 2.1 time: 0.148634 Dec 15 03:19:12.090096 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: [pid: 116156|app: 0|req: 973/1836] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 03:19:11 2021] GET /compute/v2.1/servers/fa7c86bc-c46f-4120-8f3d-d795f8d7c5cc => generated 1451 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 03:19:12.095112 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi [None req-ee289a97-4041-40ec-b22b-54e8c2588b00 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Calling method '>' {{(pid=116156) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:19:12.095710 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.compute.api [None req-ee289a97-4041-40ec-b22b-54e8c2588b00 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] [instance: bbb8462c-9501-4541-b67e-43ec5c5061a7] Fetching instance by UUID {{(pid=116156) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:19:12.101160 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-ee289a97-4041-40ec-b22b-54e8c2588b00 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:19:12.101614 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-ee289a97-4041-40ec-b22b-54e8c2588b00 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:19:12.102471 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-ee289a97-4041-40ec-b22b-54e8c2588b00 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:19:12.102903 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-ee289a97-4041-40ec-b22b-54e8c2588b00 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:19:12.160239 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.policy [None req-ee289a97-4041-40ec-b22b-54e8c2588b00 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97bdf19af9e34fc3886ff451cb9d7a27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '494b56bf5eae4d56a5591546f85bc32b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116156) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:19:12.167385 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: INFO nova.api.openstack.requestlog [None req-ee289a97-4041-40ec-b22b-54e8c2588b00 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] 10.222.0.18 "GET /compute/v2.1/servers/bbb8462c-9501-4541-b67e-43ec5c5061a7" status: 200 len: 1226 microversion: 2.1 time: 0.076093 Dec 15 03:19:12.167937 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: [pid: 116156|app: 0|req: 974/1837] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 03:19:12 2021] GET /compute/v2.1/servers/bbb8462c-9501-4541-b67e-43ec5c5061a7 => generated 1226 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 03:19:12.172232 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi [None req-077ef7ea-a676-4005-93d0-2a2572b5e758 tempest-VolumesSnapshotTestJSON-925980516 tempest-VolumesSnapshotTestJSON-925980516-project] Calling method '>' {{(pid=116156) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:19:12.172715 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.compute.api [None req-077ef7ea-a676-4005-93d0-2a2572b5e758 tempest-VolumesSnapshotTestJSON-925980516 tempest-VolumesSnapshotTestJSON-925980516-project] [instance: a0097d88-6613-416a-9f4d-1bb285e53291] Fetching instance by UUID {{(pid=116156) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:19:12.178223 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-077ef7ea-a676-4005-93d0-2a2572b5e758 tempest-VolumesSnapshotTestJSON-925980516 tempest-VolumesSnapshotTestJSON-925980516-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:19:12.178670 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-077ef7ea-a676-4005-93d0-2a2572b5e758 tempest-VolumesSnapshotTestJSON-925980516 tempest-VolumesSnapshotTestJSON-925980516-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:19:12.179436 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-077ef7ea-a676-4005-93d0-2a2572b5e758 tempest-VolumesSnapshotTestJSON-925980516 tempest-VolumesSnapshotTestJSON-925980516-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:19:12.179865 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-077ef7ea-a676-4005-93d0-2a2572b5e758 tempest-VolumesSnapshotTestJSON-925980516 tempest-VolumesSnapshotTestJSON-925980516-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:19:36.187953 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Dec 15 03:19:36.188556 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: Wed Dec 15 03:19:36 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/a0097d88-6613-416a-9f4d-1bb285e53291/os-volume_attachments/d681224a-3344-47c8-8df0-0379a5a8f296 (ip 10.222.0.18) !!! Dec 15 03:19:48.774605 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Dec 15 03:19:48.775221 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: Wed Dec 15 03:19:48 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/a0097d88-6613-416a-9f4d-1bb285e53291/os-volume_attachments/d681224a-3344-47c8-8df0-0379a5a8f296 (ip 10.222.0.18) !!! Dec 15 03:19:49.518689 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Dec 15 03:19:49.519184 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: Wed Dec 15 03:19:49 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/a0097d88-6613-416a-9f4d-1bb285e53291/os-volume_attachments/d681224a-3344-47c8-8df0-0379a5a8f296 (ip 10.222.0.18) !!! Dec 15 03:19:58.468520 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Dec 15 03:19:58.468984 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: Wed Dec 15 03:19:58 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/a0097d88-6613-416a-9f4d-1bb285e53291/os-volume_attachments/d681224a-3344-47c8-8df0-0379a5a8f296 (ip 10.222.0.18) !!! Dec 15 03:20:09.869817 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Dec 15 03:20:09.870510 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: Wed Dec 15 03:20:09 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/a0097d88-6613-416a-9f4d-1bb285e53291/os-volume_attachments/d681224a-3344-47c8-8df0-0379a5a8f296 (ip 10.222.0.18) !!! Dec 15 03:21:12.059313 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.objects.instance [None req-caa13b06-9646-4730-808e-3e8dc42598df tempest-VolumesSnapshotTestJSON-925980516 tempest-VolumesSnapshotTestJSON-925980516-project] Lazy-loading 'services' on Instance uuid a0097d88-6613-416a-9f4d-1bb285e53291 {{(pid=116157) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Dec 15 03:21:12.097719 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.objects.instance [None req-077ef7ea-a676-4005-93d0-2a2572b5e758 tempest-VolumesSnapshotTestJSON-925980516 tempest-VolumesSnapshotTestJSON-925980516-project] Lazy-loading 'services' on Instance uuid a0097d88-6613-416a-9f4d-1bb285e53291 {{(pid=116156) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Dec 15 03:21:52.118348 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Dec 15 03:21:52.119063 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: Wed Dec 15 03:21:52 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/a0097d88-6613-416a-9f4d-1bb285e53291/os-volume_attachments/d681224a-3344-47c8-8df0-0379a5a8f296 (ip 10.222.0.18) !!! Dec 15 03:22:56.204764 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Dec 15 03:22:56.205441 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: Wed Dec 15 03:22:56 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/a0097d88-6613-416a-9f4d-1bb285e53291/os-volume_attachments/d681224a-3344-47c8-8df0-0379a5a8f296 (ip 10.222.0.18) !!! Dec 15 03:23:08.791542 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Dec 15 03:23:08.792126 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: Wed Dec 15 03:23:08 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/a0097d88-6613-416a-9f4d-1bb285e53291/os-volume_attachments/d681224a-3344-47c8-8df0-0379a5a8f296 (ip 10.222.0.18) !!! Dec 15 03:23:09.536380 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Dec 15 03:23:09.536898 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: Wed Dec 15 03:23:09 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/a0097d88-6613-416a-9f4d-1bb285e53291/os-volume_attachments/d681224a-3344-47c8-8df0-0379a5a8f296 (ip 10.222.0.18) !!! Dec 15 03:23:12.399105 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: INFO nova.api.openstack.wsgi [None req-caa13b06-9646-4730-808e-3e8dc42598df tempest-VolumesSnapshotTestJSON-925980516 tempest-VolumesSnapshotTestJSON-925980516-project] HTTP exception thrown: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-56a34d79-bc40-45ab-af49-8b2716071533) Dec 15 03:23:12.399803 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi [None req-caa13b06-9646-4730-808e-3e8dc42598df tempest-VolumesSnapshotTestJSON-925980516 tempest-VolumesSnapshotTestJSON-925980516-project] Returning 400 to user: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-56a34d79-bc40-45ab-af49-8b2716071533) {{(pid=116157) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 15 03:23:12.400606 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: INFO nova.api.openstack.requestlog [None req-caa13b06-9646-4730-808e-3e8dc42598df tempest-VolumesSnapshotTestJSON-925980516 tempest-VolumesSnapshotTestJSON-925980516-project] 10.222.0.18 "DELETE /compute/v2.1/servers/a0097d88-6613-416a-9f4d-1bb285e53291/os-volume_attachments/d681224a-3344-47c8-8df0-0379a5a8f296" status: 400 len: 269 microversion: 2.1 time: 240.462836 Dec 15 03:23:12.401141 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: Wed Dec 15 03:23:12 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/a0097d88-6613-416a-9f4d-1bb285e53291/os-volume_attachments/d681224a-3344-47c8-8df0-0379a5a8f296 (ip 10.222.0.18) !!! Dec 15 03:23:12.401141 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: Wed Dec 15 03:23:12 2021 - uwsgi_response_writev_headers_and_body_do(): Broken pipe [core/writer.c line 306] during DELETE /compute/v2.1/servers/a0097d88-6613-416a-9f4d-1bb285e53291/os-volume_attachments/d681224a-3344-47c8-8df0-0379a5a8f296 (10.222.0.18) Dec 15 03:23:12.401921 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: CRITICAL nova [None req-caa13b06-9646-4730-808e-3e8dc42598df tempest-VolumesSnapshotTestJSON-925980516 tempest-VolumesSnapshotTestJSON-925980516-project] Unhandled error: OSError: write error Dec 15 03:23:12.401921 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: ERROR nova OSError: write error Dec 15 03:23:12.401921 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: ERROR nova Dec 15 03:23:12.402211 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: [pid: 116157|app: 0|req: 864/1838] 10.222.0.18 () {58 vars in 1415 bytes} [Wed Dec 15 03:19:11 2021] DELETE /compute/v2.1/servers/a0097d88-6613-416a-9f4d-1bb285e53291/os-volume_attachments/d681224a-3344-47c8-8df0-0379a5a8f296 => generated 0 bytes in 240465 msecs (HTTP/1.1 400) 9 headers in 0 bytes (0 switches on core 0) Dec 15 03:23:12.407852 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi [None req-87faf5b2-84b0-47ab-9b4d-9706598c5f83 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Calling method '>' {{(pid=116157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:23:12.408957 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.compute.api [None req-87faf5b2-84b0-47ab-9b4d-9706598c5f83 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] [instance: fa7c86bc-c46f-4120-8f3d-d795f8d7c5cc] Fetching instance by UUID {{(pid=116157) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:23:12.415946 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-87faf5b2-84b0-47ab-9b4d-9706598c5f83 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:23:12.416591 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-87faf5b2-84b0-47ab-9b4d-9706598c5f83 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:23:12.417188 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-87faf5b2-84b0-47ab-9b4d-9706598c5f83 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:23:12.417657 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-87faf5b2-84b0-47ab-9b4d-9706598c5f83 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:23:12.438879 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: INFO nova.api.openstack.wsgi [None req-077ef7ea-a676-4005-93d0-2a2572b5e758 tempest-VolumesSnapshotTestJSON-925980516 tempest-VolumesSnapshotTestJSON-925980516-project] HTTP exception thrown: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-747a6ee5-1c0d-46d9-a320-4d48032ae22f) Dec 15 03:23:12.440129 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi [None req-077ef7ea-a676-4005-93d0-2a2572b5e758 tempest-VolumesSnapshotTestJSON-925980516 tempest-VolumesSnapshotTestJSON-925980516-project] Returning 400 to user: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-747a6ee5-1c0d-46d9-a320-4d48032ae22f) {{(pid=116156) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 15 03:23:12.441192 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: INFO nova.api.openstack.requestlog [None req-077ef7ea-a676-4005-93d0-2a2572b5e758 tempest-VolumesSnapshotTestJSON-925980516 tempest-VolumesSnapshotTestJSON-925980516-project] 10.222.0.18 "DELETE /compute/v2.1/servers/a0097d88-6613-416a-9f4d-1bb285e53291/os-volume_attachments/d681224a-3344-47c8-8df0-0379a5a8f296" status: 400 len: 269 microversion: 2.1 time: 240.272259 Dec 15 03:23:12.442134 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: Wed Dec 15 03:23:12 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/a0097d88-6613-416a-9f4d-1bb285e53291/os-volume_attachments/d681224a-3344-47c8-8df0-0379a5a8f296 (ip 10.222.0.18) !!! Dec 15 03:23:12.442134 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: Wed Dec 15 03:23:12 2021 - uwsgi_response_writev_headers_and_body_do(): Broken pipe [core/writer.c line 306] during DELETE /compute/v2.1/servers/a0097d88-6613-416a-9f4d-1bb285e53291/os-volume_attachments/d681224a-3344-47c8-8df0-0379a5a8f296 (10.222.0.18) Dec 15 03:23:12.443116 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: CRITICAL nova [None req-077ef7ea-a676-4005-93d0-2a2572b5e758 tempest-VolumesSnapshotTestJSON-925980516 tempest-VolumesSnapshotTestJSON-925980516-project] Unhandled error: OSError: write error Dec 15 03:23:12.443116 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: ERROR nova OSError: write error Dec 15 03:23:12.443116 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: ERROR nova Dec 15 03:23:12.443412 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: [pid: 116156|app: 0|req: 975/1839] 10.222.0.18 () {58 vars in 1415 bytes} [Wed Dec 15 03:19:12 2021] DELETE /compute/v2.1/servers/a0097d88-6613-416a-9f4d-1bb285e53291/os-volume_attachments/d681224a-3344-47c8-8df0-0379a5a8f296 => generated 0 bytes in 240275 msecs (HTTP/1.1 400) 9 headers in 0 bytes (0 switches on core 0) Dec 15 03:23:12.456057 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi [None req-358bbf5c-6673-4a80-bcd0-de35a4e8997e tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Calling method '>' {{(pid=116156) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:23:12.456863 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.compute.api [None req-358bbf5c-6673-4a80-bcd0-de35a4e8997e tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] [instance: bbb8462c-9501-4541-b67e-43ec5c5061a7] Fetching instance by UUID {{(pid=116156) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:23:12.467196 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-358bbf5c-6673-4a80-bcd0-de35a4e8997e tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:23:12.469623 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-358bbf5c-6673-4a80-bcd0-de35a4e8997e tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:23:12.470817 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-358bbf5c-6673-4a80-bcd0-de35a4e8997e tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:23:12.471368 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-358bbf5c-6673-4a80-bcd0-de35a4e8997e tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:23:12.535733 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.policy [None req-358bbf5c-6673-4a80-bcd0-de35a4e8997e tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97bdf19af9e34fc3886ff451cb9d7a27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '494b56bf5eae4d56a5591546f85bc32b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116156) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:23:12.543320 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: INFO nova.api.openstack.requestlog [None req-358bbf5c-6673-4a80-bcd0-de35a4e8997e tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] 10.222.0.18 "GET /compute/v2.1/servers/bbb8462c-9501-4541-b67e-43ec5c5061a7" status: 200 len: 1226 microversion: 2.1 time: 0.098720 Dec 15 03:23:12.543973 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: Wed Dec 15 03:23:12 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/bbb8462c-9501-4541-b67e-43ec5c5061a7 (ip 10.222.0.18) !!! Dec 15 03:23:12.543973 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: Wed Dec 15 03:23:12 2021 - uwsgi_response_writev_headers_and_body_do(): Broken pipe [core/writer.c line 306] during GET /compute/v2.1/servers/bbb8462c-9501-4541-b67e-43ec5c5061a7 (10.222.0.18) Dec 15 03:23:12.544724 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: CRITICAL nova [None req-358bbf5c-6673-4a80-bcd0-de35a4e8997e tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Unhandled error: OSError: write error Dec 15 03:23:12.544724 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: ERROR nova OSError: write error Dec 15 03:23:12.544724 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: ERROR nova Dec 15 03:23:12.545233 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: [pid: 116156|app: 0|req: 976/1840] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 03:23:12 2021] GET /compute/v2.1/servers/bbb8462c-9501-4541-b67e-43ec5c5061a7 => generated 0 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 0 bytes (0 switches on core 0) Dec 15 03:23:12.550439 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi [None req-ad3834ab-9e7b-4c45-9d50-b152c351201b tempest-VolumesSnapshotTestJSON-925980516 tempest-VolumesSnapshotTestJSON-925980516-project] Calling method '>' {{(pid=116156) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:23:12.551183 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.compute.api [None req-ad3834ab-9e7b-4c45-9d50-b152c351201b tempest-VolumesSnapshotTestJSON-925980516 tempest-VolumesSnapshotTestJSON-925980516-project] [instance: a0097d88-6613-416a-9f4d-1bb285e53291] Fetching instance by UUID {{(pid=116156) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:23:12.557257 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-ad3834ab-9e7b-4c45-9d50-b152c351201b tempest-VolumesSnapshotTestJSON-925980516 tempest-VolumesSnapshotTestJSON-925980516-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:23:12.557865 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-ad3834ab-9e7b-4c45-9d50-b152c351201b tempest-VolumesSnapshotTestJSON-925980516 tempest-VolumesSnapshotTestJSON-925980516-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:23:12.558766 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-ad3834ab-9e7b-4c45-9d50-b152c351201b tempest-VolumesSnapshotTestJSON-925980516 tempest-VolumesSnapshotTestJSON-925980516-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:23:12.559271 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-ad3834ab-9e7b-4c45-9d50-b152c351201b tempest-VolumesSnapshotTestJSON-925980516 tempest-VolumesSnapshotTestJSON-925980516-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:23:12.572367 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.policy [None req-87faf5b2-84b0-47ab-9b4d-9706598c5f83 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c4c0c82448e40ba801c0b52ec44e74a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a093d0bf43046aaa845f3cc115f3f5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116157) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:23:12.579677 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: INFO nova.api.openstack.requestlog [None req-87faf5b2-84b0-47ab-9b4d-9706598c5f83 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] 10.222.0.18 "GET /compute/v2.1/servers/fa7c86bc-c46f-4120-8f3d-d795f8d7c5cc" status: 200 len: 1451 microversion: 2.1 time: 0.176703 Dec 15 03:23:12.580718 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: Wed Dec 15 03:23:12 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/fa7c86bc-c46f-4120-8f3d-d795f8d7c5cc (ip 10.222.0.18) !!! Dec 15 03:23:12.580718 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: Wed Dec 15 03:23:12 2021 - uwsgi_response_writev_headers_and_body_do(): Broken pipe [core/writer.c line 306] during GET /compute/v2.1/servers/fa7c86bc-c46f-4120-8f3d-d795f8d7c5cc (10.222.0.18) Dec 15 03:23:12.581290 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: CRITICAL nova [None req-87faf5b2-84b0-47ab-9b4d-9706598c5f83 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Unhandled error: OSError: write error Dec 15 03:23:12.581290 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: ERROR nova OSError: write error Dec 15 03:23:12.581290 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: ERROR nova Dec 15 03:23:12.581575 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: [pid: 116157|app: 0|req: 865/1841] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 03:23:12 2021] GET /compute/v2.1/servers/fa7c86bc-c46f-4120-8f3d-d795f8d7c5cc => generated 0 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 0 bytes (0 switches on core 0) Dec 15 03:23:12.585584 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi [None req-14f911a7-81e1-4463-888e-8876e023e71c tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Calling method '>' {{(pid=116157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:23:12.586235 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.compute.api [None req-14f911a7-81e1-4463-888e-8876e023e71c tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] [instance: fa7c86bc-c46f-4120-8f3d-d795f8d7c5cc] Fetching instance by UUID {{(pid=116157) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:23:12.592406 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-14f911a7-81e1-4463-888e-8876e023e71c tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:23:12.592853 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-14f911a7-81e1-4463-888e-8876e023e71c tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:23:12.593638 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-14f911a7-81e1-4463-888e-8876e023e71c tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:23:12.594086 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-14f911a7-81e1-4463-888e-8876e023e71c tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:23:12.726675 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.policy [None req-14f911a7-81e1-4463-888e-8876e023e71c tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c4c0c82448e40ba801c0b52ec44e74a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a093d0bf43046aaa845f3cc115f3f5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116157) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:23:12.734146 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: INFO nova.api.openstack.requestlog [None req-14f911a7-81e1-4463-888e-8876e023e71c tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] 10.222.0.18 "GET /compute/v2.1/servers/fa7c86bc-c46f-4120-8f3d-d795f8d7c5cc" status: 200 len: 1445 microversion: 2.1 time: 0.151792 Dec 15 03:23:12.734708 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: [pid: 116157|app: 0|req: 866/1842] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 03:23:12 2021] GET /compute/v2.1/servers/fa7c86bc-c46f-4120-8f3d-d795f8d7c5cc => generated 1445 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 03:23:12.739443 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi [None req-26e03ba3-1603-4b82-a075-b13f2e2d4ac4 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Calling method '>' {{(pid=116157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:23:12.740036 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.compute.api [None req-26e03ba3-1603-4b82-a075-b13f2e2d4ac4 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] [instance: bbb8462c-9501-4541-b67e-43ec5c5061a7] Fetching instance by UUID {{(pid=116157) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:23:12.745374 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-26e03ba3-1603-4b82-a075-b13f2e2d4ac4 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:23:12.745817 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-26e03ba3-1603-4b82-a075-b13f2e2d4ac4 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:23:12.746623 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-26e03ba3-1603-4b82-a075-b13f2e2d4ac4 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:23:12.747056 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-26e03ba3-1603-4b82-a075-b13f2e2d4ac4 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:23:12.808198 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.policy [None req-26e03ba3-1603-4b82-a075-b13f2e2d4ac4 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97bdf19af9e34fc3886ff451cb9d7a27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '494b56bf5eae4d56a5591546f85bc32b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116157) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:23:12.816155 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: INFO nova.api.openstack.requestlog [None req-26e03ba3-1603-4b82-a075-b13f2e2d4ac4 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] 10.222.0.18 "GET /compute/v2.1/servers/bbb8462c-9501-4541-b67e-43ec5c5061a7" status: 200 len: 1226 microversion: 2.1 time: 0.080480 Dec 15 03:23:12.817478 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: [pid: 116157|app: 0|req: 867/1843] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 03:23:12 2021] GET /compute/v2.1/servers/bbb8462c-9501-4541-b67e-43ec5c5061a7 => generated 1226 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 03:23:12.822063 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi [None req-e55d015b-cb86-4217-a3eb-bd85e49a51c3 tempest-VolumesSnapshotTestJSON-925980516 tempest-VolumesSnapshotTestJSON-925980516-project] Calling method '>' {{(pid=116157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:23:12.822554 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.compute.api [None req-e55d015b-cb86-4217-a3eb-bd85e49a51c3 tempest-VolumesSnapshotTestJSON-925980516 tempest-VolumesSnapshotTestJSON-925980516-project] [instance: a0097d88-6613-416a-9f4d-1bb285e53291] Fetching instance by UUID {{(pid=116157) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:23:12.828043 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-e55d015b-cb86-4217-a3eb-bd85e49a51c3 tempest-VolumesSnapshotTestJSON-925980516 tempest-VolumesSnapshotTestJSON-925980516-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:23:12.828490 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-e55d015b-cb86-4217-a3eb-bd85e49a51c3 tempest-VolumesSnapshotTestJSON-925980516 tempest-VolumesSnapshotTestJSON-925980516-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:23:12.829261 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-e55d015b-cb86-4217-a3eb-bd85e49a51c3 tempest-VolumesSnapshotTestJSON-925980516 tempest-VolumesSnapshotTestJSON-925980516-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:23:12.829697 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-e55d015b-cb86-4217-a3eb-bd85e49a51c3 tempest-VolumesSnapshotTestJSON-925980516 tempest-VolumesSnapshotTestJSON-925980516-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:23:18.485352 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Dec 15 03:23:18.485871 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: Wed Dec 15 03:23:18 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/a0097d88-6613-416a-9f4d-1bb285e53291/os-volume_attachments/d681224a-3344-47c8-8df0-0379a5a8f296 (ip 10.222.0.18) !!! Dec 15 03:23:29.887304 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Dec 15 03:23:29.887917 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: Wed Dec 15 03:23:29 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/a0097d88-6613-416a-9f4d-1bb285e53291/os-volume_attachments/d681224a-3344-47c8-8df0-0379a5a8f296 (ip 10.222.0.18) !!! Dec 15 03:25:11.286393 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.objects.instance [None req-ad3834ab-9e7b-4c45-9d50-b152c351201b tempest-VolumesSnapshotTestJSON-925980516 tempest-VolumesSnapshotTestJSON-925980516-project] Lazy-loading 'services' on Instance uuid a0097d88-6613-416a-9f4d-1bb285e53291 {{(pid=116156) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Dec 15 03:25:11.368864 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.objects.instance [None req-e55d015b-cb86-4217-a3eb-bd85e49a51c3 tempest-VolumesSnapshotTestJSON-925980516 tempest-VolumesSnapshotTestJSON-925980516-project] Lazy-loading 'services' on Instance uuid a0097d88-6613-416a-9f4d-1bb285e53291 {{(pid=116157) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Dec 15 03:25:12.134710 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Dec 15 03:25:12.134972 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: Wed Dec 15 03:25:12 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/a0097d88-6613-416a-9f4d-1bb285e53291/os-volume_attachments/d681224a-3344-47c8-8df0-0379a5a8f296 (ip 10.222.0.18) !!! Dec 15 03:25:12.591280 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: INFO nova.api.openstack.wsgi [None req-ad3834ab-9e7b-4c45-9d50-b152c351201b tempest-VolumesSnapshotTestJSON-925980516 tempest-VolumesSnapshotTestJSON-925980516-project] HTTP exception thrown: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-1dd4de0f-a3bb-48be-b473-7fad891d1046) Dec 15 03:25:12.591900 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi [None req-ad3834ab-9e7b-4c45-9d50-b152c351201b tempest-VolumesSnapshotTestJSON-925980516 tempest-VolumesSnapshotTestJSON-925980516-project] Returning 400 to user: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-1dd4de0f-a3bb-48be-b473-7fad891d1046) {{(pid=116156) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 15 03:25:12.592748 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: INFO nova.api.openstack.requestlog [None req-ad3834ab-9e7b-4c45-9d50-b152c351201b tempest-VolumesSnapshotTestJSON-925980516 tempest-VolumesSnapshotTestJSON-925980516-project] 10.222.0.18 "DELETE /compute/v2.1/servers/a0097d88-6613-416a-9f4d-1bb285e53291/os-volume_attachments/d681224a-3344-47c8-8df0-0379a5a8f296" status: 400 len: 269 microversion: 2.1 time: 120.046519 Dec 15 03:25:12.593253 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: Wed Dec 15 03:25:12 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/a0097d88-6613-416a-9f4d-1bb285e53291/os-volume_attachments/d681224a-3344-47c8-8df0-0379a5a8f296 (ip 10.222.0.18) !!! Dec 15 03:25:12.593253 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: Wed Dec 15 03:25:12 2021 - uwsgi_response_writev_headers_and_body_do(): Broken pipe [core/writer.c line 306] during DELETE /compute/v2.1/servers/a0097d88-6613-416a-9f4d-1bb285e53291/os-volume_attachments/d681224a-3344-47c8-8df0-0379a5a8f296 (10.222.0.18) Dec 15 03:25:12.593914 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: CRITICAL nova [None req-ad3834ab-9e7b-4c45-9d50-b152c351201b tempest-VolumesSnapshotTestJSON-925980516 tempest-VolumesSnapshotTestJSON-925980516-project] Unhandled error: OSError: write error Dec 15 03:25:12.593914 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: ERROR nova OSError: write error Dec 15 03:25:12.593914 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: ERROR nova Dec 15 03:25:12.594765 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: [pid: 116156|app: 0|req: 977/1844] 10.222.0.18 () {58 vars in 1415 bytes} [Wed Dec 15 03:23:12 2021] DELETE /compute/v2.1/servers/a0097d88-6613-416a-9f4d-1bb285e53291/os-volume_attachments/d681224a-3344-47c8-8df0-0379a5a8f296 => generated 0 bytes in 120048 msecs (HTTP/1.1 400) 9 headers in 0 bytes (0 switches on core 0) Dec 15 03:25:12.599484 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi [None req-640b9a06-dcc2-4c77-868a-ec0a77632687 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Calling method '>' {{(pid=116156) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:25:12.600095 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.compute.api [None req-640b9a06-dcc2-4c77-868a-ec0a77632687 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] [instance: fa7c86bc-c46f-4120-8f3d-d795f8d7c5cc] Fetching instance by UUID {{(pid=116156) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:25:12.606658 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-640b9a06-dcc2-4c77-868a-ec0a77632687 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:25:12.607244 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-640b9a06-dcc2-4c77-868a-ec0a77632687 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:25:12.608037 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-640b9a06-dcc2-4c77-868a-ec0a77632687 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:25:12.608477 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-640b9a06-dcc2-4c77-868a-ec0a77632687 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:25:12.624459 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: INFO nova.api.openstack.wsgi [None req-e55d015b-cb86-4217-a3eb-bd85e49a51c3 tempest-VolumesSnapshotTestJSON-925980516 tempest-VolumesSnapshotTestJSON-925980516-project] HTTP exception thrown: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-3d8f5b35-e5e6-473d-b19e-5a017e4beaed) Dec 15 03:25:12.625159 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi [None req-e55d015b-cb86-4217-a3eb-bd85e49a51c3 tempest-VolumesSnapshotTestJSON-925980516 tempest-VolumesSnapshotTestJSON-925980516-project] Returning 400 to user: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-3d8f5b35-e5e6-473d-b19e-5a017e4beaed) {{(pid=116157) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 15 03:25:12.626318 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: INFO nova.api.openstack.requestlog [None req-e55d015b-cb86-4217-a3eb-bd85e49a51c3 tempest-VolumesSnapshotTestJSON-925980516 tempest-VolumesSnapshotTestJSON-925980516-project] 10.222.0.18 "DELETE /compute/v2.1/servers/a0097d88-6613-416a-9f4d-1bb285e53291/os-volume_attachments/d681224a-3344-47c8-8df0-0379a5a8f296" status: 400 len: 269 microversion: 2.1 time: 119.807852 Dec 15 03:25:12.627147 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: Wed Dec 15 03:25:12 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/a0097d88-6613-416a-9f4d-1bb285e53291/os-volume_attachments/d681224a-3344-47c8-8df0-0379a5a8f296 (ip 10.222.0.18) !!! Dec 15 03:25:12.627147 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: Wed Dec 15 03:25:12 2021 - uwsgi_response_writev_headers_and_body_do(): Broken pipe [core/writer.c line 306] during DELETE /compute/v2.1/servers/a0097d88-6613-416a-9f4d-1bb285e53291/os-volume_attachments/d681224a-3344-47c8-8df0-0379a5a8f296 (10.222.0.18) Dec 15 03:25:12.628028 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: CRITICAL nova [None req-e55d015b-cb86-4217-a3eb-bd85e49a51c3 tempest-VolumesSnapshotTestJSON-925980516 tempest-VolumesSnapshotTestJSON-925980516-project] Unhandled error: OSError: write error Dec 15 03:25:12.628028 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: ERROR nova OSError: write error Dec 15 03:25:12.628028 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: ERROR nova Dec 15 03:25:12.628446 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: [pid: 116157|app: 0|req: 868/1845] 10.222.0.18 () {58 vars in 1415 bytes} [Wed Dec 15 03:23:12 2021] DELETE /compute/v2.1/servers/a0097d88-6613-416a-9f4d-1bb285e53291/os-volume_attachments/d681224a-3344-47c8-8df0-0379a5a8f296 => generated 0 bytes in 119810 msecs (HTTP/1.1 400) 9 headers in 0 bytes (0 switches on core 0) Dec 15 03:25:12.634392 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi [None req-46464e4c-14a6-4e3c-8e74-fc02244cc603 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Calling method '>' {{(pid=116157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:25:12.635109 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.compute.api [None req-46464e4c-14a6-4e3c-8e74-fc02244cc603 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] [instance: bbb8462c-9501-4541-b67e-43ec5c5061a7] Fetching instance by UUID {{(pid=116157) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:25:12.642863 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-46464e4c-14a6-4e3c-8e74-fc02244cc603 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:25:12.643337 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-46464e4c-14a6-4e3c-8e74-fc02244cc603 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:25:12.644342 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-46464e4c-14a6-4e3c-8e74-fc02244cc603 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:25:12.644761 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-46464e4c-14a6-4e3c-8e74-fc02244cc603 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:25:12.663281 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: INFO nova.api.openstack.wsgi [None req-46464e4c-14a6-4e3c-8e74-fc02244cc603 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] HTTP exception thrown: Instance bbb8462c-9501-4541-b67e-43ec5c5061a7 could not be found. Dec 15 03:25:12.664004 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi [None req-46464e4c-14a6-4e3c-8e74-fc02244cc603 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Returning 404 to user: Instance bbb8462c-9501-4541-b67e-43ec5c5061a7 could not be found. {{(pid=116157) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 15 03:25:12.664909 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: INFO nova.api.openstack.requestlog [None req-46464e4c-14a6-4e3c-8e74-fc02244cc603 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] 10.222.0.18 "GET /compute/v2.1/servers/bbb8462c-9501-4541-b67e-43ec5c5061a7" status: 404 len: 111 microversion: 2.1 time: 0.035665 Dec 15 03:25:12.665496 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: Wed Dec 15 03:25:12 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/bbb8462c-9501-4541-b67e-43ec5c5061a7 (ip 10.222.0.18) !!! Dec 15 03:25:12.665496 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: Wed Dec 15 03:25:12 2021 - uwsgi_response_writev_headers_and_body_do(): Broken pipe [core/writer.c line 306] during GET /compute/v2.1/servers/bbb8462c-9501-4541-b67e-43ec5c5061a7 (10.222.0.18) Dec 15 03:25:12.666179 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: CRITICAL nova [None req-46464e4c-14a6-4e3c-8e74-fc02244cc603 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Unhandled error: OSError: write error Dec 15 03:25:12.666179 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: ERROR nova OSError: write error Dec 15 03:25:12.666179 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: ERROR nova Dec 15 03:25:12.666441 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: [pid: 116157|app: 0|req: 869/1846] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 03:25:12 2021] GET /compute/v2.1/servers/bbb8462c-9501-4541-b67e-43ec5c5061a7 => generated 0 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 0 bytes (0 switches on core 0) Dec 15 03:25:12.671036 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi [None req-c1e3d574-31eb-4ec8-9325-ba74190df6e6 tempest-VolumesSnapshotTestJSON-925980516 tempest-VolumesSnapshotTestJSON-925980516-project] Calling method '>' {{(pid=116157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:25:12.671605 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.compute.api [None req-c1e3d574-31eb-4ec8-9325-ba74190df6e6 tempest-VolumesSnapshotTestJSON-925980516 tempest-VolumesSnapshotTestJSON-925980516-project] [instance: a0097d88-6613-416a-9f4d-1bb285e53291] Fetching instance by UUID {{(pid=116157) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:25:12.677317 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-c1e3d574-31eb-4ec8-9325-ba74190df6e6 tempest-VolumesSnapshotTestJSON-925980516 tempest-VolumesSnapshotTestJSON-925980516-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:25:12.677850 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-c1e3d574-31eb-4ec8-9325-ba74190df6e6 tempest-VolumesSnapshotTestJSON-925980516 tempest-VolumesSnapshotTestJSON-925980516-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:25:12.678745 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-c1e3d574-31eb-4ec8-9325-ba74190df6e6 tempest-VolumesSnapshotTestJSON-925980516 tempest-VolumesSnapshotTestJSON-925980516-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:25:12.679259 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-c1e3d574-31eb-4ec8-9325-ba74190df6e6 tempest-VolumesSnapshotTestJSON-925980516 tempest-VolumesSnapshotTestJSON-925980516-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:25:12.680424 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.policy [None req-640b9a06-dcc2-4c77-868a-ec0a77632687 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c4c0c82448e40ba801c0b52ec44e74a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a093d0bf43046aaa845f3cc115f3f5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116156) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:25:12.688108 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: INFO nova.api.openstack.requestlog [None req-640b9a06-dcc2-4c77-868a-ec0a77632687 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] 10.222.0.18 "GET /compute/v2.1/servers/fa7c86bc-c46f-4120-8f3d-d795f8d7c5cc" status: 200 len: 1214 microversion: 2.1 time: 0.092549 Dec 15 03:25:12.688638 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: Wed Dec 15 03:25:12 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/fa7c86bc-c46f-4120-8f3d-d795f8d7c5cc (ip 10.222.0.18) !!! Dec 15 03:25:12.688638 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: Wed Dec 15 03:25:12 2021 - uwsgi_response_writev_headers_and_body_do(): Broken pipe [core/writer.c line 306] during GET /compute/v2.1/servers/fa7c86bc-c46f-4120-8f3d-d795f8d7c5cc (10.222.0.18) Dec 15 03:25:12.689256 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: CRITICAL nova [None req-640b9a06-dcc2-4c77-868a-ec0a77632687 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Unhandled error: OSError: write error Dec 15 03:25:12.689256 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: ERROR nova OSError: write error Dec 15 03:25:12.689256 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: ERROR nova Dec 15 03:25:12.689511 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: [pid: 116156|app: 0|req: 978/1847] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 03:25:12 2021] GET /compute/v2.1/servers/fa7c86bc-c46f-4120-8f3d-d795f8d7c5cc => generated 0 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 0 bytes (0 switches on core 0) Dec 15 03:25:12.693703 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi [None req-7e77a1b6-a8f2-4ab7-92c1-ae0313ad8d66 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Calling method '>' {{(pid=116156) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:25:12.694368 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.compute.api [None req-7e77a1b6-a8f2-4ab7-92c1-ae0313ad8d66 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] [instance: fa7c86bc-c46f-4120-8f3d-d795f8d7c5cc] Fetching instance by UUID {{(pid=116156) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:25:12.700020 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-7e77a1b6-a8f2-4ab7-92c1-ae0313ad8d66 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:25:12.700471 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-7e77a1b6-a8f2-4ab7-92c1-ae0313ad8d66 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:25:12.701264 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-7e77a1b6-a8f2-4ab7-92c1-ae0313ad8d66 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:25:12.701708 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-7e77a1b6-a8f2-4ab7-92c1-ae0313ad8d66 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:25:12.764639 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.policy [None req-7e77a1b6-a8f2-4ab7-92c1-ae0313ad8d66 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c4c0c82448e40ba801c0b52ec44e74a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a093d0bf43046aaa845f3cc115f3f5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116156) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:25:12.772777 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: INFO nova.api.openstack.requestlog [None req-7e77a1b6-a8f2-4ab7-92c1-ae0313ad8d66 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] 10.222.0.18 "GET /compute/v2.1/servers/fa7c86bc-c46f-4120-8f3d-d795f8d7c5cc" status: 200 len: 1214 microversion: 2.1 time: 0.082389 Dec 15 03:25:12.773346 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: [pid: 116156|app: 0|req: 979/1848] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 03:25:12 2021] GET /compute/v2.1/servers/fa7c86bc-c46f-4120-8f3d-d795f8d7c5cc => generated 1214 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 03:25:12.777611 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi [None req-000d3134-485f-43c0-8dad-64cf5e7fc164 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Calling method '>' {{(pid=116156) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:25:12.778143 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.compute.api [None req-000d3134-485f-43c0-8dad-64cf5e7fc164 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] [instance: b89094ac-aee1-4bd6-a33d-8c4347cebfc7] Fetching instance by UUID {{(pid=116156) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:25:12.783976 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-000d3134-485f-43c0-8dad-64cf5e7fc164 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:25:12.784425 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-000d3134-485f-43c0-8dad-64cf5e7fc164 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:25:12.785200 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-000d3134-485f-43c0-8dad-64cf5e7fc164 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:25:12.785640 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-000d3134-485f-43c0-8dad-64cf5e7fc164 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:25:12.808671 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.compute.api [None req-000d3134-485f-43c0-8dad-64cf5e7fc164 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] [instance: b89094ac-aee1-4bd6-a33d-8c4347cebfc7] Going to try to terminate instance {{(pid=116156) delete /opt/stack/nova/nova/compute/api.py:2614}} Dec 15 03:25:12.881411 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: INFO nova.api.openstack.requestlog [None req-000d3134-485f-43c0-8dad-64cf5e7fc164 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] 10.222.0.18 "DELETE /compute/v2.1/servers/b89094ac-aee1-4bd6-a33d-8c4347cebfc7" status: 204 len: 0 microversion: 2.20 time: 0.106658 Dec 15 03:25:12.882033 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: [pid: 116156|app: 0|req: 980/1849] 10.222.0.18 () {60 vars in 1279 bytes} [Wed Dec 15 03:25:12 2021] DELETE /compute/v2.1/servers/b89094ac-aee1-4bd6-a33d-8c4347cebfc7 => generated 0 bytes in 108 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Dec 15 03:25:12.887721 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi [None req-dbc51198-37a7-4307-8a73-b86f8aba02f0 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Calling method '>' {{(pid=116156) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:25:12.888420 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.compute.api [None req-dbc51198-37a7-4307-8a73-b86f8aba02f0 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] [instance: bbb8462c-9501-4541-b67e-43ec5c5061a7] Fetching instance by UUID {{(pid=116156) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:25:12.894890 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-dbc51198-37a7-4307-8a73-b86f8aba02f0 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:25:12.895337 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-dbc51198-37a7-4307-8a73-b86f8aba02f0 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:25:12.896110 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-dbc51198-37a7-4307-8a73-b86f8aba02f0 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:25:12.896542 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-dbc51198-37a7-4307-8a73-b86f8aba02f0 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:25:12.909114 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: INFO nova.api.openstack.wsgi [None req-dbc51198-37a7-4307-8a73-b86f8aba02f0 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] HTTP exception thrown: Instance bbb8462c-9501-4541-b67e-43ec5c5061a7 could not be found. Dec 15 03:25:12.909688 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi [None req-dbc51198-37a7-4307-8a73-b86f8aba02f0 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Returning 404 to user: Instance bbb8462c-9501-4541-b67e-43ec5c5061a7 could not be found. {{(pid=116156) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 15 03:25:12.910599 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: INFO nova.api.openstack.requestlog [None req-dbc51198-37a7-4307-8a73-b86f8aba02f0 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] 10.222.0.18 "GET /compute/v2.1/servers/bbb8462c-9501-4541-b67e-43ec5c5061a7" status: 404 len: 111 microversion: 2.1 time: 0.027353 Dec 15 03:25:12.911214 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: [pid: 116156|app: 0|req: 981/1850] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 03:25:12 2021] GET /compute/v2.1/servers/bbb8462c-9501-4541-b67e-43ec5c5061a7 => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 15 03:25:12.915414 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi [None req-107515e8-f8d7-441d-a5f8-965cae304f9c tempest-VolumesSnapshotTestJSON-925980516 tempest-VolumesSnapshotTestJSON-925980516-project] Calling method '>' {{(pid=116156) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:25:12.916009 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.compute.api [None req-107515e8-f8d7-441d-a5f8-965cae304f9c tempest-VolumesSnapshotTestJSON-925980516 tempest-VolumesSnapshotTestJSON-925980516-project] [instance: a0097d88-6613-416a-9f4d-1bb285e53291] Fetching instance by UUID {{(pid=116156) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:25:12.921092 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-107515e8-f8d7-441d-a5f8-965cae304f9c tempest-VolumesSnapshotTestJSON-925980516 tempest-VolumesSnapshotTestJSON-925980516-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:25:12.921538 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-107515e8-f8d7-441d-a5f8-965cae304f9c tempest-VolumesSnapshotTestJSON-925980516 tempest-VolumesSnapshotTestJSON-925980516-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:25:12.922327 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-107515e8-f8d7-441d-a5f8-965cae304f9c tempest-VolumesSnapshotTestJSON-925980516 tempest-VolumesSnapshotTestJSON-925980516-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:25:12.922763 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-107515e8-f8d7-441d-a5f8-965cae304f9c tempest-VolumesSnapshotTestJSON-925980516 tempest-VolumesSnapshotTestJSON-925980516-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:26:16.221950 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Dec 15 03:26:16.222430 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: Wed Dec 15 03:26:16 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/a0097d88-6613-416a-9f4d-1bb285e53291/os-volume_attachments/d681224a-3344-47c8-8df0-0379a5a8f296 (ip 10.222.0.18) !!! Dec 15 03:26:28.812653 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Dec 15 03:26:28.813752 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: Wed Dec 15 03:26:28 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/a0097d88-6613-416a-9f4d-1bb285e53291/os-volume_attachments/d681224a-3344-47c8-8df0-0379a5a8f296 (ip 10.222.0.18) !!! Dec 15 03:26:29.552893 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Dec 15 03:26:29.553442 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: Wed Dec 15 03:26:29 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/a0097d88-6613-416a-9f4d-1bb285e53291/os-volume_attachments/d681224a-3344-47c8-8df0-0379a5a8f296 (ip 10.222.0.18) !!! Dec 15 03:26:38.502367 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Dec 15 03:26:38.502976 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: Wed Dec 15 03:26:38 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/a0097d88-6613-416a-9f4d-1bb285e53291/os-volume_attachments/d681224a-3344-47c8-8df0-0379a5a8f296 (ip 10.222.0.18) !!! Dec 15 03:27:11.432172 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.objects.instance [None req-c1e3d574-31eb-4ec8-9325-ba74190df6e6 tempest-VolumesSnapshotTestJSON-925980516 tempest-VolumesSnapshotTestJSON-925980516-project] Lazy-loading 'services' on Instance uuid a0097d88-6613-416a-9f4d-1bb285e53291 {{(pid=116157) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Dec 15 03:27:11.470666 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.objects.instance [None req-107515e8-f8d7-441d-a5f8-965cae304f9c tempest-VolumesSnapshotTestJSON-925980516 tempest-VolumesSnapshotTestJSON-925980516-project] Lazy-loading 'services' on Instance uuid a0097d88-6613-416a-9f4d-1bb285e53291 {{(pid=116156) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Dec 15 03:28:29.905669 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Dec 15 03:28:29.906790 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: Wed Dec 15 03:28:29 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/a0097d88-6613-416a-9f4d-1bb285e53291/os-volume_attachments/d681224a-3344-47c8-8df0-0379a5a8f296 (ip 10.222.0.18) !!! Dec 15 03:28:32.151735 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Dec 15 03:28:32.152300 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: Wed Dec 15 03:28:32 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/a0097d88-6613-416a-9f4d-1bb285e53291/os-volume_attachments/d681224a-3344-47c8-8df0-0379a5a8f296 (ip 10.222.0.18) !!! Dec 15 03:29:11.622068 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: INFO nova.api.openstack.wsgi [None req-c1e3d574-31eb-4ec8-9325-ba74190df6e6 tempest-VolumesSnapshotTestJSON-925980516 tempest-VolumesSnapshotTestJSON-925980516-project] HTTP exception thrown: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-363411fd-6b33-456d-88e7-264879d400b1) Dec 15 03:29:11.623079 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi [None req-c1e3d574-31eb-4ec8-9325-ba74190df6e6 tempest-VolumesSnapshotTestJSON-925980516 tempest-VolumesSnapshotTestJSON-925980516-project] Returning 400 to user: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-363411fd-6b33-456d-88e7-264879d400b1) {{(pid=116157) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 15 03:29:11.623587 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: INFO nova.api.openstack.requestlog [None req-c1e3d574-31eb-4ec8-9325-ba74190df6e6 tempest-VolumesSnapshotTestJSON-925980516 tempest-VolumesSnapshotTestJSON-925980516-project] 10.222.0.18 "DELETE /compute/v2.1/servers/a0097d88-6613-416a-9f4d-1bb285e53291/os-volume_attachments/d681224a-3344-47c8-8df0-0379a5a8f296" status: 400 len: 269 microversion: 2.1 time: 238.956240 Dec 15 03:29:11.624257 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: Wed Dec 15 03:29:11 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/a0097d88-6613-416a-9f4d-1bb285e53291/os-volume_attachments/d681224a-3344-47c8-8df0-0379a5a8f296 (ip 10.222.0.18) !!! Dec 15 03:29:11.624257 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: Wed Dec 15 03:29:11 2021 - uwsgi_response_writev_headers_and_body_do(): Broken pipe [core/writer.c line 306] during DELETE /compute/v2.1/servers/a0097d88-6613-416a-9f4d-1bb285e53291/os-volume_attachments/d681224a-3344-47c8-8df0-0379a5a8f296 (10.222.0.18) Dec 15 03:29:11.624667 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: CRITICAL nova [None req-c1e3d574-31eb-4ec8-9325-ba74190df6e6 tempest-VolumesSnapshotTestJSON-925980516 tempest-VolumesSnapshotTestJSON-925980516-project] Unhandled error: OSError: write error Dec 15 03:29:11.624667 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: ERROR nova OSError: write error Dec 15 03:29:11.624667 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: ERROR nova Dec 15 03:29:11.625196 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: [pid: 116157|app: 0|req: 870/1851] 10.222.0.18 () {58 vars in 1415 bytes} [Wed Dec 15 03:25:12 2021] DELETE /compute/v2.1/servers/a0097d88-6613-416a-9f4d-1bb285e53291/os-volume_attachments/d681224a-3344-47c8-8df0-0379a5a8f296 => generated 0 bytes in 238958 msecs (HTTP/1.1 400) 9 headers in 0 bytes (0 switches on core 0) Dec 15 03:29:11.629789 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi [None req-339a9f95-95b1-42d7-b7b7-d67a87223cdb tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Calling method '>' {{(pid=116157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:29:11.630418 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.compute.api [None req-339a9f95-95b1-42d7-b7b7-d67a87223cdb tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] [instance: fa7c86bc-c46f-4120-8f3d-d795f8d7c5cc] Fetching instance by UUID {{(pid=116157) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:29:11.636873 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-339a9f95-95b1-42d7-b7b7-d67a87223cdb tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:29:11.637320 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-339a9f95-95b1-42d7-b7b7-d67a87223cdb tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:29:11.638142 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-339a9f95-95b1-42d7-b7b7-d67a87223cdb tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:29:11.638572 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-339a9f95-95b1-42d7-b7b7-d67a87223cdb tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:29:11.654663 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: INFO nova.api.openstack.wsgi [None req-107515e8-f8d7-441d-a5f8-965cae304f9c tempest-VolumesSnapshotTestJSON-925980516 tempest-VolumesSnapshotTestJSON-925980516-project] HTTP exception thrown: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-acb8cf53-c33e-4383-b575-5d00729b798f) Dec 15 03:29:11.656143 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi [None req-107515e8-f8d7-441d-a5f8-965cae304f9c tempest-VolumesSnapshotTestJSON-925980516 tempest-VolumesSnapshotTestJSON-925980516-project] Returning 400 to user: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-acb8cf53-c33e-4383-b575-5d00729b798f) {{(pid=116156) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 15 03:29:11.656997 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: INFO nova.api.openstack.requestlog [None req-107515e8-f8d7-441d-a5f8-965cae304f9c tempest-VolumesSnapshotTestJSON-925980516 tempest-VolumesSnapshotTestJSON-925980516-project] 10.222.0.18 "DELETE /compute/v2.1/servers/a0097d88-6613-416a-9f4d-1bb285e53291/os-volume_attachments/d681224a-3344-47c8-8df0-0379a5a8f296" status: 400 len: 269 microversion: 2.1 time: 238.744910 Dec 15 03:29:11.658024 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: Wed Dec 15 03:29:11 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/a0097d88-6613-416a-9f4d-1bb285e53291/os-volume_attachments/d681224a-3344-47c8-8df0-0379a5a8f296 (ip 10.222.0.18) !!! Dec 15 03:29:11.658024 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: Wed Dec 15 03:29:11 2021 - uwsgi_response_writev_headers_and_body_do(): Broken pipe [core/writer.c line 306] during DELETE /compute/v2.1/servers/a0097d88-6613-416a-9f4d-1bb285e53291/os-volume_attachments/d681224a-3344-47c8-8df0-0379a5a8f296 (10.222.0.18) Dec 15 03:29:11.659905 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: CRITICAL nova [None req-107515e8-f8d7-441d-a5f8-965cae304f9c tempest-VolumesSnapshotTestJSON-925980516 tempest-VolumesSnapshotTestJSON-925980516-project] Unhandled error: OSError: write error Dec 15 03:29:11.659905 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: ERROR nova OSError: write error Dec 15 03:29:11.659905 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: ERROR nova Dec 15 03:29:11.660339 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: [pid: 116156|app: 0|req: 982/1852] 10.222.0.18 () {58 vars in 1415 bytes} [Wed Dec 15 03:25:12 2021] DELETE /compute/v2.1/servers/a0097d88-6613-416a-9f4d-1bb285e53291/os-volume_attachments/d681224a-3344-47c8-8df0-0379a5a8f296 => generated 0 bytes in 238748 msecs (HTTP/1.1 400) 9 headers in 0 bytes (0 switches on core 0) Dec 15 03:29:11.667213 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi [None req-c46537e2-8ed2-4d37-9c0f-bd1cb128d06b tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Calling method '>' {{(pid=116156) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:29:11.667704 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.compute.api [None req-c46537e2-8ed2-4d37-9c0f-bd1cb128d06b tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] [instance: b89094ac-aee1-4bd6-a33d-8c4347cebfc7] Fetching instance by UUID {{(pid=116156) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:29:11.676181 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-c46537e2-8ed2-4d37-9c0f-bd1cb128d06b tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:29:11.676639 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-c46537e2-8ed2-4d37-9c0f-bd1cb128d06b tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:29:11.677425 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-c46537e2-8ed2-4d37-9c0f-bd1cb128d06b tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:29:11.677861 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-c46537e2-8ed2-4d37-9c0f-bd1cb128d06b tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:29:11.701067 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.policy [None req-339a9f95-95b1-42d7-b7b7-d67a87223cdb tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c4c0c82448e40ba801c0b52ec44e74a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a093d0bf43046aaa845f3cc115f3f5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116157) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:29:11.701743 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.compute.api [None req-c46537e2-8ed2-4d37-9c0f-bd1cb128d06b tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] [instance: b89094ac-aee1-4bd6-a33d-8c4347cebfc7] Going to try to terminate instance {{(pid=116156) delete /opt/stack/nova/nova/compute/api.py:2614}} Dec 15 03:29:11.709439 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: INFO nova.api.openstack.requestlog [None req-339a9f95-95b1-42d7-b7b7-d67a87223cdb tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] 10.222.0.18 "GET /compute/v2.1/servers/fa7c86bc-c46f-4120-8f3d-d795f8d7c5cc" status: 200 len: 1214 microversion: 2.1 time: 0.083706 Dec 15 03:29:11.710018 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: Wed Dec 15 03:29:11 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/fa7c86bc-c46f-4120-8f3d-d795f8d7c5cc (ip 10.222.0.18) !!! Dec 15 03:29:11.710316 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: Wed Dec 15 03:29:11 2021 - uwsgi_response_writev_headers_and_body_do(): Broken pipe [core/writer.c line 306] during GET /compute/v2.1/servers/fa7c86bc-c46f-4120-8f3d-d795f8d7c5cc (10.222.0.18) Dec 15 03:29:11.710896 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: CRITICAL nova [None req-339a9f95-95b1-42d7-b7b7-d67a87223cdb tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Unhandled error: OSError: write error Dec 15 03:29:11.710896 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: ERROR nova OSError: write error Dec 15 03:29:11.710896 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: ERROR nova Dec 15 03:29:11.711159 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: [pid: 116157|app: 0|req: 871/1853] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 03:29:11 2021] GET /compute/v2.1/servers/fa7c86bc-c46f-4120-8f3d-d795f8d7c5cc => generated 0 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 0 bytes (0 switches on core 0) Dec 15 03:29:11.751101 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: INFO nova.compute.api [None req-c46537e2-8ed2-4d37-9c0f-bd1cb128d06b tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] [instance: b89094ac-aee1-4bd6-a33d-8c4347cebfc7] Instance is already in deleting state, ignoring this request Dec 15 03:29:11.751929 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: INFO nova.api.openstack.requestlog [None req-c46537e2-8ed2-4d37-9c0f-bd1cb128d06b tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] 10.222.0.18 "DELETE /compute/v2.1/servers/b89094ac-aee1-4bd6-a33d-8c4347cebfc7" status: 204 len: 0 microversion: 2.20 time: 0.089302 Dec 15 03:29:11.752442 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: Wed Dec 15 03:29:11 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/b89094ac-aee1-4bd6-a33d-8c4347cebfc7 (ip 10.222.0.18) !!! Dec 15 03:29:11.752442 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: Wed Dec 15 03:29:11 2021 - uwsgi_response_write_headers_do(): Broken pipe [core/writer.c line 248] during DELETE /compute/v2.1/servers/b89094ac-aee1-4bd6-a33d-8c4347cebfc7 (10.222.0.18) Dec 15 03:29:11.753020 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: CRITICAL nova [None req-c46537e2-8ed2-4d37-9c0f-bd1cb128d06b tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Unhandled error: OSError: write error Dec 15 03:29:11.753020 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: ERROR nova OSError: write error Dec 15 03:29:11.753020 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: ERROR nova Dec 15 03:29:11.753266 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: [pid: 116156|app: 0|req: 983/1854] 10.222.0.18 () {60 vars in 1279 bytes} [Wed Dec 15 03:29:11 2021] DELETE /compute/v2.1/servers/b89094ac-aee1-4bd6-a33d-8c4347cebfc7 => generated 0 bytes in 93 msecs (HTTP/1.1 204) 9 headers in 0 bytes (0 switches on core 0) Dec 15 03:29:11.757546 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi [None req-d4ae4b92-f900-429e-a4b0-5234d72fb32a tempest-VolumesSnapshotTestJSON-925980516 tempest-VolumesSnapshotTestJSON-925980516-project] Calling method '>' {{(pid=116156) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:29:11.758060 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.compute.api [None req-d4ae4b92-f900-429e-a4b0-5234d72fb32a tempest-VolumesSnapshotTestJSON-925980516 tempest-VolumesSnapshotTestJSON-925980516-project] [instance: a0097d88-6613-416a-9f4d-1bb285e53291] Fetching instance by UUID {{(pid=116156) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:29:11.763477 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-d4ae4b92-f900-429e-a4b0-5234d72fb32a tempest-VolumesSnapshotTestJSON-925980516 tempest-VolumesSnapshotTestJSON-925980516-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:29:11.763931 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-d4ae4b92-f900-429e-a4b0-5234d72fb32a tempest-VolumesSnapshotTestJSON-925980516 tempest-VolumesSnapshotTestJSON-925980516-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:29:11.764705 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-d4ae4b92-f900-429e-a4b0-5234d72fb32a tempest-VolumesSnapshotTestJSON-925980516 tempest-VolumesSnapshotTestJSON-925980516-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:29:11.765365 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-d4ae4b92-f900-429e-a4b0-5234d72fb32a tempest-VolumesSnapshotTestJSON-925980516 tempest-VolumesSnapshotTestJSON-925980516-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:29:11.872596 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi [None req-ff140597-8b1e-471e-9f68-9844ee028d63 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Calling method '>' {{(pid=116157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:29:11.873205 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.compute.api [None req-ff140597-8b1e-471e-9f68-9844ee028d63 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] [instance: bbb8462c-9501-4541-b67e-43ec5c5061a7] Fetching instance by UUID {{(pid=116157) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:29:11.879240 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-ff140597-8b1e-471e-9f68-9844ee028d63 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:29:11.879692 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-ff140597-8b1e-471e-9f68-9844ee028d63 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:29:11.880477 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-ff140597-8b1e-471e-9f68-9844ee028d63 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:29:11.880914 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-ff140597-8b1e-471e-9f68-9844ee028d63 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:29:11.894155 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: INFO nova.api.openstack.wsgi [None req-ff140597-8b1e-471e-9f68-9844ee028d63 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] HTTP exception thrown: Instance bbb8462c-9501-4541-b67e-43ec5c5061a7 could not be found. Dec 15 03:29:11.894745 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi [None req-ff140597-8b1e-471e-9f68-9844ee028d63 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Returning 404 to user: Instance bbb8462c-9501-4541-b67e-43ec5c5061a7 could not be found. {{(pid=116157) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 15 03:29:11.895563 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: INFO nova.api.openstack.requestlog [None req-ff140597-8b1e-471e-9f68-9844ee028d63 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] 10.222.0.18 "GET /compute/v2.1/servers/bbb8462c-9501-4541-b67e-43ec5c5061a7" status: 404 len: 111 microversion: 2.1 time: 0.183685 Dec 15 03:29:11.896042 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: Wed Dec 15 03:29:11 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/bbb8462c-9501-4541-b67e-43ec5c5061a7 (ip 10.222.0.18) !!! Dec 15 03:29:11.896042 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: Wed Dec 15 03:29:11 2021 - uwsgi_response_writev_headers_and_body_do(): Broken pipe [core/writer.c line 306] during GET /compute/v2.1/servers/bbb8462c-9501-4541-b67e-43ec5c5061a7 (10.222.0.18) Dec 15 03:29:11.896610 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: CRITICAL nova [None req-ff140597-8b1e-471e-9f68-9844ee028d63 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Unhandled error: OSError: write error Dec 15 03:29:11.896610 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: ERROR nova OSError: write error Dec 15 03:29:11.896610 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: ERROR nova Dec 15 03:29:11.896862 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: [pid: 116157|app: 0|req: 872/1855] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 03:29:11 2021] GET /compute/v2.1/servers/bbb8462c-9501-4541-b67e-43ec5c5061a7 => generated 0 bytes in 185 msecs (HTTP/1.1 404) 9 headers in 0 bytes (0 switches on core 0) Dec 15 03:29:11.901512 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi [None req-4fd162c7-e07e-4468-8358-0773c9b4e84c tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Calling method '>' {{(pid=116157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:29:11.902144 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.compute.api [None req-4fd162c7-e07e-4468-8358-0773c9b4e84c tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] [instance: fa7c86bc-c46f-4120-8f3d-d795f8d7c5cc] Fetching instance by UUID {{(pid=116157) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:29:11.908245 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-4fd162c7-e07e-4468-8358-0773c9b4e84c tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:29:11.908692 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-4fd162c7-e07e-4468-8358-0773c9b4e84c tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:29:11.909458 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-4fd162c7-e07e-4468-8358-0773c9b4e84c tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:29:11.909893 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-4fd162c7-e07e-4468-8358-0773c9b4e84c tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:29:11.968203 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.policy [None req-4fd162c7-e07e-4468-8358-0773c9b4e84c tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c4c0c82448e40ba801c0b52ec44e74a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a093d0bf43046aaa845f3cc115f3f5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116157) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:29:11.976219 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: INFO nova.api.openstack.requestlog [None req-4fd162c7-e07e-4468-8358-0773c9b4e84c tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] 10.222.0.18 "GET /compute/v2.1/servers/fa7c86bc-c46f-4120-8f3d-d795f8d7c5cc" status: 200 len: 1214 microversion: 2.1 time: 0.078020 Dec 15 03:29:11.976738 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: Wed Dec 15 03:29:11 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/fa7c86bc-c46f-4120-8f3d-d795f8d7c5cc (ip 10.222.0.18) !!! Dec 15 03:29:11.976738 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: Wed Dec 15 03:29:11 2021 - uwsgi_response_writev_headers_and_body_do(): Broken pipe [core/writer.c line 306] during GET /compute/v2.1/servers/fa7c86bc-c46f-4120-8f3d-d795f8d7c5cc (10.222.0.18) Dec 15 03:29:11.977560 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: CRITICAL nova [None req-4fd162c7-e07e-4468-8358-0773c9b4e84c tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Unhandled error: OSError: write error Dec 15 03:29:11.977560 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: ERROR nova OSError: write error Dec 15 03:29:11.977560 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: ERROR nova Dec 15 03:29:11.977853 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: [pid: 116157|app: 0|req: 873/1856] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 03:29:11 2021] GET /compute/v2.1/servers/fa7c86bc-c46f-4120-8f3d-d795f8d7c5cc => generated 0 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 0 bytes (0 switches on core 0) Dec 15 03:29:11.981917 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi [None req-f26343f6-f240-4646-80be-6a7e1f32d605 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Calling method '>' {{(pid=116157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:29:11.982423 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.compute.api [None req-f26343f6-f240-4646-80be-6a7e1f32d605 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] [instance: b89094ac-aee1-4bd6-a33d-8c4347cebfc7] Fetching instance by UUID {{(pid=116157) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:29:11.990359 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-f26343f6-f240-4646-80be-6a7e1f32d605 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:29:11.990809 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-f26343f6-f240-4646-80be-6a7e1f32d605 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:29:11.991940 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-f26343f6-f240-4646-80be-6a7e1f32d605 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:29:11.992796 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-f26343f6-f240-4646-80be-6a7e1f32d605 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:29:12.015729 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.compute.api [None req-f26343f6-f240-4646-80be-6a7e1f32d605 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] [instance: b89094ac-aee1-4bd6-a33d-8c4347cebfc7] Going to try to terminate instance {{(pid=116157) delete /opt/stack/nova/nova/compute/api.py:2614}} Dec 15 03:29:12.058150 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: INFO nova.compute.api [None req-f26343f6-f240-4646-80be-6a7e1f32d605 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] [instance: b89094ac-aee1-4bd6-a33d-8c4347cebfc7] Instance is already in deleting state, ignoring this request Dec 15 03:29:12.058947 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: INFO nova.api.openstack.requestlog [None req-f26343f6-f240-4646-80be-6a7e1f32d605 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] 10.222.0.18 "DELETE /compute/v2.1/servers/b89094ac-aee1-4bd6-a33d-8c4347cebfc7" status: 204 len: 0 microversion: 2.20 time: 0.080369 Dec 15 03:29:12.059435 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: Wed Dec 15 03:29:12 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/b89094ac-aee1-4bd6-a33d-8c4347cebfc7 (ip 10.222.0.18) !!! Dec 15 03:29:12.059435 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: Wed Dec 15 03:29:12 2021 - uwsgi_response_write_headers_do(): Broken pipe [core/writer.c line 248] during DELETE /compute/v2.1/servers/b89094ac-aee1-4bd6-a33d-8c4347cebfc7 (10.222.0.18) Dec 15 03:29:12.060003 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: CRITICAL nova [None req-f26343f6-f240-4646-80be-6a7e1f32d605 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Unhandled error: OSError: write error Dec 15 03:29:12.060003 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: ERROR nova OSError: write error Dec 15 03:29:12.060003 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: ERROR nova Dec 15 03:29:12.060254 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: [pid: 116157|app: 0|req: 874/1857] 10.222.0.18 () {60 vars in 1279 bytes} [Wed Dec 15 03:29:11 2021] DELETE /compute/v2.1/servers/b89094ac-aee1-4bd6-a33d-8c4347cebfc7 => generated 0 bytes in 82 msecs (HTTP/1.1 204) 9 headers in 0 bytes (0 switches on core 0) Dec 15 03:29:12.064213 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi [None req-9cfede36-e5bd-4ed0-88d3-9f1d1ba8771c tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Calling method '>' {{(pid=116157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:29:12.064803 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.compute.api [None req-9cfede36-e5bd-4ed0-88d3-9f1d1ba8771c tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] [instance: bbb8462c-9501-4541-b67e-43ec5c5061a7] Fetching instance by UUID {{(pid=116157) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:29:12.069899 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-9cfede36-e5bd-4ed0-88d3-9f1d1ba8771c tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:29:12.070389 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-9cfede36-e5bd-4ed0-88d3-9f1d1ba8771c tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:29:12.071154 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-9cfede36-e5bd-4ed0-88d3-9f1d1ba8771c tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:29:12.071589 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-9cfede36-e5bd-4ed0-88d3-9f1d1ba8771c tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:29:12.085149 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: INFO nova.api.openstack.wsgi [None req-9cfede36-e5bd-4ed0-88d3-9f1d1ba8771c tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] HTTP exception thrown: Instance bbb8462c-9501-4541-b67e-43ec5c5061a7 could not be found. Dec 15 03:29:12.085719 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi [None req-9cfede36-e5bd-4ed0-88d3-9f1d1ba8771c tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Returning 404 to user: Instance bbb8462c-9501-4541-b67e-43ec5c5061a7 could not be found. {{(pid=116157) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 15 03:29:12.086545 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: INFO nova.api.openstack.requestlog [None req-9cfede36-e5bd-4ed0-88d3-9f1d1ba8771c tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] 10.222.0.18 "GET /compute/v2.1/servers/bbb8462c-9501-4541-b67e-43ec5c5061a7" status: 404 len: 111 microversion: 2.1 time: 0.025577 Dec 15 03:29:12.086998 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: Wed Dec 15 03:29:12 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/bbb8462c-9501-4541-b67e-43ec5c5061a7 (ip 10.222.0.18) !!! Dec 15 03:29:12.086998 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: Wed Dec 15 03:29:12 2021 - uwsgi_response_writev_headers_and_body_do(): Broken pipe [core/writer.c line 306] during GET /compute/v2.1/servers/bbb8462c-9501-4541-b67e-43ec5c5061a7 (10.222.0.18) Dec 15 03:29:12.087549 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: CRITICAL nova [None req-9cfede36-e5bd-4ed0-88d3-9f1d1ba8771c tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Unhandled error: OSError: write error Dec 15 03:29:12.087549 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: ERROR nova OSError: write error Dec 15 03:29:12.087549 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: ERROR nova Dec 15 03:29:12.087802 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: [pid: 116157|app: 0|req: 875/1858] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 03:29:12 2021] GET /compute/v2.1/servers/bbb8462c-9501-4541-b67e-43ec5c5061a7 => generated 0 bytes in 27 msecs (HTTP/1.1 404) 9 headers in 0 bytes (0 switches on core 0) Dec 15 03:29:12.091738 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi [None req-dcdc3b7e-8600-46cb-92a6-8e768c22c435 tempest-AttachVolumeTestJSON-244989543 tempest-AttachVolumeTestJSON-244989543-project] Calling method '>' {{(pid=116157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:29:12.092604 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.compute.api [None req-dcdc3b7e-8600-46cb-92a6-8e768c22c435 tempest-AttachVolumeTestJSON-244989543 tempest-AttachVolumeTestJSON-244989543-project] [instance: f22dfea6-4599-43e4-93d5-d99f1db3b4fb] Fetching instance by UUID {{(pid=116157) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:29:12.098277 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-dcdc3b7e-8600-46cb-92a6-8e768c22c435 tempest-AttachVolumeTestJSON-244989543 tempest-AttachVolumeTestJSON-244989543-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:29:12.098723 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-dcdc3b7e-8600-46cb-92a6-8e768c22c435 tempest-AttachVolumeTestJSON-244989543 tempest-AttachVolumeTestJSON-244989543-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:29:12.099482 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-dcdc3b7e-8600-46cb-92a6-8e768c22c435 tempest-AttachVolumeTestJSON-244989543 tempest-AttachVolumeTestJSON-244989543-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:29:12.099917 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-dcdc3b7e-8600-46cb-92a6-8e768c22c435 tempest-AttachVolumeTestJSON-244989543 tempest-AttachVolumeTestJSON-244989543-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:29:12.127275 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: INFO nova.api.openstack.requestlog [None req-dcdc3b7e-8600-46cb-92a6-8e768c22c435 tempest-AttachVolumeTestJSON-244989543 tempest-AttachVolumeTestJSON-244989543-project] 10.222.0.18 "GET /compute/v2.1/servers/f22dfea6-4599-43e4-93d5-d99f1db3b4fb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.038723 Dec 15 03:29:12.127755 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: Wed Dec 15 03:29:12 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/f22dfea6-4599-43e4-93d5-d99f1db3b4fb/os-volume_attachments (ip 10.222.0.18) !!! Dec 15 03:29:12.127755 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: Wed Dec 15 03:29:12 2021 - uwsgi_response_writev_headers_and_body_do(): Broken pipe [core/writer.c line 306] during GET /compute/v2.1/servers/f22dfea6-4599-43e4-93d5-d99f1db3b4fb/os-volume_attachments (10.222.0.18) Dec 15 03:29:12.128320 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: CRITICAL nova [None req-dcdc3b7e-8600-46cb-92a6-8e768c22c435 tempest-AttachVolumeTestJSON-244989543 tempest-AttachVolumeTestJSON-244989543-project] Unhandled error: OSError: write error Dec 15 03:29:12.128320 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: ERROR nova OSError: write error Dec 15 03:29:12.128320 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: ERROR nova Dec 15 03:29:12.128593 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: [pid: 116157|app: 0|req: 876/1859] 10.222.0.18 () {58 vars in 1301 bytes} [Wed Dec 15 03:29:12 2021] GET /compute/v2.1/servers/f22dfea6-4599-43e4-93d5-d99f1db3b4fb/os-volume_attachments => generated 0 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 0 bytes (0 switches on core 0) Dec 15 03:29:12.184766 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi [req-23c2fed6-2067-4ac8-a3fe-4cf8e53b8fb0 req-1e49ac00-351c-47e8-87c2-d7b981152bc0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fa7c86bc-c46f-4120-8f3d-d795f8d7c5cc", "name": "network-vif-deleted", "tag": "6bbc39c5-40bb-4350-a006-fae5a1ef78a6"}]} {{(pid=116157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 03:29:12.186304 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 15 03:29:12.186304 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: warnings.warn(msg) Dec 15 03:29:12.192855 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [req-23c2fed6-2067-4ac8-a3fe-4cf8e53b8fb0 req-1e49ac00-351c-47e8-87c2-d7b981152bc0 service nova] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:29:12.193303 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [req-23c2fed6-2067-4ac8-a3fe-4cf8e53b8fb0 req-1e49ac00-351c-47e8-87c2-d7b981152bc0 service nova] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:29:12.203792 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: INFO nova.api.openstack.compute.server_external_events [req-23c2fed6-2067-4ac8-a3fe-4cf8e53b8fb0 req-1e49ac00-351c-47e8-87c2-d7b981152bc0 service nova] Creating event network-vif-deleted:6bbc39c5-40bb-4350-a006-fae5a1ef78a6 for instance fa7c86bc-c46f-4120-8f3d-d795f8d7c5cc on hv-cinder-81803 Dec 15 03:29:12.210224 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: INFO nova.api.openstack.requestlog [req-23c2fed6-2067-4ac8-a3fe-4cf8e53b8fb0 req-1e49ac00-351c-47e8-87c2-d7b981152bc0 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.080716 Dec 15 03:29:12.210740 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: Wed Dec 15 03:29:12 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-server-external-events (ip 10.222.0.18) !!! Dec 15 03:29:12.210740 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: Wed Dec 15 03:29:12 2021 - uwsgi_response_writev_headers_and_body_do(): Broken pipe [core/writer.c line 306] during POST /compute/v2.1/os-server-external-events (10.222.0.18) Dec 15 03:29:12.211402 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: CRITICAL nova [req-23c2fed6-2067-4ac8-a3fe-4cf8e53b8fb0 req-1e49ac00-351c-47e8-87c2-d7b981152bc0 service nova] Unhandled error: OSError: write error Dec 15 03:29:12.211402 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: ERROR nova OSError: write error Dec 15 03:29:12.211402 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: ERROR nova Dec 15 03:29:12.211656 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: [pid: 116157|app: 0|req: 877/1860] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Dec 15 03:29:12 2021] POST /compute/v2.1/os-server-external-events => generated 0 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 0 bytes (0 switches on core 0) Dec 15 03:29:12.216316 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi [None req-5f181a43-171a-4429-9ff8-4b305f3940f4 tempest-VolumesSnapshotTestJSON-925980516 tempest-VolumesSnapshotTestJSON-925980516-project] Calling method '>' {{(pid=116157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:29:12.216896 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.compute.api [None req-5f181a43-171a-4429-9ff8-4b305f3940f4 tempest-VolumesSnapshotTestJSON-925980516 tempest-VolumesSnapshotTestJSON-925980516-project] [instance: a0097d88-6613-416a-9f4d-1bb285e53291] Fetching instance by UUID {{(pid=116157) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:29:12.223328 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-5f181a43-171a-4429-9ff8-4b305f3940f4 tempest-VolumesSnapshotTestJSON-925980516 tempest-VolumesSnapshotTestJSON-925980516-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:29:12.223782 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-5f181a43-171a-4429-9ff8-4b305f3940f4 tempest-VolumesSnapshotTestJSON-925980516 tempest-VolumesSnapshotTestJSON-925980516-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:29:12.224559 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-5f181a43-171a-4429-9ff8-4b305f3940f4 tempest-VolumesSnapshotTestJSON-925980516 tempest-VolumesSnapshotTestJSON-925980516-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:29:12.225029 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-5f181a43-171a-4429-9ff8-4b305f3940f4 tempest-VolumesSnapshotTestJSON-925980516 tempest-VolumesSnapshotTestJSON-925980516-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:29:36.239821 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Dec 15 03:29:36.240428 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: Wed Dec 15 03:29:36 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/a0097d88-6613-416a-9f4d-1bb285e53291/os-volume_attachments/d681224a-3344-47c8-8df0-0379a5a8f296 (ip 10.222.0.18) !!! Dec 15 03:29:48.830066 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Dec 15 03:29:48.830656 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: Wed Dec 15 03:29:48 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/a0097d88-6613-416a-9f4d-1bb285e53291/os-volume_attachments/d681224a-3344-47c8-8df0-0379a5a8f296 (ip 10.222.0.18) !!! Dec 15 03:29:49.570608 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Dec 15 03:29:49.571122 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: Wed Dec 15 03:29:49 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/a0097d88-6613-416a-9f4d-1bb285e53291/os-volume_attachments/d681224a-3344-47c8-8df0-0379a5a8f296 (ip 10.222.0.18) !!! Dec 15 03:29:58.519644 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Dec 15 03:29:58.520111 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: Wed Dec 15 03:29:58 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/a0097d88-6613-416a-9f4d-1bb285e53291/os-volume_attachments/d681224a-3344-47c8-8df0-0379a5a8f296 (ip 10.222.0.18) !!! Dec 15 03:31:12.115681 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.objects.instance [None req-d4ae4b92-f900-429e-a4b0-5234d72fb32a tempest-VolumesSnapshotTestJSON-925980516 tempest-VolumesSnapshotTestJSON-925980516-project] Lazy-loading 'services' on Instance uuid a0097d88-6613-416a-9f4d-1bb285e53291 {{(pid=116156) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Dec 15 03:31:12.201757 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.objects.instance [None req-5f181a43-171a-4429-9ff8-4b305f3940f4 tempest-VolumesSnapshotTestJSON-925980516 tempest-VolumesSnapshotTestJSON-925980516-project] Lazy-loading 'services' on Instance uuid a0097d88-6613-416a-9f4d-1bb285e53291 {{(pid=116157) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Dec 15 03:31:49.923085 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Dec 15 03:31:49.923561 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: Wed Dec 15 03:31:49 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/a0097d88-6613-416a-9f4d-1bb285e53291/os-volume_attachments/d681224a-3344-47c8-8df0-0379a5a8f296 (ip 10.222.0.18) !!! Dec 15 03:31:52.168835 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Dec 15 03:31:52.169317 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: Wed Dec 15 03:31:52 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/a0097d88-6613-416a-9f4d-1bb285e53291/os-volume_attachments/d681224a-3344-47c8-8df0-0379a5a8f296 (ip 10.222.0.18) !!! Dec 15 03:32:56.256652 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Dec 15 03:32:56.257259 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: Wed Dec 15 03:32:56 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/a0097d88-6613-416a-9f4d-1bb285e53291/os-volume_attachments/d681224a-3344-47c8-8df0-0379a5a8f296 (ip 10.222.0.18) !!! Dec 15 03:33:08.847266 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Dec 15 03:33:08.847874 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: Wed Dec 15 03:33:08 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/a0097d88-6613-416a-9f4d-1bb285e53291/os-volume_attachments/d681224a-3344-47c8-8df0-0379a5a8f296 (ip 10.222.0.18) !!! Dec 15 03:33:09.587924 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Dec 15 03:33:09.588462 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: Wed Dec 15 03:33:09 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/a0097d88-6613-416a-9f4d-1bb285e53291/os-volume_attachments/d681224a-3344-47c8-8df0-0379a5a8f296 (ip 10.222.0.18) !!! Dec 15 03:33:12.288271 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: INFO nova.api.openstack.wsgi [None req-d4ae4b92-f900-429e-a4b0-5234d72fb32a tempest-VolumesSnapshotTestJSON-925980516 tempest-VolumesSnapshotTestJSON-925980516-project] HTTP exception thrown: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-7d63ed41-e1dc-4fc6-a0d1-bd66283dd638) Dec 15 03:33:12.288890 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi [None req-d4ae4b92-f900-429e-a4b0-5234d72fb32a tempest-VolumesSnapshotTestJSON-925980516 tempest-VolumesSnapshotTestJSON-925980516-project] Returning 400 to user: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-7d63ed41-e1dc-4fc6-a0d1-bd66283dd638) {{(pid=116156) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 15 03:33:12.289736 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: INFO nova.api.openstack.requestlog [None req-d4ae4b92-f900-429e-a4b0-5234d72fb32a tempest-VolumesSnapshotTestJSON-925980516 tempest-VolumesSnapshotTestJSON-925980516-project] 10.222.0.18 "DELETE /compute/v2.1/servers/a0097d88-6613-416a-9f4d-1bb285e53291/os-volume_attachments/d681224a-3344-47c8-8df0-0379a5a8f296" status: 400 len: 269 microversion: 2.1 time: 240.535723 Dec 15 03:33:12.290324 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: Wed Dec 15 03:33:12 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/a0097d88-6613-416a-9f4d-1bb285e53291/os-volume_attachments/d681224a-3344-47c8-8df0-0379a5a8f296 (ip 10.222.0.18) !!! Dec 15 03:33:12.290324 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: Wed Dec 15 03:33:12 2021 - uwsgi_response_writev_headers_and_body_do(): Broken pipe [core/writer.c line 306] during DELETE /compute/v2.1/servers/a0097d88-6613-416a-9f4d-1bb285e53291/os-volume_attachments/d681224a-3344-47c8-8df0-0379a5a8f296 (10.222.0.18) Dec 15 03:33:12.290915 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: CRITICAL nova [None req-d4ae4b92-f900-429e-a4b0-5234d72fb32a tempest-VolumesSnapshotTestJSON-925980516 tempest-VolumesSnapshotTestJSON-925980516-project] Unhandled error: OSError: write error Dec 15 03:33:12.290915 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: ERROR nova OSError: write error Dec 15 03:33:12.290915 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: ERROR nova Dec 15 03:33:12.291186 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: [pid: 116156|app: 0|req: 984/1861] 10.222.0.18 () {58 vars in 1415 bytes} [Wed Dec 15 03:29:11 2021] DELETE /compute/v2.1/servers/a0097d88-6613-416a-9f4d-1bb285e53291/os-volume_attachments/d681224a-3344-47c8-8df0-0379a5a8f296 => generated 0 bytes in 240537 msecs (HTTP/1.1 400) 9 headers in 0 bytes (0 switches on core 0) Dec 15 03:33:12.319180 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: INFO nova.api.openstack.wsgi [None req-5f181a43-171a-4429-9ff8-4b305f3940f4 tempest-VolumesSnapshotTestJSON-925980516 tempest-VolumesSnapshotTestJSON-925980516-project] HTTP exception thrown: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-d4f83030-bf6e-4db7-bbfe-110c13bc9f53) Dec 15 03:33:12.320028 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi [None req-5f181a43-171a-4429-9ff8-4b305f3940f4 tempest-VolumesSnapshotTestJSON-925980516 tempest-VolumesSnapshotTestJSON-925980516-project] Returning 400 to user: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-d4f83030-bf6e-4db7-bbfe-110c13bc9f53) {{(pid=116157) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 15 03:33:12.321214 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: INFO nova.api.openstack.requestlog [None req-5f181a43-171a-4429-9ff8-4b305f3940f4 tempest-VolumesSnapshotTestJSON-925980516 tempest-VolumesSnapshotTestJSON-925980516-project] 10.222.0.18 "DELETE /compute/v2.1/servers/a0097d88-6613-416a-9f4d-1bb285e53291/os-volume_attachments/d681224a-3344-47c8-8df0-0379a5a8f296" status: 400 len: 269 microversion: 2.1 time: 240.108324 Dec 15 03:33:12.321904 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: Wed Dec 15 03:33:12 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/a0097d88-6613-416a-9f4d-1bb285e53291/os-volume_attachments/d681224a-3344-47c8-8df0-0379a5a8f296 (ip 10.222.0.18) !!! Dec 15 03:33:12.321904 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: Wed Dec 15 03:33:12 2021 - uwsgi_response_writev_headers_and_body_do(): Broken pipe [core/writer.c line 306] during DELETE /compute/v2.1/servers/a0097d88-6613-416a-9f4d-1bb285e53291/os-volume_attachments/d681224a-3344-47c8-8df0-0379a5a8f296 (10.222.0.18) Dec 15 03:33:12.321904 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: CRITICAL nova [None req-5f181a43-171a-4429-9ff8-4b305f3940f4 tempest-VolumesSnapshotTestJSON-925980516 tempest-VolumesSnapshotTestJSON-925980516-project] Unhandled error: OSError: write error Dec 15 03:33:12.321904 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: ERROR nova OSError: write error Dec 15 03:33:12.321904 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: ERROR nova Dec 15 03:33:12.323371 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: [pid: 116157|app: 0|req: 878/1862] 10.222.0.18 () {58 vars in 1415 bytes} [Wed Dec 15 03:29:12 2021] DELETE /compute/v2.1/servers/a0097d88-6613-416a-9f4d-1bb285e53291/os-volume_attachments/d681224a-3344-47c8-8df0-0379a5a8f296 => generated 0 bytes in 240110 msecs (HTTP/1.1 400) 9 headers in 0 bytes (0 switches on core 0) Dec 15 03:33:12.414301 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi [None req-c359be5f-2d10-4012-92f3-f7dd2ac7b760 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Calling method '>' {{(pid=116156) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:33:12.415173 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.compute.api [None req-c359be5f-2d10-4012-92f3-f7dd2ac7b760 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] [instance: fa7c86bc-c46f-4120-8f3d-d795f8d7c5cc] Fetching instance by UUID {{(pid=116156) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:33:12.422665 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-c359be5f-2d10-4012-92f3-f7dd2ac7b760 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:33:12.423124 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-c359be5f-2d10-4012-92f3-f7dd2ac7b760 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:33:12.423999 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-c359be5f-2d10-4012-92f3-f7dd2ac7b760 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:33:12.424610 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-c359be5f-2d10-4012-92f3-f7dd2ac7b760 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:33:12.441682 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi [None req-42dcc758-a9a2-4627-8bd9-483172b688b1 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Calling method '>' {{(pid=116157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:33:12.442884 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.compute.api [None req-42dcc758-a9a2-4627-8bd9-483172b688b1 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] [instance: b89094ac-aee1-4bd6-a33d-8c4347cebfc7] Fetching instance by UUID {{(pid=116157) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:33:12.448915 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-42dcc758-a9a2-4627-8bd9-483172b688b1 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:33:12.449388 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-42dcc758-a9a2-4627-8bd9-483172b688b1 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:33:12.450178 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-42dcc758-a9a2-4627-8bd9-483172b688b1 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:33:12.450615 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-42dcc758-a9a2-4627-8bd9-483172b688b1 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:33:12.475726 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.compute.api [None req-42dcc758-a9a2-4627-8bd9-483172b688b1 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] [instance: b89094ac-aee1-4bd6-a33d-8c4347cebfc7] Going to try to terminate instance {{(pid=116157) delete /opt/stack/nova/nova/compute/api.py:2614}} Dec 15 03:33:12.492752 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.policy [None req-c359be5f-2d10-4012-92f3-f7dd2ac7b760 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c4c0c82448e40ba801c0b52ec44e74a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a093d0bf43046aaa845f3cc115f3f5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116156) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:33:12.500652 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: INFO nova.api.openstack.requestlog [None req-c359be5f-2d10-4012-92f3-f7dd2ac7b760 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] 10.222.0.18 "GET /compute/v2.1/servers/fa7c86bc-c46f-4120-8f3d-d795f8d7c5cc" status: 200 len: 1214 microversion: 2.1 time: 0.208771 Dec 15 03:33:12.501158 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: Wed Dec 15 03:33:12 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/fa7c86bc-c46f-4120-8f3d-d795f8d7c5cc (ip 10.222.0.18) !!! Dec 15 03:33:12.501158 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: Wed Dec 15 03:33:12 2021 - uwsgi_response_writev_headers_and_body_do(): Broken pipe [core/writer.c line 306] during GET /compute/v2.1/servers/fa7c86bc-c46f-4120-8f3d-d795f8d7c5cc (10.222.0.18) Dec 15 03:33:12.501734 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: CRITICAL nova [None req-c359be5f-2d10-4012-92f3-f7dd2ac7b760 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Unhandled error: OSError: write error Dec 15 03:33:12.501734 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: ERROR nova OSError: write error Dec 15 03:33:12.501734 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: ERROR nova Dec 15 03:33:12.502031 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: [pid: 116156|app: 0|req: 985/1863] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 03:33:12 2021] GET /compute/v2.1/servers/fa7c86bc-c46f-4120-8f3d-d795f8d7c5cc => generated 0 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 0 bytes (0 switches on core 0) Dec 15 03:33:12.506777 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi [None req-ee5d56c2-f24b-41a0-ac10-78b091c9bc75 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Calling method '>' {{(pid=116156) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:33:12.507846 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.compute.api [None req-ee5d56c2-f24b-41a0-ac10-78b091c9bc75 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] [instance: bbb8462c-9501-4541-b67e-43ec5c5061a7] Fetching instance by UUID {{(pid=116156) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:33:12.517399 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-ee5d56c2-f24b-41a0-ac10-78b091c9bc75 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:33:12.517856 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-ee5d56c2-f24b-41a0-ac10-78b091c9bc75 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:33:12.518669 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-ee5d56c2-f24b-41a0-ac10-78b091c9bc75 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:33:12.519102 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-ee5d56c2-f24b-41a0-ac10-78b091c9bc75 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:33:12.523174 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: INFO nova.compute.api [None req-42dcc758-a9a2-4627-8bd9-483172b688b1 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] [instance: b89094ac-aee1-4bd6-a33d-8c4347cebfc7] Instance is already in deleting state, ignoring this request Dec 15 03:33:12.523993 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: INFO nova.api.openstack.requestlog [None req-42dcc758-a9a2-4627-8bd9-483172b688b1 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] 10.222.0.18 "DELETE /compute/v2.1/servers/b89094ac-aee1-4bd6-a33d-8c4347cebfc7" status: 204 len: 0 microversion: 2.20 time: 0.200948 Dec 15 03:33:12.524517 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: Wed Dec 15 03:33:12 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/b89094ac-aee1-4bd6-a33d-8c4347cebfc7 (ip 10.222.0.18) !!! Dec 15 03:33:12.524517 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: Wed Dec 15 03:33:12 2021 - uwsgi_response_write_headers_do(): Broken pipe [core/writer.c line 248] during DELETE /compute/v2.1/servers/b89094ac-aee1-4bd6-a33d-8c4347cebfc7 (10.222.0.18) Dec 15 03:33:12.525068 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: CRITICAL nova [None req-42dcc758-a9a2-4627-8bd9-483172b688b1 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Unhandled error: OSError: write error Dec 15 03:33:12.525068 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: ERROR nova OSError: write error Dec 15 03:33:12.525068 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: ERROR nova Dec 15 03:33:12.525325 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: [pid: 116157|app: 0|req: 879/1864] 10.222.0.18 () {60 vars in 1279 bytes} [Wed Dec 15 03:33:12 2021] DELETE /compute/v2.1/servers/b89094ac-aee1-4bd6-a33d-8c4347cebfc7 => generated 0 bytes in 203 msecs (HTTP/1.1 204) 9 headers in 0 bytes (0 switches on core 0) Dec 15 03:33:12.529511 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi [None req-eceac48c-9178-47be-b034-888939760646 tempest-AttachVolumeTestJSON-244989543 tempest-AttachVolumeTestJSON-244989543-project] Calling method '>' {{(pid=116157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:33:12.530501 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.compute.api [None req-eceac48c-9178-47be-b034-888939760646 tempest-AttachVolumeTestJSON-244989543 tempest-AttachVolumeTestJSON-244989543-project] [instance: f22dfea6-4599-43e4-93d5-d99f1db3b4fb] Fetching instance by UUID {{(pid=116157) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:33:12.532208 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: INFO nova.api.openstack.wsgi [None req-ee5d56c2-f24b-41a0-ac10-78b091c9bc75 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] HTTP exception thrown: Instance bbb8462c-9501-4541-b67e-43ec5c5061a7 could not be found. Dec 15 03:33:12.532794 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi [None req-ee5d56c2-f24b-41a0-ac10-78b091c9bc75 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Returning 404 to user: Instance bbb8462c-9501-4541-b67e-43ec5c5061a7 could not be found. {{(pid=116156) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 15 03:33:12.533737 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: INFO nova.api.openstack.requestlog [None req-ee5d56c2-f24b-41a0-ac10-78b091c9bc75 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] 10.222.0.18 "GET /compute/v2.1/servers/bbb8462c-9501-4541-b67e-43ec5c5061a7" status: 404 len: 111 microversion: 2.1 time: 0.030920 Dec 15 03:33:12.534434 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: Wed Dec 15 03:33:12 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/bbb8462c-9501-4541-b67e-43ec5c5061a7 (ip 10.222.0.18) !!! Dec 15 03:33:12.534434 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: Wed Dec 15 03:33:12 2021 - uwsgi_response_writev_headers_and_body_do(): Broken pipe [core/writer.c line 306] during GET /compute/v2.1/servers/bbb8462c-9501-4541-b67e-43ec5c5061a7 (10.222.0.18) Dec 15 03:33:12.535117 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: CRITICAL nova [None req-ee5d56c2-f24b-41a0-ac10-78b091c9bc75 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Unhandled error: OSError: write error Dec 15 03:33:12.535117 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: ERROR nova OSError: write error Dec 15 03:33:12.535117 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: ERROR nova Dec 15 03:33:12.535378 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: [pid: 116156|app: 0|req: 986/1865] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 03:33:12 2021] GET /compute/v2.1/servers/bbb8462c-9501-4541-b67e-43ec5c5061a7 => generated 0 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 0 bytes (0 switches on core 0) Dec 15 03:33:12.536631 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-eceac48c-9178-47be-b034-888939760646 tempest-AttachVolumeTestJSON-244989543 tempest-AttachVolumeTestJSON-244989543-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:33:12.537186 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-eceac48c-9178-47be-b034-888939760646 tempest-AttachVolumeTestJSON-244989543 tempest-AttachVolumeTestJSON-244989543-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:33:12.538240 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-eceac48c-9178-47be-b034-888939760646 tempest-AttachVolumeTestJSON-244989543 tempest-AttachVolumeTestJSON-244989543-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:33:12.538797 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-eceac48c-9178-47be-b034-888939760646 tempest-AttachVolumeTestJSON-244989543 tempest-AttachVolumeTestJSON-244989543-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:33:12.540545 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi [None req-d62ea7f3-4bab-4802-be2d-08eaeedec6cf tempest-VolumesSnapshotTestJSON-925980516 tempest-VolumesSnapshotTestJSON-925980516-project] Calling method '>' {{(pid=116156) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:33:12.541208 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.compute.api [None req-d62ea7f3-4bab-4802-be2d-08eaeedec6cf tempest-VolumesSnapshotTestJSON-925980516 tempest-VolumesSnapshotTestJSON-925980516-project] [instance: a0097d88-6613-416a-9f4d-1bb285e53291] Fetching instance by UUID {{(pid=116156) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:33:12.548152 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-d62ea7f3-4bab-4802-be2d-08eaeedec6cf tempest-VolumesSnapshotTestJSON-925980516 tempest-VolumesSnapshotTestJSON-925980516-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:33:12.548607 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-d62ea7f3-4bab-4802-be2d-08eaeedec6cf tempest-VolumesSnapshotTestJSON-925980516 tempest-VolumesSnapshotTestJSON-925980516-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:33:12.549365 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-d62ea7f3-4bab-4802-be2d-08eaeedec6cf tempest-VolumesSnapshotTestJSON-925980516 tempest-VolumesSnapshotTestJSON-925980516-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:33:12.549796 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-d62ea7f3-4bab-4802-be2d-08eaeedec6cf tempest-VolumesSnapshotTestJSON-925980516 tempest-VolumesSnapshotTestJSON-925980516-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:33:12.569319 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: INFO nova.api.openstack.requestlog [None req-eceac48c-9178-47be-b034-888939760646 tempest-AttachVolumeTestJSON-244989543 tempest-AttachVolumeTestJSON-244989543-project] 10.222.0.18 "GET /compute/v2.1/servers/f22dfea6-4599-43e4-93d5-d99f1db3b4fb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043149 Dec 15 03:33:12.569815 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: Wed Dec 15 03:33:12 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/f22dfea6-4599-43e4-93d5-d99f1db3b4fb/os-volume_attachments (ip 10.222.0.18) !!! Dec 15 03:33:12.569815 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: Wed Dec 15 03:33:12 2021 - uwsgi_response_writev_headers_and_body_do(): Broken pipe [core/writer.c line 306] during GET /compute/v2.1/servers/f22dfea6-4599-43e4-93d5-d99f1db3b4fb/os-volume_attachments (10.222.0.18) Dec 15 03:33:12.570418 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: CRITICAL nova [None req-eceac48c-9178-47be-b034-888939760646 tempest-AttachVolumeTestJSON-244989543 tempest-AttachVolumeTestJSON-244989543-project] Unhandled error: OSError: write error Dec 15 03:33:12.570418 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: ERROR nova OSError: write error Dec 15 03:33:12.570418 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: ERROR nova Dec 15 03:33:12.570720 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: [pid: 116157|app: 0|req: 880/1866] 10.222.0.18 () {58 vars in 1301 bytes} [Wed Dec 15 03:33:12 2021] GET /compute/v2.1/servers/f22dfea6-4599-43e4-93d5-d99f1db3b4fb/os-volume_attachments => generated 0 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 0 bytes (0 switches on core 0) Dec 15 03:33:12.574631 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi [None req-f45b25cb-5697-4665-b81b-2a6c9c77fe42 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Calling method '>' {{(pid=116157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:33:12.575218 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.compute.api [None req-f45b25cb-5697-4665-b81b-2a6c9c77fe42 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] [instance: fa7c86bc-c46f-4120-8f3d-d795f8d7c5cc] Fetching instance by UUID {{(pid=116157) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:33:12.580555 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-f45b25cb-5697-4665-b81b-2a6c9c77fe42 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:33:12.580998 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-f45b25cb-5697-4665-b81b-2a6c9c77fe42 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:33:12.581766 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-f45b25cb-5697-4665-b81b-2a6c9c77fe42 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:33:12.582230 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-f45b25cb-5697-4665-b81b-2a6c9c77fe42 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:33:12.641777 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.policy [None req-f45b25cb-5697-4665-b81b-2a6c9c77fe42 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c4c0c82448e40ba801c0b52ec44e74a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a093d0bf43046aaa845f3cc115f3f5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116157) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:33:12.648870 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: INFO nova.api.openstack.requestlog [None req-f45b25cb-5697-4665-b81b-2a6c9c77fe42 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] 10.222.0.18 "GET /compute/v2.1/servers/fa7c86bc-c46f-4120-8f3d-d795f8d7c5cc" status: 200 len: 1214 microversion: 2.1 time: 0.077445 Dec 15 03:33:12.649370 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: Wed Dec 15 03:33:12 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/fa7c86bc-c46f-4120-8f3d-d795f8d7c5cc (ip 10.222.0.18) !!! Dec 15 03:33:12.649473 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: Wed Dec 15 03:33:12 2021 - uwsgi_response_writev_headers_and_body_do(): Broken pipe [core/writer.c line 306] during GET /compute/v2.1/servers/fa7c86bc-c46f-4120-8f3d-d795f8d7c5cc (10.222.0.18) Dec 15 03:33:12.649946 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: CRITICAL nova [None req-f45b25cb-5697-4665-b81b-2a6c9c77fe42 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Unhandled error: OSError: write error Dec 15 03:33:12.649946 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: ERROR nova OSError: write error Dec 15 03:33:12.649946 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: ERROR nova Dec 15 03:33:12.650239 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: [pid: 116157|app: 0|req: 881/1867] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 03:33:12 2021] GET /compute/v2.1/servers/fa7c86bc-c46f-4120-8f3d-d795f8d7c5cc => generated 0 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 0 bytes (0 switches on core 0) Dec 15 03:33:12.654151 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi [None req-75ee54a6-e867-40fe-874e-fdad011313c9 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Calling method '>' {{(pid=116157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:33:12.654637 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.compute.api [None req-75ee54a6-e867-40fe-874e-fdad011313c9 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] [instance: b89094ac-aee1-4bd6-a33d-8c4347cebfc7] Fetching instance by UUID {{(pid=116157) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:33:12.660232 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-75ee54a6-e867-40fe-874e-fdad011313c9 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:33:12.660675 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-75ee54a6-e867-40fe-874e-fdad011313c9 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:33:12.661438 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-75ee54a6-e867-40fe-874e-fdad011313c9 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:33:12.661871 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-75ee54a6-e867-40fe-874e-fdad011313c9 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:33:12.684964 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.compute.api [None req-75ee54a6-e867-40fe-874e-fdad011313c9 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] [instance: b89094ac-aee1-4bd6-a33d-8c4347cebfc7] Going to try to terminate instance {{(pid=116157) delete /opt/stack/nova/nova/compute/api.py:2614}} Dec 15 03:33:12.726259 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: INFO nova.compute.api [None req-75ee54a6-e867-40fe-874e-fdad011313c9 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] [instance: b89094ac-aee1-4bd6-a33d-8c4347cebfc7] Instance is already in deleting state, ignoring this request Dec 15 03:33:12.727764 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: INFO nova.api.openstack.requestlog [None req-75ee54a6-e867-40fe-874e-fdad011313c9 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] 10.222.0.18 "DELETE /compute/v2.1/servers/b89094ac-aee1-4bd6-a33d-8c4347cebfc7" status: 204 len: 0 microversion: 2.20 time: 0.076751 Dec 15 03:33:12.728302 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: Wed Dec 15 03:33:12 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/b89094ac-aee1-4bd6-a33d-8c4347cebfc7 (ip 10.222.0.18) !!! Dec 15 03:33:12.728302 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: Wed Dec 15 03:33:12 2021 - uwsgi_response_write_headers_do(): Broken pipe [core/writer.c line 248] during DELETE /compute/v2.1/servers/b89094ac-aee1-4bd6-a33d-8c4347cebfc7 (10.222.0.18) Dec 15 03:33:12.728886 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: CRITICAL nova [None req-75ee54a6-e867-40fe-874e-fdad011313c9 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Unhandled error: OSError: write error Dec 15 03:33:12.728886 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: ERROR nova OSError: write error Dec 15 03:33:12.728886 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: ERROR nova Dec 15 03:33:12.729155 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: [pid: 116157|app: 0|req: 882/1868] 10.222.0.18 () {60 vars in 1279 bytes} [Wed Dec 15 03:33:12 2021] DELETE /compute/v2.1/servers/b89094ac-aee1-4bd6-a33d-8c4347cebfc7 => generated 0 bytes in 78 msecs (HTTP/1.1 204) 9 headers in 0 bytes (0 switches on core 0) Dec 15 03:33:12.733691 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi [None req-a8232e45-84ad-427d-85e4-204a1d401739 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Calling method '>' {{(pid=116157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:33:12.734353 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.compute.api [None req-a8232e45-84ad-427d-85e4-204a1d401739 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] [instance: bbb8462c-9501-4541-b67e-43ec5c5061a7] Fetching instance by UUID {{(pid=116157) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:33:12.739780 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-a8232e45-84ad-427d-85e4-204a1d401739 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:33:12.740225 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-a8232e45-84ad-427d-85e4-204a1d401739 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:33:12.741003 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-a8232e45-84ad-427d-85e4-204a1d401739 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:33:12.741426 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-a8232e45-84ad-427d-85e4-204a1d401739 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:33:12.754863 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: INFO nova.api.openstack.wsgi [None req-a8232e45-84ad-427d-85e4-204a1d401739 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] HTTP exception thrown: Instance bbb8462c-9501-4541-b67e-43ec5c5061a7 could not be found. Dec 15 03:33:12.755434 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi [None req-a8232e45-84ad-427d-85e4-204a1d401739 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Returning 404 to user: Instance bbb8462c-9501-4541-b67e-43ec5c5061a7 could not be found. {{(pid=116157) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 15 03:33:12.756237 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: INFO nova.api.openstack.requestlog [None req-a8232e45-84ad-427d-85e4-204a1d401739 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] 10.222.0.18 "GET /compute/v2.1/servers/bbb8462c-9501-4541-b67e-43ec5c5061a7" status: 404 len: 111 microversion: 2.1 time: 0.026367 Dec 15 03:33:12.756704 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: Wed Dec 15 03:33:12 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/bbb8462c-9501-4541-b67e-43ec5c5061a7 (ip 10.222.0.18) !!! Dec 15 03:33:12.756704 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: Wed Dec 15 03:33:12 2021 - uwsgi_response_writev_headers_and_body_do(): Broken pipe [core/writer.c line 306] during GET /compute/v2.1/servers/bbb8462c-9501-4541-b67e-43ec5c5061a7 (10.222.0.18) Dec 15 03:33:12.757251 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: CRITICAL nova [None req-a8232e45-84ad-427d-85e4-204a1d401739 tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Unhandled error: OSError: write error Dec 15 03:33:12.757251 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: ERROR nova OSError: write error Dec 15 03:33:12.757251 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: ERROR nova Dec 15 03:33:12.757508 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: [pid: 116157|app: 0|req: 883/1869] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 03:33:12 2021] GET /compute/v2.1/servers/bbb8462c-9501-4541-b67e-43ec5c5061a7 => generated 0 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 0 bytes (0 switches on core 0) Dec 15 03:33:12.761420 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi [None req-b94d7176-4973-496d-9a65-333c1f6bec43 tempest-AttachVolumeTestJSON-244989543 tempest-AttachVolumeTestJSON-244989543-project] Calling method '>' {{(pid=116157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:33:12.762321 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.compute.api [None req-b94d7176-4973-496d-9a65-333c1f6bec43 tempest-AttachVolumeTestJSON-244989543 tempest-AttachVolumeTestJSON-244989543-project] [instance: f22dfea6-4599-43e4-93d5-d99f1db3b4fb] Fetching instance by UUID {{(pid=116157) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:33:12.767397 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-b94d7176-4973-496d-9a65-333c1f6bec43 tempest-AttachVolumeTestJSON-244989543 tempest-AttachVolumeTestJSON-244989543-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:33:12.767850 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-b94d7176-4973-496d-9a65-333c1f6bec43 tempest-AttachVolumeTestJSON-244989543 tempest-AttachVolumeTestJSON-244989543-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:33:12.768601 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-b94d7176-4973-496d-9a65-333c1f6bec43 tempest-AttachVolumeTestJSON-244989543 tempest-AttachVolumeTestJSON-244989543-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:33:12.769028 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-b94d7176-4973-496d-9a65-333c1f6bec43 tempest-AttachVolumeTestJSON-244989543 tempest-AttachVolumeTestJSON-244989543-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:33:12.797966 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: INFO nova.api.openstack.requestlog [None req-b94d7176-4973-496d-9a65-333c1f6bec43 tempest-AttachVolumeTestJSON-244989543 tempest-AttachVolumeTestJSON-244989543-project] 10.222.0.18 "GET /compute/v2.1/servers/f22dfea6-4599-43e4-93d5-d99f1db3b4fb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.039701 Dec 15 03:33:12.798472 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: Wed Dec 15 03:33:12 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/f22dfea6-4599-43e4-93d5-d99f1db3b4fb/os-volume_attachments (ip 10.222.0.18) !!! Dec 15 03:33:12.798472 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: Wed Dec 15 03:33:12 2021 - uwsgi_response_writev_headers_and_body_do(): Broken pipe [core/writer.c line 306] during GET /compute/v2.1/servers/f22dfea6-4599-43e4-93d5-d99f1db3b4fb/os-volume_attachments (10.222.0.18) Dec 15 03:33:12.799037 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: CRITICAL nova [None req-b94d7176-4973-496d-9a65-333c1f6bec43 tempest-AttachVolumeTestJSON-244989543 tempest-AttachVolumeTestJSON-244989543-project] Unhandled error: OSError: write error Dec 15 03:33:12.799037 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: ERROR nova OSError: write error Dec 15 03:33:12.799037 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: ERROR nova Dec 15 03:33:12.799298 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: [pid: 116157|app: 0|req: 884/1870] 10.222.0.18 () {58 vars in 1301 bytes} [Wed Dec 15 03:33:12 2021] GET /compute/v2.1/servers/f22dfea6-4599-43e4-93d5-d99f1db3b4fb/os-volume_attachments => generated 0 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 0 bytes (0 switches on core 0) Dec 15 03:33:12.803025 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi [None req-1e231e9b-a097-4f4f-b145-934d28e8b6dc tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Calling method '>' {{(pid=116157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:33:12.803613 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.compute.api [None req-1e231e9b-a097-4f4f-b145-934d28e8b6dc tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] [instance: fa7c86bc-c46f-4120-8f3d-d795f8d7c5cc] Fetching instance by UUID {{(pid=116157) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:33:12.808642 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-1e231e9b-a097-4f4f-b145-934d28e8b6dc tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:33:12.809084 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-1e231e9b-a097-4f4f-b145-934d28e8b6dc tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:33:12.809842 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-1e231e9b-a097-4f4f-b145-934d28e8b6dc tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:33:12.810297 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-1e231e9b-a097-4f4f-b145-934d28e8b6dc tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:33:12.870418 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.policy [None req-1e231e9b-a097-4f4f-b145-934d28e8b6dc tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c4c0c82448e40ba801c0b52ec44e74a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a093d0bf43046aaa845f3cc115f3f5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116157) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:33:12.877499 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: INFO nova.api.openstack.requestlog [None req-1e231e9b-a097-4f4f-b145-934d28e8b6dc tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] 10.222.0.18 "GET /compute/v2.1/servers/fa7c86bc-c46f-4120-8f3d-d795f8d7c5cc" status: 200 len: 1214 microversion: 2.1 time: 0.077480 Dec 15 03:33:12.878020 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: Wed Dec 15 03:33:12 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/fa7c86bc-c46f-4120-8f3d-d795f8d7c5cc (ip 10.222.0.18) !!! Dec 15 03:33:12.878020 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: Wed Dec 15 03:33:12 2021 - uwsgi_response_writev_headers_and_body_do(): Broken pipe [core/writer.c line 306] during GET /compute/v2.1/servers/fa7c86bc-c46f-4120-8f3d-d795f8d7c5cc (10.222.0.18) Dec 15 03:33:12.878596 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: CRITICAL nova [None req-1e231e9b-a097-4f4f-b145-934d28e8b6dc tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Unhandled error: OSError: write error Dec 15 03:33:12.878596 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: ERROR nova OSError: write error Dec 15 03:33:12.878596 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: ERROR nova Dec 15 03:33:12.878895 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: [pid: 116157|app: 0|req: 885/1871] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 03:33:12 2021] GET /compute/v2.1/servers/fa7c86bc-c46f-4120-8f3d-d795f8d7c5cc => generated 0 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 0 bytes (0 switches on core 0) Dec 15 03:33:12.882757 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi [None req-3af8a32a-bfe2-4733-8829-837847f59d95 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Calling method '>' {{(pid=116157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:33:12.883243 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.compute.api [None req-3af8a32a-bfe2-4733-8829-837847f59d95 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] [instance: b89094ac-aee1-4bd6-a33d-8c4347cebfc7] Fetching instance by UUID {{(pid=116157) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:33:12.888386 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-3af8a32a-bfe2-4733-8829-837847f59d95 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:33:12.888834 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-3af8a32a-bfe2-4733-8829-837847f59d95 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:33:12.889624 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-3af8a32a-bfe2-4733-8829-837847f59d95 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:33:12.890087 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-3af8a32a-bfe2-4733-8829-837847f59d95 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:33:12.913370 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.compute.api [None req-3af8a32a-bfe2-4733-8829-837847f59d95 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] [instance: b89094ac-aee1-4bd6-a33d-8c4347cebfc7] Going to try to terminate instance {{(pid=116157) delete /opt/stack/nova/nova/compute/api.py:2614}} Dec 15 03:33:12.955044 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: INFO nova.compute.api [None req-3af8a32a-bfe2-4733-8829-837847f59d95 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] [instance: b89094ac-aee1-4bd6-a33d-8c4347cebfc7] Instance is already in deleting state, ignoring this request Dec 15 03:33:12.955838 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: INFO nova.api.openstack.requestlog [None req-3af8a32a-bfe2-4733-8829-837847f59d95 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] 10.222.0.18 "DELETE /compute/v2.1/servers/b89094ac-aee1-4bd6-a33d-8c4347cebfc7" status: 204 len: 0 microversion: 2.20 time: 0.076256 Dec 15 03:33:12.956330 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: Wed Dec 15 03:33:12 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/b89094ac-aee1-4bd6-a33d-8c4347cebfc7 (ip 10.222.0.18) !!! Dec 15 03:33:12.956330 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: Wed Dec 15 03:33:12 2021 - uwsgi_response_write_headers_do(): Broken pipe [core/writer.c line 248] during DELETE /compute/v2.1/servers/b89094ac-aee1-4bd6-a33d-8c4347cebfc7 (10.222.0.18) Dec 15 03:33:12.956894 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: CRITICAL nova [None req-3af8a32a-bfe2-4733-8829-837847f59d95 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Unhandled error: OSError: write error Dec 15 03:33:12.956894 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: ERROR nova OSError: write error Dec 15 03:33:12.956894 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: ERROR nova Dec 15 03:33:12.957156 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: [pid: 116157|app: 0|req: 886/1872] 10.222.0.18 () {60 vars in 1279 bytes} [Wed Dec 15 03:33:12 2021] DELETE /compute/v2.1/servers/b89094ac-aee1-4bd6-a33d-8c4347cebfc7 => generated 0 bytes in 78 msecs (HTTP/1.1 204) 9 headers in 0 bytes (0 switches on core 0) Dec 15 03:33:12.961062 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi [None req-3116ff4e-8a15-40f7-ae24-61082cb7228e tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Calling method '>' {{(pid=116157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:33:12.961653 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.compute.api [None req-3116ff4e-8a15-40f7-ae24-61082cb7228e tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] [instance: bbb8462c-9501-4541-b67e-43ec5c5061a7] Fetching instance by UUID {{(pid=116157) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:33:12.966756 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-3116ff4e-8a15-40f7-ae24-61082cb7228e tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:33:12.967202 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-3116ff4e-8a15-40f7-ae24-61082cb7228e tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:33:12.968478 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-3116ff4e-8a15-40f7-ae24-61082cb7228e tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:33:12.968912 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-3116ff4e-8a15-40f7-ae24-61082cb7228e tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:33:12.982090 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: INFO nova.api.openstack.wsgi [None req-3116ff4e-8a15-40f7-ae24-61082cb7228e tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] HTTP exception thrown: Instance bbb8462c-9501-4541-b67e-43ec5c5061a7 could not be found. Dec 15 03:33:12.982618 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi [None req-3116ff4e-8a15-40f7-ae24-61082cb7228e tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Returning 404 to user: Instance bbb8462c-9501-4541-b67e-43ec5c5061a7 could not be found. {{(pid=116157) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 15 03:33:12.983453 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: INFO nova.api.openstack.requestlog [None req-3116ff4e-8a15-40f7-ae24-61082cb7228e tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] 10.222.0.18 "GET /compute/v2.1/servers/bbb8462c-9501-4541-b67e-43ec5c5061a7" status: 404 len: 111 microversion: 2.1 time: 0.025584 Dec 15 03:33:12.983916 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: Wed Dec 15 03:33:12 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/bbb8462c-9501-4541-b67e-43ec5c5061a7 (ip 10.222.0.18) !!! Dec 15 03:33:12.983916 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: Wed Dec 15 03:33:12 2021 - uwsgi_response_writev_headers_and_body_do(): Broken pipe [core/writer.c line 306] during GET /compute/v2.1/servers/bbb8462c-9501-4541-b67e-43ec5c5061a7 (10.222.0.18) Dec 15 03:33:12.984480 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: CRITICAL nova [None req-3116ff4e-8a15-40f7-ae24-61082cb7228e tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Unhandled error: OSError: write error Dec 15 03:33:12.984480 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: ERROR nova OSError: write error Dec 15 03:33:12.984480 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: ERROR nova Dec 15 03:33:12.984762 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: [pid: 116157|app: 0|req: 887/1873] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 03:33:12 2021] GET /compute/v2.1/servers/bbb8462c-9501-4541-b67e-43ec5c5061a7 => generated 0 bytes in 27 msecs (HTTP/1.1 404) 9 headers in 0 bytes (0 switches on core 0) Dec 15 03:33:12.989443 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi [None req-fe6098ae-e66b-431c-ba04-4869ecb81d4b tempest-AttachVolumeTestJSON-244989543 tempest-AttachVolumeTestJSON-244989543-project] Calling method '>' {{(pid=116157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:33:12.990378 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.compute.api [None req-fe6098ae-e66b-431c-ba04-4869ecb81d4b tempest-AttachVolumeTestJSON-244989543 tempest-AttachVolumeTestJSON-244989543-project] [instance: f22dfea6-4599-43e4-93d5-d99f1db3b4fb] Fetching instance by UUID {{(pid=116157) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:33:12.996009 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-fe6098ae-e66b-431c-ba04-4869ecb81d4b tempest-AttachVolumeTestJSON-244989543 tempest-AttachVolumeTestJSON-244989543-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:33:12.996462 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-fe6098ae-e66b-431c-ba04-4869ecb81d4b tempest-AttachVolumeTestJSON-244989543 tempest-AttachVolumeTestJSON-244989543-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:33:12.997269 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-fe6098ae-e66b-431c-ba04-4869ecb81d4b tempest-AttachVolumeTestJSON-244989543 tempest-AttachVolumeTestJSON-244989543-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:33:12.997704 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-fe6098ae-e66b-431c-ba04-4869ecb81d4b tempest-AttachVolumeTestJSON-244989543 tempest-AttachVolumeTestJSON-244989543-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:33:13.024983 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: INFO nova.api.openstack.requestlog [None req-fe6098ae-e66b-431c-ba04-4869ecb81d4b tempest-AttachVolumeTestJSON-244989543 tempest-AttachVolumeTestJSON-244989543-project] 10.222.0.18 "GET /compute/v2.1/servers/f22dfea6-4599-43e4-93d5-d99f1db3b4fb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.038943 Dec 15 03:33:13.025475 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: Wed Dec 15 03:33:13 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/f22dfea6-4599-43e4-93d5-d99f1db3b4fb/os-volume_attachments (ip 10.222.0.18) !!! Dec 15 03:33:13.025475 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: Wed Dec 15 03:33:13 2021 - uwsgi_response_writev_headers_and_body_do(): Broken pipe [core/writer.c line 306] during GET /compute/v2.1/servers/f22dfea6-4599-43e4-93d5-d99f1db3b4fb/os-volume_attachments (10.222.0.18) Dec 15 03:33:13.026073 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: CRITICAL nova [None req-fe6098ae-e66b-431c-ba04-4869ecb81d4b tempest-AttachVolumeTestJSON-244989543 tempest-AttachVolumeTestJSON-244989543-project] Unhandled error: OSError: write error Dec 15 03:33:13.026073 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: ERROR nova OSError: write error Dec 15 03:33:13.026073 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: ERROR nova Dec 15 03:33:13.026346 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: [pid: 116157|app: 0|req: 888/1874] 10.222.0.18 () {58 vars in 1301 bytes} [Wed Dec 15 03:33:12 2021] GET /compute/v2.1/servers/f22dfea6-4599-43e4-93d5-d99f1db3b4fb/os-volume_attachments => generated 0 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 0 bytes (0 switches on core 0) Dec 15 03:33:13.030671 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi [None req-f80cf9e0-4af8-4227-a2dd-05aa7d4c46c4 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Calling method '>' {{(pid=116157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:33:13.031151 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.compute.api [None req-f80cf9e0-4af8-4227-a2dd-05aa7d4c46c4 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] [instance: b89094ac-aee1-4bd6-a33d-8c4347cebfc7] Fetching instance by UUID {{(pid=116157) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:33:13.036245 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-f80cf9e0-4af8-4227-a2dd-05aa7d4c46c4 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:33:13.036700 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-f80cf9e0-4af8-4227-a2dd-05aa7d4c46c4 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:33:13.037471 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-f80cf9e0-4af8-4227-a2dd-05aa7d4c46c4 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:33:13.037910 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-f80cf9e0-4af8-4227-a2dd-05aa7d4c46c4 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:33:13.061022 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.compute.api [None req-f80cf9e0-4af8-4227-a2dd-05aa7d4c46c4 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] [instance: b89094ac-aee1-4bd6-a33d-8c4347cebfc7] Going to try to terminate instance {{(pid=116157) delete /opt/stack/nova/nova/compute/api.py:2614}} Dec 15 03:33:13.102936 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: INFO nova.compute.api [None req-f80cf9e0-4af8-4227-a2dd-05aa7d4c46c4 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] [instance: b89094ac-aee1-4bd6-a33d-8c4347cebfc7] Instance is already in deleting state, ignoring this request Dec 15 03:33:13.103734 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: INFO nova.api.openstack.requestlog [None req-f80cf9e0-4af8-4227-a2dd-05aa7d4c46c4 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] 10.222.0.18 "DELETE /compute/v2.1/servers/b89094ac-aee1-4bd6-a33d-8c4347cebfc7" status: 204 len: 0 microversion: 2.20 time: 0.076680 Dec 15 03:33:13.104232 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: Wed Dec 15 03:33:13 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/b89094ac-aee1-4bd6-a33d-8c4347cebfc7 (ip 10.222.0.18) !!! Dec 15 03:33:13.104232 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: Wed Dec 15 03:33:13 2021 - uwsgi_response_write_headers_do(): Broken pipe [core/writer.c line 248] during DELETE /compute/v2.1/servers/b89094ac-aee1-4bd6-a33d-8c4347cebfc7 (10.222.0.18) Dec 15 03:33:13.104808 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: CRITICAL nova [None req-f80cf9e0-4af8-4227-a2dd-05aa7d4c46c4 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Unhandled error: OSError: write error Dec 15 03:33:13.104808 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: ERROR nova OSError: write error Dec 15 03:33:13.104808 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: ERROR nova Dec 15 03:33:13.105075 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: [pid: 116157|app: 0|req: 889/1875] 10.222.0.18 () {60 vars in 1279 bytes} [Wed Dec 15 03:33:13 2021] DELETE /compute/v2.1/servers/b89094ac-aee1-4bd6-a33d-8c4347cebfc7 => generated 0 bytes in 78 msecs (HTTP/1.1 204) 9 headers in 0 bytes (0 switches on core 0) Dec 15 03:33:13.109043 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi [None req-5a7e51b9-2ee5-4066-8350-e65b5965bbed tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Calling method '.version_select at 0x7f1269a693a0>' {{(pid=116157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:33:13.129275 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: INFO nova.api.openstack.requestlog [None req-5a7e51b9-2ee5-4066-8350-e65b5965bbed tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] 10.222.0.18 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1219174885" status: 202 len: 0 microversion: 2.1 time: 0.023284 Dec 15 03:33:13.129610 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: Wed Dec 15 03:33:13 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1219174885 (ip 10.222.0.18) !!! Dec 15 03:33:13.129610 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: Wed Dec 15 03:33:13 2021 - uwsgi_response_write_headers_do(): Broken pipe [core/writer.c line 248] during DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1219174885 (10.222.0.18) Dec 15 03:33:13.130203 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: CRITICAL nova [None req-5a7e51b9-2ee5-4066-8350-e65b5965bbed tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Unhandled error: OSError: write error Dec 15 03:33:13.130203 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: ERROR nova OSError: write error Dec 15 03:33:13.130203 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: ERROR nova Dec 15 03:33:13.130500 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: [pid: 116157|app: 0|req: 890/1876] 10.222.0.18 () {58 vars in 1253 bytes} [Wed Dec 15 03:33:13 2021] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1219174885 => generated 0 bytes in 25 msecs (HTTP/1.1 202) 9 headers in 0 bytes (0 switches on core 0) Dec 15 03:33:13.141639 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi [None req-4d36cf77-c63c-4753-aa8e-52d75bdbfb52 tempest-AttachVolumeTestJSON-244989543 tempest-AttachVolumeTestJSON-244989543-project] Calling method '>' {{(pid=116157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:33:13.141639 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.compute.api [None req-4d36cf77-c63c-4753-aa8e-52d75bdbfb52 tempest-AttachVolumeTestJSON-244989543 tempest-AttachVolumeTestJSON-244989543-project] [instance: f22dfea6-4599-43e4-93d5-d99f1db3b4fb] Fetching instance by UUID {{(pid=116157) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:33:13.142944 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-4d36cf77-c63c-4753-aa8e-52d75bdbfb52 tempest-AttachVolumeTestJSON-244989543 tempest-AttachVolumeTestJSON-244989543-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:33:13.143408 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-4d36cf77-c63c-4753-aa8e-52d75bdbfb52 tempest-AttachVolumeTestJSON-244989543 tempest-AttachVolumeTestJSON-244989543-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:33:13.144196 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-4d36cf77-c63c-4753-aa8e-52d75bdbfb52 tempest-AttachVolumeTestJSON-244989543 tempest-AttachVolumeTestJSON-244989543-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:33:13.144631 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-4d36cf77-c63c-4753-aa8e-52d75bdbfb52 tempest-AttachVolumeTestJSON-244989543 tempest-AttachVolumeTestJSON-244989543-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:33:13.172897 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: INFO nova.api.openstack.requestlog [None req-4d36cf77-c63c-4753-aa8e-52d75bdbfb52 tempest-AttachVolumeTestJSON-244989543 tempest-AttachVolumeTestJSON-244989543-project] 10.222.0.18 "GET /compute/v2.1/servers/f22dfea6-4599-43e4-93d5-d99f1db3b4fb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041652 Dec 15 03:33:13.173402 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: Wed Dec 15 03:33:13 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/f22dfea6-4599-43e4-93d5-d99f1db3b4fb/os-volume_attachments (ip 10.222.0.18) !!! Dec 15 03:33:13.173402 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: Wed Dec 15 03:33:13 2021 - uwsgi_response_writev_headers_and_body_do(): Broken pipe [core/writer.c line 306] during GET /compute/v2.1/servers/f22dfea6-4599-43e4-93d5-d99f1db3b4fb/os-volume_attachments (10.222.0.18) Dec 15 03:33:13.173996 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: CRITICAL nova [None req-4d36cf77-c63c-4753-aa8e-52d75bdbfb52 tempest-AttachVolumeTestJSON-244989543 tempest-AttachVolumeTestJSON-244989543-project] Unhandled error: OSError: write error Dec 15 03:33:13.173996 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: ERROR nova OSError: write error Dec 15 03:33:13.173996 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: ERROR nova Dec 15 03:33:13.174288 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: [pid: 116157|app: 0|req: 891/1877] 10.222.0.18 () {58 vars in 1301 bytes} [Wed Dec 15 03:33:13 2021] GET /compute/v2.1/servers/f22dfea6-4599-43e4-93d5-d99f1db3b4fb/os-volume_attachments => generated 0 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 0 bytes (0 switches on core 0) Dec 15 03:33:13.178214 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi [None req-dc51b0dd-a335-4bd2-99ce-43538fab416a tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Calling method '>' {{(pid=116157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:33:13.178707 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.compute.api [None req-dc51b0dd-a335-4bd2-99ce-43538fab416a tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] [instance: b89094ac-aee1-4bd6-a33d-8c4347cebfc7] Fetching instance by UUID {{(pid=116157) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:33:13.183930 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-dc51b0dd-a335-4bd2-99ce-43538fab416a tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:33:13.184380 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-dc51b0dd-a335-4bd2-99ce-43538fab416a tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:33:13.185154 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-dc51b0dd-a335-4bd2-99ce-43538fab416a tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:33:13.185589 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-dc51b0dd-a335-4bd2-99ce-43538fab416a tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:33:13.210759 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.compute.api [None req-dc51b0dd-a335-4bd2-99ce-43538fab416a tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] [instance: b89094ac-aee1-4bd6-a33d-8c4347cebfc7] Going to try to terminate instance {{(pid=116157) delete /opt/stack/nova/nova/compute/api.py:2614}} Dec 15 03:33:13.254812 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: INFO nova.compute.api [None req-dc51b0dd-a335-4bd2-99ce-43538fab416a tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] [instance: b89094ac-aee1-4bd6-a33d-8c4347cebfc7] Instance is already in deleting state, ignoring this request Dec 15 03:33:13.255635 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: INFO nova.api.openstack.requestlog [None req-dc51b0dd-a335-4bd2-99ce-43538fab416a tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] 10.222.0.18 "DELETE /compute/v2.1/servers/b89094ac-aee1-4bd6-a33d-8c4347cebfc7" status: 204 len: 0 microversion: 2.20 time: 0.080647 Dec 15 03:33:13.256128 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: Wed Dec 15 03:33:13 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/b89094ac-aee1-4bd6-a33d-8c4347cebfc7 (ip 10.222.0.18) !!! Dec 15 03:33:13.256128 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: Wed Dec 15 03:33:13 2021 - uwsgi_response_write_headers_do(): Broken pipe [core/writer.c line 248] during DELETE /compute/v2.1/servers/b89094ac-aee1-4bd6-a33d-8c4347cebfc7 (10.222.0.18) Dec 15 03:33:13.256768 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: CRITICAL nova [None req-dc51b0dd-a335-4bd2-99ce-43538fab416a tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Unhandled error: OSError: write error Dec 15 03:33:13.256768 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: ERROR nova OSError: write error Dec 15 03:33:13.256768 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: ERROR nova Dec 15 03:33:13.257003 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: [pid: 116157|app: 0|req: 892/1878] 10.222.0.18 () {60 vars in 1279 bytes} [Wed Dec 15 03:33:13 2021] DELETE /compute/v2.1/servers/b89094ac-aee1-4bd6-a33d-8c4347cebfc7 => generated 0 bytes in 82 msecs (HTTP/1.1 204) 9 headers in 0 bytes (0 switches on core 0) Dec 15 03:33:13.261018 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi [None req-538e8682-bc61-481b-9fca-bfc0617a724f tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Calling method '.version_select at 0x7f126a3c3310>' {{(pid=116157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:33:13.275701 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: INFO nova.api.openstack.wsgi [None req-538e8682-bc61-481b-9fca-bfc0617a724f tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] HTTP exception thrown: Keypair tempest-TestShelveInstance-1219174885 not found for user 6c4c0c82448e40ba801c0b52ec44e74a Dec 15 03:33:13.276284 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi [None req-538e8682-bc61-481b-9fca-bfc0617a724f tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Returning 404 to user: Keypair tempest-TestShelveInstance-1219174885 not found for user 6c4c0c82448e40ba801c0b52ec44e74a {{(pid=116157) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 15 03:33:13.277097 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: INFO nova.api.openstack.requestlog [None req-538e8682-bc61-481b-9fca-bfc0617a724f tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] 10.222.0.18 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1219174885" status: 404 len: 143 microversion: 2.1 time: 0.019429 Dec 15 03:33:13.277548 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: Wed Dec 15 03:33:13 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1219174885 (ip 10.222.0.18) !!! Dec 15 03:33:13.277548 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: Wed Dec 15 03:33:13 2021 - uwsgi_response_writev_headers_and_body_do(): Broken pipe [core/writer.c line 306] during DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1219174885 (10.222.0.18) Dec 15 03:33:13.278205 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: CRITICAL nova [None req-538e8682-bc61-481b-9fca-bfc0617a724f tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Unhandled error: OSError: write error Dec 15 03:33:13.278205 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: ERROR nova OSError: write error Dec 15 03:33:13.278205 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: ERROR nova Dec 15 03:33:13.278491 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: [pid: 116157|app: 0|req: 893/1879] 10.222.0.18 () {58 vars in 1253 bytes} [Wed Dec 15 03:33:13 2021] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1219174885 => generated 0 bytes in 21 msecs (HTTP/1.1 404) 9 headers in 0 bytes (0 switches on core 0) Dec 15 03:33:13.282564 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi [None req-9ea4150b-e1fa-4a46-be2c-b9b5bed4b91f tempest-AttachVolumeTestJSON-244989543 tempest-AttachVolumeTestJSON-244989543-project] Calling method '>' {{(pid=116157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:33:13.283445 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.compute.api [None req-9ea4150b-e1fa-4a46-be2c-b9b5bed4b91f tempest-AttachVolumeTestJSON-244989543 tempest-AttachVolumeTestJSON-244989543-project] [instance: f22dfea6-4599-43e4-93d5-d99f1db3b4fb] Fetching instance by UUID {{(pid=116157) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:33:13.291092 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-9ea4150b-e1fa-4a46-be2c-b9b5bed4b91f tempest-AttachVolumeTestJSON-244989543 tempest-AttachVolumeTestJSON-244989543-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:33:13.291540 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-9ea4150b-e1fa-4a46-be2c-b9b5bed4b91f tempest-AttachVolumeTestJSON-244989543 tempest-AttachVolumeTestJSON-244989543-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:33:13.292311 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-9ea4150b-e1fa-4a46-be2c-b9b5bed4b91f tempest-AttachVolumeTestJSON-244989543 tempest-AttachVolumeTestJSON-244989543-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:33:13.292747 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-9ea4150b-e1fa-4a46-be2c-b9b5bed4b91f tempest-AttachVolumeTestJSON-244989543 tempest-AttachVolumeTestJSON-244989543-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:33:13.320859 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: INFO nova.api.openstack.requestlog [None req-9ea4150b-e1fa-4a46-be2c-b9b5bed4b91f tempest-AttachVolumeTestJSON-244989543 tempest-AttachVolumeTestJSON-244989543-project] 10.222.0.18 "GET /compute/v2.1/servers/f22dfea6-4599-43e4-93d5-d99f1db3b4fb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041637 Dec 15 03:33:13.321496 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: Wed Dec 15 03:33:13 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/f22dfea6-4599-43e4-93d5-d99f1db3b4fb/os-volume_attachments (ip 10.222.0.18) !!! Dec 15 03:33:13.321496 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: Wed Dec 15 03:33:13 2021 - uwsgi_response_writev_headers_and_body_do(): Broken pipe [core/writer.c line 306] during GET /compute/v2.1/servers/f22dfea6-4599-43e4-93d5-d99f1db3b4fb/os-volume_attachments (10.222.0.18) Dec 15 03:33:13.321926 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: CRITICAL nova [None req-9ea4150b-e1fa-4a46-be2c-b9b5bed4b91f tempest-AttachVolumeTestJSON-244989543 tempest-AttachVolumeTestJSON-244989543-project] Unhandled error: OSError: write error Dec 15 03:33:13.321926 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: ERROR nova OSError: write error Dec 15 03:33:13.321926 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: ERROR nova Dec 15 03:33:13.322212 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: [pid: 116157|app: 0|req: 894/1880] 10.222.0.18 () {58 vars in 1301 bytes} [Wed Dec 15 03:33:13 2021] GET /compute/v2.1/servers/f22dfea6-4599-43e4-93d5-d99f1db3b4fb/os-volume_attachments => generated 0 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 0 bytes (0 switches on core 0) Dec 15 03:33:13.326054 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi [req-7416bdf4-d7b0-4efa-8576-75b915233f75 req-5f7425ce-e28e-4435-aa8b-e66390bb0ba4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b89094ac-aee1-4bd6-a33d-8c4347cebfc7", "name": "network-vif-deleted", "tag": "455e429c-96fb-4858-b8fe-cf282ae96b72"}]} {{(pid=116157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 03:33:13.327502 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 15 03:33:13.327502 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: warnings.warn(msg) Dec 15 03:33:13.333436 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [req-7416bdf4-d7b0-4efa-8576-75b915233f75 req-5f7425ce-e28e-4435-aa8b-e66390bb0ba4 service nova] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:33:13.333877 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [req-7416bdf4-d7b0-4efa-8576-75b915233f75 req-5f7425ce-e28e-4435-aa8b-e66390bb0ba4 service nova] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:33:13.344005 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: INFO nova.api.openstack.compute.server_external_events [req-7416bdf4-d7b0-4efa-8576-75b915233f75 req-5f7425ce-e28e-4435-aa8b-e66390bb0ba4 service nova] Creating event network-vif-deleted:455e429c-96fb-4858-b8fe-cf282ae96b72 for instance b89094ac-aee1-4bd6-a33d-8c4347cebfc7 on hv-cinder-81803 Dec 15 03:33:13.349969 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: INFO nova.api.openstack.requestlog [req-7416bdf4-d7b0-4efa-8576-75b915233f75 req-5f7425ce-e28e-4435-aa8b-e66390bb0ba4 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.026823 Dec 15 03:33:13.350544 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: [pid: 116157|app: 0|req: 895/1881] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Dec 15 03:33:13 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 03:33:13.355206 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi [None req-92a149e3-2312-4570-805b-d5e5e2b73685 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Calling method '>' {{(pid=116157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:33:13.355780 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.compute.api [None req-92a149e3-2312-4570-805b-d5e5e2b73685 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] [instance: b89094ac-aee1-4bd6-a33d-8c4347cebfc7] Fetching instance by UUID {{(pid=116157) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:33:13.361715 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-92a149e3-2312-4570-805b-d5e5e2b73685 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:33:13.362216 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-92a149e3-2312-4570-805b-d5e5e2b73685 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:33:13.362966 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-92a149e3-2312-4570-805b-d5e5e2b73685 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:33:13.363396 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-92a149e3-2312-4570-805b-d5e5e2b73685 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:33:13.386881 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.compute.api [None req-92a149e3-2312-4570-805b-d5e5e2b73685 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] [instance: b89094ac-aee1-4bd6-a33d-8c4347cebfc7] Going to try to terminate instance {{(pid=116157) delete /opt/stack/nova/nova/compute/api.py:2614}} Dec 15 03:33:13.427969 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: INFO nova.compute.api [None req-92a149e3-2312-4570-805b-d5e5e2b73685 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] [instance: b89094ac-aee1-4bd6-a33d-8c4347cebfc7] Instance is already in deleting state, ignoring this request Dec 15 03:33:13.428754 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: INFO nova.api.openstack.requestlog [None req-92a149e3-2312-4570-805b-d5e5e2b73685 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] 10.222.0.18 "DELETE /compute/v2.1/servers/b89094ac-aee1-4bd6-a33d-8c4347cebfc7" status: 204 len: 0 microversion: 2.20 time: 0.077136 Dec 15 03:33:13.429291 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: [pid: 116157|app: 0|req: 896/1882] 10.222.0.18 () {60 vars in 1279 bytes} [Wed Dec 15 03:33:13 2021] DELETE /compute/v2.1/servers/b89094ac-aee1-4bd6-a33d-8c4347cebfc7 => generated 0 bytes in 78 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Dec 15 03:33:13.433501 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi [None req-232ab2c1-e417-418f-8607-d49921c421f0 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Calling method '.version_select at 0x7f1269a764c0>' {{(pid=116157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:33:13.443185 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: INFO nova.api.openstack.wsgi [None req-232ab2c1-e417-418f-8607-d49921c421f0 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] HTTP exception thrown: Keypair tempest-TestShelveInstance-1219174885 not found for user 6c4c0c82448e40ba801c0b52ec44e74a Dec 15 03:33:13.443742 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi [None req-232ab2c1-e417-418f-8607-d49921c421f0 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Returning 404 to user: Keypair tempest-TestShelveInstance-1219174885 not found for user 6c4c0c82448e40ba801c0b52ec44e74a {{(pid=116157) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 15 03:33:13.444521 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: INFO nova.api.openstack.requestlog [None req-232ab2c1-e417-418f-8607-d49921c421f0 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] 10.222.0.18 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1219174885" status: 404 len: 143 microversion: 2.1 time: 0.014226 Dec 15 03:33:13.445008 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: [pid: 116157|app: 0|req: 897/1883] 10.222.0.18 () {58 vars in 1253 bytes} [Wed Dec 15 03:33:13 2021] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1219174885 => generated 143 bytes in 15 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 15 03:33:13.449109 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi [None req-c634ca4c-75ff-4621-9317-12da888e7642 tempest-AttachVolumeTestJSON-244989543 tempest-AttachVolumeTestJSON-244989543-project] Calling method '>' {{(pid=116157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:33:13.449928 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.compute.api [None req-c634ca4c-75ff-4621-9317-12da888e7642 tempest-AttachVolumeTestJSON-244989543 tempest-AttachVolumeTestJSON-244989543-project] [instance: f22dfea6-4599-43e4-93d5-d99f1db3b4fb] Fetching instance by UUID {{(pid=116157) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:33:13.456349 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-c634ca4c-75ff-4621-9317-12da888e7642 tempest-AttachVolumeTestJSON-244989543 tempest-AttachVolumeTestJSON-244989543-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:33:13.456800 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-c634ca4c-75ff-4621-9317-12da888e7642 tempest-AttachVolumeTestJSON-244989543 tempest-AttachVolumeTestJSON-244989543-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:33:13.457571 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-c634ca4c-75ff-4621-9317-12da888e7642 tempest-AttachVolumeTestJSON-244989543 tempest-AttachVolumeTestJSON-244989543-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:33:13.458024 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-c634ca4c-75ff-4621-9317-12da888e7642 tempest-AttachVolumeTestJSON-244989543 tempest-AttachVolumeTestJSON-244989543-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:33:13.486080 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: INFO nova.api.openstack.requestlog [None req-c634ca4c-75ff-4621-9317-12da888e7642 tempest-AttachVolumeTestJSON-244989543 tempest-AttachVolumeTestJSON-244989543-project] 10.222.0.18 "GET /compute/v2.1/servers/f22dfea6-4599-43e4-93d5-d99f1db3b4fb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.039990 Dec 15 03:33:13.486549 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: [pid: 116157|app: 0|req: 898/1884] 10.222.0.18 () {58 vars in 1301 bytes} [Wed Dec 15 03:33:13 2021] GET /compute/v2.1/servers/f22dfea6-4599-43e4-93d5-d99f1db3b4fb/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 03:33:13.490744 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi [None req-6c009db8-c46b-4e83-ba1a-4aa00108809b tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Calling method '>' {{(pid=116157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:33:13.491228 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.compute.api [None req-6c009db8-c46b-4e83-ba1a-4aa00108809b tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] [instance: b89094ac-aee1-4bd6-a33d-8c4347cebfc7] Fetching instance by UUID {{(pid=116157) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:33:13.496246 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-6c009db8-c46b-4e83-ba1a-4aa00108809b tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:33:13.496691 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-6c009db8-c46b-4e83-ba1a-4aa00108809b tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:33:13.497445 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-6c009db8-c46b-4e83-ba1a-4aa00108809b tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:33:13.497880 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-6c009db8-c46b-4e83-ba1a-4aa00108809b tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:33:13.520393 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.compute.api [None req-6c009db8-c46b-4e83-ba1a-4aa00108809b tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] [instance: b89094ac-aee1-4bd6-a33d-8c4347cebfc7] Going to try to terminate instance {{(pid=116157) delete /opt/stack/nova/nova/compute/api.py:2614}} Dec 15 03:33:13.564495 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: INFO nova.compute.api [None req-6c009db8-c46b-4e83-ba1a-4aa00108809b tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] [instance: b89094ac-aee1-4bd6-a33d-8c4347cebfc7] Instance is already in deleting state, ignoring this request Dec 15 03:33:13.565289 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: INFO nova.api.openstack.requestlog [None req-6c009db8-c46b-4e83-ba1a-4aa00108809b tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] 10.222.0.18 "DELETE /compute/v2.1/servers/b89094ac-aee1-4bd6-a33d-8c4347cebfc7" status: 204 len: 0 microversion: 2.20 time: 0.077756 Dec 15 03:33:13.565831 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: [pid: 116157|app: 0|req: 899/1885] 10.222.0.18 () {60 vars in 1279 bytes} [Wed Dec 15 03:33:13 2021] DELETE /compute/v2.1/servers/b89094ac-aee1-4bd6-a33d-8c4347cebfc7 => generated 0 bytes in 79 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Dec 15 03:33:13.570121 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi [None req-05526137-8411-486d-bd2e-b264e2be81d3 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Calling method '.version_select at 0x7f126b687430>' {{(pid=116157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:33:13.579860 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: INFO nova.api.openstack.wsgi [None req-05526137-8411-486d-bd2e-b264e2be81d3 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] HTTP exception thrown: Keypair tempest-TestShelveInstance-1219174885 not found for user 6c4c0c82448e40ba801c0b52ec44e74a Dec 15 03:33:13.580421 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi [None req-05526137-8411-486d-bd2e-b264e2be81d3 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Returning 404 to user: Keypair tempest-TestShelveInstance-1219174885 not found for user 6c4c0c82448e40ba801c0b52ec44e74a {{(pid=116157) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 15 03:33:13.581197 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: INFO nova.api.openstack.requestlog [None req-05526137-8411-486d-bd2e-b264e2be81d3 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] 10.222.0.18 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1219174885" status: 404 len: 143 microversion: 2.1 time: 0.014300 Dec 15 03:33:13.581682 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: [pid: 116157|app: 0|req: 900/1886] 10.222.0.18 () {58 vars in 1253 bytes} [Wed Dec 15 03:33:13 2021] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1219174885 => generated 143 bytes in 15 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 15 03:33:13.585814 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi [None req-f488653b-b889-4ceb-9a1a-149e4aca98ed tempest-AttachVolumeTestJSON-244989543 tempest-AttachVolumeTestJSON-244989543-project] Calling method '>' {{(pid=116157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:33:13.586669 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.compute.api [None req-f488653b-b889-4ceb-9a1a-149e4aca98ed tempest-AttachVolumeTestJSON-244989543 tempest-AttachVolumeTestJSON-244989543-project] [instance: f22dfea6-4599-43e4-93d5-d99f1db3b4fb] Fetching instance by UUID {{(pid=116157) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:33:13.593195 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-f488653b-b889-4ceb-9a1a-149e4aca98ed tempest-AttachVolumeTestJSON-244989543 tempest-AttachVolumeTestJSON-244989543-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:33:13.593646 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-f488653b-b889-4ceb-9a1a-149e4aca98ed tempest-AttachVolumeTestJSON-244989543 tempest-AttachVolumeTestJSON-244989543-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:33:13.594446 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-f488653b-b889-4ceb-9a1a-149e4aca98ed tempest-AttachVolumeTestJSON-244989543 tempest-AttachVolumeTestJSON-244989543-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:33:13.594878 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-f488653b-b889-4ceb-9a1a-149e4aca98ed tempest-AttachVolumeTestJSON-244989543 tempest-AttachVolumeTestJSON-244989543-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:33:13.621823 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: INFO nova.api.openstack.requestlog [None req-f488653b-b889-4ceb-9a1a-149e4aca98ed tempest-AttachVolumeTestJSON-244989543 tempest-AttachVolumeTestJSON-244989543-project] 10.222.0.18 "GET /compute/v2.1/servers/f22dfea6-4599-43e4-93d5-d99f1db3b4fb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.039108 Dec 15 03:33:13.622388 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: [pid: 116157|app: 0|req: 901/1887] 10.222.0.18 () {58 vars in 1301 bytes} [Wed Dec 15 03:33:13 2021] GET /compute/v2.1/servers/f22dfea6-4599-43e4-93d5-d99f1db3b4fb/os-volume_attachments => generated 197 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 03:33:13.627051 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi [None req-8196010e-586b-4792-abb7-f125cbe284a7 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Calling method '>' {{(pid=116157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:33:13.627533 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.compute.api [None req-8196010e-586b-4792-abb7-f125cbe284a7 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] [instance: b89094ac-aee1-4bd6-a33d-8c4347cebfc7] Fetching instance by UUID {{(pid=116157) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:33:13.632666 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-8196010e-586b-4792-abb7-f125cbe284a7 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:33:13.633113 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-8196010e-586b-4792-abb7-f125cbe284a7 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:33:13.633868 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-8196010e-586b-4792-abb7-f125cbe284a7 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:33:13.634343 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-8196010e-586b-4792-abb7-f125cbe284a7 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:33:13.658742 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.compute.api [None req-8196010e-586b-4792-abb7-f125cbe284a7 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] [instance: b89094ac-aee1-4bd6-a33d-8c4347cebfc7] Going to try to terminate instance {{(pid=116157) delete /opt/stack/nova/nova/compute/api.py:2614}} Dec 15 03:33:13.699343 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: INFO nova.compute.api [None req-8196010e-586b-4792-abb7-f125cbe284a7 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] [instance: b89094ac-aee1-4bd6-a33d-8c4347cebfc7] Instance is already in deleting state, ignoring this request Dec 15 03:33:13.700133 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: INFO nova.api.openstack.requestlog [None req-8196010e-586b-4792-abb7-f125cbe284a7 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] 10.222.0.18 "DELETE /compute/v2.1/servers/b89094ac-aee1-4bd6-a33d-8c4347cebfc7" status: 204 len: 0 microversion: 2.20 time: 0.076779 Dec 15 03:33:13.700671 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: [pid: 116157|app: 0|req: 902/1888] 10.222.0.18 () {60 vars in 1279 bytes} [Wed Dec 15 03:33:13 2021] DELETE /compute/v2.1/servers/b89094ac-aee1-4bd6-a33d-8c4347cebfc7 => generated 0 bytes in 78 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Dec 15 03:33:13.705489 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi [None req-aad2f3b9-8283-4718-b8bc-0f8dbb6dffaf tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Calling method '.version_select at 0x7f126981f9d0>' {{(pid=116157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:33:13.714584 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: INFO nova.api.openstack.wsgi [None req-aad2f3b9-8283-4718-b8bc-0f8dbb6dffaf tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] HTTP exception thrown: Keypair tempest-TestShelveInstance-1219174885 not found for user 6c4c0c82448e40ba801c0b52ec44e74a Dec 15 03:33:13.715152 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi [None req-aad2f3b9-8283-4718-b8bc-0f8dbb6dffaf tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Returning 404 to user: Keypair tempest-TestShelveInstance-1219174885 not found for user 6c4c0c82448e40ba801c0b52ec44e74a {{(pid=116157) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 15 03:33:13.715932 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: INFO nova.api.openstack.requestlog [None req-aad2f3b9-8283-4718-b8bc-0f8dbb6dffaf tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] 10.222.0.18 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1219174885" status: 404 len: 143 microversion: 2.1 time: 0.014246 Dec 15 03:33:13.716414 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: [pid: 116157|app: 0|req: 903/1889] 10.222.0.18 () {58 vars in 1253 bytes} [Wed Dec 15 03:33:13 2021] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1219174885 => generated 143 bytes in 15 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 15 03:33:13.720606 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi [None req-b4525b72-30bf-4684-bbdd-884c6fe2073e tempest-AttachVolumeTestJSON-244989543 tempest-AttachVolumeTestJSON-244989543-project] Calling method '>' {{(pid=116157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:33:13.721421 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.compute.api [None req-b4525b72-30bf-4684-bbdd-884c6fe2073e tempest-AttachVolumeTestJSON-244989543 tempest-AttachVolumeTestJSON-244989543-project] [instance: f22dfea6-4599-43e4-93d5-d99f1db3b4fb] Fetching instance by UUID {{(pid=116157) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:33:13.727448 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-b4525b72-30bf-4684-bbdd-884c6fe2073e tempest-AttachVolumeTestJSON-244989543 tempest-AttachVolumeTestJSON-244989543-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:33:13.727896 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-b4525b72-30bf-4684-bbdd-884c6fe2073e tempest-AttachVolumeTestJSON-244989543 tempest-AttachVolumeTestJSON-244989543-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:33:13.728666 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-b4525b72-30bf-4684-bbdd-884c6fe2073e tempest-AttachVolumeTestJSON-244989543 tempest-AttachVolumeTestJSON-244989543-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:33:13.729096 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-b4525b72-30bf-4684-bbdd-884c6fe2073e tempest-AttachVolumeTestJSON-244989543 tempest-AttachVolumeTestJSON-244989543-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:33:13.756738 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: INFO nova.api.openstack.requestlog [None req-b4525b72-30bf-4684-bbdd-884c6fe2073e tempest-AttachVolumeTestJSON-244989543 tempest-AttachVolumeTestJSON-244989543-project] 10.222.0.18 "GET /compute/v2.1/servers/f22dfea6-4599-43e4-93d5-d99f1db3b4fb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.039237 Dec 15 03:33:13.757200 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: [pid: 116157|app: 0|req: 904/1890] 10.222.0.18 () {58 vars in 1301 bytes} [Wed Dec 15 03:33:13 2021] GET /compute/v2.1/servers/f22dfea6-4599-43e4-93d5-d99f1db3b4fb/os-volume_attachments => generated 197 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 03:33:13.761334 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi [None req-2f8babaa-a393-44fd-89bd-6e1aa49079d0 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Calling method '.version_select at 0x7f126a410790>' {{(pid=116157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:33:13.777473 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: INFO nova.api.openstack.requestlog [None req-2f8babaa-a393-44fd-89bd-6e1aa49079d0 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] 10.222.0.18 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1409502793" status: 204 len: 0 microversion: 2.20 time: 0.019221 Dec 15 03:33:13.778014 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: [pid: 116157|app: 0|req: 905/1891] 10.222.0.18 () {60 vars in 1261 bytes} [Wed Dec 15 03:33:13 2021] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1409502793 => generated 0 bytes in 20 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Dec 15 03:33:13.782064 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi [None req-293d2d75-a404-4e22-a439-a6e2c5319c18 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Calling method '.version_select at 0x7f126a3c3ee0>' {{(pid=116157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:33:13.790921 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: INFO nova.api.openstack.wsgi [None req-293d2d75-a404-4e22-a439-a6e2c5319c18 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] HTTP exception thrown: Keypair tempest-TestShelveInstance-1219174885 not found for user 6c4c0c82448e40ba801c0b52ec44e74a Dec 15 03:33:13.791480 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi [None req-293d2d75-a404-4e22-a439-a6e2c5319c18 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Returning 404 to user: Keypair tempest-TestShelveInstance-1219174885 not found for user 6c4c0c82448e40ba801c0b52ec44e74a {{(pid=116157) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 15 03:33:13.792274 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: INFO nova.api.openstack.requestlog [None req-293d2d75-a404-4e22-a439-a6e2c5319c18 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] 10.222.0.18 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1219174885" status: 404 len: 143 microversion: 2.1 time: 0.013341 Dec 15 03:33:13.792744 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: [pid: 116157|app: 0|req: 906/1892] 10.222.0.18 () {58 vars in 1253 bytes} [Wed Dec 15 03:33:13 2021] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1219174885 => generated 143 bytes in 14 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 15 03:33:13.797443 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi [None req-4162c692-3ee3-4962-8393-8b040f104e51 tempest-AttachVolumeTestJSON-244989543 tempest-AttachVolumeTestJSON-244989543-project] Calling method '>' {{(pid=116157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:33:13.798295 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.compute.api [None req-4162c692-3ee3-4962-8393-8b040f104e51 tempest-AttachVolumeTestJSON-244989543 tempest-AttachVolumeTestJSON-244989543-project] [instance: f22dfea6-4599-43e4-93d5-d99f1db3b4fb] Fetching instance by UUID {{(pid=116157) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:33:13.803334 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-4162c692-3ee3-4962-8393-8b040f104e51 tempest-AttachVolumeTestJSON-244989543 tempest-AttachVolumeTestJSON-244989543-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:33:13.803778 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-4162c692-3ee3-4962-8393-8b040f104e51 tempest-AttachVolumeTestJSON-244989543 tempest-AttachVolumeTestJSON-244989543-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:33:13.804543 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-4162c692-3ee3-4962-8393-8b040f104e51 tempest-AttachVolumeTestJSON-244989543 tempest-AttachVolumeTestJSON-244989543-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:33:13.804971 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-4162c692-3ee3-4962-8393-8b040f104e51 tempest-AttachVolumeTestJSON-244989543 tempest-AttachVolumeTestJSON-244989543-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:33:13.833165 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: INFO nova.api.openstack.requestlog [None req-4162c692-3ee3-4962-8393-8b040f104e51 tempest-AttachVolumeTestJSON-244989543 tempest-AttachVolumeTestJSON-244989543-project] 10.222.0.18 "GET /compute/v2.1/servers/f22dfea6-4599-43e4-93d5-d99f1db3b4fb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.039471 Dec 15 03:33:13.833694 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: [pid: 116157|app: 0|req: 907/1893] 10.222.0.18 () {58 vars in 1301 bytes} [Wed Dec 15 03:33:13 2021] GET /compute/v2.1/servers/f22dfea6-4599-43e4-93d5-d99f1db3b4fb/os-volume_attachments => generated 197 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 03:33:13.837729 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi [None req-186a79c9-1d37-435f-b97b-d5587043e261 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Calling method '.version_select at 0x7f1269a2ab80>' {{(pid=116157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:33:13.846811 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: INFO nova.api.openstack.wsgi [None req-186a79c9-1d37-435f-b97b-d5587043e261 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] HTTP exception thrown: Keypair tempest-keypair-1409502793 not found for user fedc11e2dbd74b919982a0657222cca4 Dec 15 03:33:13.847374 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi [None req-186a79c9-1d37-435f-b97b-d5587043e261 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Returning 404 to user: Keypair tempest-keypair-1409502793 not found for user fedc11e2dbd74b919982a0657222cca4 {{(pid=116157) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 15 03:33:13.848661 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: INFO nova.api.openstack.requestlog [None req-186a79c9-1d37-435f-b97b-d5587043e261 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] 10.222.0.18 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1409502793" status: 404 len: 132 microversion: 2.20 time: 0.013499 Dec 15 03:33:13.849128 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: [pid: 116157|app: 0|req: 908/1894] 10.222.0.18 () {60 vars in 1261 bytes} [Wed Dec 15 03:33:13 2021] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1409502793 => generated 132 bytes in 15 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Dec 15 03:33:13.853388 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi [None req-acc5a497-2ade-49fd-92d9-a95bf23b0d90 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Calling method '.version_select at 0x7f126a576160>' {{(pid=116157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:33:13.863531 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: INFO nova.api.openstack.wsgi [None req-acc5a497-2ade-49fd-92d9-a95bf23b0d90 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] HTTP exception thrown: Keypair tempest-TestShelveInstance-1219174885 not found for user 6c4c0c82448e40ba801c0b52ec44e74a Dec 15 03:33:13.864164 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi [None req-acc5a497-2ade-49fd-92d9-a95bf23b0d90 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] Returning 404 to user: Keypair tempest-TestShelveInstance-1219174885 not found for user 6c4c0c82448e40ba801c0b52ec44e74a {{(pid=116157) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 15 03:33:13.864974 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: INFO nova.api.openstack.requestlog [None req-acc5a497-2ade-49fd-92d9-a95bf23b0d90 tempest-TestShelveInstance-512043645 tempest-TestShelveInstance-512043645-project] 10.222.0.18 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1219174885" status: 404 len: 143 microversion: 2.1 time: 0.015207 Dec 15 03:33:13.865487 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: [pid: 116157|app: 0|req: 909/1895] 10.222.0.18 () {58 vars in 1253 bytes} [Wed Dec 15 03:33:13 2021] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1219174885 => generated 143 bytes in 16 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 15 03:33:13.873406 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi [None req-847b9810-b4e2-4cfe-b29e-9d239dd92909 tempest-AttachVolumeTestJSON-244989543 tempest-AttachVolumeTestJSON-244989543-project] Calling method '>' {{(pid=116157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:33:13.873406 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.compute.api [None req-847b9810-b4e2-4cfe-b29e-9d239dd92909 tempest-AttachVolumeTestJSON-244989543 tempest-AttachVolumeTestJSON-244989543-project] [instance: f22dfea6-4599-43e4-93d5-d99f1db3b4fb] Fetching instance by UUID {{(pid=116157) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:33:13.877638 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-847b9810-b4e2-4cfe-b29e-9d239dd92909 tempest-AttachVolumeTestJSON-244989543 tempest-AttachVolumeTestJSON-244989543-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:33:13.878236 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-847b9810-b4e2-4cfe-b29e-9d239dd92909 tempest-AttachVolumeTestJSON-244989543 tempest-AttachVolumeTestJSON-244989543-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:33:13.879019 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-847b9810-b4e2-4cfe-b29e-9d239dd92909 tempest-AttachVolumeTestJSON-244989543 tempest-AttachVolumeTestJSON-244989543-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:33:13.879448 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-847b9810-b4e2-4cfe-b29e-9d239dd92909 tempest-AttachVolumeTestJSON-244989543 tempest-AttachVolumeTestJSON-244989543-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:33:13.917186 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: INFO nova.api.openstack.requestlog [None req-847b9810-b4e2-4cfe-b29e-9d239dd92909 tempest-AttachVolumeTestJSON-244989543 tempest-AttachVolumeTestJSON-244989543-project] 10.222.0.18 "GET /compute/v2.1/servers/f22dfea6-4599-43e4-93d5-d99f1db3b4fb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050688 Dec 15 03:33:13.917789 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: [pid: 116157|app: 0|req: 910/1896] 10.222.0.18 () {58 vars in 1301 bytes} [Wed Dec 15 03:33:13 2021] GET /compute/v2.1/servers/f22dfea6-4599-43e4-93d5-d99f1db3b4fb/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 03:33:14.824995 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi [None req-ceddfa2c-5761-4c6d-9bba-fa35b1dcda58 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Action: 'create', calling method: .version_select at 0x7f126b687430>, body: {"keypair": {"name": "tempest-keypair-175947762"}} {{(pid=116157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 03:33:14.839309 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.quota [None req-ceddfa2c-5761-4c6d-9bba-fa35b1dcda58 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Getting quotas for project 9f16202549724b878f908d68384ec9c9. Resources: {'key_pairs'} {{(pid=116157) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 15 03:33:14.843855 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.quota [None req-ceddfa2c-5761-4c6d-9bba-fa35b1dcda58 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Getting quotas for user fedc11e2dbd74b919982a0657222cca4 and project 9f16202549724b878f908d68384ec9c9. Resources: {'key_pairs'} {{(pid=116157) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 15 03:33:15.086529 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.quota [None req-ceddfa2c-5761-4c6d-9bba-fa35b1dcda58 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Getting quotas for project 9f16202549724b878f908d68384ec9c9. Resources: {'key_pairs'} {{(pid=116157) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 15 03:33:15.090255 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.quota [None req-ceddfa2c-5761-4c6d-9bba-fa35b1dcda58 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Getting quotas for user fedc11e2dbd74b919982a0657222cca4 and project 9f16202549724b878f908d68384ec9c9. Resources: {'key_pairs'} {{(pid=116157) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 15 03:33:15.103665 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: INFO nova.api.openstack.requestlog [None req-ceddfa2c-5761-4c6d-9bba-fa35b1dcda58 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] 10.222.0.18 "POST /compute/v2.1/os-keypairs" status: 201 len: 2315 microversion: 2.20 time: 0.282479 Dec 15 03:33:15.104266 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: [pid: 116157|app: 0|req: 911/1897] 10.222.0.18 () {62 vars in 1198 bytes} [Wed Dec 15 03:33:14 2021] POST /compute/v2.1/os-keypairs => generated 2315 bytes in 284 msecs (HTTP/1.1 201) 9 headers in 365 bytes (2 switches on core 0) Dec 15 03:33:15.108741 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi [None req-559ef0d3-74cc-474c-b161-4d3559b5c216 tempest-AttachVolumeTestJSON-244989543 tempest-AttachVolumeTestJSON-244989543-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 03:33:15.109641 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.compute.api [None req-559ef0d3-74cc-474c-b161-4d3559b5c216 tempest-AttachVolumeTestJSON-244989543 tempest-AttachVolumeTestJSON-244989543-project] [instance: f22dfea6-4599-43e4-93d5-d99f1db3b4fb] Fetching instance by UUID {{(pid=116157) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:33:15.115398 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-559ef0d3-74cc-474c-b161-4d3559b5c216 tempest-AttachVolumeTestJSON-244989543 tempest-AttachVolumeTestJSON-244989543-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:33:15.115851 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-559ef0d3-74cc-474c-b161-4d3559b5c216 tempest-AttachVolumeTestJSON-244989543 tempest-AttachVolumeTestJSON-244989543-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:33:15.116638 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-559ef0d3-74cc-474c-b161-4d3559b5c216 tempest-AttachVolumeTestJSON-244989543 tempest-AttachVolumeTestJSON-244989543-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:33:15.117073 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-559ef0d3-74cc-474c-b161-4d3559b5c216 tempest-AttachVolumeTestJSON-244989543 tempest-AttachVolumeTestJSON-244989543-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:33:15.215945 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: INFO nova.api.openstack.requestlog [None req-559ef0d3-74cc-474c-b161-4d3559b5c216 tempest-AttachVolumeTestJSON-244989543 tempest-AttachVolumeTestJSON-244989543-project] 10.222.0.18 "POST /compute/v2.1/servers/f22dfea6-4599-43e4-93d5-d99f1db3b4fb/action" status: 200 len: 76738 microversion: 2.1 time: 0.110433 Dec 15 03:33:15.216950 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: [pid: 116157|app: 0|req: 912/1898] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Dec 15 03:33:15 2021] POST /compute/v2.1/servers/f22dfea6-4599-43e4-93d5-d99f1db3b4fb/action => generated 76738 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 03:33:16.643493 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi [None req-b2098cda-c053-4bfa-9e15-7b305cfcac1f tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-913402359", "imageRef": "5195b034-9fa4-468b-a94d-ef3ee79ce449", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "c53e204d-72ac-4b08-b5d5-620e7d8224e3"}], "security_groups": [{"name": "tempest-securitygroup--728349975"}], "key_name": "tempest-keypair-175947762", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=116157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 03:33:16.794653 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.network.neutron [None req-b2098cda-c053-4bfa-9e15-7b305cfcac1f tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] validate_networks() for [('c53e204d-72ac-4b08-b5d5-620e7d8224e3', None, None, None, None, None)] {{(pid=116157) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Dec 15 03:33:17.634463 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.virt.hardware [None req-b2098cda-c053-4bfa-9e15-7b305cfcac1f tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Flavor limits 0:0:0 {{(pid=116157) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Dec 15 03:33:17.635246 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.virt.hardware [None req-b2098cda-c053-4bfa-9e15-7b305cfcac1f tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Image limits 0:0:0 {{(pid=116157) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Dec 15 03:33:17.635887 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.virt.hardware [None req-b2098cda-c053-4bfa-9e15-7b305cfcac1f tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Flavor pref 0:0:0 {{(pid=116157) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Dec 15 03:33:17.637555 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.virt.hardware [None req-b2098cda-c053-4bfa-9e15-7b305cfcac1f tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Image pref 0:0:0 {{(pid=116157) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Dec 15 03:33:17.638524 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.virt.hardware [None req-b2098cda-c053-4bfa-9e15-7b305cfcac1f tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116157) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Dec 15 03:33:17.653535 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-b2098cda-c053-4bfa-9e15-7b305cfcac1f tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:33:17.654250 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-b2098cda-c053-4bfa-9e15-7b305cfcac1f tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:33:17.654888 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-b2098cda-c053-4bfa-9e15-7b305cfcac1f tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:33:17.655549 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-b2098cda-c053-4bfa-9e15-7b305cfcac1f tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:33:17.676109 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.quota [None req-b2098cda-c053-4bfa-9e15-7b305cfcac1f tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Getting quotas for project 9f16202549724b878f908d68384ec9c9. Resources: {'cores', 'instances', 'ram'} {{(pid=116157) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 15 03:33:17.680233 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.quota [None req-b2098cda-c053-4bfa-9e15-7b305cfcac1f tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Getting quotas for user fedc11e2dbd74b919982a0657222cca4 and project 9f16202549724b878f908d68384ec9c9. Resources: {'cores', 'instances', 'ram'} {{(pid=116157) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 15 03:33:17.694662 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.compute.api [None req-b2098cda-c053-4bfa-9e15-7b305cfcac1f tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Going to run 1 instances... {{(pid=116157) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Dec 15 03:33:17.697153 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.compute.api [None req-b2098cda-c053-4bfa-9e15-7b305cfcac1f tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] [instance: 137d7cd0-8812-42b6-b871-6aab82c07bdc] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='5195b034-9fa4-468b-a94d-ef3ee79ce449',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=116157) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Dec 15 03:33:17.752069 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: INFO nova.api.openstack.requestlog [None req-b2098cda-c053-4bfa-9e15-7b305cfcac1f tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.20 time: 1.113663 Dec 15 03:33:17.752859 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: [pid: 116157|app: 0|req: 913/1899] 10.222.0.18 () {62 vars in 1187 bytes} [Wed Dec 15 03:33:16 2021] POST /compute/v2.1/servers => generated 401 bytes in 1115 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Dec 15 03:33:17.767490 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi [None req-257c2d13-86b8-4049-8514-56a9812a93eb tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Calling method '>' {{(pid=116157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:33:17.768112 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.compute.api [None req-257c2d13-86b8-4049-8514-56a9812a93eb tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] [instance: 137d7cd0-8812-42b6-b871-6aab82c07bdc] Fetching instance by UUID {{(pid=116157) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:33:17.826504 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.policy [None req-257c2d13-86b8-4049-8514-56a9812a93eb tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fedc11e2dbd74b919982a0657222cca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f16202549724b878f908d68384ec9c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116157) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:33:17.836428 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.policy [None req-257c2d13-86b8-4049-8514-56a9812a93eb tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fedc11e2dbd74b919982a0657222cca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f16202549724b878f908d68384ec9c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116157) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:33:17.839205 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.policy [None req-257c2d13-86b8-4049-8514-56a9812a93eb tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fedc11e2dbd74b919982a0657222cca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f16202549724b878f908d68384ec9c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116157) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:33:17.840431 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: INFO nova.api.openstack.requestlog [None req-257c2d13-86b8-4049-8514-56a9812a93eb tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] 10.222.0.18 "GET /compute/v2.1/servers/137d7cd0-8812-42b6-b871-6aab82c07bdc" status: 200 len: 1280 microversion: 2.20 time: 0.081301 Dec 15 03:33:17.841121 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: [pid: 116157|app: 0|req: 914/1900] 10.222.0.18 () {60 vars in 1276 bytes} [Wed Dec 15 03:33:17 2021] GET /compute/v2.1/servers/137d7cd0-8812-42b6-b871-6aab82c07bdc => generated 1280 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Dec 15 03:33:18.536369 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Dec 15 03:33:18.536906 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: Wed Dec 15 03:33:18 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/a0097d88-6613-416a-9f4d-1bb285e53291/os-volume_attachments/d681224a-3344-47c8-8df0-0379a5a8f296 (ip 10.222.0.18) !!! Dec 15 03:33:18.859686 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi [None req-6cc813b4-5c13-4330-8780-3bdca8bd14f9 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Calling method '>' {{(pid=116157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:33:18.860466 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.compute.api [None req-6cc813b4-5c13-4330-8780-3bdca8bd14f9 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] [instance: 137d7cd0-8812-42b6-b871-6aab82c07bdc] Fetching instance by UUID {{(pid=116157) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:33:18.867419 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-6cc813b4-5c13-4330-8780-3bdca8bd14f9 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:33:18.868191 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-6cc813b4-5c13-4330-8780-3bdca8bd14f9 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:33:18.869319 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-6cc813b4-5c13-4330-8780-3bdca8bd14f9 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:33:18.869971 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-6cc813b4-5c13-4330-8780-3bdca8bd14f9 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:33:18.945717 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.policy [None req-6cc813b4-5c13-4330-8780-3bdca8bd14f9 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fedc11e2dbd74b919982a0657222cca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f16202549724b878f908d68384ec9c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116157) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:33:18.954771 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.policy [None req-6cc813b4-5c13-4330-8780-3bdca8bd14f9 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fedc11e2dbd74b919982a0657222cca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f16202549724b878f908d68384ec9c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116157) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:33:18.958925 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.policy [None req-6cc813b4-5c13-4330-8780-3bdca8bd14f9 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fedc11e2dbd74b919982a0657222cca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f16202549724b878f908d68384ec9c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116157) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:33:18.960417 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: INFO nova.api.openstack.requestlog [None req-6cc813b4-5c13-4330-8780-3bdca8bd14f9 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] 10.222.0.18 "GET /compute/v2.1/servers/137d7cd0-8812-42b6-b871-6aab82c07bdc" status: 200 len: 1340 microversion: 2.20 time: 0.105116 Dec 15 03:33:18.973492 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: [pid: 116157|app: 0|req: 915/1901] 10.222.0.18 () {60 vars in 1276 bytes} [Wed Dec 15 03:33:18 2021] GET /compute/v2.1/servers/137d7cd0-8812-42b6-b871-6aab82c07bdc => generated 1340 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Dec 15 03:33:19.981605 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi [None req-5ce56de8-a485-4d72-acd4-5268b9696044 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Calling method '>' {{(pid=116157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:33:19.982376 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.compute.api [None req-5ce56de8-a485-4d72-acd4-5268b9696044 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] [instance: 137d7cd0-8812-42b6-b871-6aab82c07bdc] Fetching instance by UUID {{(pid=116157) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:33:19.990756 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-5ce56de8-a485-4d72-acd4-5268b9696044 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:33:19.991492 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-5ce56de8-a485-4d72-acd4-5268b9696044 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:33:19.992760 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-5ce56de8-a485-4d72-acd4-5268b9696044 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:33:19.993397 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-5ce56de8-a485-4d72-acd4-5268b9696044 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:33:20.163787 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.policy [None req-5ce56de8-a485-4d72-acd4-5268b9696044 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fedc11e2dbd74b919982a0657222cca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f16202549724b878f908d68384ec9c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116157) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:33:20.173260 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.policy [None req-5ce56de8-a485-4d72-acd4-5268b9696044 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fedc11e2dbd74b919982a0657222cca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f16202549724b878f908d68384ec9c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116157) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:33:20.174951 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.policy [None req-5ce56de8-a485-4d72-acd4-5268b9696044 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fedc11e2dbd74b919982a0657222cca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f16202549724b878f908d68384ec9c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116157) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:33:20.176119 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: INFO nova.api.openstack.requestlog [None req-5ce56de8-a485-4d72-acd4-5268b9696044 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] 10.222.0.18 "GET /compute/v2.1/servers/137d7cd0-8812-42b6-b871-6aab82c07bdc" status: 200 len: 1405 microversion: 2.20 time: 0.200140 Dec 15 03:33:20.176783 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: [pid: 116157|app: 0|req: 916/1902] 10.222.0.18 () {60 vars in 1276 bytes} [Wed Dec 15 03:33:19 2021] GET /compute/v2.1/servers/137d7cd0-8812-42b6-b871-6aab82c07bdc => generated 1405 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 03:33:20.945498 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi [req-ad3540a7-cfa0-41ec-a949-9e4e77d3041a req-7af86050-77e6-4866-badb-0d7cfccc9866 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "137d7cd0-8812-42b6-b871-6aab82c07bdc", "tag": "d2c8771c-872e-47b5-8613-92878f05fa99"}]} {{(pid=116157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 03:33:20.947783 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 15 03:33:20.947783 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: warnings.warn(msg) Dec 15 03:33:20.959029 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [req-ad3540a7-cfa0-41ec-a949-9e4e77d3041a req-7af86050-77e6-4866-badb-0d7cfccc9866 service nova] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:33:20.959540 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [req-ad3540a7-cfa0-41ec-a949-9e4e77d3041a req-7af86050-77e6-4866-badb-0d7cfccc9866 service nova] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:33:20.975860 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: INFO nova.api.openstack.compute.server_external_events [req-ad3540a7-cfa0-41ec-a949-9e4e77d3041a req-7af86050-77e6-4866-badb-0d7cfccc9866 service nova] Creating event network-changed:d2c8771c-872e-47b5-8613-92878f05fa99 for instance 137d7cd0-8812-42b6-b871-6aab82c07bdc on hv-cinder-81803 Dec 15 03:33:20.983650 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: INFO nova.api.openstack.requestlog [req-ad3540a7-cfa0-41ec-a949-9e4e77d3041a req-7af86050-77e6-4866-badb-0d7cfccc9866 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045059 Dec 15 03:33:20.984939 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: [pid: 116157|app: 0|req: 917/1903] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Dec 15 03:33:20 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 03:33:21.195392 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi [None req-313d4864-7d17-4881-9771-e49dd1f87376 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Calling method '>' {{(pid=116157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:33:21.196654 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.compute.api [None req-313d4864-7d17-4881-9771-e49dd1f87376 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] [instance: 137d7cd0-8812-42b6-b871-6aab82c07bdc] Fetching instance by UUID {{(pid=116157) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:33:21.203762 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-313d4864-7d17-4881-9771-e49dd1f87376 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:33:21.204509 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-313d4864-7d17-4881-9771-e49dd1f87376 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:33:21.205520 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-313d4864-7d17-4881-9771-e49dd1f87376 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:33:21.206069 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-313d4864-7d17-4881-9771-e49dd1f87376 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:33:21.351659 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.policy [None req-313d4864-7d17-4881-9771-e49dd1f87376 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fedc11e2dbd74b919982a0657222cca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f16202549724b878f908d68384ec9c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116157) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:33:21.362240 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.policy [None req-313d4864-7d17-4881-9771-e49dd1f87376 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fedc11e2dbd74b919982a0657222cca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f16202549724b878f908d68384ec9c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116157) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:33:21.363880 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.policy [None req-313d4864-7d17-4881-9771-e49dd1f87376 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fedc11e2dbd74b919982a0657222cca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f16202549724b878f908d68384ec9c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116157) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:33:21.365096 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: INFO nova.api.openstack.requestlog [None req-313d4864-7d17-4881-9771-e49dd1f87376 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] 10.222.0.18 "GET /compute/v2.1/servers/137d7cd0-8812-42b6-b871-6aab82c07bdc" status: 200 len: 1405 microversion: 2.20 time: 0.173839 Dec 15 03:33:21.365743 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: [pid: 116157|app: 0|req: 918/1904] 10.222.0.18 () {60 vars in 1276 bytes} [Wed Dec 15 03:33:21 2021] GET /compute/v2.1/servers/137d7cd0-8812-42b6-b871-6aab82c07bdc => generated 1405 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Dec 15 03:33:22.383459 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi [None req-ecc5f2b9-5e97-481e-b012-ba9a35fe7425 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Calling method '>' {{(pid=116157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:33:22.384146 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.compute.api [None req-ecc5f2b9-5e97-481e-b012-ba9a35fe7425 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] [instance: 137d7cd0-8812-42b6-b871-6aab82c07bdc] Fetching instance by UUID {{(pid=116157) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:33:22.390671 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-ecc5f2b9-5e97-481e-b012-ba9a35fe7425 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:33:22.391130 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-ecc5f2b9-5e97-481e-b012-ba9a35fe7425 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:33:22.391930 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-ecc5f2b9-5e97-481e-b012-ba9a35fe7425 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:33:22.392370 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-ecc5f2b9-5e97-481e-b012-ba9a35fe7425 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:33:22.531703 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.policy [None req-ecc5f2b9-5e97-481e-b012-ba9a35fe7425 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fedc11e2dbd74b919982a0657222cca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f16202549724b878f908d68384ec9c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116157) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:33:22.540029 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.policy [None req-ecc5f2b9-5e97-481e-b012-ba9a35fe7425 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fedc11e2dbd74b919982a0657222cca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f16202549724b878f908d68384ec9c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116157) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:33:22.541544 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.policy [None req-ecc5f2b9-5e97-481e-b012-ba9a35fe7425 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fedc11e2dbd74b919982a0657222cca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f16202549724b878f908d68384ec9c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116157) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:33:22.542728 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: INFO nova.api.openstack.requestlog [None req-ecc5f2b9-5e97-481e-b012-ba9a35fe7425 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] 10.222.0.18 "GET /compute/v2.1/servers/137d7cd0-8812-42b6-b871-6aab82c07bdc" status: 200 len: 1405 microversion: 2.20 time: 0.163013 Dec 15 03:33:22.543293 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: [pid: 116157|app: 0|req: 919/1905] 10.222.0.18 () {60 vars in 1276 bytes} [Wed Dec 15 03:33:22 2021] GET /compute/v2.1/servers/137d7cd0-8812-42b6-b871-6aab82c07bdc => generated 1405 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Dec 15 03:33:23.561765 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi [None req-1fddc80e-071d-4d1e-b79d-c10a72f78493 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Calling method '>' {{(pid=116157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:33:23.562523 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.compute.api [None req-1fddc80e-071d-4d1e-b79d-c10a72f78493 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] [instance: 137d7cd0-8812-42b6-b871-6aab82c07bdc] Fetching instance by UUID {{(pid=116157) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:33:23.569636 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-1fddc80e-071d-4d1e-b79d-c10a72f78493 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:33:23.570129 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-1fddc80e-071d-4d1e-b79d-c10a72f78493 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:33:23.571135 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-1fddc80e-071d-4d1e-b79d-c10a72f78493 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:33:23.571367 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-1fddc80e-071d-4d1e-b79d-c10a72f78493 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:33:23.702540 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.policy [None req-1fddc80e-071d-4d1e-b79d-c10a72f78493 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fedc11e2dbd74b919982a0657222cca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f16202549724b878f908d68384ec9c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116157) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:33:23.710241 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.policy [None req-1fddc80e-071d-4d1e-b79d-c10a72f78493 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fedc11e2dbd74b919982a0657222cca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f16202549724b878f908d68384ec9c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116157) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:33:23.711735 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.policy [None req-1fddc80e-071d-4d1e-b79d-c10a72f78493 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fedc11e2dbd74b919982a0657222cca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f16202549724b878f908d68384ec9c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116157) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:33:23.712840 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: INFO nova.api.openstack.requestlog [None req-1fddc80e-071d-4d1e-b79d-c10a72f78493 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] 10.222.0.18 "GET /compute/v2.1/servers/137d7cd0-8812-42b6-b871-6aab82c07bdc" status: 200 len: 1405 microversion: 2.20 time: 0.155296 Dec 15 03:33:23.713397 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: [pid: 116157|app: 0|req: 920/1906] 10.222.0.18 () {60 vars in 1276 bytes} [Wed Dec 15 03:33:23 2021] GET /compute/v2.1/servers/137d7cd0-8812-42b6-b871-6aab82c07bdc => generated 1405 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Dec 15 03:33:24.731758 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi [None req-f67633dd-8fcf-4670-96b4-cf369d5f319f tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Calling method '>' {{(pid=116157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:33:24.732410 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.compute.api [None req-f67633dd-8fcf-4670-96b4-cf369d5f319f tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] [instance: 137d7cd0-8812-42b6-b871-6aab82c07bdc] Fetching instance by UUID {{(pid=116157) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:33:24.739214 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-f67633dd-8fcf-4670-96b4-cf369d5f319f tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:33:24.739665 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-f67633dd-8fcf-4670-96b4-cf369d5f319f tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:33:24.740445 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-f67633dd-8fcf-4670-96b4-cf369d5f319f tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:33:24.740883 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-f67633dd-8fcf-4670-96b4-cf369d5f319f tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:33:24.870434 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.policy [None req-f67633dd-8fcf-4670-96b4-cf369d5f319f tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fedc11e2dbd74b919982a0657222cca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f16202549724b878f908d68384ec9c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116157) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:33:24.878046 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.policy [None req-f67633dd-8fcf-4670-96b4-cf369d5f319f tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fedc11e2dbd74b919982a0657222cca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f16202549724b878f908d68384ec9c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116157) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:33:24.879545 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.policy [None req-f67633dd-8fcf-4670-96b4-cf369d5f319f tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fedc11e2dbd74b919982a0657222cca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f16202549724b878f908d68384ec9c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116157) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:33:24.880639 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: INFO nova.api.openstack.requestlog [None req-f67633dd-8fcf-4670-96b4-cf369d5f319f tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] 10.222.0.18 "GET /compute/v2.1/servers/137d7cd0-8812-42b6-b871-6aab82c07bdc" status: 200 len: 1405 microversion: 2.20 time: 0.152572 Dec 15 03:33:24.881196 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: [pid: 116157|app: 0|req: 921/1907] 10.222.0.18 () {60 vars in 1276 bytes} [Wed Dec 15 03:33:24 2021] GET /compute/v2.1/servers/137d7cd0-8812-42b6-b871-6aab82c07bdc => generated 1405 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Dec 15 03:33:25.898674 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi [None req-c4ca0108-f185-40d6-836b-1f1f18607d55 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Calling method '>' {{(pid=116157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:33:25.899332 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.compute.api [None req-c4ca0108-f185-40d6-836b-1f1f18607d55 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] [instance: 137d7cd0-8812-42b6-b871-6aab82c07bdc] Fetching instance by UUID {{(pid=116157) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:33:25.905649 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-c4ca0108-f185-40d6-836b-1f1f18607d55 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:33:25.906254 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-c4ca0108-f185-40d6-836b-1f1f18607d55 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:33:25.907046 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-c4ca0108-f185-40d6-836b-1f1f18607d55 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:33:25.907485 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-c4ca0108-f185-40d6-836b-1f1f18607d55 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:33:26.034840 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.policy [None req-c4ca0108-f185-40d6-836b-1f1f18607d55 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fedc11e2dbd74b919982a0657222cca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f16202549724b878f908d68384ec9c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116157) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:33:26.042472 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.policy [None req-c4ca0108-f185-40d6-836b-1f1f18607d55 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fedc11e2dbd74b919982a0657222cca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f16202549724b878f908d68384ec9c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116157) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:33:26.043966 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.policy [None req-c4ca0108-f185-40d6-836b-1f1f18607d55 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fedc11e2dbd74b919982a0657222cca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f16202549724b878f908d68384ec9c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116157) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:33:26.045562 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: INFO nova.api.openstack.requestlog [None req-c4ca0108-f185-40d6-836b-1f1f18607d55 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] 10.222.0.18 "GET /compute/v2.1/servers/137d7cd0-8812-42b6-b871-6aab82c07bdc" status: 200 len: 1405 microversion: 2.20 time: 0.150188 Dec 15 03:33:26.046138 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: [pid: 116157|app: 0|req: 922/1908] 10.222.0.18 () {60 vars in 1276 bytes} [Wed Dec 15 03:33:25 2021] GET /compute/v2.1/servers/137d7cd0-8812-42b6-b871-6aab82c07bdc => generated 1405 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Dec 15 03:33:27.063488 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi [None req-bd6e6eb9-6023-4b62-80a7-8642d8eeb890 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Calling method '>' {{(pid=116157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:33:27.064130 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.compute.api [None req-bd6e6eb9-6023-4b62-80a7-8642d8eeb890 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] [instance: 137d7cd0-8812-42b6-b871-6aab82c07bdc] Fetching instance by UUID {{(pid=116157) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:33:27.070384 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-bd6e6eb9-6023-4b62-80a7-8642d8eeb890 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:33:27.070842 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-bd6e6eb9-6023-4b62-80a7-8642d8eeb890 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:33:27.071624 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-bd6e6eb9-6023-4b62-80a7-8642d8eeb890 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:33:27.072064 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-bd6e6eb9-6023-4b62-80a7-8642d8eeb890 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:33:27.201789 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.policy [None req-bd6e6eb9-6023-4b62-80a7-8642d8eeb890 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fedc11e2dbd74b919982a0657222cca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f16202549724b878f908d68384ec9c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116157) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:33:27.209934 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.policy [None req-bd6e6eb9-6023-4b62-80a7-8642d8eeb890 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fedc11e2dbd74b919982a0657222cca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f16202549724b878f908d68384ec9c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116157) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:33:27.211128 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.policy [None req-bd6e6eb9-6023-4b62-80a7-8642d8eeb890 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fedc11e2dbd74b919982a0657222cca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f16202549724b878f908d68384ec9c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116157) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:33:27.212238 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: INFO nova.api.openstack.requestlog [None req-bd6e6eb9-6023-4b62-80a7-8642d8eeb890 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] 10.222.0.18 "GET /compute/v2.1/servers/137d7cd0-8812-42b6-b871-6aab82c07bdc" status: 200 len: 1405 microversion: 2.20 time: 0.152534 Dec 15 03:33:27.212793 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: [pid: 116157|app: 0|req: 923/1909] 10.222.0.18 () {60 vars in 1276 bytes} [Wed Dec 15 03:33:27 2021] GET /compute/v2.1/servers/137d7cd0-8812-42b6-b871-6aab82c07bdc => generated 1405 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Dec 15 03:33:27.647837 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi [req-dafd481b-be45-4f07-b0d6-1a410612473a req-331f3ba5-fa70-4803-b05e-b6cc7dbedeb3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "137d7cd0-8812-42b6-b871-6aab82c07bdc", "name": "network-vif-plugged", "status": "completed", "tag": "d2c8771c-872e-47b5-8613-92878f05fa99"}]} {{(pid=116157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 03:33:27.649421 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 15 03:33:27.649421 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: warnings.warn(msg) Dec 15 03:33:27.656735 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [req-dafd481b-be45-4f07-b0d6-1a410612473a req-331f3ba5-fa70-4803-b05e-b6cc7dbedeb3 service nova] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:33:27.657178 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [req-dafd481b-be45-4f07-b0d6-1a410612473a req-331f3ba5-fa70-4803-b05e-b6cc7dbedeb3 service nova] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:33:27.667633 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: INFO nova.api.openstack.compute.server_external_events [req-dafd481b-be45-4f07-b0d6-1a410612473a req-331f3ba5-fa70-4803-b05e-b6cc7dbedeb3 service nova] Creating event network-vif-plugged:d2c8771c-872e-47b5-8613-92878f05fa99 for instance 137d7cd0-8812-42b6-b871-6aab82c07bdc on hv-cinder-81803 Dec 15 03:33:27.672535 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: INFO nova.api.openstack.requestlog [req-dafd481b-be45-4f07-b0d6-1a410612473a req-331f3ba5-fa70-4803-b05e-b6cc7dbedeb3 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.194776 Dec 15 03:33:27.673093 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: [pid: 116157|app: 0|req: 924/1910] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Dec 15 03:33:27 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 15 03:33:28.231966 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi [None req-464271e0-1aa5-4dda-8469-590ab6adb73c tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Calling method '>' {{(pid=116157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:33:28.232682 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.compute.api [None req-464271e0-1aa5-4dda-8469-590ab6adb73c tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] [instance: 137d7cd0-8812-42b6-b871-6aab82c07bdc] Fetching instance by UUID {{(pid=116157) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:33:28.239162 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-464271e0-1aa5-4dda-8469-590ab6adb73c tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:33:28.239608 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-464271e0-1aa5-4dda-8469-590ab6adb73c tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:33:28.240391 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-464271e0-1aa5-4dda-8469-590ab6adb73c tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:33:28.240818 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-464271e0-1aa5-4dda-8469-590ab6adb73c tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:33:28.368960 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.policy [None req-464271e0-1aa5-4dda-8469-590ab6adb73c tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fedc11e2dbd74b919982a0657222cca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f16202549724b878f908d68384ec9c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116157) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:33:28.377241 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.policy [None req-464271e0-1aa5-4dda-8469-590ab6adb73c tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fedc11e2dbd74b919982a0657222cca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f16202549724b878f908d68384ec9c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116157) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:33:28.378768 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.policy [None req-464271e0-1aa5-4dda-8469-590ab6adb73c tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fedc11e2dbd74b919982a0657222cca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f16202549724b878f908d68384ec9c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116157) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:33:28.379858 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: INFO nova.api.openstack.requestlog [None req-464271e0-1aa5-4dda-8469-590ab6adb73c tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] 10.222.0.18 "GET /compute/v2.1/servers/137d7cd0-8812-42b6-b871-6aab82c07bdc" status: 200 len: 1405 microversion: 2.20 time: 0.152413 Dec 15 03:33:28.380405 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: [pid: 116157|app: 0|req: 925/1911] 10.222.0.18 () {60 vars in 1276 bytes} [Wed Dec 15 03:33:28 2021] GET /compute/v2.1/servers/137d7cd0-8812-42b6-b871-6aab82c07bdc => generated 1405 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Dec 15 03:33:29.398024 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi [None req-815c233a-8354-45e8-9654-54e0abf804ff tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Calling method '>' {{(pid=116157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:33:29.398668 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.compute.api [None req-815c233a-8354-45e8-9654-54e0abf804ff tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] [instance: 137d7cd0-8812-42b6-b871-6aab82c07bdc] Fetching instance by UUID {{(pid=116157) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:33:29.404798 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-815c233a-8354-45e8-9654-54e0abf804ff tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:33:29.405243 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-815c233a-8354-45e8-9654-54e0abf804ff tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:33:29.406531 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-815c233a-8354-45e8-9654-54e0abf804ff tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:33:29.406963 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-815c233a-8354-45e8-9654-54e0abf804ff tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:33:29.531757 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.policy [None req-815c233a-8354-45e8-9654-54e0abf804ff tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fedc11e2dbd74b919982a0657222cca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f16202549724b878f908d68384ec9c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116157) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:33:29.539367 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.policy [None req-815c233a-8354-45e8-9654-54e0abf804ff tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fedc11e2dbd74b919982a0657222cca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f16202549724b878f908d68384ec9c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116157) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:33:29.540856 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.policy [None req-815c233a-8354-45e8-9654-54e0abf804ff tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fedc11e2dbd74b919982a0657222cca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f16202549724b878f908d68384ec9c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116157) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:33:29.542030 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: INFO nova.api.openstack.requestlog [None req-815c233a-8354-45e8-9654-54e0abf804ff tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] 10.222.0.18 "GET /compute/v2.1/servers/137d7cd0-8812-42b6-b871-6aab82c07bdc" status: 200 len: 1596 microversion: 2.20 time: 0.147774 Dec 15 03:33:29.542582 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: [pid: 116157|app: 0|req: 926/1912] 10.222.0.18 () {60 vars in 1276 bytes} [Wed Dec 15 03:33:29 2021] GET /compute/v2.1/servers/137d7cd0-8812-42b6-b871-6aab82c07bdc => generated 1596 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Dec 15 03:33:29.559240 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi [None req-b5165517-12eb-475c-8ea8-663ed1dfd4fe tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Calling method '>' {{(pid=116157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:33:29.559721 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.compute.api [None req-b5165517-12eb-475c-8ea8-663ed1dfd4fe tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] [instance: 137d7cd0-8812-42b6-b871-6aab82c07bdc] Fetching instance by UUID {{(pid=116157) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:33:29.565011 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-b5165517-12eb-475c-8ea8-663ed1dfd4fe tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:33:29.565457 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-b5165517-12eb-475c-8ea8-663ed1dfd4fe tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:33:29.566315 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-b5165517-12eb-475c-8ea8-663ed1dfd4fe tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:33:29.566744 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-b5165517-12eb-475c-8ea8-663ed1dfd4fe tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:33:29.646282 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: INFO nova.api.openstack.requestlog [None req-b5165517-12eb-475c-8ea8-663ed1dfd4fe tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] 10.222.0.18 "GET /compute/v2.1/servers/137d7cd0-8812-42b6-b871-6aab82c07bdc/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.090231 Dec 15 03:33:29.646869 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: [pid: 116157|app: 0|req: 927/1913] 10.222.0.18 () {60 vars in 1315 bytes} [Wed Dec 15 03:33:29 2021] GET /compute/v2.1/servers/137d7cd0-8812-42b6-b871-6aab82c07bdc/os-interface => generated 284 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Dec 15 03:33:30.558427 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi [None req-b4dcb85b-976e-4464-911f-4b1f3fe04a6a tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 03:33:30.559423 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.compute.api [None req-b4dcb85b-976e-4464-911f-4b1f3fe04a6a tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] [instance: 137d7cd0-8812-42b6-b871-6aab82c07bdc] Fetching instance by UUID {{(pid=116157) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:33:30.565337 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-b4dcb85b-976e-4464-911f-4b1f3fe04a6a tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:33:30.565857 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-b4dcb85b-976e-4464-911f-4b1f3fe04a6a tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:33:30.566717 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-b4dcb85b-976e-4464-911f-4b1f3fe04a6a tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:33:30.567240 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-b4dcb85b-976e-4464-911f-4b1f3fe04a6a tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:33:30.645938 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: INFO nova.api.openstack.requestlog [None req-b4dcb85b-976e-4464-911f-4b1f3fe04a6a tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] 10.222.0.18 "POST /compute/v2.1/servers/137d7cd0-8812-42b6-b871-6aab82c07bdc/action" status: 200 len: 14 microversion: 2.20 time: 0.091609 Dec 15 03:33:30.649220 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: [pid: 116157|app: 0|req: 928/1914] 10.222.0.18 () {62 vars in 1318 bytes} [Wed Dec 15 03:33:30 2021] POST /compute/v2.1/servers/137d7cd0-8812-42b6-b871-6aab82c07bdc/action => generated 14 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 03:33:30.711380 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi [req-1893e2a6-606d-4693-b4c5-d783ae506db7 req-feee48e4-88a2-49ea-a783-9f044093d3b7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "137d7cd0-8812-42b6-b871-6aab82c07bdc", "tag": "d2c8771c-872e-47b5-8613-92878f05fa99"}]} {{(pid=116157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 03:33:30.712840 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 15 03:33:30.712840 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: warnings.warn(msg) Dec 15 03:33:30.721667 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [req-1893e2a6-606d-4693-b4c5-d783ae506db7 req-feee48e4-88a2-49ea-a783-9f044093d3b7 service nova] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:33:30.722147 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [req-1893e2a6-606d-4693-b4c5-d783ae506db7 req-feee48e4-88a2-49ea-a783-9f044093d3b7 service nova] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:33:30.732919 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: INFO nova.api.openstack.compute.server_external_events [req-1893e2a6-606d-4693-b4c5-d783ae506db7 req-feee48e4-88a2-49ea-a783-9f044093d3b7 service nova] Creating event network-changed:d2c8771c-872e-47b5-8613-92878f05fa99 for instance 137d7cd0-8812-42b6-b871-6aab82c07bdc on hv-cinder-81803 Dec 15 03:33:30.737692 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: INFO nova.api.openstack.requestlog [req-1893e2a6-606d-4693-b4c5-d783ae506db7 req-feee48e4-88a2-49ea-a783-9f044093d3b7 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.089679 Dec 15 03:33:30.738393 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: [pid: 116157|app: 0|req: 929/1915] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Dec 15 03:33:30 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 03:33:31.657566 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi [None req-c403f520-b850-4f1c-a741-258460990797 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 03:33:31.658585 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.compute.api [None req-c403f520-b850-4f1c-a741-258460990797 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] [instance: 137d7cd0-8812-42b6-b871-6aab82c07bdc] Fetching instance by UUID {{(pid=116157) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:33:31.664547 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-c403f520-b850-4f1c-a741-258460990797 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:33:31.664996 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-c403f520-b850-4f1c-a741-258460990797 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:33:31.665778 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-c403f520-b850-4f1c-a741-258460990797 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:33:31.666238 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-c403f520-b850-4f1c-a741-258460990797 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:33:31.745689 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: INFO nova.api.openstack.requestlog [None req-c403f520-b850-4f1c-a741-258460990797 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] 10.222.0.18 "POST /compute/v2.1/servers/137d7cd0-8812-42b6-b871-6aab82c07bdc/action" status: 200 len: 14 microversion: 2.20 time: 0.092384 Dec 15 03:33:31.746445 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: [pid: 116157|app: 0|req: 930/1916] 10.222.0.18 () {62 vars in 1318 bytes} [Wed Dec 15 03:33:31 2021] POST /compute/v2.1/servers/137d7cd0-8812-42b6-b871-6aab82c07bdc/action => generated 14 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 03:33:32.757049 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi [None req-1a6214c3-3da5-4363-941a-c3ea15a455ff tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 03:33:32.758095 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.compute.api [None req-1a6214c3-3da5-4363-941a-c3ea15a455ff tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] [instance: 137d7cd0-8812-42b6-b871-6aab82c07bdc] Fetching instance by UUID {{(pid=116157) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:33:32.764975 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-1a6214c3-3da5-4363-941a-c3ea15a455ff tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:33:32.765423 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-1a6214c3-3da5-4363-941a-c3ea15a455ff tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:33:32.766229 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-1a6214c3-3da5-4363-941a-c3ea15a455ff tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:33:32.766666 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-1a6214c3-3da5-4363-941a-c3ea15a455ff tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:33:32.849211 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: INFO nova.api.openstack.requestlog [None req-1a6214c3-3da5-4363-941a-c3ea15a455ff tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] 10.222.0.18 "POST /compute/v2.1/servers/137d7cd0-8812-42b6-b871-6aab82c07bdc/action" status: 200 len: 14 microversion: 2.20 time: 0.095955 Dec 15 03:33:32.849795 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: [pid: 116157|app: 0|req: 931/1917] 10.222.0.18 () {62 vars in 1318 bytes} [Wed Dec 15 03:33:32 2021] POST /compute/v2.1/servers/137d7cd0-8812-42b6-b871-6aab82c07bdc/action => generated 14 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 03:33:33.860640 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi [None req-b183c2c7-f9cc-4ed6-a896-66eed73ac5e4 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 03:33:33.861635 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.compute.api [None req-b183c2c7-f9cc-4ed6-a896-66eed73ac5e4 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] [instance: 137d7cd0-8812-42b6-b871-6aab82c07bdc] Fetching instance by UUID {{(pid=116157) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:33:33.868485 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-b183c2c7-f9cc-4ed6-a896-66eed73ac5e4 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:33:33.868937 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-b183c2c7-f9cc-4ed6-a896-66eed73ac5e4 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:33:33.869716 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-b183c2c7-f9cc-4ed6-a896-66eed73ac5e4 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:33:33.870187 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-b183c2c7-f9cc-4ed6-a896-66eed73ac5e4 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:33:33.949744 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: INFO nova.api.openstack.requestlog [None req-b183c2c7-f9cc-4ed6-a896-66eed73ac5e4 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] 10.222.0.18 "POST /compute/v2.1/servers/137d7cd0-8812-42b6-b871-6aab82c07bdc/action" status: 200 len: 14 microversion: 2.20 time: 0.093507 Dec 15 03:33:33.950349 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: [pid: 116157|app: 0|req: 932/1918] 10.222.0.18 () {62 vars in 1318 bytes} [Wed Dec 15 03:33:33 2021] POST /compute/v2.1/servers/137d7cd0-8812-42b6-b871-6aab82c07bdc/action => generated 14 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 03:33:34.961131 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi [None req-c54af47d-a318-4324-997c-ebf5d2a2809f tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 03:33:34.962163 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.compute.api [None req-c54af47d-a318-4324-997c-ebf5d2a2809f tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] [instance: 137d7cd0-8812-42b6-b871-6aab82c07bdc] Fetching instance by UUID {{(pid=116157) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:33:34.969596 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-c54af47d-a318-4324-997c-ebf5d2a2809f tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:33:34.970087 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-c54af47d-a318-4324-997c-ebf5d2a2809f tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:33:34.970882 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-c54af47d-a318-4324-997c-ebf5d2a2809f tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:33:34.971320 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-c54af47d-a318-4324-997c-ebf5d2a2809f tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:33:35.053319 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: INFO nova.api.openstack.requestlog [None req-c54af47d-a318-4324-997c-ebf5d2a2809f tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] 10.222.0.18 "POST /compute/v2.1/servers/137d7cd0-8812-42b6-b871-6aab82c07bdc/action" status: 200 len: 14 microversion: 2.20 time: 0.096047 Dec 15 03:33:35.053959 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: [pid: 116157|app: 0|req: 933/1919] 10.222.0.18 () {62 vars in 1318 bytes} [Wed Dec 15 03:33:34 2021] POST /compute/v2.1/servers/137d7cd0-8812-42b6-b871-6aab82c07bdc/action => generated 14 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 03:33:36.065136 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi [None req-3a06f753-f955-431f-9c45-34462bf67fc7 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 03:33:36.066167 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.compute.api [None req-3a06f753-f955-431f-9c45-34462bf67fc7 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] [instance: 137d7cd0-8812-42b6-b871-6aab82c07bdc] Fetching instance by UUID {{(pid=116157) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:33:36.072975 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-3a06f753-f955-431f-9c45-34462bf67fc7 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:33:36.073425 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-3a06f753-f955-431f-9c45-34462bf67fc7 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:33:36.074259 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-3a06f753-f955-431f-9c45-34462bf67fc7 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:33:36.074700 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-3a06f753-f955-431f-9c45-34462bf67fc7 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:33:36.151729 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: INFO nova.api.openstack.requestlog [None req-3a06f753-f955-431f-9c45-34462bf67fc7 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] 10.222.0.18 "POST /compute/v2.1/servers/137d7cd0-8812-42b6-b871-6aab82c07bdc/action" status: 200 len: 14 microversion: 2.20 time: 0.090999 Dec 15 03:33:36.152254 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: [pid: 116157|app: 0|req: 934/1920] 10.222.0.18 () {62 vars in 1318 bytes} [Wed Dec 15 03:33:36 2021] POST /compute/v2.1/servers/137d7cd0-8812-42b6-b871-6aab82c07bdc/action => generated 14 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 03:33:37.162912 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi [None req-3abed73f-cfc8-4dc2-8a16-917e769a32e0 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 03:33:37.163899 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.compute.api [None req-3abed73f-cfc8-4dc2-8a16-917e769a32e0 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] [instance: 137d7cd0-8812-42b6-b871-6aab82c07bdc] Fetching instance by UUID {{(pid=116157) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:33:37.170710 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-3abed73f-cfc8-4dc2-8a16-917e769a32e0 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:33:37.171667 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-3abed73f-cfc8-4dc2-8a16-917e769a32e0 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:33:37.172437 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-3abed73f-cfc8-4dc2-8a16-917e769a32e0 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:33:37.172867 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-3abed73f-cfc8-4dc2-8a16-917e769a32e0 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:33:37.252774 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: INFO nova.api.openstack.requestlog [None req-3abed73f-cfc8-4dc2-8a16-917e769a32e0 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] 10.222.0.18 "POST /compute/v2.1/servers/137d7cd0-8812-42b6-b871-6aab82c07bdc/action" status: 200 len: 14 microversion: 2.20 time: 0.093806 Dec 15 03:33:37.253408 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: [pid: 116157|app: 0|req: 935/1921] 10.222.0.18 () {62 vars in 1318 bytes} [Wed Dec 15 03:33:37 2021] POST /compute/v2.1/servers/137d7cd0-8812-42b6-b871-6aab82c07bdc/action => generated 14 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 03:33:38.264036 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi [None req-59f1395e-d824-441b-872a-84da9003fe71 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 03:33:38.265585 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.compute.api [None req-59f1395e-d824-441b-872a-84da9003fe71 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] [instance: 137d7cd0-8812-42b6-b871-6aab82c07bdc] Fetching instance by UUID {{(pid=116157) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:33:38.272377 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-59f1395e-d824-441b-872a-84da9003fe71 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:33:38.272819 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-59f1395e-d824-441b-872a-84da9003fe71 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:33:38.273590 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-59f1395e-d824-441b-872a-84da9003fe71 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:33:38.274044 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-59f1395e-d824-441b-872a-84da9003fe71 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:33:38.355018 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: INFO nova.api.openstack.requestlog [None req-59f1395e-d824-441b-872a-84da9003fe71 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] 10.222.0.18 "POST /compute/v2.1/servers/137d7cd0-8812-42b6-b871-6aab82c07bdc/action" status: 200 len: 14 microversion: 2.20 time: 0.094977 Dec 15 03:33:38.355777 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: [pid: 116157|app: 0|req: 936/1922] 10.222.0.18 () {62 vars in 1318 bytes} [Wed Dec 15 03:33:38 2021] POST /compute/v2.1/servers/137d7cd0-8812-42b6-b871-6aab82c07bdc/action => generated 14 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 03:33:39.366822 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi [None req-1b7468f4-d9cb-4ceb-b73b-80bd9bee678a tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 03:33:39.367820 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.compute.api [None req-1b7468f4-d9cb-4ceb-b73b-80bd9bee678a tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] [instance: 137d7cd0-8812-42b6-b871-6aab82c07bdc] Fetching instance by UUID {{(pid=116157) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:33:39.374638 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-1b7468f4-d9cb-4ceb-b73b-80bd9bee678a tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:33:39.375086 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-1b7468f4-d9cb-4ceb-b73b-80bd9bee678a tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:33:39.375866 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-1b7468f4-d9cb-4ceb-b73b-80bd9bee678a tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:33:39.376298 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-1b7468f4-d9cb-4ceb-b73b-80bd9bee678a tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:33:39.458172 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: INFO nova.api.openstack.requestlog [None req-1b7468f4-d9cb-4ceb-b73b-80bd9bee678a tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] 10.222.0.18 "POST /compute/v2.1/servers/137d7cd0-8812-42b6-b871-6aab82c07bdc/action" status: 200 len: 14 microversion: 2.20 time: 0.095384 Dec 15 03:33:39.458885 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: [pid: 116157|app: 0|req: 937/1923] 10.222.0.18 () {62 vars in 1318 bytes} [Wed Dec 15 03:33:39 2021] POST /compute/v2.1/servers/137d7cd0-8812-42b6-b871-6aab82c07bdc/action => generated 14 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 03:33:40.470186 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi [None req-2481997d-1f51-4a19-9809-8f0abc711af5 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 03:33:40.471154 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.compute.api [None req-2481997d-1f51-4a19-9809-8f0abc711af5 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] [instance: 137d7cd0-8812-42b6-b871-6aab82c07bdc] Fetching instance by UUID {{(pid=116157) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:33:40.478260 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-2481997d-1f51-4a19-9809-8f0abc711af5 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:33:40.478718 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-2481997d-1f51-4a19-9809-8f0abc711af5 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:33:40.479498 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-2481997d-1f51-4a19-9809-8f0abc711af5 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:33:40.479933 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-2481997d-1f51-4a19-9809-8f0abc711af5 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:33:40.565537 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: INFO nova.api.openstack.requestlog [None req-2481997d-1f51-4a19-9809-8f0abc711af5 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] 10.222.0.18 "POST /compute/v2.1/servers/137d7cd0-8812-42b6-b871-6aab82c07bdc/action" status: 200 len: 7120 microversion: 2.20 time: 0.100002 Dec 15 03:33:40.566180 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: [pid: 116157|app: 0|req: 938/1924] 10.222.0.18 () {62 vars in 1318 bytes} [Wed Dec 15 03:33:40 2021] POST /compute/v2.1/servers/137d7cd0-8812-42b6-b871-6aab82c07bdc/action => generated 7120 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Dec 15 03:33:41.576188 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi [None req-6dfe6e9b-8543-4c9c-9b47-f412dba695f1 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 03:33:41.577184 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.compute.api [None req-6dfe6e9b-8543-4c9c-9b47-f412dba695f1 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] [instance: 137d7cd0-8812-42b6-b871-6aab82c07bdc] Fetching instance by UUID {{(pid=116157) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:33:41.584022 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-6dfe6e9b-8543-4c9c-9b47-f412dba695f1 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:33:41.584470 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-6dfe6e9b-8543-4c9c-9b47-f412dba695f1 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:33:41.585240 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-6dfe6e9b-8543-4c9c-9b47-f412dba695f1 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:33:41.585671 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-6dfe6e9b-8543-4c9c-9b47-f412dba695f1 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:33:41.675231 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: INFO nova.api.openstack.requestlog [None req-6dfe6e9b-8543-4c9c-9b47-f412dba695f1 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] 10.222.0.18 "POST /compute/v2.1/servers/137d7cd0-8812-42b6-b871-6aab82c07bdc/action" status: 200 len: 15753 microversion: 2.20 time: 0.102917 Dec 15 03:33:41.675853 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: [pid: 116157|app: 0|req: 939/1925] 10.222.0.18 () {62 vars in 1318 bytes} [Wed Dec 15 03:33:41 2021] POST /compute/v2.1/servers/137d7cd0-8812-42b6-b871-6aab82c07bdc/action => generated 15753 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Dec 15 03:33:42.687030 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi [None req-314b1f3d-8527-481b-a554-e27ff5c594da tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 03:33:42.688020 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.compute.api [None req-314b1f3d-8527-481b-a554-e27ff5c594da tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] [instance: 137d7cd0-8812-42b6-b871-6aab82c07bdc] Fetching instance by UUID {{(pid=116157) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:33:42.694825 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-314b1f3d-8527-481b-a554-e27ff5c594da tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:33:42.695271 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-314b1f3d-8527-481b-a554-e27ff5c594da tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:33:42.696041 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-314b1f3d-8527-481b-a554-e27ff5c594da tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:33:42.696472 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-314b1f3d-8527-481b-a554-e27ff5c594da tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:33:42.780663 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: INFO nova.api.openstack.requestlog [None req-314b1f3d-8527-481b-a554-e27ff5c594da tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] 10.222.0.18 "POST /compute/v2.1/servers/137d7cd0-8812-42b6-b871-6aab82c07bdc/action" status: 200 len: 18498 microversion: 2.20 time: 0.097557 Dec 15 03:33:42.781273 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: [pid: 116157|app: 0|req: 940/1926] 10.222.0.18 () {62 vars in 1318 bytes} [Wed Dec 15 03:33:42 2021] POST /compute/v2.1/servers/137d7cd0-8812-42b6-b871-6aab82c07bdc/action => generated 18498 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Dec 15 03:33:43.793078 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi [None req-4e21e57a-6d6b-420c-acb7-5a20108b02d6 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 03:33:43.794107 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.compute.api [None req-4e21e57a-6d6b-420c-acb7-5a20108b02d6 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] [instance: 137d7cd0-8812-42b6-b871-6aab82c07bdc] Fetching instance by UUID {{(pid=116157) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:33:43.801179 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-4e21e57a-6d6b-420c-acb7-5a20108b02d6 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:33:43.801624 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-4e21e57a-6d6b-420c-acb7-5a20108b02d6 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:33:43.802436 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-4e21e57a-6d6b-420c-acb7-5a20108b02d6 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:33:43.802873 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-4e21e57a-6d6b-420c-acb7-5a20108b02d6 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:33:43.890208 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: INFO nova.api.openstack.requestlog [None req-4e21e57a-6d6b-420c-acb7-5a20108b02d6 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] 10.222.0.18 "POST /compute/v2.1/servers/137d7cd0-8812-42b6-b871-6aab82c07bdc/action" status: 200 len: 20997 microversion: 2.20 time: 0.100950 Dec 15 03:33:43.891109 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: [pid: 116157|app: 0|req: 941/1927] 10.222.0.18 () {62 vars in 1318 bytes} [Wed Dec 15 03:33:43 2021] POST /compute/v2.1/servers/137d7cd0-8812-42b6-b871-6aab82c07bdc/action => generated 20997 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Dec 15 03:33:44.902213 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi [None req-4ca8df72-022c-413a-85fb-987da35978c9 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 03:33:44.903330 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.compute.api [None req-4ca8df72-022c-413a-85fb-987da35978c9 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] [instance: 137d7cd0-8812-42b6-b871-6aab82c07bdc] Fetching instance by UUID {{(pid=116157) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:33:44.910282 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-4ca8df72-022c-413a-85fb-987da35978c9 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:33:44.910733 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-4ca8df72-022c-413a-85fb-987da35978c9 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:33:44.911541 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-4ca8df72-022c-413a-85fb-987da35978c9 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:33:44.911979 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-4ca8df72-022c-413a-85fb-987da35978c9 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:33:45.003964 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: INFO nova.api.openstack.requestlog [None req-4ca8df72-022c-413a-85fb-987da35978c9 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] 10.222.0.18 "POST /compute/v2.1/servers/137d7cd0-8812-42b6-b871-6aab82c07bdc/action" status: 200 len: 22981 microversion: 2.20 time: 0.105685 Dec 15 03:33:45.004575 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: [pid: 116157|app: 0|req: 942/1928] 10.222.0.18 () {62 vars in 1318 bytes} [Wed Dec 15 03:33:44 2021] POST /compute/v2.1/servers/137d7cd0-8812-42b6-b871-6aab82c07bdc/action => generated 22981 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Dec 15 03:33:46.015830 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi [None req-fd0318ce-2e9b-4618-86d7-131df2fdffc7 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 03:33:46.016826 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.compute.api [None req-fd0318ce-2e9b-4618-86d7-131df2fdffc7 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] [instance: 137d7cd0-8812-42b6-b871-6aab82c07bdc] Fetching instance by UUID {{(pid=116157) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:33:46.023634 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-fd0318ce-2e9b-4618-86d7-131df2fdffc7 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:33:46.024086 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-fd0318ce-2e9b-4618-86d7-131df2fdffc7 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:33:46.024866 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-fd0318ce-2e9b-4618-86d7-131df2fdffc7 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:33:46.025301 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-fd0318ce-2e9b-4618-86d7-131df2fdffc7 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:33:46.113682 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: INFO nova.api.openstack.requestlog [None req-fd0318ce-2e9b-4618-86d7-131df2fdffc7 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] 10.222.0.18 "POST /compute/v2.1/servers/137d7cd0-8812-42b6-b871-6aab82c07bdc/action" status: 200 len: 24436 microversion: 2.20 time: 0.101827 Dec 15 03:33:46.114347 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: [pid: 116157|app: 0|req: 943/1929] 10.222.0.18 () {62 vars in 1318 bytes} [Wed Dec 15 03:33:46 2021] POST /compute/v2.1/servers/137d7cd0-8812-42b6-b871-6aab82c07bdc/action => generated 24436 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Dec 15 03:33:47.125863 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi [None req-231fcbb9-2e9d-415b-b3f0-d3329b4e8009 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 03:33:47.126899 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.compute.api [None req-231fcbb9-2e9d-415b-b3f0-d3329b4e8009 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] [instance: 137d7cd0-8812-42b6-b871-6aab82c07bdc] Fetching instance by UUID {{(pid=116157) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:33:47.133719 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-231fcbb9-2e9d-415b-b3f0-d3329b4e8009 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:33:47.134195 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-231fcbb9-2e9d-415b-b3f0-d3329b4e8009 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:33:47.134975 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-231fcbb9-2e9d-415b-b3f0-d3329b4e8009 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:33:47.135407 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-231fcbb9-2e9d-415b-b3f0-d3329b4e8009 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:33:47.225765 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: INFO nova.api.openstack.requestlog [None req-231fcbb9-2e9d-415b-b3f0-d3329b4e8009 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] 10.222.0.18 "POST /compute/v2.1/servers/137d7cd0-8812-42b6-b871-6aab82c07bdc/action" status: 200 len: 26113 microversion: 2.20 time: 0.104456 Dec 15 03:33:47.226453 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: [pid: 116157|app: 0|req: 944/1930] 10.222.0.18 () {62 vars in 1318 bytes} [Wed Dec 15 03:33:47 2021] POST /compute/v2.1/servers/137d7cd0-8812-42b6-b871-6aab82c07bdc/action => generated 26113 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Dec 15 03:33:48.238362 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi [None req-b325e7b2-4549-4acd-8742-2013c9967399 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 03:33:48.239401 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.compute.api [None req-b325e7b2-4549-4acd-8742-2013c9967399 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] [instance: 137d7cd0-8812-42b6-b871-6aab82c07bdc] Fetching instance by UUID {{(pid=116157) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:33:48.246225 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-b325e7b2-4549-4acd-8742-2013c9967399 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:33:48.246670 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-b325e7b2-4549-4acd-8742-2013c9967399 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:33:48.247442 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-b325e7b2-4549-4acd-8742-2013c9967399 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:33:48.247878 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-b325e7b2-4549-4acd-8742-2013c9967399 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:33:48.343367 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: INFO nova.api.openstack.requestlog [None req-b325e7b2-4549-4acd-8742-2013c9967399 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] 10.222.0.18 "POST /compute/v2.1/servers/137d7cd0-8812-42b6-b871-6aab82c07bdc/action" status: 200 len: 27335 microversion: 2.20 time: 0.109824 Dec 15 03:33:48.344228 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: [pid: 116157|app: 0|req: 945/1931] 10.222.0.18 () {62 vars in 1318 bytes} [Wed Dec 15 03:33:48 2021] POST /compute/v2.1/servers/137d7cd0-8812-42b6-b871-6aab82c07bdc/action => generated 27335 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Dec 15 03:33:49.354771 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi [None req-76b4a285-293c-49d3-911b-0d622d92e762 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 03:33:49.355778 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.compute.api [None req-76b4a285-293c-49d3-911b-0d622d92e762 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] [instance: 137d7cd0-8812-42b6-b871-6aab82c07bdc] Fetching instance by UUID {{(pid=116157) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:33:49.362868 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-76b4a285-293c-49d3-911b-0d622d92e762 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:33:49.363326 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-76b4a285-293c-49d3-911b-0d622d92e762 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:33:49.364115 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-76b4a285-293c-49d3-911b-0d622d92e762 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:33:49.364556 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-76b4a285-293c-49d3-911b-0d622d92e762 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:33:49.453165 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: INFO nova.api.openstack.requestlog [None req-76b4a285-293c-49d3-911b-0d622d92e762 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] 10.222.0.18 "POST /compute/v2.1/servers/137d7cd0-8812-42b6-b871-6aab82c07bdc/action" status: 200 len: 27895 microversion: 2.20 time: 0.102262 Dec 15 03:33:49.454321 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: [pid: 116157|app: 0|req: 946/1932] 10.222.0.18 () {62 vars in 1318 bytes} [Wed Dec 15 03:33:49 2021] POST /compute/v2.1/servers/137d7cd0-8812-42b6-b871-6aab82c07bdc/action => generated 27895 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Dec 15 03:33:50.465670 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi [None req-9cf49ae3-9ad5-488a-990d-f2dbce5ba3f7 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 03:33:50.466641 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.compute.api [None req-9cf49ae3-9ad5-488a-990d-f2dbce5ba3f7 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] [instance: 137d7cd0-8812-42b6-b871-6aab82c07bdc] Fetching instance by UUID {{(pid=116157) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:33:50.473731 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-9cf49ae3-9ad5-488a-990d-f2dbce5ba3f7 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:33:50.474214 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-9cf49ae3-9ad5-488a-990d-f2dbce5ba3f7 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:33:50.474993 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-9cf49ae3-9ad5-488a-990d-f2dbce5ba3f7 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:33:50.475428 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-9cf49ae3-9ad5-488a-990d-f2dbce5ba3f7 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:33:50.566378 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: INFO nova.api.openstack.requestlog [None req-9cf49ae3-9ad5-488a-990d-f2dbce5ba3f7 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] 10.222.0.18 "POST /compute/v2.1/servers/137d7cd0-8812-42b6-b871-6aab82c07bdc/action" status: 200 len: 28188 microversion: 2.20 time: 0.104638 Dec 15 03:33:50.567035 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: [pid: 116157|app: 0|req: 947/1933] 10.222.0.18 () {62 vars in 1318 bytes} [Wed Dec 15 03:33:50 2021] POST /compute/v2.1/servers/137d7cd0-8812-42b6-b871-6aab82c07bdc/action => generated 28188 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 15 03:33:51.578464 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi [None req-7a51f9cf-aa06-47dc-aa24-4407a9995a06 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 03:33:51.580151 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.compute.api [None req-7a51f9cf-aa06-47dc-aa24-4407a9995a06 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] [instance: 137d7cd0-8812-42b6-b871-6aab82c07bdc] Fetching instance by UUID {{(pid=116157) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:33:51.587027 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-7a51f9cf-aa06-47dc-aa24-4407a9995a06 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:33:51.587483 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-7a51f9cf-aa06-47dc-aa24-4407a9995a06 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:33:51.588304 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-7a51f9cf-aa06-47dc-aa24-4407a9995a06 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:33:51.588748 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-7a51f9cf-aa06-47dc-aa24-4407a9995a06 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:33:51.674442 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: INFO nova.api.openstack.requestlog [None req-7a51f9cf-aa06-47dc-aa24-4407a9995a06 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] 10.222.0.18 "POST /compute/v2.1/servers/137d7cd0-8812-42b6-b871-6aab82c07bdc/action" status: 200 len: 28188 microversion: 2.20 time: 0.099923 Dec 15 03:33:51.675078 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: [pid: 116157|app: 0|req: 948/1934] 10.222.0.18 () {62 vars in 1318 bytes} [Wed Dec 15 03:33:51 2021] POST /compute/v2.1/servers/137d7cd0-8812-42b6-b871-6aab82c07bdc/action => generated 28188 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Dec 15 03:33:52.685733 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi [None req-84848d90-d19b-4708-813a-23a2b2a56521 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 03:33:52.686767 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.compute.api [None req-84848d90-d19b-4708-813a-23a2b2a56521 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] [instance: 137d7cd0-8812-42b6-b871-6aab82c07bdc] Fetching instance by UUID {{(pid=116157) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:33:52.693663 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-84848d90-d19b-4708-813a-23a2b2a56521 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:33:52.694156 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-84848d90-d19b-4708-813a-23a2b2a56521 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:33:52.694946 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-84848d90-d19b-4708-813a-23a2b2a56521 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:33:52.695385 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-84848d90-d19b-4708-813a-23a2b2a56521 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:33:52.787662 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: INFO nova.api.openstack.requestlog [None req-84848d90-d19b-4708-813a-23a2b2a56521 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] 10.222.0.18 "POST /compute/v2.1/servers/137d7cd0-8812-42b6-b871-6aab82c07bdc/action" status: 200 len: 28479 microversion: 2.20 time: 0.105786 Dec 15 03:33:52.788557 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: [pid: 116157|app: 0|req: 949/1935] 10.222.0.18 () {62 vars in 1318 bytes} [Wed Dec 15 03:33:52 2021] POST /compute/v2.1/servers/137d7cd0-8812-42b6-b871-6aab82c07bdc/action => generated 28479 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Dec 15 03:33:53.800664 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi [None req-7dbf5ecf-31c8-4277-9794-8946d07341ca tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 03:33:53.801658 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.compute.api [None req-7dbf5ecf-31c8-4277-9794-8946d07341ca tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] [instance: 137d7cd0-8812-42b6-b871-6aab82c07bdc] Fetching instance by UUID {{(pid=116157) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:33:53.808586 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-7dbf5ecf-31c8-4277-9794-8946d07341ca tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:33:53.809057 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-7dbf5ecf-31c8-4277-9794-8946d07341ca tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:33:53.809814 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-7dbf5ecf-31c8-4277-9794-8946d07341ca tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:33:53.810283 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-7dbf5ecf-31c8-4277-9794-8946d07341ca tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:33:53.905219 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: INFO nova.api.openstack.requestlog [None req-7dbf5ecf-31c8-4277-9794-8946d07341ca tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] 10.222.0.18 "POST /compute/v2.1/servers/137d7cd0-8812-42b6-b871-6aab82c07bdc/action" status: 200 len: 28646 microversion: 2.20 time: 0.109150 Dec 15 03:33:53.905878 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: [pid: 116157|app: 0|req: 950/1936] 10.222.0.18 () {62 vars in 1318 bytes} [Wed Dec 15 03:33:53 2021] POST /compute/v2.1/servers/137d7cd0-8812-42b6-b871-6aab82c07bdc/action => generated 28646 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Dec 15 03:33:54.917324 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi [None req-8828c13f-b1fc-46b0-b53f-94fc1e17cb74 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 03:33:54.918351 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.compute.api [None req-8828c13f-b1fc-46b0-b53f-94fc1e17cb74 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] [instance: 137d7cd0-8812-42b6-b871-6aab82c07bdc] Fetching instance by UUID {{(pid=116157) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:33:54.925847 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-8828c13f-b1fc-46b0-b53f-94fc1e17cb74 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:33:54.926330 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-8828c13f-b1fc-46b0-b53f-94fc1e17cb74 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:33:54.927115 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-8828c13f-b1fc-46b0-b53f-94fc1e17cb74 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:33:54.927556 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-8828c13f-b1fc-46b0-b53f-94fc1e17cb74 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:33:55.014078 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: INFO nova.api.openstack.requestlog [None req-8828c13f-b1fc-46b0-b53f-94fc1e17cb74 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] 10.222.0.18 "POST /compute/v2.1/servers/137d7cd0-8812-42b6-b871-6aab82c07bdc/action" status: 200 len: 28646 microversion: 2.20 time: 0.100651 Dec 15 03:33:55.014692 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: [pid: 116157|app: 0|req: 951/1937] 10.222.0.18 () {62 vars in 1318 bytes} [Wed Dec 15 03:33:54 2021] POST /compute/v2.1/servers/137d7cd0-8812-42b6-b871-6aab82c07bdc/action => generated 28646 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Dec 15 03:33:56.025342 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi [None req-c317b611-8c95-4404-a076-9fba1e825467 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 03:33:56.026362 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.compute.api [None req-c317b611-8c95-4404-a076-9fba1e825467 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] [instance: 137d7cd0-8812-42b6-b871-6aab82c07bdc] Fetching instance by UUID {{(pid=116157) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:33:56.033215 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-c317b611-8c95-4404-a076-9fba1e825467 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:33:56.033709 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-c317b611-8c95-4404-a076-9fba1e825467 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:33:56.034570 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-c317b611-8c95-4404-a076-9fba1e825467 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:33:56.035011 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-c317b611-8c95-4404-a076-9fba1e825467 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:33:56.117621 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: INFO nova.api.openstack.requestlog [None req-c317b611-8c95-4404-a076-9fba1e825467 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] 10.222.0.18 "POST /compute/v2.1/servers/137d7cd0-8812-42b6-b871-6aab82c07bdc/action" status: 200 len: 28646 microversion: 2.20 time: 0.096183 Dec 15 03:33:56.118279 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: [pid: 116157|app: 0|req: 952/1938] 10.222.0.18 () {62 vars in 1318 bytes} [Wed Dec 15 03:33:56 2021] POST /compute/v2.1/servers/137d7cd0-8812-42b6-b871-6aab82c07bdc/action => generated 28646 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Dec 15 03:33:57.129309 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi [None req-c1856617-1b28-4b6e-aa0c-e0abd74ad635 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 03:33:57.130350 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.compute.api [None req-c1856617-1b28-4b6e-aa0c-e0abd74ad635 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] [instance: 137d7cd0-8812-42b6-b871-6aab82c07bdc] Fetching instance by UUID {{(pid=116157) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:33:57.137270 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-c1856617-1b28-4b6e-aa0c-e0abd74ad635 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:33:57.137725 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-c1856617-1b28-4b6e-aa0c-e0abd74ad635 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:33:57.138552 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-c1856617-1b28-4b6e-aa0c-e0abd74ad635 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:33:57.138998 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-c1856617-1b28-4b6e-aa0c-e0abd74ad635 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:33:57.227947 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: INFO nova.api.openstack.requestlog [None req-c1856617-1b28-4b6e-aa0c-e0abd74ad635 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] 10.222.0.18 "POST /compute/v2.1/servers/137d7cd0-8812-42b6-b871-6aab82c07bdc/action" status: 200 len: 30875 microversion: 2.20 time: 0.102700 Dec 15 03:33:57.228864 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: [pid: 116157|app: 0|req: 953/1939] 10.222.0.18 () {62 vars in 1318 bytes} [Wed Dec 15 03:33:57 2021] POST /compute/v2.1/servers/137d7cd0-8812-42b6-b871-6aab82c07bdc/action => generated 30875 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Dec 15 03:33:58.240586 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi [None req-878bf273-d542-43b4-b7c1-65470850178d tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 03:33:58.241575 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.compute.api [None req-878bf273-d542-43b4-b7c1-65470850178d tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] [instance: 137d7cd0-8812-42b6-b871-6aab82c07bdc] Fetching instance by UUID {{(pid=116157) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:33:58.248401 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-878bf273-d542-43b4-b7c1-65470850178d tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:33:58.248870 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-878bf273-d542-43b4-b7c1-65470850178d tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:33:58.249641 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-878bf273-d542-43b4-b7c1-65470850178d tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:33:58.250109 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-878bf273-d542-43b4-b7c1-65470850178d tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:33:58.336792 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: INFO nova.api.openstack.requestlog [None req-878bf273-d542-43b4-b7c1-65470850178d tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] 10.222.0.18 "POST /compute/v2.1/servers/137d7cd0-8812-42b6-b871-6aab82c07bdc/action" status: 200 len: 32678 microversion: 2.20 time: 0.100556 Dec 15 03:33:58.337451 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: [pid: 116157|app: 0|req: 954/1940] 10.222.0.18 () {62 vars in 1318 bytes} [Wed Dec 15 03:33:58 2021] POST /compute/v2.1/servers/137d7cd0-8812-42b6-b871-6aab82c07bdc/action => generated 32678 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Dec 15 03:33:59.349026 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi [None req-bd3b7f24-25cf-4a00-a032-ef13ae07ab15 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 03:33:59.350043 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.compute.api [None req-bd3b7f24-25cf-4a00-a032-ef13ae07ab15 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] [instance: 137d7cd0-8812-42b6-b871-6aab82c07bdc] Fetching instance by UUID {{(pid=116157) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:33:59.356807 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-bd3b7f24-25cf-4a00-a032-ef13ae07ab15 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:33:59.357263 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-bd3b7f24-25cf-4a00-a032-ef13ae07ab15 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:33:59.358074 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-bd3b7f24-25cf-4a00-a032-ef13ae07ab15 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:33:59.358513 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-bd3b7f24-25cf-4a00-a032-ef13ae07ab15 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:33:59.446374 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: INFO nova.api.openstack.requestlog [None req-bd3b7f24-25cf-4a00-a032-ef13ae07ab15 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] 10.222.0.18 "POST /compute/v2.1/servers/137d7cd0-8812-42b6-b871-6aab82c07bdc/action" status: 200 len: 33765 microversion: 2.20 time: 0.101594 Dec 15 03:33:59.447028 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: [pid: 116157|app: 0|req: 955/1941] 10.222.0.18 () {62 vars in 1318 bytes} [Wed Dec 15 03:33:59 2021] POST /compute/v2.1/servers/137d7cd0-8812-42b6-b871-6aab82c07bdc/action => generated 33765 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Dec 15 03:34:00.459203 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi [None req-703a0ae1-032e-4fec-a7e7-aa127a463e67 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 03:34:00.460142 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.compute.api [None req-703a0ae1-032e-4fec-a7e7-aa127a463e67 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] [instance: 137d7cd0-8812-42b6-b871-6aab82c07bdc] Fetching instance by UUID {{(pid=116157) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:34:00.466934 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-703a0ae1-032e-4fec-a7e7-aa127a463e67 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:34:00.467416 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-703a0ae1-032e-4fec-a7e7-aa127a463e67 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:34:00.468194 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-703a0ae1-032e-4fec-a7e7-aa127a463e67 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:34:00.468631 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-703a0ae1-032e-4fec-a7e7-aa127a463e67 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:34:00.556094 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: INFO nova.api.openstack.requestlog [None req-703a0ae1-032e-4fec-a7e7-aa127a463e67 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] 10.222.0.18 "POST /compute/v2.1/servers/137d7cd0-8812-42b6-b871-6aab82c07bdc/action" status: 200 len: 35046 microversion: 2.20 time: 0.101398 Dec 15 03:34:00.556718 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: [pid: 116157|app: 0|req: 956/1942] 10.222.0.18 () {62 vars in 1318 bytes} [Wed Dec 15 03:34:00 2021] POST /compute/v2.1/servers/137d7cd0-8812-42b6-b871-6aab82c07bdc/action => generated 35046 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Dec 15 03:34:01.568969 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi [None req-bbbff0a0-88b2-4cc9-85da-bb588d355c88 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 03:34:01.569960 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.compute.api [None req-bbbff0a0-88b2-4cc9-85da-bb588d355c88 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] [instance: 137d7cd0-8812-42b6-b871-6aab82c07bdc] Fetching instance by UUID {{(pid=116157) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:34:01.576697 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-bbbff0a0-88b2-4cc9-85da-bb588d355c88 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:34:01.577141 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-bbbff0a0-88b2-4cc9-85da-bb588d355c88 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:34:01.577912 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-bbbff0a0-88b2-4cc9-85da-bb588d355c88 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:34:01.578366 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-bbbff0a0-88b2-4cc9-85da-bb588d355c88 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:34:01.666984 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: INFO nova.api.openstack.requestlog [None req-bbbff0a0-88b2-4cc9-85da-bb588d355c88 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] 10.222.0.18 "POST /compute/v2.1/servers/137d7cd0-8812-42b6-b871-6aab82c07bdc/action" status: 200 len: 36597 microversion: 2.20 time: 0.102391 Dec 15 03:34:01.667615 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: [pid: 116157|app: 0|req: 957/1943] 10.222.0.18 () {62 vars in 1318 bytes} [Wed Dec 15 03:34:01 2021] POST /compute/v2.1/servers/137d7cd0-8812-42b6-b871-6aab82c07bdc/action => generated 36597 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Dec 15 03:34:02.679161 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi [None req-bc40d46f-0716-4305-8ddb-4ce16ce85fee tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 03:34:02.680152 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.compute.api [None req-bc40d46f-0716-4305-8ddb-4ce16ce85fee tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] [instance: 137d7cd0-8812-42b6-b871-6aab82c07bdc] Fetching instance by UUID {{(pid=116157) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:34:02.686999 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-bc40d46f-0716-4305-8ddb-4ce16ce85fee tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:34:02.687433 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-bc40d46f-0716-4305-8ddb-4ce16ce85fee tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:34:02.688206 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-bc40d46f-0716-4305-8ddb-4ce16ce85fee tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:34:02.688638 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-bc40d46f-0716-4305-8ddb-4ce16ce85fee tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:34:02.776462 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: INFO nova.api.openstack.requestlog [None req-bc40d46f-0716-4305-8ddb-4ce16ce85fee tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] 10.222.0.18 "POST /compute/v2.1/servers/137d7cd0-8812-42b6-b871-6aab82c07bdc/action" status: 200 len: 38199 microversion: 2.20 time: 0.101162 Dec 15 03:34:02.777343 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: [pid: 116157|app: 0|req: 958/1944] 10.222.0.18 () {62 vars in 1318 bytes} [Wed Dec 15 03:34:02 2021] POST /compute/v2.1/servers/137d7cd0-8812-42b6-b871-6aab82c07bdc/action => generated 38199 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Dec 15 03:34:03.789405 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi [None req-8b0e78e5-e5bb-469d-99aa-37ebb0f61199 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 03:34:03.790434 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.compute.api [None req-8b0e78e5-e5bb-469d-99aa-37ebb0f61199 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] [instance: 137d7cd0-8812-42b6-b871-6aab82c07bdc] Fetching instance by UUID {{(pid=116157) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:34:03.797270 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-8b0e78e5-e5bb-469d-99aa-37ebb0f61199 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:34:03.797718 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-8b0e78e5-e5bb-469d-99aa-37ebb0f61199 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:34:03.798635 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-8b0e78e5-e5bb-469d-99aa-37ebb0f61199 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:34:03.799593 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-8b0e78e5-e5bb-469d-99aa-37ebb0f61199 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:34:03.887411 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: INFO nova.api.openstack.requestlog [None req-8b0e78e5-e5bb-469d-99aa-37ebb0f61199 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] 10.222.0.18 "POST /compute/v2.1/servers/137d7cd0-8812-42b6-b871-6aab82c07bdc/action" status: 200 len: 38201 microversion: 2.20 time: 0.101942 Dec 15 03:34:03.888045 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: [pid: 116157|app: 0|req: 959/1945] 10.222.0.18 () {62 vars in 1318 bytes} [Wed Dec 15 03:34:03 2021] POST /compute/v2.1/servers/137d7cd0-8812-42b6-b871-6aab82c07bdc/action => generated 38201 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Dec 15 03:34:04.899757 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi [None req-8589031a-98bd-43ca-a9ed-5be7da18edfd tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 03:34:04.900781 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.compute.api [None req-8589031a-98bd-43ca-a9ed-5be7da18edfd tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] [instance: 137d7cd0-8812-42b6-b871-6aab82c07bdc] Fetching instance by UUID {{(pid=116157) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:34:04.907613 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-8589031a-98bd-43ca-a9ed-5be7da18edfd tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:34:04.908092 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-8589031a-98bd-43ca-a9ed-5be7da18edfd tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:34:04.908883 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-8589031a-98bd-43ca-a9ed-5be7da18edfd tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:34:04.909315 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-8589031a-98bd-43ca-a9ed-5be7da18edfd tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:34:04.990152 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: INFO nova.api.openstack.requestlog [None req-8589031a-98bd-43ca-a9ed-5be7da18edfd tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] 10.222.0.18 "POST /compute/v2.1/servers/137d7cd0-8812-42b6-b871-6aab82c07bdc/action" status: 200 len: 38201 microversion: 2.20 time: 0.094338 Dec 15 03:34:04.990795 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: [pid: 116157|app: 0|req: 960/1946] 10.222.0.18 () {62 vars in 1318 bytes} [Wed Dec 15 03:34:04 2021] POST /compute/v2.1/servers/137d7cd0-8812-42b6-b871-6aab82c07bdc/action => generated 38201 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Dec 15 03:34:06.002101 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi [None req-0c9bc9cc-b770-42e6-8aff-d1a4c8bf5207 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 03:34:06.003108 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.compute.api [None req-0c9bc9cc-b770-42e6-8aff-d1a4c8bf5207 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] [instance: 137d7cd0-8812-42b6-b871-6aab82c07bdc] Fetching instance by UUID {{(pid=116157) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:34:06.009908 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-0c9bc9cc-b770-42e6-8aff-d1a4c8bf5207 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:34:06.010383 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-0c9bc9cc-b770-42e6-8aff-d1a4c8bf5207 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:34:06.011163 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-0c9bc9cc-b770-42e6-8aff-d1a4c8bf5207 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:34:06.011592 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-0c9bc9cc-b770-42e6-8aff-d1a4c8bf5207 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:34:06.093107 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: INFO nova.api.openstack.requestlog [None req-0c9bc9cc-b770-42e6-8aff-d1a4c8bf5207 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] 10.222.0.18 "POST /compute/v2.1/servers/137d7cd0-8812-42b6-b871-6aab82c07bdc/action" status: 200 len: 38201 microversion: 2.20 time: 0.095489 Dec 15 03:34:06.093725 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: [pid: 116157|app: 0|req: 961/1947] 10.222.0.18 () {62 vars in 1318 bytes} [Wed Dec 15 03:34:05 2021] POST /compute/v2.1/servers/137d7cd0-8812-42b6-b871-6aab82c07bdc/action => generated 38201 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Dec 15 03:34:07.105155 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi [None req-2d4ccb33-854b-4093-816b-02aa26d320ac tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 03:34:07.106170 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.compute.api [None req-2d4ccb33-854b-4093-816b-02aa26d320ac tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] [instance: 137d7cd0-8812-42b6-b871-6aab82c07bdc] Fetching instance by UUID {{(pid=116157) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:34:07.113469 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-2d4ccb33-854b-4093-816b-02aa26d320ac tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:34:07.113951 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-2d4ccb33-854b-4093-816b-02aa26d320ac tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:34:07.114754 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-2d4ccb33-854b-4093-816b-02aa26d320ac tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:34:07.115186 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-2d4ccb33-854b-4093-816b-02aa26d320ac tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:34:07.203139 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: INFO nova.api.openstack.requestlog [None req-2d4ccb33-854b-4093-816b-02aa26d320ac tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] 10.222.0.18 "POST /compute/v2.1/servers/137d7cd0-8812-42b6-b871-6aab82c07bdc/action" status: 200 len: 38342 microversion: 2.20 time: 0.101861 Dec 15 03:34:07.204340 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: [pid: 116157|app: 0|req: 962/1948] 10.222.0.18 () {62 vars in 1318 bytes} [Wed Dec 15 03:34:07 2021] POST /compute/v2.1/servers/137d7cd0-8812-42b6-b871-6aab82c07bdc/action => generated 38342 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Dec 15 03:34:07.213870 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi [None req-b15d3af6-b897-4ac2-89f2-b54730a64b67 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Calling method '>' {{(pid=116157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:34:07.214470 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.compute.api [None req-b15d3af6-b897-4ac2-89f2-b54730a64b67 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] [instance: 137d7cd0-8812-42b6-b871-6aab82c07bdc] Fetching instance by UUID {{(pid=116157) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:34:07.221214 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-b15d3af6-b897-4ac2-89f2-b54730a64b67 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:34:07.221664 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-b15d3af6-b897-4ac2-89f2-b54730a64b67 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:34:07.222740 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-b15d3af6-b897-4ac2-89f2-b54730a64b67 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:34:07.223176 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-b15d3af6-b897-4ac2-89f2-b54730a64b67 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:34:07.246343 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: INFO nova.api.openstack.requestlog [None req-b15d3af6-b897-4ac2-89f2-b54730a64b67 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] 10.222.0.18 "GET /compute/v2.1/servers/137d7cd0-8812-42b6-b871-6aab82c07bdc/ips" status: 200 len: 150 microversion: 2.20 time: 0.036261 Dec 15 03:34:07.246906 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: [pid: 116157|app: 0|req: 963/1949] 10.222.0.18 () {60 vars in 1288 bytes} [Wed Dec 15 03:34:07 2021] GET /compute/v2.1/servers/137d7cd0-8812-42b6-b871-6aab82c07bdc/ips => generated 150 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Dec 15 03:35:07.320390 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi [None req-6f01b2a6-8759-4f2c-b43e-a8246bb9c64d tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Calling method '>' {{(pid=116157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:35:07.321041 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.compute.api [None req-6f01b2a6-8759-4f2c-b43e-a8246bb9c64d tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] [instance: 137d7cd0-8812-42b6-b871-6aab82c07bdc] Fetching instance by UUID {{(pid=116157) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:35:07.326856 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-6f01b2a6-8759-4f2c-b43e-a8246bb9c64d tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:35:07.327301 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-6f01b2a6-8759-4f2c-b43e-a8246bb9c64d tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:35:07.328074 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-6f01b2a6-8759-4f2c-b43e-a8246bb9c64d tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:35:07.328510 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-6f01b2a6-8759-4f2c-b43e-a8246bb9c64d tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:35:07.353309 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.compute.api [None req-6f01b2a6-8759-4f2c-b43e-a8246bb9c64d tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] [instance: 137d7cd0-8812-42b6-b871-6aab82c07bdc] Going to try to terminate instance {{(pid=116157) delete /opt/stack/nova/nova/compute/api.py:2614}} Dec 15 03:35:07.424356 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: INFO nova.api.openstack.requestlog [None req-6f01b2a6-8759-4f2c-b43e-a8246bb9c64d tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] 10.222.0.18 "DELETE /compute/v2.1/servers/137d7cd0-8812-42b6-b871-6aab82c07bdc" status: 204 len: 0 microversion: 2.20 time: 0.108474 Dec 15 03:35:07.425023 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: [pid: 116157|app: 0|req: 964/1950] 10.222.0.18 () {60 vars in 1279 bytes} [Wed Dec 15 03:35:07 2021] DELETE /compute/v2.1/servers/137d7cd0-8812-42b6-b871-6aab82c07bdc => generated 0 bytes in 110 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Dec 15 03:35:07.433661 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi [None req-f567ab32-e99c-4a75-9eaf-448b95e31660 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Calling method '>' {{(pid=116157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:35:07.434390 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.compute.api [None req-f567ab32-e99c-4a75-9eaf-448b95e31660 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] [instance: 137d7cd0-8812-42b6-b871-6aab82c07bdc] Fetching instance by UUID {{(pid=116157) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:35:07.440354 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-f567ab32-e99c-4a75-9eaf-448b95e31660 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:35:07.440807 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-f567ab32-e99c-4a75-9eaf-448b95e31660 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:35:07.441584 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-f567ab32-e99c-4a75-9eaf-448b95e31660 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:35:07.442041 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-f567ab32-e99c-4a75-9eaf-448b95e31660 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:35:07.572707 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.policy [None req-f567ab32-e99c-4a75-9eaf-448b95e31660 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fedc11e2dbd74b919982a0657222cca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f16202549724b878f908d68384ec9c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116157) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:35:07.580353 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.policy [None req-f567ab32-e99c-4a75-9eaf-448b95e31660 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fedc11e2dbd74b919982a0657222cca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f16202549724b878f908d68384ec9c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116157) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:35:07.581850 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.policy [None req-f567ab32-e99c-4a75-9eaf-448b95e31660 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fedc11e2dbd74b919982a0657222cca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f16202549724b878f908d68384ec9c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116157) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:35:07.583689 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: INFO nova.api.openstack.requestlog [None req-f567ab32-e99c-4a75-9eaf-448b95e31660 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] 10.222.0.18 "GET /compute/v2.1/servers/137d7cd0-8812-42b6-b871-6aab82c07bdc" status: 200 len: 1720 microversion: 2.20 time: 0.153376 Dec 15 03:35:07.584247 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: [pid: 116157|app: 0|req: 965/1951] 10.222.0.18 () {60 vars in 1276 bytes} [Wed Dec 15 03:35:07 2021] GET /compute/v2.1/servers/137d7cd0-8812-42b6-b871-6aab82c07bdc => generated 1720 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Dec 15 03:35:08.602521 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi [None req-b2fff262-86c3-4e7c-963c-bebb080ff956 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Calling method '>' {{(pid=116157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:35:08.603159 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.compute.api [None req-b2fff262-86c3-4e7c-963c-bebb080ff956 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] [instance: 137d7cd0-8812-42b6-b871-6aab82c07bdc] Fetching instance by UUID {{(pid=116157) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:35:08.609394 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-b2fff262-86c3-4e7c-963c-bebb080ff956 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:35:08.609846 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-b2fff262-86c3-4e7c-963c-bebb080ff956 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:35:08.610658 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-b2fff262-86c3-4e7c-963c-bebb080ff956 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:35:08.611095 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-b2fff262-86c3-4e7c-963c-bebb080ff956 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:35:08.740936 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.policy [None req-b2fff262-86c3-4e7c-963c-bebb080ff956 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fedc11e2dbd74b919982a0657222cca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f16202549724b878f908d68384ec9c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116157) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:35:08.748607 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.policy [None req-b2fff262-86c3-4e7c-963c-bebb080ff956 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fedc11e2dbd74b919982a0657222cca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f16202549724b878f908d68384ec9c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116157) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:35:08.750128 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.policy [None req-b2fff262-86c3-4e7c-963c-bebb080ff956 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fedc11e2dbd74b919982a0657222cca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f16202549724b878f908d68384ec9c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116157) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:35:08.751280 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: INFO nova.api.openstack.requestlog [None req-b2fff262-86c3-4e7c-963c-bebb080ff956 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] 10.222.0.18 "GET /compute/v2.1/servers/137d7cd0-8812-42b6-b871-6aab82c07bdc" status: 200 len: 1720 microversion: 2.20 time: 0.152520 Dec 15 03:35:08.751832 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: [pid: 116157|app: 0|req: 966/1952] 10.222.0.18 () {60 vars in 1276 bytes} [Wed Dec 15 03:35:08 2021] GET /compute/v2.1/servers/137d7cd0-8812-42b6-b871-6aab82c07bdc => generated 1720 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Dec 15 03:35:09.802249 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi [req-1bc6387a-73c0-47fc-b909-ac2e8b5063a9 req-f2ef777a-6ddb-445e-bb74-8ff3af97c34c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "137d7cd0-8812-42b6-b871-6aab82c07bdc", "name": "network-vif-deleted", "tag": "d2c8771c-872e-47b5-8613-92878f05fa99"}]} {{(pid=116157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 03:35:09.803934 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 15 03:35:09.803934 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: warnings.warn(msg) Dec 15 03:35:09.811054 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [req-1bc6387a-73c0-47fc-b909-ac2e8b5063a9 req-f2ef777a-6ddb-445e-bb74-8ff3af97c34c service nova] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:35:09.811502 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [req-1bc6387a-73c0-47fc-b909-ac2e8b5063a9 req-f2ef777a-6ddb-445e-bb74-8ff3af97c34c service nova] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:35:09.829647 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: INFO nova.api.openstack.compute.server_external_events [req-1bc6387a-73c0-47fc-b909-ac2e8b5063a9 req-f2ef777a-6ddb-445e-bb74-8ff3af97c34c service nova] Creating event network-vif-deleted:d2c8771c-872e-47b5-8613-92878f05fa99 for instance 137d7cd0-8812-42b6-b871-6aab82c07bdc on hv-cinder-81803 Dec 15 03:35:09.839145 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: INFO nova.api.openstack.requestlog [req-1bc6387a-73c0-47fc-b909-ac2e8b5063a9 req-f2ef777a-6ddb-445e-bb74-8ff3af97c34c service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.097300 Dec 15 03:35:09.840174 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: [pid: 116157|app: 0|req: 967/1953] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Dec 15 03:35:09 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 15 03:35:09.847556 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi [None req-0e285dec-3f59-42dc-bf96-f35922a962da tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Calling method '>' {{(pid=116157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:35:09.849008 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.compute.api [None req-0e285dec-3f59-42dc-bf96-f35922a962da tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] [instance: 137d7cd0-8812-42b6-b871-6aab82c07bdc] Fetching instance by UUID {{(pid=116157) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:35:09.856934 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-0e285dec-3f59-42dc-bf96-f35922a962da tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:35:09.857382 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-0e285dec-3f59-42dc-bf96-f35922a962da tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:35:09.858213 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-0e285dec-3f59-42dc-bf96-f35922a962da tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:35:09.858651 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-0e285dec-3f59-42dc-bf96-f35922a962da tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:35:09.896110 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-0e285dec-3f59-42dc-bf96-f35922a962da tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:35:09.896616 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-0e285dec-3f59-42dc-bf96-f35922a962da tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:35:09.897074 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.objects.instance [None req-0e285dec-3f59-42dc-bf96-f35922a962da tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lazy-loading 'fault' on Instance uuid 137d7cd0-8812-42b6-b871-6aab82c07bdc {{(pid=116157) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Dec 15 03:35:09.942661 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Dec 15 03:35:09.943323 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: Wed Dec 15 03:35:09 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/a0097d88-6613-416a-9f4d-1bb285e53291/os-volume_attachments/d681224a-3344-47c8-8df0-0379a5a8f296 (ip 10.222.0.18) !!! Dec 15 03:35:09.946490 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.policy [None req-0e285dec-3f59-42dc-bf96-f35922a962da tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fedc11e2dbd74b919982a0657222cca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f16202549724b878f908d68384ec9c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116157) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:35:09.960669 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.policy [None req-0e285dec-3f59-42dc-bf96-f35922a962da tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fedc11e2dbd74b919982a0657222cca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f16202549724b878f908d68384ec9c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116157) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:35:09.962255 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.policy [None req-0e285dec-3f59-42dc-bf96-f35922a962da tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fedc11e2dbd74b919982a0657222cca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f16202549724b878f908d68384ec9c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116157) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:35:09.963605 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: INFO nova.api.openstack.requestlog [None req-0e285dec-3f59-42dc-bf96-f35922a962da tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] 10.222.0.18 "GET /compute/v2.1/servers/137d7cd0-8812-42b6-b871-6aab82c07bdc" status: 200 len: 1370 microversion: 2.20 time: 0.121374 Dec 15 03:35:09.974797 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: [pid: 116157|app: 0|req: 968/1954] 10.222.0.18 () {60 vars in 1276 bytes} [Wed Dec 15 03:35:09 2021] GET /compute/v2.1/servers/137d7cd0-8812-42b6-b871-6aab82c07bdc => generated 1370 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 03:35:10.982180 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi [None req-e7a5fc78-c3e9-49ac-8c38-c138c6528f7b tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Calling method '>' {{(pid=116157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:35:10.982807 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.compute.api [None req-e7a5fc78-c3e9-49ac-8c38-c138c6528f7b tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] [instance: 137d7cd0-8812-42b6-b871-6aab82c07bdc] Fetching instance by UUID {{(pid=116157) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:35:10.989000 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-e7a5fc78-c3e9-49ac-8c38-c138c6528f7b tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:35:10.989387 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-e7a5fc78-c3e9-49ac-8c38-c138c6528f7b tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:35:10.990192 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-e7a5fc78-c3e9-49ac-8c38-c138c6528f7b tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:35:10.990623 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-e7a5fc78-c3e9-49ac-8c38-c138c6528f7b tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:35:11.003315 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: INFO nova.api.openstack.wsgi [None req-e7a5fc78-c3e9-49ac-8c38-c138c6528f7b tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] HTTP exception thrown: Instance 137d7cd0-8812-42b6-b871-6aab82c07bdc could not be found. Dec 15 03:35:11.003888 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi [None req-e7a5fc78-c3e9-49ac-8c38-c138c6528f7b tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Returning 404 to user: Instance 137d7cd0-8812-42b6-b871-6aab82c07bdc could not be found. {{(pid=116157) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 15 03:35:11.004735 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: INFO nova.api.openstack.requestlog [None req-e7a5fc78-c3e9-49ac-8c38-c138c6528f7b tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] 10.222.0.18 "GET /compute/v2.1/servers/137d7cd0-8812-42b6-b871-6aab82c07bdc" status: 404 len: 111 microversion: 2.20 time: 0.026211 Dec 15 03:35:11.005236 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: [pid: 116157|app: 0|req: 969/1955] 10.222.0.18 () {60 vars in 1276 bytes} [Wed Dec 15 03:35:10 2021] GET /compute/v2.1/servers/137d7cd0-8812-42b6-b871-6aab82c07bdc => generated 111 bytes in 27 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Dec 15 03:35:11.012529 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi [None req-5d54ff76-9f4c-4d18-ad70-48bc5b4d545a tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Calling method '.version_select at 0x7f126981f8b0>' {{(pid=116157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:35:11.029824 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: INFO nova.api.openstack.requestlog [None req-5d54ff76-9f4c-4d18-ad70-48bc5b4d545a tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] 10.222.0.18 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-175947762" status: 204 len: 0 microversion: 2.20 time: 0.020442 Dec 15 03:35:11.030485 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: [pid: 116157|app: 0|req: 970/1956] 10.222.0.18 () {60 vars in 1258 bytes} [Wed Dec 15 03:35:11 2021] DELETE /compute/v2.1/os-keypairs/tempest-keypair-175947762 => generated 0 bytes in 22 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Dec 15 03:35:11.650031 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi [None req-231894fb-2fc7-4358-b0f1-cc2a1654f33e tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Calling method '>' {{(pid=116157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:35:11.650556 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.compute.api [None req-231894fb-2fc7-4358-b0f1-cc2a1654f33e tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] [instance: 137d7cd0-8812-42b6-b871-6aab82c07bdc] Fetching instance by UUID {{(pid=116157) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:35:11.656551 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-231894fb-2fc7-4358-b0f1-cc2a1654f33e tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:35:11.657003 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-231894fb-2fc7-4358-b0f1-cc2a1654f33e tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:35:11.657810 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-231894fb-2fc7-4358-b0f1-cc2a1654f33e tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:35:11.658287 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-231894fb-2fc7-4358-b0f1-cc2a1654f33e tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:35:11.671680 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: INFO nova.api.openstack.wsgi [None req-231894fb-2fc7-4358-b0f1-cc2a1654f33e tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] HTTP exception thrown: Instance 137d7cd0-8812-42b6-b871-6aab82c07bdc could not be found. Dec 15 03:35:11.672261 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi [None req-231894fb-2fc7-4358-b0f1-cc2a1654f33e tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Returning 404 to user: Instance 137d7cd0-8812-42b6-b871-6aab82c07bdc could not be found. {{(pid=116157) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 15 03:35:11.673078 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: INFO nova.api.openstack.requestlog [None req-231894fb-2fc7-4358-b0f1-cc2a1654f33e tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] 10.222.0.18 "DELETE /compute/v2.1/servers/137d7cd0-8812-42b6-b871-6aab82c07bdc" status: 404 len: 111 microversion: 2.20 time: 0.026910 Dec 15 03:35:11.673597 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: [pid: 116157|app: 0|req: 971/1957] 10.222.0.18 () {60 vars in 1279 bytes} [Wed Dec 15 03:35:11 2021] DELETE /compute/v2.1/servers/137d7cd0-8812-42b6-b871-6aab82c07bdc => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Dec 15 03:35:11.681199 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi [None req-c608f7c3-c2ca-4e80-bcb7-d0d8c0d59498 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Calling method '>' {{(pid=116157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:35:11.681790 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.compute.api [None req-c608f7c3-c2ca-4e80-bcb7-d0d8c0d59498 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] [instance: 137d7cd0-8812-42b6-b871-6aab82c07bdc] Fetching instance by UUID {{(pid=116157) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:35:11.687253 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-c608f7c3-c2ca-4e80-bcb7-d0d8c0d59498 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:35:11.687696 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-c608f7c3-c2ca-4e80-bcb7-d0d8c0d59498 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:35:11.688454 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-c608f7c3-c2ca-4e80-bcb7-d0d8c0d59498 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:35:11.688880 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-c608f7c3-c2ca-4e80-bcb7-d0d8c0d59498 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:35:11.701622 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: INFO nova.api.openstack.wsgi [None req-c608f7c3-c2ca-4e80-bcb7-d0d8c0d59498 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] HTTP exception thrown: Instance 137d7cd0-8812-42b6-b871-6aab82c07bdc could not be found. Dec 15 03:35:11.702217 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi [None req-c608f7c3-c2ca-4e80-bcb7-d0d8c0d59498 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Returning 404 to user: Instance 137d7cd0-8812-42b6-b871-6aab82c07bdc could not be found. {{(pid=116157) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 15 03:35:11.703021 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: INFO nova.api.openstack.requestlog [None req-c608f7c3-c2ca-4e80-bcb7-d0d8c0d59498 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] 10.222.0.18 "GET /compute/v2.1/servers/137d7cd0-8812-42b6-b871-6aab82c07bdc" status: 404 len: 111 microversion: 2.20 time: 0.025245 Dec 15 03:35:11.703540 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: [pid: 116157|app: 0|req: 972/1958] 10.222.0.18 () {60 vars in 1276 bytes} [Wed Dec 15 03:35:11 2021] GET /compute/v2.1/servers/137d7cd0-8812-42b6-b871-6aab82c07bdc => generated 111 bytes in 26 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Dec 15 03:35:12.517463 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.objects.instance [None req-d62ea7f3-4bab-4802-be2d-08eaeedec6cf tempest-VolumesSnapshotTestJSON-925980516 tempest-VolumesSnapshotTestJSON-925980516-project] Lazy-loading 'services' on Instance uuid a0097d88-6613-416a-9f4d-1bb285e53291 {{(pid=116156) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Dec 15 03:36:28.864285 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Dec 15 03:36:28.864949 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: Wed Dec 15 03:36:28 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/a0097d88-6613-416a-9f4d-1bb285e53291/os-volume_attachments/d681224a-3344-47c8-8df0-0379a5a8f296 (ip 10.222.0.18) !!! Dec 15 03:36:29.605551 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Dec 15 03:36:29.606209 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: Wed Dec 15 03:36:29 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Dec 15 03:36:38.553693 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Dec 15 03:36:38.554368 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: Wed Dec 15 03:36:38 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/a0097d88-6613-416a-9f4d-1bb285e53291/os-volume_attachments/d681224a-3344-47c8-8df0-0379a5a8f296 (ip 10.222.0.18) !!! Dec 15 03:37:12.946988 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: INFO nova.api.openstack.wsgi [None req-d62ea7f3-4bab-4802-be2d-08eaeedec6cf tempest-VolumesSnapshotTestJSON-925980516 tempest-VolumesSnapshotTestJSON-925980516-project] HTTP exception thrown: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-150d97fc-a5fb-4897-b597-95bb23f5669e) Dec 15 03:37:12.947690 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi [None req-d62ea7f3-4bab-4802-be2d-08eaeedec6cf tempest-VolumesSnapshotTestJSON-925980516 tempest-VolumesSnapshotTestJSON-925980516-project] Returning 400 to user: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-150d97fc-a5fb-4897-b597-95bb23f5669e) {{(pid=116156) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 15 03:37:12.948565 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: INFO nova.api.openstack.requestlog [None req-d62ea7f3-4bab-4802-be2d-08eaeedec6cf tempest-VolumesSnapshotTestJSON-925980516 tempest-VolumesSnapshotTestJSON-925980516-project] 10.222.0.18 "DELETE /compute/v2.1/servers/a0097d88-6613-416a-9f4d-1bb285e53291/os-volume_attachments/d681224a-3344-47c8-8df0-0379a5a8f296" status: 400 len: 269 microversion: 2.1 time: 240.412328 Dec 15 03:37:12.949149 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: Wed Dec 15 03:37:12 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/a0097d88-6613-416a-9f4d-1bb285e53291/os-volume_attachments/d681224a-3344-47c8-8df0-0379a5a8f296 (ip 10.222.0.18) !!! Dec 15 03:37:12.949149 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: Wed Dec 15 03:37:12 2021 - uwsgi_response_writev_headers_and_body_do(): Broken pipe [core/writer.c line 306] during DELETE /compute/v2.1/servers/a0097d88-6613-416a-9f4d-1bb285e53291/os-volume_attachments/d681224a-3344-47c8-8df0-0379a5a8f296 (10.222.0.18) Dec 15 03:37:12.949664 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: CRITICAL nova [None req-d62ea7f3-4bab-4802-be2d-08eaeedec6cf tempest-VolumesSnapshotTestJSON-925980516 tempest-VolumesSnapshotTestJSON-925980516-project] Unhandled error: OSError: write error Dec 15 03:37:12.949664 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: ERROR nova OSError: write error Dec 15 03:37:12.949664 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: ERROR nova Dec 15 03:37:12.949952 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: [pid: 116156|app: 0|req: 987/1959] 10.222.0.18 () {58 vars in 1415 bytes} [Wed Dec 15 03:33:12 2021] DELETE /compute/v2.1/servers/a0097d88-6613-416a-9f4d-1bb285e53291/os-volume_attachments/d681224a-3344-47c8-8df0-0379a5a8f296 => generated 0 bytes in 240414 msecs (HTTP/1.1 400) 9 headers in 0 bytes (0 switches on core 0) Dec 15 03:37:14.051822 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi [None req-845db5af-f43f-447e-a5e9-4b440df2e464 tempest-VolumesSnapshotTestJSON-925980516 tempest-VolumesSnapshotTestJSON-925980516-project] Calling method '>' {{(pid=116157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:37:14.052358 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.compute.api [None req-845db5af-f43f-447e-a5e9-4b440df2e464 tempest-VolumesSnapshotTestJSON-925980516 tempest-VolumesSnapshotTestJSON-925980516-project] [instance: a0097d88-6613-416a-9f4d-1bb285e53291] Fetching instance by UUID {{(pid=116157) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:37:14.058081 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-845db5af-f43f-447e-a5e9-4b440df2e464 tempest-VolumesSnapshotTestJSON-925980516 tempest-VolumesSnapshotTestJSON-925980516-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:37:14.058540 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-845db5af-f43f-447e-a5e9-4b440df2e464 tempest-VolumesSnapshotTestJSON-925980516 tempest-VolumesSnapshotTestJSON-925980516-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:37:14.059352 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-845db5af-f43f-447e-a5e9-4b440df2e464 tempest-VolumesSnapshotTestJSON-925980516 tempest-VolumesSnapshotTestJSON-925980516-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:37:14.059791 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-845db5af-f43f-447e-a5e9-4b440df2e464 tempest-VolumesSnapshotTestJSON-925980516 tempest-VolumesSnapshotTestJSON-925980516-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:37:14.092469 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.compute.api [None req-845db5af-f43f-447e-a5e9-4b440df2e464 tempest-VolumesSnapshotTestJSON-925980516 tempest-VolumesSnapshotTestJSON-925980516-project] [instance: a0097d88-6613-416a-9f4d-1bb285e53291] Going to try to terminate instance {{(pid=116157) delete /opt/stack/nova/nova/compute/api.py:2614}} Dec 15 03:37:14.166799 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: INFO nova.api.openstack.requestlog [None req-845db5af-f43f-447e-a5e9-4b440df2e464 tempest-VolumesSnapshotTestJSON-925980516 tempest-VolumesSnapshotTestJSON-925980516-project] 10.222.0.18 "DELETE /compute/v2.1/servers/a0097d88-6613-416a-9f4d-1bb285e53291" status: 204 len: 0 microversion: 2.1 time: 0.119804 Dec 15 03:37:14.167371 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: [pid: 116157|app: 0|req: 973/1960] 10.222.0.18 () {58 vars in 1238 bytes} [Wed Dec 15 03:37:14 2021] DELETE /compute/v2.1/servers/a0097d88-6613-416a-9f4d-1bb285e53291 => generated 0 bytes in 121 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Dec 15 03:37:14.177571 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi [None req-8c72077b-3b45-451a-9ee4-b017bdbc66c0 tempest-VolumesSnapshotTestJSON-925980516 tempest-VolumesSnapshotTestJSON-925980516-project] Calling method '>' {{(pid=116156) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:37:14.178235 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.compute.api [None req-8c72077b-3b45-451a-9ee4-b017bdbc66c0 tempest-VolumesSnapshotTestJSON-925980516 tempest-VolumesSnapshotTestJSON-925980516-project] [instance: a0097d88-6613-416a-9f4d-1bb285e53291] Fetching instance by UUID {{(pid=116156) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:37:14.184947 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-8c72077b-3b45-451a-9ee4-b017bdbc66c0 tempest-VolumesSnapshotTestJSON-925980516 tempest-VolumesSnapshotTestJSON-925980516-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:37:14.185398 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-8c72077b-3b45-451a-9ee4-b017bdbc66c0 tempest-VolumesSnapshotTestJSON-925980516 tempest-VolumesSnapshotTestJSON-925980516-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:37:14.186207 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-8c72077b-3b45-451a-9ee4-b017bdbc66c0 tempest-VolumesSnapshotTestJSON-925980516 tempest-VolumesSnapshotTestJSON-925980516-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:37:14.186648 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-8c72077b-3b45-451a-9ee4-b017bdbc66c0 tempest-VolumesSnapshotTestJSON-925980516 tempest-VolumesSnapshotTestJSON-925980516-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:37:14.316830 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.policy [None req-8c72077b-3b45-451a-9ee4-b017bdbc66c0 tempest-VolumesSnapshotTestJSON-925980516 tempest-VolumesSnapshotTestJSON-925980516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4ffcca165af40abbd93569e7f01acbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ca6934bc24846ad82474c4ef7ba6323', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116156) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:37:14.325155 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: INFO nova.api.openstack.requestlog [None req-8c72077b-3b45-451a-9ee4-b017bdbc66c0 tempest-VolumesSnapshotTestJSON-925980516 tempest-VolumesSnapshotTestJSON-925980516-project] 10.222.0.18 "GET /compute/v2.1/servers/a0097d88-6613-416a-9f4d-1bb285e53291" status: 200 len: 1560 microversion: 2.1 time: 0.152762 Dec 15 03:37:14.325735 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: [pid: 116156|app: 0|req: 988/1961] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 03:37:14 2021] GET /compute/v2.1/servers/a0097d88-6613-416a-9f4d-1bb285e53291 => generated 1560 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 03:37:15.344179 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi [None req-efbe4b1e-ba5a-4080-9240-b237b2a72de7 tempest-VolumesSnapshotTestJSON-925980516 tempest-VolumesSnapshotTestJSON-925980516-project] Calling method '>' {{(pid=116157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:37:15.344891 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.compute.api [None req-efbe4b1e-ba5a-4080-9240-b237b2a72de7 tempest-VolumesSnapshotTestJSON-925980516 tempest-VolumesSnapshotTestJSON-925980516-project] [instance: a0097d88-6613-416a-9f4d-1bb285e53291] Fetching instance by UUID {{(pid=116157) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:37:15.351223 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-efbe4b1e-ba5a-4080-9240-b237b2a72de7 tempest-VolumesSnapshotTestJSON-925980516 tempest-VolumesSnapshotTestJSON-925980516-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:37:15.351675 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-efbe4b1e-ba5a-4080-9240-b237b2a72de7 tempest-VolumesSnapshotTestJSON-925980516 tempest-VolumesSnapshotTestJSON-925980516-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:37:15.352493 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-efbe4b1e-ba5a-4080-9240-b237b2a72de7 tempest-VolumesSnapshotTestJSON-925980516 tempest-VolumesSnapshotTestJSON-925980516-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:37:15.352932 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-efbe4b1e-ba5a-4080-9240-b237b2a72de7 tempest-VolumesSnapshotTestJSON-925980516 tempest-VolumesSnapshotTestJSON-925980516-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:37:15.536731 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.policy [None req-efbe4b1e-ba5a-4080-9240-b237b2a72de7 tempest-VolumesSnapshotTestJSON-925980516 tempest-VolumesSnapshotTestJSON-925980516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4ffcca165af40abbd93569e7f01acbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ca6934bc24846ad82474c4ef7ba6323', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116157) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:37:15.544376 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: INFO nova.api.openstack.requestlog [None req-efbe4b1e-ba5a-4080-9240-b237b2a72de7 tempest-VolumesSnapshotTestJSON-925980516 tempest-VolumesSnapshotTestJSON-925980516-project] 10.222.0.18 "GET /compute/v2.1/servers/a0097d88-6613-416a-9f4d-1bb285e53291" status: 200 len: 1560 microversion: 2.1 time: 0.204582 Dec 15 03:37:15.544936 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: [pid: 116157|app: 0|req: 974/1962] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 03:37:15 2021] GET /compute/v2.1/servers/a0097d88-6613-416a-9f4d-1bb285e53291 => generated 1560 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 03:37:16.561458 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi [None req-05c4c0f7-9c36-4623-a60d-fc8b385c6203 tempest-VolumesSnapshotTestJSON-925980516 tempest-VolumesSnapshotTestJSON-925980516-project] Calling method '>' {{(pid=116156) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:37:16.562103 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.compute.api [None req-05c4c0f7-9c36-4623-a60d-fc8b385c6203 tempest-VolumesSnapshotTestJSON-925980516 tempest-VolumesSnapshotTestJSON-925980516-project] [instance: a0097d88-6613-416a-9f4d-1bb285e53291] Fetching instance by UUID {{(pid=116156) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:37:16.568906 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-05c4c0f7-9c36-4623-a60d-fc8b385c6203 tempest-VolumesSnapshotTestJSON-925980516 tempest-VolumesSnapshotTestJSON-925980516-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:37:16.569358 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-05c4c0f7-9c36-4623-a60d-fc8b385c6203 tempest-VolumesSnapshotTestJSON-925980516 tempest-VolumesSnapshotTestJSON-925980516-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:37:16.570179 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-05c4c0f7-9c36-4623-a60d-fc8b385c6203 tempest-VolumesSnapshotTestJSON-925980516 tempest-VolumesSnapshotTestJSON-925980516-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:37:16.570626 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-05c4c0f7-9c36-4623-a60d-fc8b385c6203 tempest-VolumesSnapshotTestJSON-925980516 tempest-VolumesSnapshotTestJSON-925980516-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:37:16.701723 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.policy [None req-05c4c0f7-9c36-4623-a60d-fc8b385c6203 tempest-VolumesSnapshotTestJSON-925980516 tempest-VolumesSnapshotTestJSON-925980516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4ffcca165af40abbd93569e7f01acbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ca6934bc24846ad82474c4ef7ba6323', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116156) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:37:16.710017 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: INFO nova.api.openstack.requestlog [None req-05c4c0f7-9c36-4623-a60d-fc8b385c6203 tempest-VolumesSnapshotTestJSON-925980516 tempest-VolumesSnapshotTestJSON-925980516-project] 10.222.0.18 "GET /compute/v2.1/servers/a0097d88-6613-416a-9f4d-1bb285e53291" status: 200 len: 1560 microversion: 2.1 time: 0.152187 Dec 15 03:37:16.710593 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: [pid: 116156|app: 0|req: 989/1963] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 03:37:16 2021] GET /compute/v2.1/servers/a0097d88-6613-416a-9f4d-1bb285e53291 => generated 1560 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 03:37:17.727109 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi [None req-74bfdbdc-6f68-4e68-b5f8-d60eebbe96e8 tempest-VolumesSnapshotTestJSON-925980516 tempest-VolumesSnapshotTestJSON-925980516-project] Calling method '>' {{(pid=116157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:37:17.727718 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.compute.api [None req-74bfdbdc-6f68-4e68-b5f8-d60eebbe96e8 tempest-VolumesSnapshotTestJSON-925980516 tempest-VolumesSnapshotTestJSON-925980516-project] [instance: a0097d88-6613-416a-9f4d-1bb285e53291] Fetching instance by UUID {{(pid=116157) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:37:17.734042 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-74bfdbdc-6f68-4e68-b5f8-d60eebbe96e8 tempest-VolumesSnapshotTestJSON-925980516 tempest-VolumesSnapshotTestJSON-925980516-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:37:17.734496 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-74bfdbdc-6f68-4e68-b5f8-d60eebbe96e8 tempest-VolumesSnapshotTestJSON-925980516 tempest-VolumesSnapshotTestJSON-925980516-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:37:17.735269 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-74bfdbdc-6f68-4e68-b5f8-d60eebbe96e8 tempest-VolumesSnapshotTestJSON-925980516 tempest-VolumesSnapshotTestJSON-925980516-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:37:17.735700 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-74bfdbdc-6f68-4e68-b5f8-d60eebbe96e8 tempest-VolumesSnapshotTestJSON-925980516 tempest-VolumesSnapshotTestJSON-925980516-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:37:17.864341 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.policy [None req-74bfdbdc-6f68-4e68-b5f8-d60eebbe96e8 tempest-VolumesSnapshotTestJSON-925980516 tempest-VolumesSnapshotTestJSON-925980516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4ffcca165af40abbd93569e7f01acbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ca6934bc24846ad82474c4ef7ba6323', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116157) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:37:17.872023 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: INFO nova.api.openstack.requestlog [None req-74bfdbdc-6f68-4e68-b5f8-d60eebbe96e8 tempest-VolumesSnapshotTestJSON-925980516 tempest-VolumesSnapshotTestJSON-925980516-project] 10.222.0.18 "GET /compute/v2.1/servers/a0097d88-6613-416a-9f4d-1bb285e53291" status: 200 len: 1560 microversion: 2.1 time: 0.148649 Dec 15 03:37:17.872590 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: [pid: 116157|app: 0|req: 975/1964] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 03:37:17 2021] GET /compute/v2.1/servers/a0097d88-6613-416a-9f4d-1bb285e53291 => generated 1560 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 03:37:18.889895 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi [None req-6f974a1e-37a1-4307-9747-1507162fd6f5 tempest-VolumesSnapshotTestJSON-925980516 tempest-VolumesSnapshotTestJSON-925980516-project] Calling method '>' {{(pid=116156) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:37:18.890537 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.compute.api [None req-6f974a1e-37a1-4307-9747-1507162fd6f5 tempest-VolumesSnapshotTestJSON-925980516 tempest-VolumesSnapshotTestJSON-925980516-project] [instance: a0097d88-6613-416a-9f4d-1bb285e53291] Fetching instance by UUID {{(pid=116156) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:37:18.896790 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-6f974a1e-37a1-4307-9747-1507162fd6f5 tempest-VolumesSnapshotTestJSON-925980516 tempest-VolumesSnapshotTestJSON-925980516-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:37:18.897241 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-6f974a1e-37a1-4307-9747-1507162fd6f5 tempest-VolumesSnapshotTestJSON-925980516 tempest-VolumesSnapshotTestJSON-925980516-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:37:18.898049 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-6f974a1e-37a1-4307-9747-1507162fd6f5 tempest-VolumesSnapshotTestJSON-925980516 tempest-VolumesSnapshotTestJSON-925980516-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:37:18.898495 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-6f974a1e-37a1-4307-9747-1507162fd6f5 tempest-VolumesSnapshotTestJSON-925980516 tempest-VolumesSnapshotTestJSON-925980516-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:37:19.023740 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.policy [None req-6f974a1e-37a1-4307-9747-1507162fd6f5 tempest-VolumesSnapshotTestJSON-925980516 tempest-VolumesSnapshotTestJSON-925980516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4ffcca165af40abbd93569e7f01acbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ca6934bc24846ad82474c4ef7ba6323', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116156) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:37:19.031364 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: INFO nova.api.openstack.requestlog [None req-6f974a1e-37a1-4307-9747-1507162fd6f5 tempest-VolumesSnapshotTestJSON-925980516 tempest-VolumesSnapshotTestJSON-925980516-project] 10.222.0.18 "GET /compute/v2.1/servers/a0097d88-6613-416a-9f4d-1bb285e53291" status: 200 len: 1560 microversion: 2.1 time: 0.145184 Dec 15 03:37:19.031921 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: [pid: 116156|app: 0|req: 990/1965] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 03:37:18 2021] GET /compute/v2.1/servers/a0097d88-6613-416a-9f4d-1bb285e53291 => generated 1560 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 03:37:20.048741 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi [None req-65da8c90-db69-466a-9fbe-3724bccee547 tempest-VolumesSnapshotTestJSON-925980516 tempest-VolumesSnapshotTestJSON-925980516-project] Calling method '>' {{(pid=116157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:37:20.049353 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.compute.api [None req-65da8c90-db69-466a-9fbe-3724bccee547 tempest-VolumesSnapshotTestJSON-925980516 tempest-VolumesSnapshotTestJSON-925980516-project] [instance: a0097d88-6613-416a-9f4d-1bb285e53291] Fetching instance by UUID {{(pid=116157) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:37:20.056190 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-65da8c90-db69-466a-9fbe-3724bccee547 tempest-VolumesSnapshotTestJSON-925980516 tempest-VolumesSnapshotTestJSON-925980516-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:37:20.056637 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-65da8c90-db69-466a-9fbe-3724bccee547 tempest-VolumesSnapshotTestJSON-925980516 tempest-VolumesSnapshotTestJSON-925980516-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:37:20.057418 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-65da8c90-db69-466a-9fbe-3724bccee547 tempest-VolumesSnapshotTestJSON-925980516 tempest-VolumesSnapshotTestJSON-925980516-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:37:20.057853 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-65da8c90-db69-466a-9fbe-3724bccee547 tempest-VolumesSnapshotTestJSON-925980516 tempest-VolumesSnapshotTestJSON-925980516-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:37:20.185056 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.policy [None req-65da8c90-db69-466a-9fbe-3724bccee547 tempest-VolumesSnapshotTestJSON-925980516 tempest-VolumesSnapshotTestJSON-925980516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4ffcca165af40abbd93569e7f01acbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ca6934bc24846ad82474c4ef7ba6323', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116157) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:37:20.192748 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: INFO nova.api.openstack.requestlog [None req-65da8c90-db69-466a-9fbe-3724bccee547 tempest-VolumesSnapshotTestJSON-925980516 tempest-VolumesSnapshotTestJSON-925980516-project] 10.222.0.18 "GET /compute/v2.1/servers/a0097d88-6613-416a-9f4d-1bb285e53291" status: 200 len: 1560 microversion: 2.1 time: 0.147666 Dec 15 03:37:20.193426 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: [pid: 116157|app: 0|req: 976/1966] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 03:37:20 2021] GET /compute/v2.1/servers/a0097d88-6613-416a-9f4d-1bb285e53291 => generated 1560 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 03:37:21.209508 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi [None req-4779056a-6e18-486f-8121-d3474547df3c tempest-VolumesSnapshotTestJSON-925980516 tempest-VolumesSnapshotTestJSON-925980516-project] Calling method '>' {{(pid=116156) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:37:21.210154 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.compute.api [None req-4779056a-6e18-486f-8121-d3474547df3c tempest-VolumesSnapshotTestJSON-925980516 tempest-VolumesSnapshotTestJSON-925980516-project] [instance: a0097d88-6613-416a-9f4d-1bb285e53291] Fetching instance by UUID {{(pid=116156) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:37:21.216424 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-4779056a-6e18-486f-8121-d3474547df3c tempest-VolumesSnapshotTestJSON-925980516 tempest-VolumesSnapshotTestJSON-925980516-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:37:21.216876 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-4779056a-6e18-486f-8121-d3474547df3c tempest-VolumesSnapshotTestJSON-925980516 tempest-VolumesSnapshotTestJSON-925980516-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:37:21.217654 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-4779056a-6e18-486f-8121-d3474547df3c tempest-VolumesSnapshotTestJSON-925980516 tempest-VolumesSnapshotTestJSON-925980516-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:37:21.218131 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-4779056a-6e18-486f-8121-d3474547df3c tempest-VolumesSnapshotTestJSON-925980516 tempest-VolumesSnapshotTestJSON-925980516-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:37:21.347711 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.policy [None req-4779056a-6e18-486f-8121-d3474547df3c tempest-VolumesSnapshotTestJSON-925980516 tempest-VolumesSnapshotTestJSON-925980516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4ffcca165af40abbd93569e7f01acbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ca6934bc24846ad82474c4ef7ba6323', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116156) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:37:21.355368 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: INFO nova.api.openstack.requestlog [None req-4779056a-6e18-486f-8121-d3474547df3c tempest-VolumesSnapshotTestJSON-925980516 tempest-VolumesSnapshotTestJSON-925980516-project] 10.222.0.18 "GET /compute/v2.1/servers/a0097d88-6613-416a-9f4d-1bb285e53291" status: 200 len: 1560 microversion: 2.1 time: 0.149497 Dec 15 03:37:21.355922 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: [pid: 116156|app: 0|req: 991/1967] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 03:37:21 2021] GET /compute/v2.1/servers/a0097d88-6613-416a-9f4d-1bb285e53291 => generated 1560 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 03:37:22.375259 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi [None req-e794250a-842f-49fa-bb31-fe5237c04f05 tempest-VolumesSnapshotTestJSON-925980516 tempest-VolumesSnapshotTestJSON-925980516-project] Calling method '>' {{(pid=116157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:37:22.375865 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.compute.api [None req-e794250a-842f-49fa-bb31-fe5237c04f05 tempest-VolumesSnapshotTestJSON-925980516 tempest-VolumesSnapshotTestJSON-925980516-project] [instance: a0097d88-6613-416a-9f4d-1bb285e53291] Fetching instance by UUID {{(pid=116157) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:37:22.382690 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-e794250a-842f-49fa-bb31-fe5237c04f05 tempest-VolumesSnapshotTestJSON-925980516 tempest-VolumesSnapshotTestJSON-925980516-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:37:22.383148 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-e794250a-842f-49fa-bb31-fe5237c04f05 tempest-VolumesSnapshotTestJSON-925980516 tempest-VolumesSnapshotTestJSON-925980516-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:37:22.383912 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-e794250a-842f-49fa-bb31-fe5237c04f05 tempest-VolumesSnapshotTestJSON-925980516 tempest-VolumesSnapshotTestJSON-925980516-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:37:22.384342 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-e794250a-842f-49fa-bb31-fe5237c04f05 tempest-VolumesSnapshotTestJSON-925980516 tempest-VolumesSnapshotTestJSON-925980516-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:37:22.508468 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.policy [None req-e794250a-842f-49fa-bb31-fe5237c04f05 tempest-VolumesSnapshotTestJSON-925980516 tempest-VolumesSnapshotTestJSON-925980516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4ffcca165af40abbd93569e7f01acbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ca6934bc24846ad82474c4ef7ba6323', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116157) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:37:22.516122 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: INFO nova.api.openstack.requestlog [None req-e794250a-842f-49fa-bb31-fe5237c04f05 tempest-VolumesSnapshotTestJSON-925980516 tempest-VolumesSnapshotTestJSON-925980516-project] 10.222.0.18 "GET /compute/v2.1/servers/a0097d88-6613-416a-9f4d-1bb285e53291" status: 200 len: 1560 microversion: 2.1 time: 0.144536 Dec 15 03:37:22.516682 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: [pid: 116157|app: 0|req: 977/1968] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 03:37:22 2021] GET /compute/v2.1/servers/a0097d88-6613-416a-9f4d-1bb285e53291 => generated 1560 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 03:37:23.532943 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi [None req-ea02122b-c0e0-4224-9c07-11175d1f162c tempest-VolumesSnapshotTestJSON-925980516 tempest-VolumesSnapshotTestJSON-925980516-project] Calling method '>' {{(pid=116156) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:37:23.533484 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.compute.api [None req-ea02122b-c0e0-4224-9c07-11175d1f162c tempest-VolumesSnapshotTestJSON-925980516 tempest-VolumesSnapshotTestJSON-925980516-project] [instance: a0097d88-6613-416a-9f4d-1bb285e53291] Fetching instance by UUID {{(pid=116156) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:37:23.540313 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-ea02122b-c0e0-4224-9c07-11175d1f162c tempest-VolumesSnapshotTestJSON-925980516 tempest-VolumesSnapshotTestJSON-925980516-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:37:23.540777 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-ea02122b-c0e0-4224-9c07-11175d1f162c tempest-VolumesSnapshotTestJSON-925980516 tempest-VolumesSnapshotTestJSON-925980516-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:37:23.541561 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-ea02122b-c0e0-4224-9c07-11175d1f162c tempest-VolumesSnapshotTestJSON-925980516 tempest-VolumesSnapshotTestJSON-925980516-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:37:23.542019 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-ea02122b-c0e0-4224-9c07-11175d1f162c tempest-VolumesSnapshotTestJSON-925980516 tempest-VolumesSnapshotTestJSON-925980516-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:37:23.666759 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.policy [None req-ea02122b-c0e0-4224-9c07-11175d1f162c tempest-VolumesSnapshotTestJSON-925980516 tempest-VolumesSnapshotTestJSON-925980516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4ffcca165af40abbd93569e7f01acbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ca6934bc24846ad82474c4ef7ba6323', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116156) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:37:23.674473 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: INFO nova.api.openstack.requestlog [None req-ea02122b-c0e0-4224-9c07-11175d1f162c tempest-VolumesSnapshotTestJSON-925980516 tempest-VolumesSnapshotTestJSON-925980516-project] 10.222.0.18 "GET /compute/v2.1/servers/a0097d88-6613-416a-9f4d-1bb285e53291" status: 200 len: 1560 microversion: 2.1 time: 0.145314 Dec 15 03:37:23.675040 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: [pid: 116156|app: 0|req: 992/1969] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 03:37:23 2021] GET /compute/v2.1/servers/a0097d88-6613-416a-9f4d-1bb285e53291 => generated 1560 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 03:37:24.691464 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi [None req-ff2d9906-842e-4b67-aaf4-ee5b2148e613 tempest-VolumesSnapshotTestJSON-925980516 tempest-VolumesSnapshotTestJSON-925980516-project] Calling method '>' {{(pid=116157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:37:24.692102 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.compute.api [None req-ff2d9906-842e-4b67-aaf4-ee5b2148e613 tempest-VolumesSnapshotTestJSON-925980516 tempest-VolumesSnapshotTestJSON-925980516-project] [instance: a0097d88-6613-416a-9f4d-1bb285e53291] Fetching instance by UUID {{(pid=116157) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:37:24.698351 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-ff2d9906-842e-4b67-aaf4-ee5b2148e613 tempest-VolumesSnapshotTestJSON-925980516 tempest-VolumesSnapshotTestJSON-925980516-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:37:24.698805 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-ff2d9906-842e-4b67-aaf4-ee5b2148e613 tempest-VolumesSnapshotTestJSON-925980516 tempest-VolumesSnapshotTestJSON-925980516-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:37:24.699592 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-ff2d9906-842e-4b67-aaf4-ee5b2148e613 tempest-VolumesSnapshotTestJSON-925980516 tempest-VolumesSnapshotTestJSON-925980516-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:37:24.700032 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-ff2d9906-842e-4b67-aaf4-ee5b2148e613 tempest-VolumesSnapshotTestJSON-925980516 tempest-VolumesSnapshotTestJSON-925980516-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:37:24.829192 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.policy [None req-ff2d9906-842e-4b67-aaf4-ee5b2148e613 tempest-VolumesSnapshotTestJSON-925980516 tempest-VolumesSnapshotTestJSON-925980516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4ffcca165af40abbd93569e7f01acbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ca6934bc24846ad82474c4ef7ba6323', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116157) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:37:24.836863 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: INFO nova.api.openstack.requestlog [None req-ff2d9906-842e-4b67-aaf4-ee5b2148e613 tempest-VolumesSnapshotTestJSON-925980516 tempest-VolumesSnapshotTestJSON-925980516-project] 10.222.0.18 "GET /compute/v2.1/servers/a0097d88-6613-416a-9f4d-1bb285e53291" status: 200 len: 1560 microversion: 2.1 time: 0.149118 Dec 15 03:37:24.837422 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: [pid: 116157|app: 0|req: 978/1970] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 03:37:24 2021] GET /compute/v2.1/servers/a0097d88-6613-416a-9f4d-1bb285e53291 => generated 1560 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 03:37:25.853746 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi [None req-8df594c4-a0ea-4e84-8818-044290db24ac tempest-VolumesSnapshotTestJSON-925980516 tempest-VolumesSnapshotTestJSON-925980516-project] Calling method '>' {{(pid=116156) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:37:25.854455 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.compute.api [None req-8df594c4-a0ea-4e84-8818-044290db24ac tempest-VolumesSnapshotTestJSON-925980516 tempest-VolumesSnapshotTestJSON-925980516-project] [instance: a0097d88-6613-416a-9f4d-1bb285e53291] Fetching instance by UUID {{(pid=116156) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:37:25.860581 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-8df594c4-a0ea-4e84-8818-044290db24ac tempest-VolumesSnapshotTestJSON-925980516 tempest-VolumesSnapshotTestJSON-925980516-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:37:25.861027 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-8df594c4-a0ea-4e84-8818-044290db24ac tempest-VolumesSnapshotTestJSON-925980516 tempest-VolumesSnapshotTestJSON-925980516-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:37:25.861828 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-8df594c4-a0ea-4e84-8818-044290db24ac tempest-VolumesSnapshotTestJSON-925980516 tempest-VolumesSnapshotTestJSON-925980516-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:37:25.862282 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-8df594c4-a0ea-4e84-8818-044290db24ac tempest-VolumesSnapshotTestJSON-925980516 tempest-VolumesSnapshotTestJSON-925980516-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:37:25.988092 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.policy [None req-8df594c4-a0ea-4e84-8818-044290db24ac tempest-VolumesSnapshotTestJSON-925980516 tempest-VolumesSnapshotTestJSON-925980516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4ffcca165af40abbd93569e7f01acbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ca6934bc24846ad82474c4ef7ba6323', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116156) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:37:25.995945 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: INFO nova.api.openstack.requestlog [None req-8df594c4-a0ea-4e84-8818-044290db24ac tempest-VolumesSnapshotTestJSON-925980516 tempest-VolumesSnapshotTestJSON-925980516-project] 10.222.0.18 "GET /compute/v2.1/servers/a0097d88-6613-416a-9f4d-1bb285e53291" status: 200 len: 1560 microversion: 2.1 time: 0.145775 Dec 15 03:37:25.996517 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: [pid: 116156|app: 0|req: 993/1971] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 03:37:25 2021] GET /compute/v2.1/servers/a0097d88-6613-416a-9f4d-1bb285e53291 => generated 1560 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 03:37:27.012347 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi [None req-2e21d7c3-d4c1-4bb3-bd44-3642c32395b1 tempest-VolumesSnapshotTestJSON-925980516 tempest-VolumesSnapshotTestJSON-925980516-project] Calling method '>' {{(pid=116157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:37:27.012956 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.compute.api [None req-2e21d7c3-d4c1-4bb3-bd44-3642c32395b1 tempest-VolumesSnapshotTestJSON-925980516 tempest-VolumesSnapshotTestJSON-925980516-project] [instance: a0097d88-6613-416a-9f4d-1bb285e53291] Fetching instance by UUID {{(pid=116157) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:37:27.019201 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-2e21d7c3-d4c1-4bb3-bd44-3642c32395b1 tempest-VolumesSnapshotTestJSON-925980516 tempest-VolumesSnapshotTestJSON-925980516-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:37:27.019654 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-2e21d7c3-d4c1-4bb3-bd44-3642c32395b1 tempest-VolumesSnapshotTestJSON-925980516 tempest-VolumesSnapshotTestJSON-925980516-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:37:27.020431 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-2e21d7c3-d4c1-4bb3-bd44-3642c32395b1 tempest-VolumesSnapshotTestJSON-925980516 tempest-VolumesSnapshotTestJSON-925980516-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:37:27.020869 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-2e21d7c3-d4c1-4bb3-bd44-3642c32395b1 tempest-VolumesSnapshotTestJSON-925980516 tempest-VolumesSnapshotTestJSON-925980516-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:37:27.146500 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.policy [None req-2e21d7c3-d4c1-4bb3-bd44-3642c32395b1 tempest-VolumesSnapshotTestJSON-925980516 tempest-VolumesSnapshotTestJSON-925980516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4ffcca165af40abbd93569e7f01acbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ca6934bc24846ad82474c4ef7ba6323', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116157) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:37:27.154247 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: INFO nova.api.openstack.requestlog [None req-2e21d7c3-d4c1-4bb3-bd44-3642c32395b1 tempest-VolumesSnapshotTestJSON-925980516 tempest-VolumesSnapshotTestJSON-925980516-project] 10.222.0.18 "GET /compute/v2.1/servers/a0097d88-6613-416a-9f4d-1bb285e53291" status: 200 len: 1560 microversion: 2.1 time: 0.145568 Dec 15 03:37:27.154815 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: [pid: 116157|app: 0|req: 979/1972] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 03:37:27 2021] GET /compute/v2.1/servers/a0097d88-6613-416a-9f4d-1bb285e53291 => generated 1560 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 03:37:28.171481 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi [None req-a742edd2-0371-447f-ab46-af84bb362631 tempest-VolumesSnapshotTestJSON-925980516 tempest-VolumesSnapshotTestJSON-925980516-project] Calling method '>' {{(pid=116156) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:37:28.172091 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.compute.api [None req-a742edd2-0371-447f-ab46-af84bb362631 tempest-VolumesSnapshotTestJSON-925980516 tempest-VolumesSnapshotTestJSON-925980516-project] [instance: a0097d88-6613-416a-9f4d-1bb285e53291] Fetching instance by UUID {{(pid=116156) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:37:28.178908 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-a742edd2-0371-447f-ab46-af84bb362631 tempest-VolumesSnapshotTestJSON-925980516 tempest-VolumesSnapshotTestJSON-925980516-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:37:28.179360 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-a742edd2-0371-447f-ab46-af84bb362631 tempest-VolumesSnapshotTestJSON-925980516 tempest-VolumesSnapshotTestJSON-925980516-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:37:28.180136 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-a742edd2-0371-447f-ab46-af84bb362631 tempest-VolumesSnapshotTestJSON-925980516 tempest-VolumesSnapshotTestJSON-925980516-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:37:28.180574 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-a742edd2-0371-447f-ab46-af84bb362631 tempest-VolumesSnapshotTestJSON-925980516 tempest-VolumesSnapshotTestJSON-925980516-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:37:28.309118 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.policy [None req-a742edd2-0371-447f-ab46-af84bb362631 tempest-VolumesSnapshotTestJSON-925980516 tempest-VolumesSnapshotTestJSON-925980516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4ffcca165af40abbd93569e7f01acbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ca6934bc24846ad82474c4ef7ba6323', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116156) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:37:28.317369 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: INFO nova.api.openstack.requestlog [None req-a742edd2-0371-447f-ab46-af84bb362631 tempest-VolumesSnapshotTestJSON-925980516 tempest-VolumesSnapshotTestJSON-925980516-project] 10.222.0.18 "GET /compute/v2.1/servers/a0097d88-6613-416a-9f4d-1bb285e53291" status: 200 len: 1560 microversion: 2.1 time: 0.149556 Dec 15 03:37:28.317929 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: [pid: 116156|app: 0|req: 994/1973] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 03:37:28 2021] GET /compute/v2.1/servers/a0097d88-6613-416a-9f4d-1bb285e53291 => generated 1560 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 03:37:29.334277 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi [None req-d222245c-72f4-4e4c-94cd-5826cc47c009 tempest-VolumesSnapshotTestJSON-925980516 tempest-VolumesSnapshotTestJSON-925980516-project] Calling method '>' {{(pid=116157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:37:29.334890 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.compute.api [None req-d222245c-72f4-4e4c-94cd-5826cc47c009 tempest-VolumesSnapshotTestJSON-925980516 tempest-VolumesSnapshotTestJSON-925980516-project] [instance: a0097d88-6613-416a-9f4d-1bb285e53291] Fetching instance by UUID {{(pid=116157) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:37:29.341132 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-d222245c-72f4-4e4c-94cd-5826cc47c009 tempest-VolumesSnapshotTestJSON-925980516 tempest-VolumesSnapshotTestJSON-925980516-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:37:29.341580 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-d222245c-72f4-4e4c-94cd-5826cc47c009 tempest-VolumesSnapshotTestJSON-925980516 tempest-VolumesSnapshotTestJSON-925980516-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:37:29.342378 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-d222245c-72f4-4e4c-94cd-5826cc47c009 tempest-VolumesSnapshotTestJSON-925980516 tempest-VolumesSnapshotTestJSON-925980516-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:37:29.342811 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-d222245c-72f4-4e4c-94cd-5826cc47c009 tempest-VolumesSnapshotTestJSON-925980516 tempest-VolumesSnapshotTestJSON-925980516-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:37:29.478245 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.policy [None req-d222245c-72f4-4e4c-94cd-5826cc47c009 tempest-VolumesSnapshotTestJSON-925980516 tempest-VolumesSnapshotTestJSON-925980516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4ffcca165af40abbd93569e7f01acbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ca6934bc24846ad82474c4ef7ba6323', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116157) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:37:29.485778 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: INFO nova.api.openstack.requestlog [None req-d222245c-72f4-4e4c-94cd-5826cc47c009 tempest-VolumesSnapshotTestJSON-925980516 tempest-VolumesSnapshotTestJSON-925980516-project] 10.222.0.18 "GET /compute/v2.1/servers/a0097d88-6613-416a-9f4d-1bb285e53291" status: 200 len: 1560 microversion: 2.1 time: 0.155199 Dec 15 03:37:29.486362 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: [pid: 116157|app: 0|req: 980/1974] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 03:37:29 2021] GET /compute/v2.1/servers/a0097d88-6613-416a-9f4d-1bb285e53291 => generated 1560 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 03:37:30.503063 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi [None req-b5cfe0c5-3cd9-445b-b35a-6f7a6bd98ed8 tempest-VolumesSnapshotTestJSON-925980516 tempest-VolumesSnapshotTestJSON-925980516-project] Calling method '>' {{(pid=116156) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:37:30.503678 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.compute.api [None req-b5cfe0c5-3cd9-445b-b35a-6f7a6bd98ed8 tempest-VolumesSnapshotTestJSON-925980516 tempest-VolumesSnapshotTestJSON-925980516-project] [instance: a0097d88-6613-416a-9f4d-1bb285e53291] Fetching instance by UUID {{(pid=116156) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:37:30.509881 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-b5cfe0c5-3cd9-445b-b35a-6f7a6bd98ed8 tempest-VolumesSnapshotTestJSON-925980516 tempest-VolumesSnapshotTestJSON-925980516-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:37:30.510368 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-b5cfe0c5-3cd9-445b-b35a-6f7a6bd98ed8 tempest-VolumesSnapshotTestJSON-925980516 tempest-VolumesSnapshotTestJSON-925980516-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:37:30.511148 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-b5cfe0c5-3cd9-445b-b35a-6f7a6bd98ed8 tempest-VolumesSnapshotTestJSON-925980516 tempest-VolumesSnapshotTestJSON-925980516-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:37:30.511586 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-b5cfe0c5-3cd9-445b-b35a-6f7a6bd98ed8 tempest-VolumesSnapshotTestJSON-925980516 tempest-VolumesSnapshotTestJSON-925980516-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:37:30.636463 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.policy [None req-b5cfe0c5-3cd9-445b-b35a-6f7a6bd98ed8 tempest-VolumesSnapshotTestJSON-925980516 tempest-VolumesSnapshotTestJSON-925980516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4ffcca165af40abbd93569e7f01acbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ca6934bc24846ad82474c4ef7ba6323', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116156) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:37:30.644778 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: INFO nova.api.openstack.requestlog [None req-b5cfe0c5-3cd9-445b-b35a-6f7a6bd98ed8 tempest-VolumesSnapshotTestJSON-925980516 tempest-VolumesSnapshotTestJSON-925980516-project] 10.222.0.18 "GET /compute/v2.1/servers/a0097d88-6613-416a-9f4d-1bb285e53291" status: 200 len: 1560 microversion: 2.1 time: 0.145378 Dec 15 03:37:30.645337 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: [pid: 116156|app: 0|req: 995/1975] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 03:37:30 2021] GET /compute/v2.1/servers/a0097d88-6613-416a-9f4d-1bb285e53291 => generated 1560 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 03:37:31.661597 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi [None req-5c32fbfa-0680-40d7-b91b-e83f8909ac8d tempest-VolumesSnapshotTestJSON-925980516 tempest-VolumesSnapshotTestJSON-925980516-project] Calling method '>' {{(pid=116157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:37:31.662336 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.compute.api [None req-5c32fbfa-0680-40d7-b91b-e83f8909ac8d tempest-VolumesSnapshotTestJSON-925980516 tempest-VolumesSnapshotTestJSON-925980516-project] [instance: a0097d88-6613-416a-9f4d-1bb285e53291] Fetching instance by UUID {{(pid=116157) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:37:31.668406 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-5c32fbfa-0680-40d7-b91b-e83f8909ac8d tempest-VolumesSnapshotTestJSON-925980516 tempest-VolumesSnapshotTestJSON-925980516-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:37:31.668854 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-5c32fbfa-0680-40d7-b91b-e83f8909ac8d tempest-VolumesSnapshotTestJSON-925980516 tempest-VolumesSnapshotTestJSON-925980516-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:37:31.669633 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-5c32fbfa-0680-40d7-b91b-e83f8909ac8d tempest-VolumesSnapshotTestJSON-925980516 tempest-VolumesSnapshotTestJSON-925980516-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:37:31.670100 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-5c32fbfa-0680-40d7-b91b-e83f8909ac8d tempest-VolumesSnapshotTestJSON-925980516 tempest-VolumesSnapshotTestJSON-925980516-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:37:31.797236 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.policy [None req-5c32fbfa-0680-40d7-b91b-e83f8909ac8d tempest-VolumesSnapshotTestJSON-925980516 tempest-VolumesSnapshotTestJSON-925980516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4ffcca165af40abbd93569e7f01acbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ca6934bc24846ad82474c4ef7ba6323', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116157) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:37:31.804935 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: INFO nova.api.openstack.requestlog [None req-5c32fbfa-0680-40d7-b91b-e83f8909ac8d tempest-VolumesSnapshotTestJSON-925980516 tempest-VolumesSnapshotTestJSON-925980516-project] 10.222.0.18 "GET /compute/v2.1/servers/a0097d88-6613-416a-9f4d-1bb285e53291" status: 200 len: 1560 microversion: 2.1 time: 0.146988 Dec 15 03:37:31.805504 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: [pid: 116157|app: 0|req: 981/1976] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 03:37:31 2021] GET /compute/v2.1/servers/a0097d88-6613-416a-9f4d-1bb285e53291 => generated 1560 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 03:37:32.822204 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi [None req-1eb3b9e0-80f3-45dd-89e4-1fb8dcb87e47 tempest-VolumesSnapshotTestJSON-925980516 tempest-VolumesSnapshotTestJSON-925980516-project] Calling method '>' {{(pid=116156) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:37:32.822819 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.compute.api [None req-1eb3b9e0-80f3-45dd-89e4-1fb8dcb87e47 tempest-VolumesSnapshotTestJSON-925980516 tempest-VolumesSnapshotTestJSON-925980516-project] [instance: a0097d88-6613-416a-9f4d-1bb285e53291] Fetching instance by UUID {{(pid=116156) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:37:32.829068 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-1eb3b9e0-80f3-45dd-89e4-1fb8dcb87e47 tempest-VolumesSnapshotTestJSON-925980516 tempest-VolumesSnapshotTestJSON-925980516-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:37:32.829521 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-1eb3b9e0-80f3-45dd-89e4-1fb8dcb87e47 tempest-VolumesSnapshotTestJSON-925980516 tempest-VolumesSnapshotTestJSON-925980516-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:37:32.830360 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-1eb3b9e0-80f3-45dd-89e4-1fb8dcb87e47 tempest-VolumesSnapshotTestJSON-925980516 tempest-VolumesSnapshotTestJSON-925980516-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:37:32.830803 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-1eb3b9e0-80f3-45dd-89e4-1fb8dcb87e47 tempest-VolumesSnapshotTestJSON-925980516 tempest-VolumesSnapshotTestJSON-925980516-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:37:32.959154 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.policy [None req-1eb3b9e0-80f3-45dd-89e4-1fb8dcb87e47 tempest-VolumesSnapshotTestJSON-925980516 tempest-VolumesSnapshotTestJSON-925980516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4ffcca165af40abbd93569e7f01acbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ca6934bc24846ad82474c4ef7ba6323', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116156) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:37:32.966762 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: INFO nova.api.openstack.requestlog [None req-1eb3b9e0-80f3-45dd-89e4-1fb8dcb87e47 tempest-VolumesSnapshotTestJSON-925980516 tempest-VolumesSnapshotTestJSON-925980516-project] 10.222.0.18 "GET /compute/v2.1/servers/a0097d88-6613-416a-9f4d-1bb285e53291" status: 200 len: 1560 microversion: 2.1 time: 0.148196 Dec 15 03:37:32.967322 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: [pid: 116156|app: 0|req: 996/1977] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 03:37:32 2021] GET /compute/v2.1/servers/a0097d88-6613-416a-9f4d-1bb285e53291 => generated 1560 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 03:37:33.984270 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi [None req-7981e83c-9ef2-427b-8da6-88a43645f3fb tempest-VolumesSnapshotTestJSON-925980516 tempest-VolumesSnapshotTestJSON-925980516-project] Calling method '>' {{(pid=116157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:37:33.984878 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.compute.api [None req-7981e83c-9ef2-427b-8da6-88a43645f3fb tempest-VolumesSnapshotTestJSON-925980516 tempest-VolumesSnapshotTestJSON-925980516-project] [instance: a0097d88-6613-416a-9f4d-1bb285e53291] Fetching instance by UUID {{(pid=116157) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:37:33.991111 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-7981e83c-9ef2-427b-8da6-88a43645f3fb tempest-VolumesSnapshotTestJSON-925980516 tempest-VolumesSnapshotTestJSON-925980516-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:37:33.991579 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-7981e83c-9ef2-427b-8da6-88a43645f3fb tempest-VolumesSnapshotTestJSON-925980516 tempest-VolumesSnapshotTestJSON-925980516-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:37:33.992324 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-7981e83c-9ef2-427b-8da6-88a43645f3fb tempest-VolumesSnapshotTestJSON-925980516 tempest-VolumesSnapshotTestJSON-925980516-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:37:33.992754 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-7981e83c-9ef2-427b-8da6-88a43645f3fb tempest-VolumesSnapshotTestJSON-925980516 tempest-VolumesSnapshotTestJSON-925980516-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:37:34.121860 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.policy [None req-7981e83c-9ef2-427b-8da6-88a43645f3fb tempest-VolumesSnapshotTestJSON-925980516 tempest-VolumesSnapshotTestJSON-925980516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4ffcca165af40abbd93569e7f01acbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ca6934bc24846ad82474c4ef7ba6323', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116157) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:37:34.130053 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: INFO nova.api.openstack.requestlog [None req-7981e83c-9ef2-427b-8da6-88a43645f3fb tempest-VolumesSnapshotTestJSON-925980516 tempest-VolumesSnapshotTestJSON-925980516-project] 10.222.0.18 "GET /compute/v2.1/servers/a0097d88-6613-416a-9f4d-1bb285e53291" status: 200 len: 1560 microversion: 2.1 time: 0.149313 Dec 15 03:37:34.130613 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: [pid: 116157|app: 0|req: 982/1978] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 03:37:33 2021] GET /compute/v2.1/servers/a0097d88-6613-416a-9f4d-1bb285e53291 => generated 1560 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 03:37:35.147260 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi [None req-d0cf426f-8309-40ac-931f-439c9b8a0a89 tempest-VolumesSnapshotTestJSON-925980516 tempest-VolumesSnapshotTestJSON-925980516-project] Calling method '>' {{(pid=116156) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:37:35.147874 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.compute.api [None req-d0cf426f-8309-40ac-931f-439c9b8a0a89 tempest-VolumesSnapshotTestJSON-925980516 tempest-VolumesSnapshotTestJSON-925980516-project] [instance: a0097d88-6613-416a-9f4d-1bb285e53291] Fetching instance by UUID {{(pid=116156) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:37:35.154162 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-d0cf426f-8309-40ac-931f-439c9b8a0a89 tempest-VolumesSnapshotTestJSON-925980516 tempest-VolumesSnapshotTestJSON-925980516-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:37:35.154561 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-d0cf426f-8309-40ac-931f-439c9b8a0a89 tempest-VolumesSnapshotTestJSON-925980516 tempest-VolumesSnapshotTestJSON-925980516-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:37:35.155337 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-d0cf426f-8309-40ac-931f-439c9b8a0a89 tempest-VolumesSnapshotTestJSON-925980516 tempest-VolumesSnapshotTestJSON-925980516-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:37:35.155772 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-d0cf426f-8309-40ac-931f-439c9b8a0a89 tempest-VolumesSnapshotTestJSON-925980516 tempest-VolumesSnapshotTestJSON-925980516-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:37:35.281213 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.policy [None req-d0cf426f-8309-40ac-931f-439c9b8a0a89 tempest-VolumesSnapshotTestJSON-925980516 tempest-VolumesSnapshotTestJSON-925980516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4ffcca165af40abbd93569e7f01acbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ca6934bc24846ad82474c4ef7ba6323', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116156) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:37:35.289465 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: INFO nova.api.openstack.requestlog [None req-d0cf426f-8309-40ac-931f-439c9b8a0a89 tempest-VolumesSnapshotTestJSON-925980516 tempest-VolumesSnapshotTestJSON-925980516-project] 10.222.0.18 "GET /compute/v2.1/servers/a0097d88-6613-416a-9f4d-1bb285e53291" status: 200 len: 1560 microversion: 2.1 time: 0.146338 Dec 15 03:37:35.290057 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: [pid: 116156|app: 0|req: 997/1979] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 03:37:35 2021] GET /compute/v2.1/servers/a0097d88-6613-416a-9f4d-1bb285e53291 => generated 1560 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 03:37:36.306645 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi [None req-85fbd413-1349-4747-8b25-50041fb2d977 tempest-VolumesSnapshotTestJSON-925980516 tempest-VolumesSnapshotTestJSON-925980516-project] Calling method '>' {{(pid=116157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:37:36.307282 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.compute.api [None req-85fbd413-1349-4747-8b25-50041fb2d977 tempest-VolumesSnapshotTestJSON-925980516 tempest-VolumesSnapshotTestJSON-925980516-project] [instance: a0097d88-6613-416a-9f4d-1bb285e53291] Fetching instance by UUID {{(pid=116157) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:37:36.313475 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-85fbd413-1349-4747-8b25-50041fb2d977 tempest-VolumesSnapshotTestJSON-925980516 tempest-VolumesSnapshotTestJSON-925980516-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:37:36.313921 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-85fbd413-1349-4747-8b25-50041fb2d977 tempest-VolumesSnapshotTestJSON-925980516 tempest-VolumesSnapshotTestJSON-925980516-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:37:36.314731 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-85fbd413-1349-4747-8b25-50041fb2d977 tempest-VolumesSnapshotTestJSON-925980516 tempest-VolumesSnapshotTestJSON-925980516-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:37:36.315669 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-85fbd413-1349-4747-8b25-50041fb2d977 tempest-VolumesSnapshotTestJSON-925980516 tempest-VolumesSnapshotTestJSON-925980516-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:37:36.439510 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.policy [None req-85fbd413-1349-4747-8b25-50041fb2d977 tempest-VolumesSnapshotTestJSON-925980516 tempest-VolumesSnapshotTestJSON-925980516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4ffcca165af40abbd93569e7f01acbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ca6934bc24846ad82474c4ef7ba6323', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116157) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:37:36.447558 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: INFO nova.api.openstack.requestlog [None req-85fbd413-1349-4747-8b25-50041fb2d977 tempest-VolumesSnapshotTestJSON-925980516 tempest-VolumesSnapshotTestJSON-925980516-project] 10.222.0.18 "GET /compute/v2.1/servers/a0097d88-6613-416a-9f4d-1bb285e53291" status: 200 len: 1560 microversion: 2.1 time: 0.144574 Dec 15 03:37:36.448119 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: [pid: 116157|app: 0|req: 983/1980] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 03:37:36 2021] GET /compute/v2.1/servers/a0097d88-6613-416a-9f4d-1bb285e53291 => generated 1560 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 03:37:37.464842 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi [None req-f4c596bd-7ea9-470c-82f9-bd0b36eda9a5 tempest-VolumesSnapshotTestJSON-925980516 tempest-VolumesSnapshotTestJSON-925980516-project] Calling method '>' {{(pid=116156) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:37:37.465411 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.compute.api [None req-f4c596bd-7ea9-470c-82f9-bd0b36eda9a5 tempest-VolumesSnapshotTestJSON-925980516 tempest-VolumesSnapshotTestJSON-925980516-project] [instance: a0097d88-6613-416a-9f4d-1bb285e53291] Fetching instance by UUID {{(pid=116156) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:37:37.472583 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-f4c596bd-7ea9-470c-82f9-bd0b36eda9a5 tempest-VolumesSnapshotTestJSON-925980516 tempest-VolumesSnapshotTestJSON-925980516-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:37:37.473042 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-f4c596bd-7ea9-470c-82f9-bd0b36eda9a5 tempest-VolumesSnapshotTestJSON-925980516 tempest-VolumesSnapshotTestJSON-925980516-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:37:37.473827 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-f4c596bd-7ea9-470c-82f9-bd0b36eda9a5 tempest-VolumesSnapshotTestJSON-925980516 tempest-VolumesSnapshotTestJSON-925980516-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:37:37.474291 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-f4c596bd-7ea9-470c-82f9-bd0b36eda9a5 tempest-VolumesSnapshotTestJSON-925980516 tempest-VolumesSnapshotTestJSON-925980516-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:37:37.604138 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.policy [None req-f4c596bd-7ea9-470c-82f9-bd0b36eda9a5 tempest-VolumesSnapshotTestJSON-925980516 tempest-VolumesSnapshotTestJSON-925980516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4ffcca165af40abbd93569e7f01acbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ca6934bc24846ad82474c4ef7ba6323', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116156) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:37:37.611856 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: INFO nova.api.openstack.requestlog [None req-f4c596bd-7ea9-470c-82f9-bd0b36eda9a5 tempest-VolumesSnapshotTestJSON-925980516 tempest-VolumesSnapshotTestJSON-925980516-project] 10.222.0.18 "GET /compute/v2.1/servers/a0097d88-6613-416a-9f4d-1bb285e53291" status: 200 len: 1560 microversion: 2.1 time: 0.150743 Dec 15 03:37:37.612424 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: [pid: 116156|app: 0|req: 998/1981] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 03:37:37 2021] GET /compute/v2.1/servers/a0097d88-6613-416a-9f4d-1bb285e53291 => generated 1560 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 03:37:38.627933 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi [None req-e2e3995d-8917-45fe-a8ec-dc7cf2ba96ac tempest-VolumesSnapshotTestJSON-925980516 tempest-VolumesSnapshotTestJSON-925980516-project] Calling method '>' {{(pid=116157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:37:38.628536 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.compute.api [None req-e2e3995d-8917-45fe-a8ec-dc7cf2ba96ac tempest-VolumesSnapshotTestJSON-925980516 tempest-VolumesSnapshotTestJSON-925980516-project] [instance: a0097d88-6613-416a-9f4d-1bb285e53291] Fetching instance by UUID {{(pid=116157) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:37:38.634697 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-e2e3995d-8917-45fe-a8ec-dc7cf2ba96ac tempest-VolumesSnapshotTestJSON-925980516 tempest-VolumesSnapshotTestJSON-925980516-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:37:38.635143 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-e2e3995d-8917-45fe-a8ec-dc7cf2ba96ac tempest-VolumesSnapshotTestJSON-925980516 tempest-VolumesSnapshotTestJSON-925980516-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:37:38.635913 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-e2e3995d-8917-45fe-a8ec-dc7cf2ba96ac tempest-VolumesSnapshotTestJSON-925980516 tempest-VolumesSnapshotTestJSON-925980516-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:37:38.636342 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-e2e3995d-8917-45fe-a8ec-dc7cf2ba96ac tempest-VolumesSnapshotTestJSON-925980516 tempest-VolumesSnapshotTestJSON-925980516-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:37:38.761905 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.policy [None req-e2e3995d-8917-45fe-a8ec-dc7cf2ba96ac tempest-VolumesSnapshotTestJSON-925980516 tempest-VolumesSnapshotTestJSON-925980516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4ffcca165af40abbd93569e7f01acbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ca6934bc24846ad82474c4ef7ba6323', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116157) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:37:38.769565 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: INFO nova.api.openstack.requestlog [None req-e2e3995d-8917-45fe-a8ec-dc7cf2ba96ac tempest-VolumesSnapshotTestJSON-925980516 tempest-VolumesSnapshotTestJSON-925980516-project] 10.222.0.18 "GET /compute/v2.1/servers/a0097d88-6613-416a-9f4d-1bb285e53291" status: 200 len: 1560 microversion: 2.1 time: 0.145334 Dec 15 03:37:38.770176 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: [pid: 116157|app: 0|req: 984/1982] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 03:37:38 2021] GET /compute/v2.1/servers/a0097d88-6613-416a-9f4d-1bb285e53291 => generated 1560 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 03:37:39.786543 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi [None req-65990f3f-d342-4190-8278-b72abfea2ea2 tempest-VolumesSnapshotTestJSON-925980516 tempest-VolumesSnapshotTestJSON-925980516-project] Calling method '>' {{(pid=116156) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:37:39.787271 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.compute.api [None req-65990f3f-d342-4190-8278-b72abfea2ea2 tempest-VolumesSnapshotTestJSON-925980516 tempest-VolumesSnapshotTestJSON-925980516-project] [instance: a0097d88-6613-416a-9f4d-1bb285e53291] Fetching instance by UUID {{(pid=116156) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:37:39.793558 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-65990f3f-d342-4190-8278-b72abfea2ea2 tempest-VolumesSnapshotTestJSON-925980516 tempest-VolumesSnapshotTestJSON-925980516-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:37:39.794044 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-65990f3f-d342-4190-8278-b72abfea2ea2 tempest-VolumesSnapshotTestJSON-925980516 tempest-VolumesSnapshotTestJSON-925980516-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:37:39.794831 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-65990f3f-d342-4190-8278-b72abfea2ea2 tempest-VolumesSnapshotTestJSON-925980516 tempest-VolumesSnapshotTestJSON-925980516-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:37:39.795266 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-65990f3f-d342-4190-8278-b72abfea2ea2 tempest-VolumesSnapshotTestJSON-925980516 tempest-VolumesSnapshotTestJSON-925980516-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:37:39.924326 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.policy [None req-65990f3f-d342-4190-8278-b72abfea2ea2 tempest-VolumesSnapshotTestJSON-925980516 tempest-VolumesSnapshotTestJSON-925980516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4ffcca165af40abbd93569e7f01acbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ca6934bc24846ad82474c4ef7ba6323', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116156) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:37:39.932907 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: INFO nova.api.openstack.requestlog [None req-65990f3f-d342-4190-8278-b72abfea2ea2 tempest-VolumesSnapshotTestJSON-925980516 tempest-VolumesSnapshotTestJSON-925980516-project] 10.222.0.18 "GET /compute/v2.1/servers/a0097d88-6613-416a-9f4d-1bb285e53291" status: 200 len: 1560 microversion: 2.1 time: 0.150054 Dec 15 03:37:39.933473 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: [pid: 116156|app: 0|req: 999/1983] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 03:37:39 2021] GET /compute/v2.1/servers/a0097d88-6613-416a-9f4d-1bb285e53291 => generated 1560 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 03:37:40.949324 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi [None req-1d945787-7648-4e44-9084-95d3fef18e06 tempest-VolumesSnapshotTestJSON-925980516 tempest-VolumesSnapshotTestJSON-925980516-project] Calling method '>' {{(pid=116157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:37:40.949961 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.compute.api [None req-1d945787-7648-4e44-9084-95d3fef18e06 tempest-VolumesSnapshotTestJSON-925980516 tempest-VolumesSnapshotTestJSON-925980516-project] [instance: a0097d88-6613-416a-9f4d-1bb285e53291] Fetching instance by UUID {{(pid=116157) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:37:40.956322 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-1d945787-7648-4e44-9084-95d3fef18e06 tempest-VolumesSnapshotTestJSON-925980516 tempest-VolumesSnapshotTestJSON-925980516-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:37:40.956771 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-1d945787-7648-4e44-9084-95d3fef18e06 tempest-VolumesSnapshotTestJSON-925980516 tempest-VolumesSnapshotTestJSON-925980516-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:37:40.957574 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-1d945787-7648-4e44-9084-95d3fef18e06 tempest-VolumesSnapshotTestJSON-925980516 tempest-VolumesSnapshotTestJSON-925980516-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:37:40.958039 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-1d945787-7648-4e44-9084-95d3fef18e06 tempest-VolumesSnapshotTestJSON-925980516 tempest-VolumesSnapshotTestJSON-925980516-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:37:41.087706 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.policy [None req-1d945787-7648-4e44-9084-95d3fef18e06 tempest-VolumesSnapshotTestJSON-925980516 tempest-VolumesSnapshotTestJSON-925980516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4ffcca165af40abbd93569e7f01acbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ca6934bc24846ad82474c4ef7ba6323', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116157) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:37:41.095638 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: INFO nova.api.openstack.requestlog [None req-1d945787-7648-4e44-9084-95d3fef18e06 tempest-VolumesSnapshotTestJSON-925980516 tempest-VolumesSnapshotTestJSON-925980516-project] 10.222.0.18 "GET /compute/v2.1/servers/a0097d88-6613-416a-9f4d-1bb285e53291" status: 200 len: 1560 microversion: 2.1 time: 0.149938 Dec 15 03:37:41.096208 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: [pid: 116157|app: 0|req: 985/1984] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 03:37:40 2021] GET /compute/v2.1/servers/a0097d88-6613-416a-9f4d-1bb285e53291 => generated 1560 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 03:37:42.113327 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi [None req-90746b75-6abc-4e16-aab9-eeba45c668cf tempest-VolumesSnapshotTestJSON-925980516 tempest-VolumesSnapshotTestJSON-925980516-project] Calling method '>' {{(pid=116156) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:37:42.113939 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.compute.api [None req-90746b75-6abc-4e16-aab9-eeba45c668cf tempest-VolumesSnapshotTestJSON-925980516 tempest-VolumesSnapshotTestJSON-925980516-project] [instance: a0097d88-6613-416a-9f4d-1bb285e53291] Fetching instance by UUID {{(pid=116156) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:37:42.119838 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-90746b75-6abc-4e16-aab9-eeba45c668cf tempest-VolumesSnapshotTestJSON-925980516 tempest-VolumesSnapshotTestJSON-925980516-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:37:42.120283 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-90746b75-6abc-4e16-aab9-eeba45c668cf tempest-VolumesSnapshotTestJSON-925980516 tempest-VolumesSnapshotTestJSON-925980516-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:37:42.121054 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-90746b75-6abc-4e16-aab9-eeba45c668cf tempest-VolumesSnapshotTestJSON-925980516 tempest-VolumesSnapshotTestJSON-925980516-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:37:42.121479 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-90746b75-6abc-4e16-aab9-eeba45c668cf tempest-VolumesSnapshotTestJSON-925980516 tempest-VolumesSnapshotTestJSON-925980516-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:37:42.247574 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.policy [None req-90746b75-6abc-4e16-aab9-eeba45c668cf tempest-VolumesSnapshotTestJSON-925980516 tempest-VolumesSnapshotTestJSON-925980516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4ffcca165af40abbd93569e7f01acbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ca6934bc24846ad82474c4ef7ba6323', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116156) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:37:42.255873 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: INFO nova.api.openstack.requestlog [None req-90746b75-6abc-4e16-aab9-eeba45c668cf tempest-VolumesSnapshotTestJSON-925980516 tempest-VolumesSnapshotTestJSON-925980516-project] 10.222.0.18 "GET /compute/v2.1/servers/a0097d88-6613-416a-9f4d-1bb285e53291" status: 200 len: 1560 microversion: 2.1 time: 0.146742 Dec 15 03:37:42.256441 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: [pid: 116156|app: 0|req: 1000/1985] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 03:37:42 2021] GET /compute/v2.1/servers/a0097d88-6613-416a-9f4d-1bb285e53291 => generated 1560 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 03:37:43.273100 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi [None req-bb805567-4e2d-4aa5-9962-e214bd26a58c tempest-VolumesSnapshotTestJSON-925980516 tempest-VolumesSnapshotTestJSON-925980516-project] Calling method '>' {{(pid=116157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:37:43.273734 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.compute.api [None req-bb805567-4e2d-4aa5-9962-e214bd26a58c tempest-VolumesSnapshotTestJSON-925980516 tempest-VolumesSnapshotTestJSON-925980516-project] [instance: a0097d88-6613-416a-9f4d-1bb285e53291] Fetching instance by UUID {{(pid=116157) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:37:43.279956 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-bb805567-4e2d-4aa5-9962-e214bd26a58c tempest-VolumesSnapshotTestJSON-925980516 tempest-VolumesSnapshotTestJSON-925980516-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:37:43.280402 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-bb805567-4e2d-4aa5-9962-e214bd26a58c tempest-VolumesSnapshotTestJSON-925980516 tempest-VolumesSnapshotTestJSON-925980516-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:37:43.281168 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-bb805567-4e2d-4aa5-9962-e214bd26a58c tempest-VolumesSnapshotTestJSON-925980516 tempest-VolumesSnapshotTestJSON-925980516-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:37:43.281598 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-bb805567-4e2d-4aa5-9962-e214bd26a58c tempest-VolumesSnapshotTestJSON-925980516 tempest-VolumesSnapshotTestJSON-925980516-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:37:43.405744 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.policy [None req-bb805567-4e2d-4aa5-9962-e214bd26a58c tempest-VolumesSnapshotTestJSON-925980516 tempest-VolumesSnapshotTestJSON-925980516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4ffcca165af40abbd93569e7f01acbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ca6934bc24846ad82474c4ef7ba6323', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116157) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:37:43.413462 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: INFO nova.api.openstack.requestlog [None req-bb805567-4e2d-4aa5-9962-e214bd26a58c tempest-VolumesSnapshotTestJSON-925980516 tempest-VolumesSnapshotTestJSON-925980516-project] 10.222.0.18 "GET /compute/v2.1/servers/a0097d88-6613-416a-9f4d-1bb285e53291" status: 200 len: 1560 microversion: 2.1 time: 0.143885 Dec 15 03:37:43.414034 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: [pid: 116157|app: 0|req: 986/1986] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 03:37:43 2021] GET /compute/v2.1/servers/a0097d88-6613-416a-9f4d-1bb285e53291 => generated 1560 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 03:37:44.430802 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi [None req-038cce4a-a7c8-419d-a855-67c5cc02ffd8 tempest-VolumesSnapshotTestJSON-925980516 tempest-VolumesSnapshotTestJSON-925980516-project] Calling method '>' {{(pid=116156) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:37:44.431405 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.compute.api [None req-038cce4a-a7c8-419d-a855-67c5cc02ffd8 tempest-VolumesSnapshotTestJSON-925980516 tempest-VolumesSnapshotTestJSON-925980516-project] [instance: a0097d88-6613-416a-9f4d-1bb285e53291] Fetching instance by UUID {{(pid=116156) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:37:44.437568 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-038cce4a-a7c8-419d-a855-67c5cc02ffd8 tempest-VolumesSnapshotTestJSON-925980516 tempest-VolumesSnapshotTestJSON-925980516-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:37:44.438038 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-038cce4a-a7c8-419d-a855-67c5cc02ffd8 tempest-VolumesSnapshotTestJSON-925980516 tempest-VolumesSnapshotTestJSON-925980516-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:37:44.438813 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-038cce4a-a7c8-419d-a855-67c5cc02ffd8 tempest-VolumesSnapshotTestJSON-925980516 tempest-VolumesSnapshotTestJSON-925980516-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:37:44.439246 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-038cce4a-a7c8-419d-a855-67c5cc02ffd8 tempest-VolumesSnapshotTestJSON-925980516 tempest-VolumesSnapshotTestJSON-925980516-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:37:44.566984 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.policy [None req-038cce4a-a7c8-419d-a855-67c5cc02ffd8 tempest-VolumesSnapshotTestJSON-925980516 tempest-VolumesSnapshotTestJSON-925980516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4ffcca165af40abbd93569e7f01acbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ca6934bc24846ad82474c4ef7ba6323', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116156) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:37:44.574571 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: INFO nova.api.openstack.requestlog [None req-038cce4a-a7c8-419d-a855-67c5cc02ffd8 tempest-VolumesSnapshotTestJSON-925980516 tempest-VolumesSnapshotTestJSON-925980516-project] 10.222.0.18 "GET /compute/v2.1/servers/a0097d88-6613-416a-9f4d-1bb285e53291" status: 200 len: 1560 microversion: 2.1 time: 0.147382 Dec 15 03:37:44.575140 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: [pid: 116156|app: 0|req: 1001/1987] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 03:37:44 2021] GET /compute/v2.1/servers/a0097d88-6613-416a-9f4d-1bb285e53291 => generated 1560 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 03:37:45.591441 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi [None req-717fce26-bb31-4d2d-b0fb-7e21ec3bf70a tempest-VolumesSnapshotTestJSON-925980516 tempest-VolumesSnapshotTestJSON-925980516-project] Calling method '>' {{(pid=116157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:37:45.592052 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.compute.api [None req-717fce26-bb31-4d2d-b0fb-7e21ec3bf70a tempest-VolumesSnapshotTestJSON-925980516 tempest-VolumesSnapshotTestJSON-925980516-project] [instance: a0097d88-6613-416a-9f4d-1bb285e53291] Fetching instance by UUID {{(pid=116157) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:37:45.598546 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-717fce26-bb31-4d2d-b0fb-7e21ec3bf70a tempest-VolumesSnapshotTestJSON-925980516 tempest-VolumesSnapshotTestJSON-925980516-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:37:45.599064 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-717fce26-bb31-4d2d-b0fb-7e21ec3bf70a tempest-VolumesSnapshotTestJSON-925980516 tempest-VolumesSnapshotTestJSON-925980516-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:37:45.599833 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-717fce26-bb31-4d2d-b0fb-7e21ec3bf70a tempest-VolumesSnapshotTestJSON-925980516 tempest-VolumesSnapshotTestJSON-925980516-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:37:45.600269 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-717fce26-bb31-4d2d-b0fb-7e21ec3bf70a tempest-VolumesSnapshotTestJSON-925980516 tempest-VolumesSnapshotTestJSON-925980516-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:37:45.730622 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.policy [None req-717fce26-bb31-4d2d-b0fb-7e21ec3bf70a tempest-VolumesSnapshotTestJSON-925980516 tempest-VolumesSnapshotTestJSON-925980516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4ffcca165af40abbd93569e7f01acbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ca6934bc24846ad82474c4ef7ba6323', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116157) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:37:45.738892 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: INFO nova.api.openstack.requestlog [None req-717fce26-bb31-4d2d-b0fb-7e21ec3bf70a tempest-VolumesSnapshotTestJSON-925980516 tempest-VolumesSnapshotTestJSON-925980516-project] 10.222.0.18 "GET /compute/v2.1/servers/a0097d88-6613-416a-9f4d-1bb285e53291" status: 200 len: 1560 microversion: 2.1 time: 0.151134 Dec 15 03:37:45.739456 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: [pid: 116157|app: 0|req: 987/1988] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 03:37:45 2021] GET /compute/v2.1/servers/a0097d88-6613-416a-9f4d-1bb285e53291 => generated 1560 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 03:37:46.756393 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi [None req-7a59f54c-d89f-4c5c-ae7c-0db4a9ebd53e tempest-VolumesSnapshotTestJSON-925980516 tempest-VolumesSnapshotTestJSON-925980516-project] Calling method '>' {{(pid=116156) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:37:46.757002 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.compute.api [None req-7a59f54c-d89f-4c5c-ae7c-0db4a9ebd53e tempest-VolumesSnapshotTestJSON-925980516 tempest-VolumesSnapshotTestJSON-925980516-project] [instance: a0097d88-6613-416a-9f4d-1bb285e53291] Fetching instance by UUID {{(pid=116156) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:37:46.763478 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-7a59f54c-d89f-4c5c-ae7c-0db4a9ebd53e tempest-VolumesSnapshotTestJSON-925980516 tempest-VolumesSnapshotTestJSON-925980516-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:37:46.763920 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-7a59f54c-d89f-4c5c-ae7c-0db4a9ebd53e tempest-VolumesSnapshotTestJSON-925980516 tempest-VolumesSnapshotTestJSON-925980516-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:37:46.764773 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-7a59f54c-d89f-4c5c-ae7c-0db4a9ebd53e tempest-VolumesSnapshotTestJSON-925980516 tempest-VolumesSnapshotTestJSON-925980516-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:37:46.765211 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-7a59f54c-d89f-4c5c-ae7c-0db4a9ebd53e tempest-VolumesSnapshotTestJSON-925980516 tempest-VolumesSnapshotTestJSON-925980516-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:37:46.890492 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.policy [None req-7a59f54c-d89f-4c5c-ae7c-0db4a9ebd53e tempest-VolumesSnapshotTestJSON-925980516 tempest-VolumesSnapshotTestJSON-925980516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4ffcca165af40abbd93569e7f01acbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ca6934bc24846ad82474c4ef7ba6323', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116156) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:37:46.898044 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: INFO nova.api.openstack.requestlog [None req-7a59f54c-d89f-4c5c-ae7c-0db4a9ebd53e tempest-VolumesSnapshotTestJSON-925980516 tempest-VolumesSnapshotTestJSON-925980516-project] 10.222.0.18 "GET /compute/v2.1/servers/a0097d88-6613-416a-9f4d-1bb285e53291" status: 200 len: 1560 microversion: 2.1 time: 0.145919 Dec 15 03:37:46.898604 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: [pid: 116156|app: 0|req: 1002/1989] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 03:37:46 2021] GET /compute/v2.1/servers/a0097d88-6613-416a-9f4d-1bb285e53291 => generated 1560 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 03:37:47.914770 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi [None req-0e552bf9-fba0-4249-ba85-904af907cea8 tempest-VolumesSnapshotTestJSON-925980516 tempest-VolumesSnapshotTestJSON-925980516-project] Calling method '>' {{(pid=116157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:37:47.915361 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.compute.api [None req-0e552bf9-fba0-4249-ba85-904af907cea8 tempest-VolumesSnapshotTestJSON-925980516 tempest-VolumesSnapshotTestJSON-925980516-project] [instance: a0097d88-6613-416a-9f4d-1bb285e53291] Fetching instance by UUID {{(pid=116157) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:37:47.921501 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-0e552bf9-fba0-4249-ba85-904af907cea8 tempest-VolumesSnapshotTestJSON-925980516 tempest-VolumesSnapshotTestJSON-925980516-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:37:47.921944 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-0e552bf9-fba0-4249-ba85-904af907cea8 tempest-VolumesSnapshotTestJSON-925980516 tempest-VolumesSnapshotTestJSON-925980516-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:37:47.922752 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-0e552bf9-fba0-4249-ba85-904af907cea8 tempest-VolumesSnapshotTestJSON-925980516 tempest-VolumesSnapshotTestJSON-925980516-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:37:47.923180 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-0e552bf9-fba0-4249-ba85-904af907cea8 tempest-VolumesSnapshotTestJSON-925980516 tempest-VolumesSnapshotTestJSON-925980516-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:37:48.052712 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.policy [None req-0e552bf9-fba0-4249-ba85-904af907cea8 tempest-VolumesSnapshotTestJSON-925980516 tempest-VolumesSnapshotTestJSON-925980516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4ffcca165af40abbd93569e7f01acbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ca6934bc24846ad82474c4ef7ba6323', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116157) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:37:48.060398 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: INFO nova.api.openstack.requestlog [None req-0e552bf9-fba0-4249-ba85-904af907cea8 tempest-VolumesSnapshotTestJSON-925980516 tempest-VolumesSnapshotTestJSON-925980516-project] 10.222.0.18 "GET /compute/v2.1/servers/a0097d88-6613-416a-9f4d-1bb285e53291" status: 200 len: 1560 microversion: 2.1 time: 0.149274 Dec 15 03:37:48.060964 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: [pid: 116157|app: 0|req: 988/1990] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 03:37:47 2021] GET /compute/v2.1/servers/a0097d88-6613-416a-9f4d-1bb285e53291 => generated 1560 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 03:37:49.078141 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi [None req-d53b0c0c-91d0-46c4-acd3-a330d1f12e4f tempest-VolumesSnapshotTestJSON-925980516 tempest-VolumesSnapshotTestJSON-925980516-project] Calling method '>' {{(pid=116156) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:37:49.078752 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.compute.api [None req-d53b0c0c-91d0-46c4-acd3-a330d1f12e4f tempest-VolumesSnapshotTestJSON-925980516 tempest-VolumesSnapshotTestJSON-925980516-project] [instance: a0097d88-6613-416a-9f4d-1bb285e53291] Fetching instance by UUID {{(pid=116156) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:37:49.085541 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-d53b0c0c-91d0-46c4-acd3-a330d1f12e4f tempest-VolumesSnapshotTestJSON-925980516 tempest-VolumesSnapshotTestJSON-925980516-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:37:49.086068 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-d53b0c0c-91d0-46c4-acd3-a330d1f12e4f tempest-VolumesSnapshotTestJSON-925980516 tempest-VolumesSnapshotTestJSON-925980516-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:37:49.086785 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-d53b0c0c-91d0-46c4-acd3-a330d1f12e4f tempest-VolumesSnapshotTestJSON-925980516 tempest-VolumesSnapshotTestJSON-925980516-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:37:49.087219 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-d53b0c0c-91d0-46c4-acd3-a330d1f12e4f tempest-VolumesSnapshotTestJSON-925980516 tempest-VolumesSnapshotTestJSON-925980516-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:37:49.215578 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.policy [None req-d53b0c0c-91d0-46c4-acd3-a330d1f12e4f tempest-VolumesSnapshotTestJSON-925980516 tempest-VolumesSnapshotTestJSON-925980516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4ffcca165af40abbd93569e7f01acbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ca6934bc24846ad82474c4ef7ba6323', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116156) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:37:49.223497 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: INFO nova.api.openstack.requestlog [None req-d53b0c0c-91d0-46c4-acd3-a330d1f12e4f tempest-VolumesSnapshotTestJSON-925980516 tempest-VolumesSnapshotTestJSON-925980516-project] 10.222.0.18 "GET /compute/v2.1/servers/a0097d88-6613-416a-9f4d-1bb285e53291" status: 200 len: 1560 microversion: 2.1 time: 0.148994 Dec 15 03:37:49.224059 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: [pid: 116156|app: 0|req: 1003/1991] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 03:37:49 2021] GET /compute/v2.1/servers/a0097d88-6613-416a-9f4d-1bb285e53291 => generated 1560 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 03:37:50.240828 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi [None req-88fe09d8-8700-4ad7-8829-34d6868e0615 tempest-VolumesSnapshotTestJSON-925980516 tempest-VolumesSnapshotTestJSON-925980516-project] Calling method '>' {{(pid=116157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:37:50.241383 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.compute.api [None req-88fe09d8-8700-4ad7-8829-34d6868e0615 tempest-VolumesSnapshotTestJSON-925980516 tempest-VolumesSnapshotTestJSON-925980516-project] [instance: a0097d88-6613-416a-9f4d-1bb285e53291] Fetching instance by UUID {{(pid=116157) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:37:50.247631 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-88fe09d8-8700-4ad7-8829-34d6868e0615 tempest-VolumesSnapshotTestJSON-925980516 tempest-VolumesSnapshotTestJSON-925980516-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:37:50.248081 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-88fe09d8-8700-4ad7-8829-34d6868e0615 tempest-VolumesSnapshotTestJSON-925980516 tempest-VolumesSnapshotTestJSON-925980516-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:37:50.248865 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-88fe09d8-8700-4ad7-8829-34d6868e0615 tempest-VolumesSnapshotTestJSON-925980516 tempest-VolumesSnapshotTestJSON-925980516-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:37:50.249302 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-88fe09d8-8700-4ad7-8829-34d6868e0615 tempest-VolumesSnapshotTestJSON-925980516 tempest-VolumesSnapshotTestJSON-925980516-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:37:50.373776 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.policy [None req-88fe09d8-8700-4ad7-8829-34d6868e0615 tempest-VolumesSnapshotTestJSON-925980516 tempest-VolumesSnapshotTestJSON-925980516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4ffcca165af40abbd93569e7f01acbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ca6934bc24846ad82474c4ef7ba6323', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116157) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:37:50.382053 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: INFO nova.api.openstack.requestlog [None req-88fe09d8-8700-4ad7-8829-34d6868e0615 tempest-VolumesSnapshotTestJSON-925980516 tempest-VolumesSnapshotTestJSON-925980516-project] 10.222.0.18 "GET /compute/v2.1/servers/a0097d88-6613-416a-9f4d-1bb285e53291" status: 200 len: 1560 microversion: 2.1 time: 0.145447 Dec 15 03:37:50.382619 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: [pid: 116157|app: 0|req: 989/1992] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 03:37:50 2021] GET /compute/v2.1/servers/a0097d88-6613-416a-9f4d-1bb285e53291 => generated 1560 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 03:37:51.399335 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi [None req-c92de542-671b-475e-ad90-14b788c50b66 tempest-VolumesSnapshotTestJSON-925980516 tempest-VolumesSnapshotTestJSON-925980516-project] Calling method '>' {{(pid=116156) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:37:51.399951 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.compute.api [None req-c92de542-671b-475e-ad90-14b788c50b66 tempest-VolumesSnapshotTestJSON-925980516 tempest-VolumesSnapshotTestJSON-925980516-project] [instance: a0097d88-6613-416a-9f4d-1bb285e53291] Fetching instance by UUID {{(pid=116156) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:37:51.406194 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-c92de542-671b-475e-ad90-14b788c50b66 tempest-VolumesSnapshotTestJSON-925980516 tempest-VolumesSnapshotTestJSON-925980516-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:37:51.406649 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-c92de542-671b-475e-ad90-14b788c50b66 tempest-VolumesSnapshotTestJSON-925980516 tempest-VolumesSnapshotTestJSON-925980516-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:37:51.407444 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-c92de542-671b-475e-ad90-14b788c50b66 tempest-VolumesSnapshotTestJSON-925980516 tempest-VolumesSnapshotTestJSON-925980516-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:37:51.407897 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-c92de542-671b-475e-ad90-14b788c50b66 tempest-VolumesSnapshotTestJSON-925980516 tempest-VolumesSnapshotTestJSON-925980516-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:37:51.535760 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.policy [None req-c92de542-671b-475e-ad90-14b788c50b66 tempest-VolumesSnapshotTestJSON-925980516 tempest-VolumesSnapshotTestJSON-925980516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4ffcca165af40abbd93569e7f01acbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ca6934bc24846ad82474c4ef7ba6323', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116156) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:37:51.543444 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: INFO nova.api.openstack.requestlog [None req-c92de542-671b-475e-ad90-14b788c50b66 tempest-VolumesSnapshotTestJSON-925980516 tempest-VolumesSnapshotTestJSON-925980516-project] 10.222.0.18 "GET /compute/v2.1/servers/a0097d88-6613-416a-9f4d-1bb285e53291" status: 200 len: 1560 microversion: 2.1 time: 0.147690 Dec 15 03:37:51.544002 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: [pid: 116156|app: 0|req: 1004/1993] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 03:37:51 2021] GET /compute/v2.1/servers/a0097d88-6613-416a-9f4d-1bb285e53291 => generated 1560 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 03:37:52.560130 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi [None req-667d60cd-a34a-4f9a-93da-82974656c9cd tempest-VolumesSnapshotTestJSON-925980516 tempest-VolumesSnapshotTestJSON-925980516-project] Calling method '>' {{(pid=116157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:37:52.560729 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.compute.api [None req-667d60cd-a34a-4f9a-93da-82974656c9cd tempest-VolumesSnapshotTestJSON-925980516 tempest-VolumesSnapshotTestJSON-925980516-project] [instance: a0097d88-6613-416a-9f4d-1bb285e53291] Fetching instance by UUID {{(pid=116157) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:37:52.567617 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-667d60cd-a34a-4f9a-93da-82974656c9cd tempest-VolumesSnapshotTestJSON-925980516 tempest-VolumesSnapshotTestJSON-925980516-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:37:52.568067 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-667d60cd-a34a-4f9a-93da-82974656c9cd tempest-VolumesSnapshotTestJSON-925980516 tempest-VolumesSnapshotTestJSON-925980516-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:37:52.568841 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-667d60cd-a34a-4f9a-93da-82974656c9cd tempest-VolumesSnapshotTestJSON-925980516 tempest-VolumesSnapshotTestJSON-925980516-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:37:52.569277 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-667d60cd-a34a-4f9a-93da-82974656c9cd tempest-VolumesSnapshotTestJSON-925980516 tempest-VolumesSnapshotTestJSON-925980516-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:37:52.697324 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.policy [None req-667d60cd-a34a-4f9a-93da-82974656c9cd tempest-VolumesSnapshotTestJSON-925980516 tempest-VolumesSnapshotTestJSON-925980516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4ffcca165af40abbd93569e7f01acbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ca6934bc24846ad82474c4ef7ba6323', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116157) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:37:52.704951 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: INFO nova.api.openstack.requestlog [None req-667d60cd-a34a-4f9a-93da-82974656c9cd tempest-VolumesSnapshotTestJSON-925980516 tempest-VolumesSnapshotTestJSON-925980516-project] 10.222.0.18 "GET /compute/v2.1/servers/a0097d88-6613-416a-9f4d-1bb285e53291" status: 200 len: 1560 microversion: 2.1 time: 0.148443 Dec 15 03:37:52.705510 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: [pid: 116157|app: 0|req: 990/1994] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 03:37:52 2021] GET /compute/v2.1/servers/a0097d88-6613-416a-9f4d-1bb285e53291 => generated 1560 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 03:37:53.722176 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi [None req-a65db0e2-46c0-4d9c-9fe0-dbee8648be18 tempest-VolumesSnapshotTestJSON-925980516 tempest-VolumesSnapshotTestJSON-925980516-project] Calling method '>' {{(pid=116156) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:37:53.722828 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.compute.api [None req-a65db0e2-46c0-4d9c-9fe0-dbee8648be18 tempest-VolumesSnapshotTestJSON-925980516 tempest-VolumesSnapshotTestJSON-925980516-project] [instance: a0097d88-6613-416a-9f4d-1bb285e53291] Fetching instance by UUID {{(pid=116156) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:37:53.729058 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-a65db0e2-46c0-4d9c-9fe0-dbee8648be18 tempest-VolumesSnapshotTestJSON-925980516 tempest-VolumesSnapshotTestJSON-925980516-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:37:53.729507 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-a65db0e2-46c0-4d9c-9fe0-dbee8648be18 tempest-VolumesSnapshotTestJSON-925980516 tempest-VolumesSnapshotTestJSON-925980516-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:37:53.730318 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-a65db0e2-46c0-4d9c-9fe0-dbee8648be18 tempest-VolumesSnapshotTestJSON-925980516 tempest-VolumesSnapshotTestJSON-925980516-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:37:53.730754 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-a65db0e2-46c0-4d9c-9fe0-dbee8648be18 tempest-VolumesSnapshotTestJSON-925980516 tempest-VolumesSnapshotTestJSON-925980516-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:37:53.856617 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.policy [None req-a65db0e2-46c0-4d9c-9fe0-dbee8648be18 tempest-VolumesSnapshotTestJSON-925980516 tempest-VolumesSnapshotTestJSON-925980516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4ffcca165af40abbd93569e7f01acbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ca6934bc24846ad82474c4ef7ba6323', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116156) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:37:53.864251 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: INFO nova.api.openstack.requestlog [None req-a65db0e2-46c0-4d9c-9fe0-dbee8648be18 tempest-VolumesSnapshotTestJSON-925980516 tempest-VolumesSnapshotTestJSON-925980516-project] 10.222.0.18 "GET /compute/v2.1/servers/a0097d88-6613-416a-9f4d-1bb285e53291" status: 200 len: 1560 microversion: 2.1 time: 0.146051 Dec 15 03:37:53.864809 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: [pid: 116156|app: 0|req: 1005/1995] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 03:37:53 2021] GET /compute/v2.1/servers/a0097d88-6613-416a-9f4d-1bb285e53291 => generated 1560 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 03:37:54.881991 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi [None req-d2f14c72-7021-4ea3-83f0-cfc572bb5299 tempest-VolumesSnapshotTestJSON-925980516 tempest-VolumesSnapshotTestJSON-925980516-project] Calling method '>' {{(pid=116157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:37:54.882624 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.compute.api [None req-d2f14c72-7021-4ea3-83f0-cfc572bb5299 tempest-VolumesSnapshotTestJSON-925980516 tempest-VolumesSnapshotTestJSON-925980516-project] [instance: a0097d88-6613-416a-9f4d-1bb285e53291] Fetching instance by UUID {{(pid=116157) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:37:54.888936 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-d2f14c72-7021-4ea3-83f0-cfc572bb5299 tempest-VolumesSnapshotTestJSON-925980516 tempest-VolumesSnapshotTestJSON-925980516-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:37:54.889389 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-d2f14c72-7021-4ea3-83f0-cfc572bb5299 tempest-VolumesSnapshotTestJSON-925980516 tempest-VolumesSnapshotTestJSON-925980516-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:37:54.890214 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-d2f14c72-7021-4ea3-83f0-cfc572bb5299 tempest-VolumesSnapshotTestJSON-925980516 tempest-VolumesSnapshotTestJSON-925980516-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:37:54.890651 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-d2f14c72-7021-4ea3-83f0-cfc572bb5299 tempest-VolumesSnapshotTestJSON-925980516 tempest-VolumesSnapshotTestJSON-925980516-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:37:55.016308 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.policy [None req-d2f14c72-7021-4ea3-83f0-cfc572bb5299 tempest-VolumesSnapshotTestJSON-925980516 tempest-VolumesSnapshotTestJSON-925980516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4ffcca165af40abbd93569e7f01acbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ca6934bc24846ad82474c4ef7ba6323', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116157) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:37:55.023939 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: INFO nova.api.openstack.requestlog [None req-d2f14c72-7021-4ea3-83f0-cfc572bb5299 tempest-VolumesSnapshotTestJSON-925980516 tempest-VolumesSnapshotTestJSON-925980516-project] 10.222.0.18 "GET /compute/v2.1/servers/a0097d88-6613-416a-9f4d-1bb285e53291" status: 200 len: 1560 microversion: 2.1 time: 0.146242 Dec 15 03:37:55.024510 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: [pid: 116157|app: 0|req: 991/1996] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 03:37:54 2021] GET /compute/v2.1/servers/a0097d88-6613-416a-9f4d-1bb285e53291 => generated 1560 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 03:37:56.040545 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi [None req-e0a69876-78fc-4aa1-8e14-f14d3280c87f tempest-VolumesSnapshotTestJSON-925980516 tempest-VolumesSnapshotTestJSON-925980516-project] Calling method '>' {{(pid=116156) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:37:56.041163 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.compute.api [None req-e0a69876-78fc-4aa1-8e14-f14d3280c87f tempest-VolumesSnapshotTestJSON-925980516 tempest-VolumesSnapshotTestJSON-925980516-project] [instance: a0097d88-6613-416a-9f4d-1bb285e53291] Fetching instance by UUID {{(pid=116156) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:37:56.047421 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-e0a69876-78fc-4aa1-8e14-f14d3280c87f tempest-VolumesSnapshotTestJSON-925980516 tempest-VolumesSnapshotTestJSON-925980516-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:37:56.047880 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-e0a69876-78fc-4aa1-8e14-f14d3280c87f tempest-VolumesSnapshotTestJSON-925980516 tempest-VolumesSnapshotTestJSON-925980516-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:37:56.048663 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-e0a69876-78fc-4aa1-8e14-f14d3280c87f tempest-VolumesSnapshotTestJSON-925980516 tempest-VolumesSnapshotTestJSON-925980516-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:37:56.049109 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-e0a69876-78fc-4aa1-8e14-f14d3280c87f tempest-VolumesSnapshotTestJSON-925980516 tempest-VolumesSnapshotTestJSON-925980516-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:37:56.182549 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.policy [None req-e0a69876-78fc-4aa1-8e14-f14d3280c87f tempest-VolumesSnapshotTestJSON-925980516 tempest-VolumesSnapshotTestJSON-925980516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4ffcca165af40abbd93569e7f01acbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ca6934bc24846ad82474c4ef7ba6323', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116156) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:37:56.191047 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: INFO nova.api.openstack.requestlog [None req-e0a69876-78fc-4aa1-8e14-f14d3280c87f tempest-VolumesSnapshotTestJSON-925980516 tempest-VolumesSnapshotTestJSON-925980516-project] 10.222.0.18 "GET /compute/v2.1/servers/a0097d88-6613-416a-9f4d-1bb285e53291" status: 200 len: 1560 microversion: 2.1 time: 0.153225 Dec 15 03:37:56.191616 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: [pid: 116156|app: 0|req: 1006/1997] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 03:37:56 2021] GET /compute/v2.1/servers/a0097d88-6613-416a-9f4d-1bb285e53291 => generated 1560 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 03:37:56.275784 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Dec 15 03:37:56.276298 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: Wed Dec 15 03:37:56 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Dec 15 03:37:57.208458 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi [None req-3052a084-57af-4e3c-add9-754ef2d096f1 tempest-VolumesSnapshotTestJSON-925980516 tempest-VolumesSnapshotTestJSON-925980516-project] Calling method '>' {{(pid=116157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:37:57.209244 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.compute.api [None req-3052a084-57af-4e3c-add9-754ef2d096f1 tempest-VolumesSnapshotTestJSON-925980516 tempest-VolumesSnapshotTestJSON-925980516-project] [instance: a0097d88-6613-416a-9f4d-1bb285e53291] Fetching instance by UUID {{(pid=116157) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:37:57.215511 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-3052a084-57af-4e3c-add9-754ef2d096f1 tempest-VolumesSnapshotTestJSON-925980516 tempest-VolumesSnapshotTestJSON-925980516-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:37:57.215971 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-3052a084-57af-4e3c-add9-754ef2d096f1 tempest-VolumesSnapshotTestJSON-925980516 tempest-VolumesSnapshotTestJSON-925980516-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:37:57.216962 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-3052a084-57af-4e3c-add9-754ef2d096f1 tempest-VolumesSnapshotTestJSON-925980516 tempest-VolumesSnapshotTestJSON-925980516-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:37:57.217405 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-3052a084-57af-4e3c-add9-754ef2d096f1 tempest-VolumesSnapshotTestJSON-925980516 tempest-VolumesSnapshotTestJSON-925980516-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:37:57.348876 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.policy [None req-3052a084-57af-4e3c-add9-754ef2d096f1 tempest-VolumesSnapshotTestJSON-925980516 tempest-VolumesSnapshotTestJSON-925980516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4ffcca165af40abbd93569e7f01acbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ca6934bc24846ad82474c4ef7ba6323', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116157) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:37:57.356596 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: INFO nova.api.openstack.requestlog [None req-3052a084-57af-4e3c-add9-754ef2d096f1 tempest-VolumesSnapshotTestJSON-925980516 tempest-VolumesSnapshotTestJSON-925980516-project] 10.222.0.18 "GET /compute/v2.1/servers/a0097d88-6613-416a-9f4d-1bb285e53291" status: 200 len: 1560 microversion: 2.1 time: 0.152264 Dec 15 03:37:57.357163 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: [pid: 116157|app: 0|req: 992/1998] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 03:37:57 2021] GET /compute/v2.1/servers/a0097d88-6613-416a-9f4d-1bb285e53291 => generated 1560 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 03:37:58.373326 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi [None req-62b8377a-994b-4959-b2e4-b8d34556a9ea tempest-VolumesSnapshotTestJSON-925980516 tempest-VolumesSnapshotTestJSON-925980516-project] Calling method '>' {{(pid=116156) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:37:58.373930 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.compute.api [None req-62b8377a-994b-4959-b2e4-b8d34556a9ea tempest-VolumesSnapshotTestJSON-925980516 tempest-VolumesSnapshotTestJSON-925980516-project] [instance: a0097d88-6613-416a-9f4d-1bb285e53291] Fetching instance by UUID {{(pid=116156) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:37:58.381017 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-62b8377a-994b-4959-b2e4-b8d34556a9ea tempest-VolumesSnapshotTestJSON-925980516 tempest-VolumesSnapshotTestJSON-925980516-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:37:58.381469 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-62b8377a-994b-4959-b2e4-b8d34556a9ea tempest-VolumesSnapshotTestJSON-925980516 tempest-VolumesSnapshotTestJSON-925980516-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:37:58.382278 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-62b8377a-994b-4959-b2e4-b8d34556a9ea tempest-VolumesSnapshotTestJSON-925980516 tempest-VolumesSnapshotTestJSON-925980516-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:37:58.382712 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-62b8377a-994b-4959-b2e4-b8d34556a9ea tempest-VolumesSnapshotTestJSON-925980516 tempest-VolumesSnapshotTestJSON-925980516-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:37:58.507405 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.policy [None req-62b8377a-994b-4959-b2e4-b8d34556a9ea tempest-VolumesSnapshotTestJSON-925980516 tempest-VolumesSnapshotTestJSON-925980516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4ffcca165af40abbd93569e7f01acbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ca6934bc24846ad82474c4ef7ba6323', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116156) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:37:58.514942 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: INFO nova.api.openstack.requestlog [None req-62b8377a-994b-4959-b2e4-b8d34556a9ea tempest-VolumesSnapshotTestJSON-925980516 tempest-VolumesSnapshotTestJSON-925980516-project] 10.222.0.18 "GET /compute/v2.1/servers/a0097d88-6613-416a-9f4d-1bb285e53291" status: 200 len: 1560 microversion: 2.1 time: 0.145201 Dec 15 03:37:58.515509 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: [pid: 116156|app: 0|req: 1007/1999] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 03:37:58 2021] GET /compute/v2.1/servers/a0097d88-6613-416a-9f4d-1bb285e53291 => generated 1560 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 03:37:59.531843 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi [None req-1a0a0a84-13f7-4495-a4c1-2f1f41d46be3 tempest-VolumesSnapshotTestJSON-925980516 tempest-VolumesSnapshotTestJSON-925980516-project] Calling method '>' {{(pid=116157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:37:59.532383 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.compute.api [None req-1a0a0a84-13f7-4495-a4c1-2f1f41d46be3 tempest-VolumesSnapshotTestJSON-925980516 tempest-VolumesSnapshotTestJSON-925980516-project] [instance: a0097d88-6613-416a-9f4d-1bb285e53291] Fetching instance by UUID {{(pid=116157) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:37:59.539110 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-1a0a0a84-13f7-4495-a4c1-2f1f41d46be3 tempest-VolumesSnapshotTestJSON-925980516 tempest-VolumesSnapshotTestJSON-925980516-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:37:59.539596 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-1a0a0a84-13f7-4495-a4c1-2f1f41d46be3 tempest-VolumesSnapshotTestJSON-925980516 tempest-VolumesSnapshotTestJSON-925980516-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:37:59.542117 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-1a0a0a84-13f7-4495-a4c1-2f1f41d46be3 tempest-VolumesSnapshotTestJSON-925980516 tempest-VolumesSnapshotTestJSON-925980516-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:37:59.542663 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-1a0a0a84-13f7-4495-a4c1-2f1f41d46be3 tempest-VolumesSnapshotTestJSON-925980516 tempest-VolumesSnapshotTestJSON-925980516-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:37:59.670755 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.policy [None req-1a0a0a84-13f7-4495-a4c1-2f1f41d46be3 tempest-VolumesSnapshotTestJSON-925980516 tempest-VolumesSnapshotTestJSON-925980516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4ffcca165af40abbd93569e7f01acbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ca6934bc24846ad82474c4ef7ba6323', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116157) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:37:59.679241 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: INFO nova.api.openstack.requestlog [None req-1a0a0a84-13f7-4495-a4c1-2f1f41d46be3 tempest-VolumesSnapshotTestJSON-925980516 tempest-VolumesSnapshotTestJSON-925980516-project] 10.222.0.18 "GET /compute/v2.1/servers/a0097d88-6613-416a-9f4d-1bb285e53291" status: 200 len: 1560 microversion: 2.1 time: 0.151163 Dec 15 03:37:59.679787 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: [pid: 116157|app: 0|req: 993/2000] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 03:37:59 2021] GET /compute/v2.1/servers/a0097d88-6613-416a-9f4d-1bb285e53291 => generated 1560 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 03:38:00.696408 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi [None req-11d276ca-0a74-48ea-b6b1-a0ef1ea416fe tempest-VolumesSnapshotTestJSON-925980516 tempest-VolumesSnapshotTestJSON-925980516-project] Calling method '>' {{(pid=116156) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:38:00.697021 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.compute.api [None req-11d276ca-0a74-48ea-b6b1-a0ef1ea416fe tempest-VolumesSnapshotTestJSON-925980516 tempest-VolumesSnapshotTestJSON-925980516-project] [instance: a0097d88-6613-416a-9f4d-1bb285e53291] Fetching instance by UUID {{(pid=116156) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:38:00.703417 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-11d276ca-0a74-48ea-b6b1-a0ef1ea416fe tempest-VolumesSnapshotTestJSON-925980516 tempest-VolumesSnapshotTestJSON-925980516-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:38:00.704140 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-11d276ca-0a74-48ea-b6b1-a0ef1ea416fe tempest-VolumesSnapshotTestJSON-925980516 tempest-VolumesSnapshotTestJSON-925980516-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:38:00.704948 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-11d276ca-0a74-48ea-b6b1-a0ef1ea416fe tempest-VolumesSnapshotTestJSON-925980516 tempest-VolumesSnapshotTestJSON-925980516-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:38:00.705511 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-11d276ca-0a74-48ea-b6b1-a0ef1ea416fe tempest-VolumesSnapshotTestJSON-925980516 tempest-VolumesSnapshotTestJSON-925980516-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:38:01.065648 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.policy [None req-11d276ca-0a74-48ea-b6b1-a0ef1ea416fe tempest-VolumesSnapshotTestJSON-925980516 tempest-VolumesSnapshotTestJSON-925980516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4ffcca165af40abbd93569e7f01acbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ca6934bc24846ad82474c4ef7ba6323', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116156) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:38:01.073379 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: INFO nova.api.openstack.requestlog [None req-11d276ca-0a74-48ea-b6b1-a0ef1ea416fe tempest-VolumesSnapshotTestJSON-925980516 tempest-VolumesSnapshotTestJSON-925980516-project] 10.222.0.18 "GET /compute/v2.1/servers/a0097d88-6613-416a-9f4d-1bb285e53291" status: 200 len: 1560 microversion: 2.1 time: 0.380609 Dec 15 03:38:01.073941 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: [pid: 116156|app: 0|req: 1008/2001] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 03:38:00 2021] GET /compute/v2.1/servers/a0097d88-6613-416a-9f4d-1bb285e53291 => generated 1560 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 03:38:02.090273 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi [None req-f6d63e17-5859-4de5-813f-6c0624059b0f tempest-VolumesSnapshotTestJSON-925980516 tempest-VolumesSnapshotTestJSON-925980516-project] Calling method '>' {{(pid=116157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:38:02.090891 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.compute.api [None req-f6d63e17-5859-4de5-813f-6c0624059b0f tempest-VolumesSnapshotTestJSON-925980516 tempest-VolumesSnapshotTestJSON-925980516-project] [instance: a0097d88-6613-416a-9f4d-1bb285e53291] Fetching instance by UUID {{(pid=116157) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:38:02.097174 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-f6d63e17-5859-4de5-813f-6c0624059b0f tempest-VolumesSnapshotTestJSON-925980516 tempest-VolumesSnapshotTestJSON-925980516-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:38:02.097652 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-f6d63e17-5859-4de5-813f-6c0624059b0f tempest-VolumesSnapshotTestJSON-925980516 tempest-VolumesSnapshotTestJSON-925980516-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:38:02.098473 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-f6d63e17-5859-4de5-813f-6c0624059b0f tempest-VolumesSnapshotTestJSON-925980516 tempest-VolumesSnapshotTestJSON-925980516-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:38:02.098909 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-f6d63e17-5859-4de5-813f-6c0624059b0f tempest-VolumesSnapshotTestJSON-925980516 tempest-VolumesSnapshotTestJSON-925980516-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:38:02.226621 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.policy [None req-f6d63e17-5859-4de5-813f-6c0624059b0f tempest-VolumesSnapshotTestJSON-925980516 tempest-VolumesSnapshotTestJSON-925980516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4ffcca165af40abbd93569e7f01acbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ca6934bc24846ad82474c4ef7ba6323', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116157) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:38:02.234256 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: INFO nova.api.openstack.requestlog [None req-f6d63e17-5859-4de5-813f-6c0624059b0f tempest-VolumesSnapshotTestJSON-925980516 tempest-VolumesSnapshotTestJSON-925980516-project] 10.222.0.18 "GET /compute/v2.1/servers/a0097d88-6613-416a-9f4d-1bb285e53291" status: 200 len: 1560 microversion: 2.1 time: 0.147632 Dec 15 03:38:02.234824 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: [pid: 116157|app: 0|req: 994/2002] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 03:38:02 2021] GET /compute/v2.1/servers/a0097d88-6613-416a-9f4d-1bb285e53291 => generated 1560 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 03:38:03.250702 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi [None req-4f3ce534-34d3-48b3-8993-9dec8f59156d tempest-VolumesSnapshotTestJSON-925980516 tempest-VolumesSnapshotTestJSON-925980516-project] Calling method '>' {{(pid=116156) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:38:03.251308 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.compute.api [None req-4f3ce534-34d3-48b3-8993-9dec8f59156d tempest-VolumesSnapshotTestJSON-925980516 tempest-VolumesSnapshotTestJSON-925980516-project] [instance: a0097d88-6613-416a-9f4d-1bb285e53291] Fetching instance by UUID {{(pid=116156) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:38:03.258025 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-4f3ce534-34d3-48b3-8993-9dec8f59156d tempest-VolumesSnapshotTestJSON-925980516 tempest-VolumesSnapshotTestJSON-925980516-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:38:03.258473 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-4f3ce534-34d3-48b3-8993-9dec8f59156d tempest-VolumesSnapshotTestJSON-925980516 tempest-VolumesSnapshotTestJSON-925980516-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:38:03.259249 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-4f3ce534-34d3-48b3-8993-9dec8f59156d tempest-VolumesSnapshotTestJSON-925980516 tempest-VolumesSnapshotTestJSON-925980516-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:38:03.259682 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-4f3ce534-34d3-48b3-8993-9dec8f59156d tempest-VolumesSnapshotTestJSON-925980516 tempest-VolumesSnapshotTestJSON-925980516-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:38:03.385568 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.policy [None req-4f3ce534-34d3-48b3-8993-9dec8f59156d tempest-VolumesSnapshotTestJSON-925980516 tempest-VolumesSnapshotTestJSON-925980516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4ffcca165af40abbd93569e7f01acbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ca6934bc24846ad82474c4ef7ba6323', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116156) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:38:03.393920 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: INFO nova.api.openstack.requestlog [None req-4f3ce534-34d3-48b3-8993-9dec8f59156d tempest-VolumesSnapshotTestJSON-925980516 tempest-VolumesSnapshotTestJSON-925980516-project] 10.222.0.18 "GET /compute/v2.1/servers/a0097d88-6613-416a-9f4d-1bb285e53291" status: 200 len: 1560 microversion: 2.1 time: 0.146856 Dec 15 03:38:03.394510 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: [pid: 116156|app: 0|req: 1009/2003] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 03:38:03 2021] GET /compute/v2.1/servers/a0097d88-6613-416a-9f4d-1bb285e53291 => generated 1560 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 03:38:04.411226 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi [None req-e7a694a6-d079-414c-8b82-87daa87def9f tempest-VolumesSnapshotTestJSON-925980516 tempest-VolumesSnapshotTestJSON-925980516-project] Calling method '>' {{(pid=116157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:38:04.411836 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.compute.api [None req-e7a694a6-d079-414c-8b82-87daa87def9f tempest-VolumesSnapshotTestJSON-925980516 tempest-VolumesSnapshotTestJSON-925980516-project] [instance: a0097d88-6613-416a-9f4d-1bb285e53291] Fetching instance by UUID {{(pid=116157) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:38:04.418060 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-e7a694a6-d079-414c-8b82-87daa87def9f tempest-VolumesSnapshotTestJSON-925980516 tempest-VolumesSnapshotTestJSON-925980516-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:38:04.418512 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-e7a694a6-d079-414c-8b82-87daa87def9f tempest-VolumesSnapshotTestJSON-925980516 tempest-VolumesSnapshotTestJSON-925980516-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:38:04.419290 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-e7a694a6-d079-414c-8b82-87daa87def9f tempest-VolumesSnapshotTestJSON-925980516 tempest-VolumesSnapshotTestJSON-925980516-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:38:04.419727 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-e7a694a6-d079-414c-8b82-87daa87def9f tempest-VolumesSnapshotTestJSON-925980516 tempest-VolumesSnapshotTestJSON-925980516-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:38:04.545712 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.policy [None req-e7a694a6-d079-414c-8b82-87daa87def9f tempest-VolumesSnapshotTestJSON-925980516 tempest-VolumesSnapshotTestJSON-925980516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4ffcca165af40abbd93569e7f01acbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ca6934bc24846ad82474c4ef7ba6323', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116157) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:38:04.553403 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: INFO nova.api.openstack.requestlog [None req-e7a694a6-d079-414c-8b82-87daa87def9f tempest-VolumesSnapshotTestJSON-925980516 tempest-VolumesSnapshotTestJSON-925980516-project] 10.222.0.18 "GET /compute/v2.1/servers/a0097d88-6613-416a-9f4d-1bb285e53291" status: 200 len: 1560 microversion: 2.1 time: 0.146440 Dec 15 03:38:04.553973 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: [pid: 116157|app: 0|req: 995/2004] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 03:38:04 2021] GET /compute/v2.1/servers/a0097d88-6613-416a-9f4d-1bb285e53291 => generated 1560 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 03:38:05.570019 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi [None req-3fe1cc00-f1a2-49de-b340-74bccfde97c1 tempest-VolumesSnapshotTestJSON-925980516 tempest-VolumesSnapshotTestJSON-925980516-project] Calling method '>' {{(pid=116156) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:38:05.570735 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.compute.api [None req-3fe1cc00-f1a2-49de-b340-74bccfde97c1 tempest-VolumesSnapshotTestJSON-925980516 tempest-VolumesSnapshotTestJSON-925980516-project] [instance: a0097d88-6613-416a-9f4d-1bb285e53291] Fetching instance by UUID {{(pid=116156) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:38:05.577005 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-3fe1cc00-f1a2-49de-b340-74bccfde97c1 tempest-VolumesSnapshotTestJSON-925980516 tempest-VolumesSnapshotTestJSON-925980516-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:38:05.577461 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-3fe1cc00-f1a2-49de-b340-74bccfde97c1 tempest-VolumesSnapshotTestJSON-925980516 tempest-VolumesSnapshotTestJSON-925980516-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:38:05.578279 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-3fe1cc00-f1a2-49de-b340-74bccfde97c1 tempest-VolumesSnapshotTestJSON-925980516 tempest-VolumesSnapshotTestJSON-925980516-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:38:05.578719 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-3fe1cc00-f1a2-49de-b340-74bccfde97c1 tempest-VolumesSnapshotTestJSON-925980516 tempest-VolumesSnapshotTestJSON-925980516-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:38:05.710106 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.policy [None req-3fe1cc00-f1a2-49de-b340-74bccfde97c1 tempest-VolumesSnapshotTestJSON-925980516 tempest-VolumesSnapshotTestJSON-925980516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4ffcca165af40abbd93569e7f01acbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ca6934bc24846ad82474c4ef7ba6323', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116156) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:38:05.717734 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: INFO nova.api.openstack.requestlog [None req-3fe1cc00-f1a2-49de-b340-74bccfde97c1 tempest-VolumesSnapshotTestJSON-925980516 tempest-VolumesSnapshotTestJSON-925980516-project] 10.222.0.18 "GET /compute/v2.1/servers/a0097d88-6613-416a-9f4d-1bb285e53291" status: 200 len: 1560 microversion: 2.1 time: 0.151409 Dec 15 03:38:05.718584 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: [pid: 116156|app: 0|req: 1010/2005] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 03:38:05 2021] GET /compute/v2.1/servers/a0097d88-6613-416a-9f4d-1bb285e53291 => generated 1560 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 03:38:06.734971 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi [None req-d08d0bed-b4ca-4960-a3f9-f23a953d2458 tempest-VolumesSnapshotTestJSON-925980516 tempest-VolumesSnapshotTestJSON-925980516-project] Calling method '>' {{(pid=116157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:38:06.735597 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.compute.api [None req-d08d0bed-b4ca-4960-a3f9-f23a953d2458 tempest-VolumesSnapshotTestJSON-925980516 tempest-VolumesSnapshotTestJSON-925980516-project] [instance: a0097d88-6613-416a-9f4d-1bb285e53291] Fetching instance by UUID {{(pid=116157) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:38:06.742425 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-d08d0bed-b4ca-4960-a3f9-f23a953d2458 tempest-VolumesSnapshotTestJSON-925980516 tempest-VolumesSnapshotTestJSON-925980516-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:38:06.742879 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-d08d0bed-b4ca-4960-a3f9-f23a953d2458 tempest-VolumesSnapshotTestJSON-925980516 tempest-VolumesSnapshotTestJSON-925980516-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:38:06.743651 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-d08d0bed-b4ca-4960-a3f9-f23a953d2458 tempest-VolumesSnapshotTestJSON-925980516 tempest-VolumesSnapshotTestJSON-925980516-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:38:06.744106 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-d08d0bed-b4ca-4960-a3f9-f23a953d2458 tempest-VolumesSnapshotTestJSON-925980516 tempest-VolumesSnapshotTestJSON-925980516-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:38:06.870301 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.policy [None req-d08d0bed-b4ca-4960-a3f9-f23a953d2458 tempest-VolumesSnapshotTestJSON-925980516 tempest-VolumesSnapshotTestJSON-925980516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4ffcca165af40abbd93569e7f01acbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ca6934bc24846ad82474c4ef7ba6323', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116157) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:38:06.878659 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: INFO nova.api.openstack.requestlog [None req-d08d0bed-b4ca-4960-a3f9-f23a953d2458 tempest-VolumesSnapshotTestJSON-925980516 tempest-VolumesSnapshotTestJSON-925980516-project] 10.222.0.18 "GET /compute/v2.1/servers/a0097d88-6613-416a-9f4d-1bb285e53291" status: 200 len: 1560 microversion: 2.1 time: 0.147383 Dec 15 03:38:06.879215 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: [pid: 116157|app: 0|req: 996/2006] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 03:38:06 2021] GET /compute/v2.1/servers/a0097d88-6613-416a-9f4d-1bb285e53291 => generated 1560 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 03:38:07.895977 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi [None req-4541087f-2508-4f11-a66d-86f30285bd96 tempest-VolumesSnapshotTestJSON-925980516 tempest-VolumesSnapshotTestJSON-925980516-project] Calling method '>' {{(pid=116156) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:38:07.896613 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.compute.api [None req-4541087f-2508-4f11-a66d-86f30285bd96 tempest-VolumesSnapshotTestJSON-925980516 tempest-VolumesSnapshotTestJSON-925980516-project] [instance: a0097d88-6613-416a-9f4d-1bb285e53291] Fetching instance by UUID {{(pid=116156) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:38:07.902779 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-4541087f-2508-4f11-a66d-86f30285bd96 tempest-VolumesSnapshotTestJSON-925980516 tempest-VolumesSnapshotTestJSON-925980516-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:38:07.903225 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-4541087f-2508-4f11-a66d-86f30285bd96 tempest-VolumesSnapshotTestJSON-925980516 tempest-VolumesSnapshotTestJSON-925980516-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:38:07.903994 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-4541087f-2508-4f11-a66d-86f30285bd96 tempest-VolumesSnapshotTestJSON-925980516 tempest-VolumesSnapshotTestJSON-925980516-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:38:07.904424 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-4541087f-2508-4f11-a66d-86f30285bd96 tempest-VolumesSnapshotTestJSON-925980516 tempest-VolumesSnapshotTestJSON-925980516-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:38:08.030052 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.policy [None req-4541087f-2508-4f11-a66d-86f30285bd96 tempest-VolumesSnapshotTestJSON-925980516 tempest-VolumesSnapshotTestJSON-925980516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4ffcca165af40abbd93569e7f01acbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ca6934bc24846ad82474c4ef7ba6323', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116156) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:38:08.037682 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: INFO nova.api.openstack.requestlog [None req-4541087f-2508-4f11-a66d-86f30285bd96 tempest-VolumesSnapshotTestJSON-925980516 tempest-VolumesSnapshotTestJSON-925980516-project] 10.222.0.18 "GET /compute/v2.1/servers/a0097d88-6613-416a-9f4d-1bb285e53291" status: 200 len: 1560 microversion: 2.1 time: 0.145949 Dec 15 03:38:08.038278 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: [pid: 116156|app: 0|req: 1011/2007] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 03:38:07 2021] GET /compute/v2.1/servers/a0097d88-6613-416a-9f4d-1bb285e53291 => generated 1560 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 03:38:09.055710 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi [None req-081d462b-ef1c-41d5-8e1e-69b4e9ae7228 tempest-VolumesSnapshotTestJSON-925980516 tempest-VolumesSnapshotTestJSON-925980516-project] Calling method '>' {{(pid=116157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:38:09.056315 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.compute.api [None req-081d462b-ef1c-41d5-8e1e-69b4e9ae7228 tempest-VolumesSnapshotTestJSON-925980516 tempest-VolumesSnapshotTestJSON-925980516-project] [instance: a0097d88-6613-416a-9f4d-1bb285e53291] Fetching instance by UUID {{(pid=116157) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:38:09.062828 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-081d462b-ef1c-41d5-8e1e-69b4e9ae7228 tempest-VolumesSnapshotTestJSON-925980516 tempest-VolumesSnapshotTestJSON-925980516-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:38:09.063289 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-081d462b-ef1c-41d5-8e1e-69b4e9ae7228 tempest-VolumesSnapshotTestJSON-925980516 tempest-VolumesSnapshotTestJSON-925980516-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:38:09.064081 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-081d462b-ef1c-41d5-8e1e-69b4e9ae7228 tempest-VolumesSnapshotTestJSON-925980516 tempest-VolumesSnapshotTestJSON-925980516-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:38:09.065209 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-081d462b-ef1c-41d5-8e1e-69b4e9ae7228 tempest-VolumesSnapshotTestJSON-925980516 tempest-VolumesSnapshotTestJSON-925980516-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:38:09.193778 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.policy [None req-081d462b-ef1c-41d5-8e1e-69b4e9ae7228 tempest-VolumesSnapshotTestJSON-925980516 tempest-VolumesSnapshotTestJSON-925980516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4ffcca165af40abbd93569e7f01acbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ca6934bc24846ad82474c4ef7ba6323', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116157) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:38:09.201495 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: INFO nova.api.openstack.requestlog [None req-081d462b-ef1c-41d5-8e1e-69b4e9ae7228 tempest-VolumesSnapshotTestJSON-925980516 tempest-VolumesSnapshotTestJSON-925980516-project] 10.222.0.18 "GET /compute/v2.1/servers/a0097d88-6613-416a-9f4d-1bb285e53291" status: 200 len: 1560 microversion: 2.1 time: 0.149429 Dec 15 03:38:09.202082 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: [pid: 116157|app: 0|req: 997/2008] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 03:38:09 2021] GET /compute/v2.1/servers/a0097d88-6613-416a-9f4d-1bb285e53291 => generated 1560 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 03:38:10.218629 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi [None req-96760e11-3054-48cd-a0a5-447f0d77f38c tempest-VolumesSnapshotTestJSON-925980516 tempest-VolumesSnapshotTestJSON-925980516-project] Calling method '>' {{(pid=116156) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:38:10.219241 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.compute.api [None req-96760e11-3054-48cd-a0a5-447f0d77f38c tempest-VolumesSnapshotTestJSON-925980516 tempest-VolumesSnapshotTestJSON-925980516-project] [instance: a0097d88-6613-416a-9f4d-1bb285e53291] Fetching instance by UUID {{(pid=116156) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:38:10.225435 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-96760e11-3054-48cd-a0a5-447f0d77f38c tempest-VolumesSnapshotTestJSON-925980516 tempest-VolumesSnapshotTestJSON-925980516-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:38:10.225889 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-96760e11-3054-48cd-a0a5-447f0d77f38c tempest-VolumesSnapshotTestJSON-925980516 tempest-VolumesSnapshotTestJSON-925980516-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:38:10.226698 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-96760e11-3054-48cd-a0a5-447f0d77f38c tempest-VolumesSnapshotTestJSON-925980516 tempest-VolumesSnapshotTestJSON-925980516-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:38:10.227136 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-96760e11-3054-48cd-a0a5-447f0d77f38c tempest-VolumesSnapshotTestJSON-925980516 tempest-VolumesSnapshotTestJSON-925980516-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:38:10.352348 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.policy [None req-96760e11-3054-48cd-a0a5-447f0d77f38c tempest-VolumesSnapshotTestJSON-925980516 tempest-VolumesSnapshotTestJSON-925980516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4ffcca165af40abbd93569e7f01acbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ca6934bc24846ad82474c4ef7ba6323', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116156) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:38:10.360011 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: INFO nova.api.openstack.requestlog [None req-96760e11-3054-48cd-a0a5-447f0d77f38c tempest-VolumesSnapshotTestJSON-925980516 tempest-VolumesSnapshotTestJSON-925980516-project] 10.222.0.18 "GET /compute/v2.1/servers/a0097d88-6613-416a-9f4d-1bb285e53291" status: 200 len: 1560 microversion: 2.1 time: 0.145333 Dec 15 03:38:10.360580 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: [pid: 116156|app: 0|req: 1012/2009] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 03:38:10 2021] GET /compute/v2.1/servers/a0097d88-6613-416a-9f4d-1bb285e53291 => generated 1560 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 03:38:11.376889 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi [None req-3f67c2db-abda-4422-bff0-543d8e67c81b tempest-VolumesSnapshotTestJSON-925980516 tempest-VolumesSnapshotTestJSON-925980516-project] Calling method '>' {{(pid=116157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:38:11.377529 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.compute.api [None req-3f67c2db-abda-4422-bff0-543d8e67c81b tempest-VolumesSnapshotTestJSON-925980516 tempest-VolumesSnapshotTestJSON-925980516-project] [instance: a0097d88-6613-416a-9f4d-1bb285e53291] Fetching instance by UUID {{(pid=116157) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:38:11.383786 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-3f67c2db-abda-4422-bff0-543d8e67c81b tempest-VolumesSnapshotTestJSON-925980516 tempest-VolumesSnapshotTestJSON-925980516-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:38:11.384229 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-3f67c2db-abda-4422-bff0-543d8e67c81b tempest-VolumesSnapshotTestJSON-925980516 tempest-VolumesSnapshotTestJSON-925980516-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:38:11.384995 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-3f67c2db-abda-4422-bff0-543d8e67c81b tempest-VolumesSnapshotTestJSON-925980516 tempest-VolumesSnapshotTestJSON-925980516-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:38:11.385426 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-3f67c2db-abda-4422-bff0-543d8e67c81b tempest-VolumesSnapshotTestJSON-925980516 tempest-VolumesSnapshotTestJSON-925980516-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:38:11.511657 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.policy [None req-3f67c2db-abda-4422-bff0-543d8e67c81b tempest-VolumesSnapshotTestJSON-925980516 tempest-VolumesSnapshotTestJSON-925980516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4ffcca165af40abbd93569e7f01acbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ca6934bc24846ad82474c4ef7ba6323', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116157) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:38:11.519917 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: INFO nova.api.openstack.requestlog [None req-3f67c2db-abda-4422-bff0-543d8e67c81b tempest-VolumesSnapshotTestJSON-925980516 tempest-VolumesSnapshotTestJSON-925980516-project] 10.222.0.18 "GET /compute/v2.1/servers/a0097d88-6613-416a-9f4d-1bb285e53291" status: 200 len: 1560 microversion: 2.1 time: 0.146818 Dec 15 03:38:11.520478 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: [pid: 116157|app: 0|req: 998/2010] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 03:38:11 2021] GET /compute/v2.1/servers/a0097d88-6613-416a-9f4d-1bb285e53291 => generated 1560 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 03:38:12.536850 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi [None req-fd629743-f99b-474b-87d9-275cc8c52b75 tempest-VolumesSnapshotTestJSON-925980516 tempest-VolumesSnapshotTestJSON-925980516-project] Calling method '>' {{(pid=116156) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:38:12.537498 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.compute.api [None req-fd629743-f99b-474b-87d9-275cc8c52b75 tempest-VolumesSnapshotTestJSON-925980516 tempest-VolumesSnapshotTestJSON-925980516-project] [instance: a0097d88-6613-416a-9f4d-1bb285e53291] Fetching instance by UUID {{(pid=116156) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:38:12.543375 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-fd629743-f99b-474b-87d9-275cc8c52b75 tempest-VolumesSnapshotTestJSON-925980516 tempest-VolumesSnapshotTestJSON-925980516-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:38:12.543825 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-fd629743-f99b-474b-87d9-275cc8c52b75 tempest-VolumesSnapshotTestJSON-925980516 tempest-VolumesSnapshotTestJSON-925980516-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:38:12.544597 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-fd629743-f99b-474b-87d9-275cc8c52b75 tempest-VolumesSnapshotTestJSON-925980516 tempest-VolumesSnapshotTestJSON-925980516-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:38:12.545035 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-fd629743-f99b-474b-87d9-275cc8c52b75 tempest-VolumesSnapshotTestJSON-925980516 tempest-VolumesSnapshotTestJSON-925980516-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:38:12.674148 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.policy [None req-fd629743-f99b-474b-87d9-275cc8c52b75 tempest-VolumesSnapshotTestJSON-925980516 tempest-VolumesSnapshotTestJSON-925980516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4ffcca165af40abbd93569e7f01acbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ca6934bc24846ad82474c4ef7ba6323', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116156) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:38:12.681813 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: INFO nova.api.openstack.requestlog [None req-fd629743-f99b-474b-87d9-275cc8c52b75 tempest-VolumesSnapshotTestJSON-925980516 tempest-VolumesSnapshotTestJSON-925980516-project] 10.222.0.18 "GET /compute/v2.1/servers/a0097d88-6613-416a-9f4d-1bb285e53291" status: 200 len: 1560 microversion: 2.1 time: 0.148846 Dec 15 03:38:12.682411 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: [pid: 116156|app: 0|req: 1013/2011] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 03:38:12 2021] GET /compute/v2.1/servers/a0097d88-6613-416a-9f4d-1bb285e53291 => generated 1560 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 03:38:13.699663 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi [None req-bf5fb809-caed-4c1c-a19d-2c836203f5f8 tempest-VolumesSnapshotTestJSON-925980516 tempest-VolumesSnapshotTestJSON-925980516-project] Calling method '>' {{(pid=116157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:38:13.700266 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.compute.api [None req-bf5fb809-caed-4c1c-a19d-2c836203f5f8 tempest-VolumesSnapshotTestJSON-925980516 tempest-VolumesSnapshotTestJSON-925980516-project] [instance: a0097d88-6613-416a-9f4d-1bb285e53291] Fetching instance by UUID {{(pid=116157) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:38:13.707044 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-bf5fb809-caed-4c1c-a19d-2c836203f5f8 tempest-VolumesSnapshotTestJSON-925980516 tempest-VolumesSnapshotTestJSON-925980516-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:38:13.707510 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-bf5fb809-caed-4c1c-a19d-2c836203f5f8 tempest-VolumesSnapshotTestJSON-925980516 tempest-VolumesSnapshotTestJSON-925980516-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:38:13.708283 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-bf5fb809-caed-4c1c-a19d-2c836203f5f8 tempest-VolumesSnapshotTestJSON-925980516 tempest-VolumesSnapshotTestJSON-925980516-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:38:13.708717 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-bf5fb809-caed-4c1c-a19d-2c836203f5f8 tempest-VolumesSnapshotTestJSON-925980516 tempest-VolumesSnapshotTestJSON-925980516-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:38:13.838167 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.policy [None req-bf5fb809-caed-4c1c-a19d-2c836203f5f8 tempest-VolumesSnapshotTestJSON-925980516 tempest-VolumesSnapshotTestJSON-925980516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4ffcca165af40abbd93569e7f01acbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ca6934bc24846ad82474c4ef7ba6323', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116157) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:38:13.846046 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: INFO nova.api.openstack.requestlog [None req-bf5fb809-caed-4c1c-a19d-2c836203f5f8 tempest-VolumesSnapshotTestJSON-925980516 tempest-VolumesSnapshotTestJSON-925980516-project] 10.222.0.18 "GET /compute/v2.1/servers/a0097d88-6613-416a-9f4d-1bb285e53291" status: 200 len: 1560 microversion: 2.1 time: 0.150000 Dec 15 03:38:13.846609 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: [pid: 116157|app: 0|req: 999/2012] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 03:38:13 2021] GET /compute/v2.1/servers/a0097d88-6613-416a-9f4d-1bb285e53291 => generated 1560 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 03:38:14.863218 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi [None req-87f269e6-cee4-4680-b7d9-aec771d68980 tempest-VolumesSnapshotTestJSON-925980516 tempest-VolumesSnapshotTestJSON-925980516-project] Calling method '>' {{(pid=116156) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:38:14.863857 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.compute.api [None req-87f269e6-cee4-4680-b7d9-aec771d68980 tempest-VolumesSnapshotTestJSON-925980516 tempest-VolumesSnapshotTestJSON-925980516-project] [instance: a0097d88-6613-416a-9f4d-1bb285e53291] Fetching instance by UUID {{(pid=116156) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:38:14.870127 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-87f269e6-cee4-4680-b7d9-aec771d68980 tempest-VolumesSnapshotTestJSON-925980516 tempest-VolumesSnapshotTestJSON-925980516-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:38:14.870579 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-87f269e6-cee4-4680-b7d9-aec771d68980 tempest-VolumesSnapshotTestJSON-925980516 tempest-VolumesSnapshotTestJSON-925980516-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:38:14.871361 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-87f269e6-cee4-4680-b7d9-aec771d68980 tempest-VolumesSnapshotTestJSON-925980516 tempest-VolumesSnapshotTestJSON-925980516-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:38:14.871832 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-87f269e6-cee4-4680-b7d9-aec771d68980 tempest-VolumesSnapshotTestJSON-925980516 tempest-VolumesSnapshotTestJSON-925980516-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:38:14.996685 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.policy [None req-87f269e6-cee4-4680-b7d9-aec771d68980 tempest-VolumesSnapshotTestJSON-925980516 tempest-VolumesSnapshotTestJSON-925980516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4ffcca165af40abbd93569e7f01acbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ca6934bc24846ad82474c4ef7ba6323', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116156) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:38:15.004926 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: INFO nova.api.openstack.requestlog [None req-87f269e6-cee4-4680-b7d9-aec771d68980 tempest-VolumesSnapshotTestJSON-925980516 tempest-VolumesSnapshotTestJSON-925980516-project] 10.222.0.18 "GET /compute/v2.1/servers/a0097d88-6613-416a-9f4d-1bb285e53291" status: 200 len: 1560 microversion: 2.1 time: 0.145842 Dec 15 03:38:15.005485 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: [pid: 116156|app: 0|req: 1014/2013] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 03:38:14 2021] GET /compute/v2.1/servers/a0097d88-6613-416a-9f4d-1bb285e53291 => generated 1560 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 03:38:16.021557 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi [None req-ad9b2bbc-5e80-47ef-9b1d-5f798d2e22e6 tempest-VolumesSnapshotTestJSON-925980516 tempest-VolumesSnapshotTestJSON-925980516-project] Calling method '>' {{(pid=116157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:38:16.022205 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.compute.api [None req-ad9b2bbc-5e80-47ef-9b1d-5f798d2e22e6 tempest-VolumesSnapshotTestJSON-925980516 tempest-VolumesSnapshotTestJSON-925980516-project] [instance: a0097d88-6613-416a-9f4d-1bb285e53291] Fetching instance by UUID {{(pid=116157) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:38:16.028589 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-ad9b2bbc-5e80-47ef-9b1d-5f798d2e22e6 tempest-VolumesSnapshotTestJSON-925980516 tempest-VolumesSnapshotTestJSON-925980516-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:38:16.029034 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-ad9b2bbc-5e80-47ef-9b1d-5f798d2e22e6 tempest-VolumesSnapshotTestJSON-925980516 tempest-VolumesSnapshotTestJSON-925980516-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:38:16.029807 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-ad9b2bbc-5e80-47ef-9b1d-5f798d2e22e6 tempest-VolumesSnapshotTestJSON-925980516 tempest-VolumesSnapshotTestJSON-925980516-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:38:16.030271 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-ad9b2bbc-5e80-47ef-9b1d-5f798d2e22e6 tempest-VolumesSnapshotTestJSON-925980516 tempest-VolumesSnapshotTestJSON-925980516-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:38:16.155628 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.policy [None req-ad9b2bbc-5e80-47ef-9b1d-5f798d2e22e6 tempest-VolumesSnapshotTestJSON-925980516 tempest-VolumesSnapshotTestJSON-925980516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4ffcca165af40abbd93569e7f01acbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ca6934bc24846ad82474c4ef7ba6323', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116157) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:38:16.163691 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: INFO nova.api.openstack.requestlog [None req-ad9b2bbc-5e80-47ef-9b1d-5f798d2e22e6 tempest-VolumesSnapshotTestJSON-925980516 tempest-VolumesSnapshotTestJSON-925980516-project] 10.222.0.18 "GET /compute/v2.1/servers/a0097d88-6613-416a-9f4d-1bb285e53291" status: 200 len: 1560 microversion: 2.1 time: 0.145808 Dec 15 03:38:16.164257 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: [pid: 116157|app: 0|req: 1000/2014] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 03:38:16 2021] GET /compute/v2.1/servers/a0097d88-6613-416a-9f4d-1bb285e53291 => generated 1560 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 03:38:17.180819 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi [None req-1d9ee7b2-8f9d-4443-b67e-28f1e8640648 tempest-VolumesSnapshotTestJSON-925980516 tempest-VolumesSnapshotTestJSON-925980516-project] Calling method '>' {{(pid=116156) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:38:17.181428 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.compute.api [None req-1d9ee7b2-8f9d-4443-b67e-28f1e8640648 tempest-VolumesSnapshotTestJSON-925980516 tempest-VolumesSnapshotTestJSON-925980516-project] [instance: a0097d88-6613-416a-9f4d-1bb285e53291] Fetching instance by UUID {{(pid=116156) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:38:17.187674 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-1d9ee7b2-8f9d-4443-b67e-28f1e8640648 tempest-VolumesSnapshotTestJSON-925980516 tempest-VolumesSnapshotTestJSON-925980516-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:38:17.188130 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-1d9ee7b2-8f9d-4443-b67e-28f1e8640648 tempest-VolumesSnapshotTestJSON-925980516 tempest-VolumesSnapshotTestJSON-925980516-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:38:17.188908 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-1d9ee7b2-8f9d-4443-b67e-28f1e8640648 tempest-VolumesSnapshotTestJSON-925980516 tempest-VolumesSnapshotTestJSON-925980516-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:38:17.189348 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-1d9ee7b2-8f9d-4443-b67e-28f1e8640648 tempest-VolumesSnapshotTestJSON-925980516 tempest-VolumesSnapshotTestJSON-925980516-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:38:17.319903 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.policy [None req-1d9ee7b2-8f9d-4443-b67e-28f1e8640648 tempest-VolumesSnapshotTestJSON-925980516 tempest-VolumesSnapshotTestJSON-925980516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4ffcca165af40abbd93569e7f01acbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ca6934bc24846ad82474c4ef7ba6323', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116156) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:38:17.327608 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: INFO nova.api.openstack.requestlog [None req-1d9ee7b2-8f9d-4443-b67e-28f1e8640648 tempest-VolumesSnapshotTestJSON-925980516 tempest-VolumesSnapshotTestJSON-925980516-project] 10.222.0.18 "GET /compute/v2.1/servers/a0097d88-6613-416a-9f4d-1bb285e53291" status: 200 len: 1560 microversion: 2.1 time: 0.150440 Dec 15 03:38:17.328168 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: [pid: 116156|app: 0|req: 1015/2015] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 03:38:17 2021] GET /compute/v2.1/servers/a0097d88-6613-416a-9f4d-1bb285e53291 => generated 1560 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 03:38:18.344587 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi [None req-e9133911-4be8-4f76-a8ff-865f20fa03b6 tempest-VolumesSnapshotTestJSON-925980516 tempest-VolumesSnapshotTestJSON-925980516-project] Calling method '>' {{(pid=116157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:38:18.345207 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.compute.api [None req-e9133911-4be8-4f76-a8ff-865f20fa03b6 tempest-VolumesSnapshotTestJSON-925980516 tempest-VolumesSnapshotTestJSON-925980516-project] [instance: a0097d88-6613-416a-9f4d-1bb285e53291] Fetching instance by UUID {{(pid=116157) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:38:18.351767 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-e9133911-4be8-4f76-a8ff-865f20fa03b6 tempest-VolumesSnapshotTestJSON-925980516 tempest-VolumesSnapshotTestJSON-925980516-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:38:18.352223 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-e9133911-4be8-4f76-a8ff-865f20fa03b6 tempest-VolumesSnapshotTestJSON-925980516 tempest-VolumesSnapshotTestJSON-925980516-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:38:18.353012 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-e9133911-4be8-4f76-a8ff-865f20fa03b6 tempest-VolumesSnapshotTestJSON-925980516 tempest-VolumesSnapshotTestJSON-925980516-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:38:18.353460 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-e9133911-4be8-4f76-a8ff-865f20fa03b6 tempest-VolumesSnapshotTestJSON-925980516 tempest-VolumesSnapshotTestJSON-925980516-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:38:18.478985 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.policy [None req-e9133911-4be8-4f76-a8ff-865f20fa03b6 tempest-VolumesSnapshotTestJSON-925980516 tempest-VolumesSnapshotTestJSON-925980516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4ffcca165af40abbd93569e7f01acbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ca6934bc24846ad82474c4ef7ba6323', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116157) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:38:18.486691 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: INFO nova.api.openstack.requestlog [None req-e9133911-4be8-4f76-a8ff-865f20fa03b6 tempest-VolumesSnapshotTestJSON-925980516 tempest-VolumesSnapshotTestJSON-925980516-project] 10.222.0.18 "GET /compute/v2.1/servers/a0097d88-6613-416a-9f4d-1bb285e53291" status: 200 len: 1560 microversion: 2.1 time: 0.146039 Dec 15 03:38:18.487266 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: [pid: 116157|app: 0|req: 1001/2016] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 03:38:18 2021] GET /compute/v2.1/servers/a0097d88-6613-416a-9f4d-1bb285e53291 => generated 1560 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 03:38:19.503559 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi [None req-a056d831-988b-4dcc-b1c6-7a123d16c07a tempest-VolumesSnapshotTestJSON-925980516 tempest-VolumesSnapshotTestJSON-925980516-project] Calling method '>' {{(pid=116156) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:38:19.504131 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.compute.api [None req-a056d831-988b-4dcc-b1c6-7a123d16c07a tempest-VolumesSnapshotTestJSON-925980516 tempest-VolumesSnapshotTestJSON-925980516-project] [instance: a0097d88-6613-416a-9f4d-1bb285e53291] Fetching instance by UUID {{(pid=116156) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:38:19.510321 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-a056d831-988b-4dcc-b1c6-7a123d16c07a tempest-VolumesSnapshotTestJSON-925980516 tempest-VolumesSnapshotTestJSON-925980516-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:38:19.510771 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-a056d831-988b-4dcc-b1c6-7a123d16c07a tempest-VolumesSnapshotTestJSON-925980516 tempest-VolumesSnapshotTestJSON-925980516-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:38:19.511533 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-a056d831-988b-4dcc-b1c6-7a123d16c07a tempest-VolumesSnapshotTestJSON-925980516 tempest-VolumesSnapshotTestJSON-925980516-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:38:19.511967 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-a056d831-988b-4dcc-b1c6-7a123d16c07a tempest-VolumesSnapshotTestJSON-925980516 tempest-VolumesSnapshotTestJSON-925980516-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:38:19.639501 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.policy [None req-a056d831-988b-4dcc-b1c6-7a123d16c07a tempest-VolumesSnapshotTestJSON-925980516 tempest-VolumesSnapshotTestJSON-925980516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4ffcca165af40abbd93569e7f01acbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ca6934bc24846ad82474c4ef7ba6323', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116156) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:38:19.647583 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: INFO nova.api.openstack.requestlog [None req-a056d831-988b-4dcc-b1c6-7a123d16c07a tempest-VolumesSnapshotTestJSON-925980516 tempest-VolumesSnapshotTestJSON-925980516-project] 10.222.0.18 "GET /compute/v2.1/servers/a0097d88-6613-416a-9f4d-1bb285e53291" status: 200 len: 1560 microversion: 2.1 time: 0.147753 Dec 15 03:38:19.648146 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: [pid: 116156|app: 0|req: 1016/2017] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 03:38:19 2021] GET /compute/v2.1/servers/a0097d88-6613-416a-9f4d-1bb285e53291 => generated 1560 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 03:38:20.664732 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi [None req-98b53766-525f-411e-862b-8ca6fd7d35f4 tempest-VolumesSnapshotTestJSON-925980516 tempest-VolumesSnapshotTestJSON-925980516-project] Calling method '>' {{(pid=116157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:38:20.665349 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.compute.api [None req-98b53766-525f-411e-862b-8ca6fd7d35f4 tempest-VolumesSnapshotTestJSON-925980516 tempest-VolumesSnapshotTestJSON-925980516-project] [instance: a0097d88-6613-416a-9f4d-1bb285e53291] Fetching instance by UUID {{(pid=116157) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:38:20.671695 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-98b53766-525f-411e-862b-8ca6fd7d35f4 tempest-VolumesSnapshotTestJSON-925980516 tempest-VolumesSnapshotTestJSON-925980516-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:38:20.672150 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-98b53766-525f-411e-862b-8ca6fd7d35f4 tempest-VolumesSnapshotTestJSON-925980516 tempest-VolumesSnapshotTestJSON-925980516-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:38:20.672934 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-98b53766-525f-411e-862b-8ca6fd7d35f4 tempest-VolumesSnapshotTestJSON-925980516 tempest-VolumesSnapshotTestJSON-925980516-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:38:20.673372 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-98b53766-525f-411e-862b-8ca6fd7d35f4 tempest-VolumesSnapshotTestJSON-925980516 tempest-VolumesSnapshotTestJSON-925980516-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:38:20.804687 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.policy [None req-98b53766-525f-411e-862b-8ca6fd7d35f4 tempest-VolumesSnapshotTestJSON-925980516 tempest-VolumesSnapshotTestJSON-925980516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4ffcca165af40abbd93569e7f01acbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ca6934bc24846ad82474c4ef7ba6323', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116157) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:38:20.812370 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: INFO nova.api.openstack.requestlog [None req-98b53766-525f-411e-862b-8ca6fd7d35f4 tempest-VolumesSnapshotTestJSON-925980516 tempest-VolumesSnapshotTestJSON-925980516-project] 10.222.0.18 "GET /compute/v2.1/servers/a0097d88-6613-416a-9f4d-1bb285e53291" status: 200 len: 1560 microversion: 2.1 time: 0.151316 Dec 15 03:38:20.812944 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: [pid: 116157|app: 0|req: 1002/2018] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 03:38:20 2021] GET /compute/v2.1/servers/a0097d88-6613-416a-9f4d-1bb285e53291 => generated 1560 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 03:38:21.829289 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi [None req-7010e73f-f122-4291-80d5-86710a024661 tempest-VolumesSnapshotTestJSON-925980516 tempest-VolumesSnapshotTestJSON-925980516-project] Calling method '>' {{(pid=116156) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:38:21.829881 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.compute.api [None req-7010e73f-f122-4291-80d5-86710a024661 tempest-VolumesSnapshotTestJSON-925980516 tempest-VolumesSnapshotTestJSON-925980516-project] [instance: a0097d88-6613-416a-9f4d-1bb285e53291] Fetching instance by UUID {{(pid=116156) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:38:21.836099 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-7010e73f-f122-4291-80d5-86710a024661 tempest-VolumesSnapshotTestJSON-925980516 tempest-VolumesSnapshotTestJSON-925980516-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:38:21.836547 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-7010e73f-f122-4291-80d5-86710a024661 tempest-VolumesSnapshotTestJSON-925980516 tempest-VolumesSnapshotTestJSON-925980516-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:38:21.837313 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-7010e73f-f122-4291-80d5-86710a024661 tempest-VolumesSnapshotTestJSON-925980516 tempest-VolumesSnapshotTestJSON-925980516-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:38:21.837742 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-7010e73f-f122-4291-80d5-86710a024661 tempest-VolumesSnapshotTestJSON-925980516 tempest-VolumesSnapshotTestJSON-925980516-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:38:21.963247 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.policy [None req-7010e73f-f122-4291-80d5-86710a024661 tempest-VolumesSnapshotTestJSON-925980516 tempest-VolumesSnapshotTestJSON-925980516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4ffcca165af40abbd93569e7f01acbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ca6934bc24846ad82474c4ef7ba6323', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116156) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:38:21.971078 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: INFO nova.api.openstack.requestlog [None req-7010e73f-f122-4291-80d5-86710a024661 tempest-VolumesSnapshotTestJSON-925980516 tempest-VolumesSnapshotTestJSON-925980516-project] 10.222.0.18 "GET /compute/v2.1/servers/a0097d88-6613-416a-9f4d-1bb285e53291" status: 200 len: 1560 microversion: 2.1 time: 0.145438 Dec 15 03:38:21.971632 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: [pid: 116156|app: 0|req: 1017/2019] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 03:38:21 2021] GET /compute/v2.1/servers/a0097d88-6613-416a-9f4d-1bb285e53291 => generated 1560 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 03:38:22.987777 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi [None req-1998cd7e-8cf0-4386-80b1-c80d4ee9aba5 tempest-VolumesSnapshotTestJSON-925980516 tempest-VolumesSnapshotTestJSON-925980516-project] Calling method '>' {{(pid=116157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:38:22.988392 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.compute.api [None req-1998cd7e-8cf0-4386-80b1-c80d4ee9aba5 tempest-VolumesSnapshotTestJSON-925980516 tempest-VolumesSnapshotTestJSON-925980516-project] [instance: a0097d88-6613-416a-9f4d-1bb285e53291] Fetching instance by UUID {{(pid=116157) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:38:22.994686 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-1998cd7e-8cf0-4386-80b1-c80d4ee9aba5 tempest-VolumesSnapshotTestJSON-925980516 tempest-VolumesSnapshotTestJSON-925980516-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:38:22.995145 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-1998cd7e-8cf0-4386-80b1-c80d4ee9aba5 tempest-VolumesSnapshotTestJSON-925980516 tempest-VolumesSnapshotTestJSON-925980516-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:38:22.995927 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-1998cd7e-8cf0-4386-80b1-c80d4ee9aba5 tempest-VolumesSnapshotTestJSON-925980516 tempest-VolumesSnapshotTestJSON-925980516-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:38:22.996387 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-1998cd7e-8cf0-4386-80b1-c80d4ee9aba5 tempest-VolumesSnapshotTestJSON-925980516 tempest-VolumesSnapshotTestJSON-925980516-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:38:23.122004 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.policy [None req-1998cd7e-8cf0-4386-80b1-c80d4ee9aba5 tempest-VolumesSnapshotTestJSON-925980516 tempest-VolumesSnapshotTestJSON-925980516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4ffcca165af40abbd93569e7f01acbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ca6934bc24846ad82474c4ef7ba6323', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116157) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:38:23.130376 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: INFO nova.api.openstack.requestlog [None req-1998cd7e-8cf0-4386-80b1-c80d4ee9aba5 tempest-VolumesSnapshotTestJSON-925980516 tempest-VolumesSnapshotTestJSON-925980516-project] 10.222.0.18 "GET /compute/v2.1/servers/a0097d88-6613-416a-9f4d-1bb285e53291" status: 200 len: 1560 microversion: 2.1 time: 0.146268 Dec 15 03:38:23.130946 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: [pid: 116157|app: 0|req: 1003/2020] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 03:38:22 2021] GET /compute/v2.1/servers/a0097d88-6613-416a-9f4d-1bb285e53291 => generated 1560 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 03:38:24.147705 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi [None req-31bf62aa-f9ce-47f2-8633-82cd2248baa8 tempest-VolumesSnapshotTestJSON-925980516 tempest-VolumesSnapshotTestJSON-925980516-project] Calling method '>' {{(pid=116156) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:38:24.148310 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.compute.api [None req-31bf62aa-f9ce-47f2-8633-82cd2248baa8 tempest-VolumesSnapshotTestJSON-925980516 tempest-VolumesSnapshotTestJSON-925980516-project] [instance: a0097d88-6613-416a-9f4d-1bb285e53291] Fetching instance by UUID {{(pid=116156) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:38:24.154489 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-31bf62aa-f9ce-47f2-8633-82cd2248baa8 tempest-VolumesSnapshotTestJSON-925980516 tempest-VolumesSnapshotTestJSON-925980516-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:38:24.154938 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-31bf62aa-f9ce-47f2-8633-82cd2248baa8 tempest-VolumesSnapshotTestJSON-925980516 tempest-VolumesSnapshotTestJSON-925980516-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:38:24.155740 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-31bf62aa-f9ce-47f2-8633-82cd2248baa8 tempest-VolumesSnapshotTestJSON-925980516 tempest-VolumesSnapshotTestJSON-925980516-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:38:24.156170 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-31bf62aa-f9ce-47f2-8633-82cd2248baa8 tempest-VolumesSnapshotTestJSON-925980516 tempest-VolumesSnapshotTestJSON-925980516-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:38:24.285863 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.policy [None req-31bf62aa-f9ce-47f2-8633-82cd2248baa8 tempest-VolumesSnapshotTestJSON-925980516 tempest-VolumesSnapshotTestJSON-925980516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4ffcca165af40abbd93569e7f01acbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ca6934bc24846ad82474c4ef7ba6323', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116156) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:38:24.293520 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: INFO nova.api.openstack.requestlog [None req-31bf62aa-f9ce-47f2-8633-82cd2248baa8 tempest-VolumesSnapshotTestJSON-925980516 tempest-VolumesSnapshotTestJSON-925980516-project] 10.222.0.18 "GET /compute/v2.1/servers/a0097d88-6613-416a-9f4d-1bb285e53291" status: 200 len: 1560 microversion: 2.1 time: 0.149917 Dec 15 03:38:24.294102 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: [pid: 116156|app: 0|req: 1018/2021] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 03:38:24 2021] GET /compute/v2.1/servers/a0097d88-6613-416a-9f4d-1bb285e53291 => generated 1560 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 03:38:25.310403 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi [None req-6e2a0ae2-d92a-4d4d-8f0f-a7e9559b1c2d tempest-VolumesSnapshotTestJSON-925980516 tempest-VolumesSnapshotTestJSON-925980516-project] Calling method '>' {{(pid=116157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:38:25.311023 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.compute.api [None req-6e2a0ae2-d92a-4d4d-8f0f-a7e9559b1c2d tempest-VolumesSnapshotTestJSON-925980516 tempest-VolumesSnapshotTestJSON-925980516-project] [instance: a0097d88-6613-416a-9f4d-1bb285e53291] Fetching instance by UUID {{(pid=116157) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:38:25.317772 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-6e2a0ae2-d92a-4d4d-8f0f-a7e9559b1c2d tempest-VolumesSnapshotTestJSON-925980516 tempest-VolumesSnapshotTestJSON-925980516-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:38:25.318256 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-6e2a0ae2-d92a-4d4d-8f0f-a7e9559b1c2d tempest-VolumesSnapshotTestJSON-925980516 tempest-VolumesSnapshotTestJSON-925980516-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:38:25.319046 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-6e2a0ae2-d92a-4d4d-8f0f-a7e9559b1c2d tempest-VolumesSnapshotTestJSON-925980516 tempest-VolumesSnapshotTestJSON-925980516-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:38:25.319487 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-6e2a0ae2-d92a-4d4d-8f0f-a7e9559b1c2d tempest-VolumesSnapshotTestJSON-925980516 tempest-VolumesSnapshotTestJSON-925980516-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:38:25.449869 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.policy [None req-6e2a0ae2-d92a-4d4d-8f0f-a7e9559b1c2d tempest-VolumesSnapshotTestJSON-925980516 tempest-VolumesSnapshotTestJSON-925980516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4ffcca165af40abbd93569e7f01acbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ca6934bc24846ad82474c4ef7ba6323', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116157) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:38:25.457525 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: INFO nova.api.openstack.requestlog [None req-6e2a0ae2-d92a-4d4d-8f0f-a7e9559b1c2d tempest-VolumesSnapshotTestJSON-925980516 tempest-VolumesSnapshotTestJSON-925980516-project] 10.222.0.18 "GET /compute/v2.1/servers/a0097d88-6613-416a-9f4d-1bb285e53291" status: 200 len: 1560 microversion: 2.1 time: 0.150870 Dec 15 03:38:25.458155 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: [pid: 116157|app: 0|req: 1004/2022] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 03:38:25 2021] GET /compute/v2.1/servers/a0097d88-6613-416a-9f4d-1bb285e53291 => generated 1560 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 03:38:26.475025 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi [None req-6983627d-1ddf-4b0a-b087-97b18ba2fae1 tempest-VolumesSnapshotTestJSON-925980516 tempest-VolumesSnapshotTestJSON-925980516-project] Calling method '>' {{(pid=116156) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:38:26.475642 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.compute.api [None req-6983627d-1ddf-4b0a-b087-97b18ba2fae1 tempest-VolumesSnapshotTestJSON-925980516 tempest-VolumesSnapshotTestJSON-925980516-project] [instance: a0097d88-6613-416a-9f4d-1bb285e53291] Fetching instance by UUID {{(pid=116156) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:38:26.481916 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-6983627d-1ddf-4b0a-b087-97b18ba2fae1 tempest-VolumesSnapshotTestJSON-925980516 tempest-VolumesSnapshotTestJSON-925980516-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:38:26.482397 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-6983627d-1ddf-4b0a-b087-97b18ba2fae1 tempest-VolumesSnapshotTestJSON-925980516 tempest-VolumesSnapshotTestJSON-925980516-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:38:26.483175 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-6983627d-1ddf-4b0a-b087-97b18ba2fae1 tempest-VolumesSnapshotTestJSON-925980516 tempest-VolumesSnapshotTestJSON-925980516-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:38:26.483610 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-6983627d-1ddf-4b0a-b087-97b18ba2fae1 tempest-VolumesSnapshotTestJSON-925980516 tempest-VolumesSnapshotTestJSON-925980516-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:38:26.609893 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.policy [None req-6983627d-1ddf-4b0a-b087-97b18ba2fae1 tempest-VolumesSnapshotTestJSON-925980516 tempest-VolumesSnapshotTestJSON-925980516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4ffcca165af40abbd93569e7f01acbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ca6934bc24846ad82474c4ef7ba6323', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116156) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:38:26.617569 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: INFO nova.api.openstack.requestlog [None req-6983627d-1ddf-4b0a-b087-97b18ba2fae1 tempest-VolumesSnapshotTestJSON-925980516 tempest-VolumesSnapshotTestJSON-925980516-project] 10.222.0.18 "GET /compute/v2.1/servers/a0097d88-6613-416a-9f4d-1bb285e53291" status: 200 len: 1560 microversion: 2.1 time: 0.146842 Dec 15 03:38:26.618156 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: [pid: 116156|app: 0|req: 1019/2023] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 03:38:26 2021] GET /compute/v2.1/servers/a0097d88-6613-416a-9f4d-1bb285e53291 => generated 1560 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 03:38:27.638724 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi [None req-3c3b036c-d363-40eb-bc4b-c02eabc3789c tempest-VolumesSnapshotTestJSON-925980516 tempest-VolumesSnapshotTestJSON-925980516-project] Calling method '>' {{(pid=116157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:38:27.639346 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.compute.api [None req-3c3b036c-d363-40eb-bc4b-c02eabc3789c tempest-VolumesSnapshotTestJSON-925980516 tempest-VolumesSnapshotTestJSON-925980516-project] [instance: a0097d88-6613-416a-9f4d-1bb285e53291] Fetching instance by UUID {{(pid=116157) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:38:27.645598 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-3c3b036c-d363-40eb-bc4b-c02eabc3789c tempest-VolumesSnapshotTestJSON-925980516 tempest-VolumesSnapshotTestJSON-925980516-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:38:27.646084 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-3c3b036c-d363-40eb-bc4b-c02eabc3789c tempest-VolumesSnapshotTestJSON-925980516 tempest-VolumesSnapshotTestJSON-925980516-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:38:27.646867 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-3c3b036c-d363-40eb-bc4b-c02eabc3789c tempest-VolumesSnapshotTestJSON-925980516 tempest-VolumesSnapshotTestJSON-925980516-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:38:27.647396 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-3c3b036c-d363-40eb-bc4b-c02eabc3789c tempest-VolumesSnapshotTestJSON-925980516 tempest-VolumesSnapshotTestJSON-925980516-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:38:27.773205 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.policy [None req-3c3b036c-d363-40eb-bc4b-c02eabc3789c tempest-VolumesSnapshotTestJSON-925980516 tempest-VolumesSnapshotTestJSON-925980516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4ffcca165af40abbd93569e7f01acbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ca6934bc24846ad82474c4ef7ba6323', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116157) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:38:27.780817 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: INFO nova.api.openstack.requestlog [None req-3c3b036c-d363-40eb-bc4b-c02eabc3789c tempest-VolumesSnapshotTestJSON-925980516 tempest-VolumesSnapshotTestJSON-925980516-project] 10.222.0.18 "GET /compute/v2.1/servers/a0097d88-6613-416a-9f4d-1bb285e53291" status: 200 len: 1560 microversion: 2.1 time: 0.149735 Dec 15 03:38:27.781384 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: [pid: 116157|app: 0|req: 1005/2024] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 03:38:27 2021] GET /compute/v2.1/servers/a0097d88-6613-416a-9f4d-1bb285e53291 => generated 1560 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 03:38:28.797581 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi [None req-d0ede3c9-007d-4b6e-b141-7d000d0605c5 tempest-VolumesSnapshotTestJSON-925980516 tempest-VolumesSnapshotTestJSON-925980516-project] Calling method '>' {{(pid=116156) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:38:28.798218 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.compute.api [None req-d0ede3c9-007d-4b6e-b141-7d000d0605c5 tempest-VolumesSnapshotTestJSON-925980516 tempest-VolumesSnapshotTestJSON-925980516-project] [instance: a0097d88-6613-416a-9f4d-1bb285e53291] Fetching instance by UUID {{(pid=116156) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:38:28.804458 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-d0ede3c9-007d-4b6e-b141-7d000d0605c5 tempest-VolumesSnapshotTestJSON-925980516 tempest-VolumesSnapshotTestJSON-925980516-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:38:28.804906 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-d0ede3c9-007d-4b6e-b141-7d000d0605c5 tempest-VolumesSnapshotTestJSON-925980516 tempest-VolumesSnapshotTestJSON-925980516-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:38:28.805672 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-d0ede3c9-007d-4b6e-b141-7d000d0605c5 tempest-VolumesSnapshotTestJSON-925980516 tempest-VolumesSnapshotTestJSON-925980516-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:38:28.806133 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-d0ede3c9-007d-4b6e-b141-7d000d0605c5 tempest-VolumesSnapshotTestJSON-925980516 tempest-VolumesSnapshotTestJSON-925980516-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:38:28.934774 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.policy [None req-d0ede3c9-007d-4b6e-b141-7d000d0605c5 tempest-VolumesSnapshotTestJSON-925980516 tempest-VolumesSnapshotTestJSON-925980516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4ffcca165af40abbd93569e7f01acbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ca6934bc24846ad82474c4ef7ba6323', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116156) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:38:28.942840 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: INFO nova.api.openstack.requestlog [None req-d0ede3c9-007d-4b6e-b141-7d000d0605c5 tempest-VolumesSnapshotTestJSON-925980516 tempest-VolumesSnapshotTestJSON-925980516-project] 10.222.0.18 "GET /compute/v2.1/servers/a0097d88-6613-416a-9f4d-1bb285e53291" status: 200 len: 1560 microversion: 2.1 time: 0.148904 Dec 15 03:38:28.943397 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: [pid: 116156|app: 0|req: 1020/2025] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 03:38:28 2021] GET /compute/v2.1/servers/a0097d88-6613-416a-9f4d-1bb285e53291 => generated 1560 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 03:38:29.959535 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi [None req-98b8caa8-8151-4e22-b6b9-f5ee87cb7c7c tempest-VolumesSnapshotTestJSON-925980516 tempest-VolumesSnapshotTestJSON-925980516-project] Calling method '>' {{(pid=116157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:38:29.960139 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.compute.api [None req-98b8caa8-8151-4e22-b6b9-f5ee87cb7c7c tempest-VolumesSnapshotTestJSON-925980516 tempest-VolumesSnapshotTestJSON-925980516-project] [instance: a0097d88-6613-416a-9f4d-1bb285e53291] Fetching instance by UUID {{(pid=116157) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:38:29.961342 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Dec 15 03:38:29.961726 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: Wed Dec 15 03:38:29 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Dec 15 03:38:29.966415 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-98b8caa8-8151-4e22-b6b9-f5ee87cb7c7c tempest-VolumesSnapshotTestJSON-925980516 tempest-VolumesSnapshotTestJSON-925980516-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:38:29.966856 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-98b8caa8-8151-4e22-b6b9-f5ee87cb7c7c tempest-VolumesSnapshotTestJSON-925980516 tempest-VolumesSnapshotTestJSON-925980516-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:38:29.967885 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-98b8caa8-8151-4e22-b6b9-f5ee87cb7c7c tempest-VolumesSnapshotTestJSON-925980516 tempest-VolumesSnapshotTestJSON-925980516-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:38:29.968329 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-98b8caa8-8151-4e22-b6b9-f5ee87cb7c7c tempest-VolumesSnapshotTestJSON-925980516 tempest-VolumesSnapshotTestJSON-925980516-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:38:30.103231 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.policy [None req-98b8caa8-8151-4e22-b6b9-f5ee87cb7c7c tempest-VolumesSnapshotTestJSON-925980516 tempest-VolumesSnapshotTestJSON-925980516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4ffcca165af40abbd93569e7f01acbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ca6934bc24846ad82474c4ef7ba6323', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116157) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:38:30.110849 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: INFO nova.api.openstack.requestlog [None req-98b8caa8-8151-4e22-b6b9-f5ee87cb7c7c tempest-VolumesSnapshotTestJSON-925980516 tempest-VolumesSnapshotTestJSON-925980516-project] 10.222.0.18 "GET /compute/v2.1/servers/a0097d88-6613-416a-9f4d-1bb285e53291" status: 200 len: 1560 microversion: 2.1 time: 0.155496 Dec 15 03:38:30.111411 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: [pid: 116157|app: 0|req: 1006/2026] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 03:38:29 2021] GET /compute/v2.1/servers/a0097d88-6613-416a-9f4d-1bb285e53291 => generated 1560 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 03:38:31.126771 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi [None req-fede06e9-3f92-4ed2-80e7-36204c2c4e1b tempest-VolumesSnapshotTestJSON-925980516 tempest-VolumesSnapshotTestJSON-925980516-project] Calling method '>' {{(pid=116156) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:38:31.127378 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.compute.api [None req-fede06e9-3f92-4ed2-80e7-36204c2c4e1b tempest-VolumesSnapshotTestJSON-925980516 tempest-VolumesSnapshotTestJSON-925980516-project] [instance: a0097d88-6613-416a-9f4d-1bb285e53291] Fetching instance by UUID {{(pid=116156) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:38:31.133676 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-fede06e9-3f92-4ed2-80e7-36204c2c4e1b tempest-VolumesSnapshotTestJSON-925980516 tempest-VolumesSnapshotTestJSON-925980516-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:38:31.134155 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-fede06e9-3f92-4ed2-80e7-36204c2c4e1b tempest-VolumesSnapshotTestJSON-925980516 tempest-VolumesSnapshotTestJSON-925980516-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:38:31.134927 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-fede06e9-3f92-4ed2-80e7-36204c2c4e1b tempest-VolumesSnapshotTestJSON-925980516 tempest-VolumesSnapshotTestJSON-925980516-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:38:31.135359 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-fede06e9-3f92-4ed2-80e7-36204c2c4e1b tempest-VolumesSnapshotTestJSON-925980516 tempest-VolumesSnapshotTestJSON-925980516-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:38:31.261679 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.policy [None req-fede06e9-3f92-4ed2-80e7-36204c2c4e1b tempest-VolumesSnapshotTestJSON-925980516 tempest-VolumesSnapshotTestJSON-925980516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4ffcca165af40abbd93569e7f01acbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ca6934bc24846ad82474c4ef7ba6323', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116156) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:38:31.269279 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: INFO nova.api.openstack.requestlog [None req-fede06e9-3f92-4ed2-80e7-36204c2c4e1b tempest-VolumesSnapshotTestJSON-925980516 tempest-VolumesSnapshotTestJSON-925980516-project] 10.222.0.18 "GET /compute/v2.1/servers/a0097d88-6613-416a-9f4d-1bb285e53291" status: 200 len: 1560 microversion: 2.1 time: 0.146133 Dec 15 03:38:31.269845 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: [pid: 116156|app: 0|req: 1021/2027] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 03:38:31 2021] GET /compute/v2.1/servers/a0097d88-6613-416a-9f4d-1bb285e53291 => generated 1560 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 03:38:32.286556 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi [None req-f5a00da6-0461-4de8-827a-5881dba48768 tempest-VolumesSnapshotTestJSON-925980516 tempest-VolumesSnapshotTestJSON-925980516-project] Calling method '>' {{(pid=116157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:38:32.287113 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.compute.api [None req-f5a00da6-0461-4de8-827a-5881dba48768 tempest-VolumesSnapshotTestJSON-925980516 tempest-VolumesSnapshotTestJSON-925980516-project] [instance: a0097d88-6613-416a-9f4d-1bb285e53291] Fetching instance by UUID {{(pid=116157) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:38:32.293259 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-f5a00da6-0461-4de8-827a-5881dba48768 tempest-VolumesSnapshotTestJSON-925980516 tempest-VolumesSnapshotTestJSON-925980516-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:38:32.293706 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-f5a00da6-0461-4de8-827a-5881dba48768 tempest-VolumesSnapshotTestJSON-925980516 tempest-VolumesSnapshotTestJSON-925980516-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:38:32.294505 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-f5a00da6-0461-4de8-827a-5881dba48768 tempest-VolumesSnapshotTestJSON-925980516 tempest-VolumesSnapshotTestJSON-925980516-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:38:32.294941 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-f5a00da6-0461-4de8-827a-5881dba48768 tempest-VolumesSnapshotTestJSON-925980516 tempest-VolumesSnapshotTestJSON-925980516-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:38:32.420066 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.policy [None req-f5a00da6-0461-4de8-827a-5881dba48768 tempest-VolumesSnapshotTestJSON-925980516 tempest-VolumesSnapshotTestJSON-925980516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4ffcca165af40abbd93569e7f01acbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ca6934bc24846ad82474c4ef7ba6323', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116157) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:38:32.428389 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: INFO nova.api.openstack.requestlog [None req-f5a00da6-0461-4de8-827a-5881dba48768 tempest-VolumesSnapshotTestJSON-925980516 tempest-VolumesSnapshotTestJSON-925980516-project] 10.222.0.18 "GET /compute/v2.1/servers/a0097d88-6613-416a-9f4d-1bb285e53291" status: 200 len: 1560 microversion: 2.1 time: 0.145531 Dec 15 03:38:32.428993 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: [pid: 116157|app: 0|req: 1007/2028] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 03:38:32 2021] GET /compute/v2.1/servers/a0097d88-6613-416a-9f4d-1bb285e53291 => generated 1560 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 03:38:33.445667 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi [None req-3589c9df-3ed5-48a0-880c-1886ee0265b1 tempest-VolumesSnapshotTestJSON-925980516 tempest-VolumesSnapshotTestJSON-925980516-project] Calling method '>' {{(pid=116156) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:38:33.446314 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.compute.api [None req-3589c9df-3ed5-48a0-880c-1886ee0265b1 tempest-VolumesSnapshotTestJSON-925980516 tempest-VolumesSnapshotTestJSON-925980516-project] [instance: a0097d88-6613-416a-9f4d-1bb285e53291] Fetching instance by UUID {{(pid=116156) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:38:33.452543 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-3589c9df-3ed5-48a0-880c-1886ee0265b1 tempest-VolumesSnapshotTestJSON-925980516 tempest-VolumesSnapshotTestJSON-925980516-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:38:33.452992 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-3589c9df-3ed5-48a0-880c-1886ee0265b1 tempest-VolumesSnapshotTestJSON-925980516 tempest-VolumesSnapshotTestJSON-925980516-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:38:33.453767 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-3589c9df-3ed5-48a0-880c-1886ee0265b1 tempest-VolumesSnapshotTestJSON-925980516 tempest-VolumesSnapshotTestJSON-925980516-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:38:33.454226 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-3589c9df-3ed5-48a0-880c-1886ee0265b1 tempest-VolumesSnapshotTestJSON-925980516 tempest-VolumesSnapshotTestJSON-925980516-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:38:33.583158 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.policy [None req-3589c9df-3ed5-48a0-880c-1886ee0265b1 tempest-VolumesSnapshotTestJSON-925980516 tempest-VolumesSnapshotTestJSON-925980516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4ffcca165af40abbd93569e7f01acbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ca6934bc24846ad82474c4ef7ba6323', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116156) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:38:33.590750 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: INFO nova.api.openstack.requestlog [None req-3589c9df-3ed5-48a0-880c-1886ee0265b1 tempest-VolumesSnapshotTestJSON-925980516 tempest-VolumesSnapshotTestJSON-925980516-project] 10.222.0.18 "GET /compute/v2.1/servers/a0097d88-6613-416a-9f4d-1bb285e53291" status: 200 len: 1560 microversion: 2.1 time: 0.149241 Dec 15 03:38:33.591313 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: [pid: 116156|app: 0|req: 1022/2029] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 03:38:33 2021] GET /compute/v2.1/servers/a0097d88-6613-416a-9f4d-1bb285e53291 => generated 1560 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 03:38:34.607905 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi [None req-3bad8bce-c835-4e3c-af2f-c12de6e49916 tempest-VolumesSnapshotTestJSON-925980516 tempest-VolumesSnapshotTestJSON-925980516-project] Calling method '>' {{(pid=116157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:38:34.608527 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.compute.api [None req-3bad8bce-c835-4e3c-af2f-c12de6e49916 tempest-VolumesSnapshotTestJSON-925980516 tempest-VolumesSnapshotTestJSON-925980516-project] [instance: a0097d88-6613-416a-9f4d-1bb285e53291] Fetching instance by UUID {{(pid=116157) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:38:34.614777 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-3bad8bce-c835-4e3c-af2f-c12de6e49916 tempest-VolumesSnapshotTestJSON-925980516 tempest-VolumesSnapshotTestJSON-925980516-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:38:34.615227 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-3bad8bce-c835-4e3c-af2f-c12de6e49916 tempest-VolumesSnapshotTestJSON-925980516 tempest-VolumesSnapshotTestJSON-925980516-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:38:34.616002 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-3bad8bce-c835-4e3c-af2f-c12de6e49916 tempest-VolumesSnapshotTestJSON-925980516 tempest-VolumesSnapshotTestJSON-925980516-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:38:34.616438 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-3bad8bce-c835-4e3c-af2f-c12de6e49916 tempest-VolumesSnapshotTestJSON-925980516 tempest-VolumesSnapshotTestJSON-925980516-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:38:34.740743 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.policy [None req-3bad8bce-c835-4e3c-af2f-c12de6e49916 tempest-VolumesSnapshotTestJSON-925980516 tempest-VolumesSnapshotTestJSON-925980516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4ffcca165af40abbd93569e7f01acbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ca6934bc24846ad82474c4ef7ba6323', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116157) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:38:34.748318 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: INFO nova.api.openstack.requestlog [None req-3bad8bce-c835-4e3c-af2f-c12de6e49916 tempest-VolumesSnapshotTestJSON-925980516 tempest-VolumesSnapshotTestJSON-925980516-project] 10.222.0.18 "GET /compute/v2.1/servers/a0097d88-6613-416a-9f4d-1bb285e53291" status: 200 len: 1560 microversion: 2.1 time: 0.144122 Dec 15 03:38:34.748879 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: [pid: 116157|app: 0|req: 1008/2030] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 03:38:34 2021] GET /compute/v2.1/servers/a0097d88-6613-416a-9f4d-1bb285e53291 => generated 1560 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 03:38:35.765587 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi [None req-728c009c-3b68-40af-83cf-42255ee8924f tempest-VolumesSnapshotTestJSON-925980516 tempest-VolumesSnapshotTestJSON-925980516-project] Calling method '>' {{(pid=116156) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:38:35.766229 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.compute.api [None req-728c009c-3b68-40af-83cf-42255ee8924f tempest-VolumesSnapshotTestJSON-925980516 tempest-VolumesSnapshotTestJSON-925980516-project] [instance: a0097d88-6613-416a-9f4d-1bb285e53291] Fetching instance by UUID {{(pid=116156) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:38:35.772406 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-728c009c-3b68-40af-83cf-42255ee8924f tempest-VolumesSnapshotTestJSON-925980516 tempest-VolumesSnapshotTestJSON-925980516-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:38:35.772860 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-728c009c-3b68-40af-83cf-42255ee8924f tempest-VolumesSnapshotTestJSON-925980516 tempest-VolumesSnapshotTestJSON-925980516-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:38:35.773636 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-728c009c-3b68-40af-83cf-42255ee8924f tempest-VolumesSnapshotTestJSON-925980516 tempest-VolumesSnapshotTestJSON-925980516-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:38:35.774102 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-728c009c-3b68-40af-83cf-42255ee8924f tempest-VolumesSnapshotTestJSON-925980516 tempest-VolumesSnapshotTestJSON-925980516-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:38:35.899877 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.policy [None req-728c009c-3b68-40af-83cf-42255ee8924f tempest-VolumesSnapshotTestJSON-925980516 tempest-VolumesSnapshotTestJSON-925980516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4ffcca165af40abbd93569e7f01acbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ca6934bc24846ad82474c4ef7ba6323', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116156) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:38:35.907474 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: INFO nova.api.openstack.requestlog [None req-728c009c-3b68-40af-83cf-42255ee8924f tempest-VolumesSnapshotTestJSON-925980516 tempest-VolumesSnapshotTestJSON-925980516-project] 10.222.0.18 "GET /compute/v2.1/servers/a0097d88-6613-416a-9f4d-1bb285e53291" status: 200 len: 1560 microversion: 2.1 time: 0.145603 Dec 15 03:38:35.908069 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: [pid: 116156|app: 0|req: 1023/2031] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 03:38:35 2021] GET /compute/v2.1/servers/a0097d88-6613-416a-9f4d-1bb285e53291 => generated 1560 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 03:38:36.924801 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi [None req-3fcb8016-c3de-4c1a-b42c-c5fe7cbeb8d3 tempest-VolumesSnapshotTestJSON-925980516 tempest-VolumesSnapshotTestJSON-925980516-project] Calling method '>' {{(pid=116157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:38:36.925393 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.compute.api [None req-3fcb8016-c3de-4c1a-b42c-c5fe7cbeb8d3 tempest-VolumesSnapshotTestJSON-925980516 tempest-VolumesSnapshotTestJSON-925980516-project] [instance: a0097d88-6613-416a-9f4d-1bb285e53291] Fetching instance by UUID {{(pid=116157) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:38:36.931763 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-3fcb8016-c3de-4c1a-b42c-c5fe7cbeb8d3 tempest-VolumesSnapshotTestJSON-925980516 tempest-VolumesSnapshotTestJSON-925980516-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:38:36.932241 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-3fcb8016-c3de-4c1a-b42c-c5fe7cbeb8d3 tempest-VolumesSnapshotTestJSON-925980516 tempest-VolumesSnapshotTestJSON-925980516-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:38:36.933007 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-3fcb8016-c3de-4c1a-b42c-c5fe7cbeb8d3 tempest-VolumesSnapshotTestJSON-925980516 tempest-VolumesSnapshotTestJSON-925980516-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:38:36.933442 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-3fcb8016-c3de-4c1a-b42c-c5fe7cbeb8d3 tempest-VolumesSnapshotTestJSON-925980516 tempest-VolumesSnapshotTestJSON-925980516-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:38:37.061334 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.policy [None req-3fcb8016-c3de-4c1a-b42c-c5fe7cbeb8d3 tempest-VolumesSnapshotTestJSON-925980516 tempest-VolumesSnapshotTestJSON-925980516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4ffcca165af40abbd93569e7f01acbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ca6934bc24846ad82474c4ef7ba6323', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116157) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:38:37.069390 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: INFO nova.api.openstack.requestlog [None req-3fcb8016-c3de-4c1a-b42c-c5fe7cbeb8d3 tempest-VolumesSnapshotTestJSON-925980516 tempest-VolumesSnapshotTestJSON-925980516-project] 10.222.0.18 "GET /compute/v2.1/servers/a0097d88-6613-416a-9f4d-1bb285e53291" status: 200 len: 1560 microversion: 2.1 time: 0.148222 Dec 15 03:38:37.069947 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: [pid: 116157|app: 0|req: 1009/2032] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 03:38:36 2021] GET /compute/v2.1/servers/a0097d88-6613-416a-9f4d-1bb285e53291 => generated 1560 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 03:38:38.086591 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi [None req-9c320fbd-1f00-43f4-9e94-54e56e5f2732 tempest-VolumesSnapshotTestJSON-925980516 tempest-VolumesSnapshotTestJSON-925980516-project] Calling method '>' {{(pid=116156) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:38:38.087235 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.compute.api [None req-9c320fbd-1f00-43f4-9e94-54e56e5f2732 tempest-VolumesSnapshotTestJSON-925980516 tempest-VolumesSnapshotTestJSON-925980516-project] [instance: a0097d88-6613-416a-9f4d-1bb285e53291] Fetching instance by UUID {{(pid=116156) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:38:38.093634 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-9c320fbd-1f00-43f4-9e94-54e56e5f2732 tempest-VolumesSnapshotTestJSON-925980516 tempest-VolumesSnapshotTestJSON-925980516-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:38:38.094122 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-9c320fbd-1f00-43f4-9e94-54e56e5f2732 tempest-VolumesSnapshotTestJSON-925980516 tempest-VolumesSnapshotTestJSON-925980516-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:38:38.094902 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-9c320fbd-1f00-43f4-9e94-54e56e5f2732 tempest-VolumesSnapshotTestJSON-925980516 tempest-VolumesSnapshotTestJSON-925980516-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:38:38.095338 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-9c320fbd-1f00-43f4-9e94-54e56e5f2732 tempest-VolumesSnapshotTestJSON-925980516 tempest-VolumesSnapshotTestJSON-925980516-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:38:38.225348 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.policy [None req-9c320fbd-1f00-43f4-9e94-54e56e5f2732 tempest-VolumesSnapshotTestJSON-925980516 tempest-VolumesSnapshotTestJSON-925980516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4ffcca165af40abbd93569e7f01acbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ca6934bc24846ad82474c4ef7ba6323', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116156) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:38:38.233149 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: INFO nova.api.openstack.requestlog [None req-9c320fbd-1f00-43f4-9e94-54e56e5f2732 tempest-VolumesSnapshotTestJSON-925980516 tempest-VolumesSnapshotTestJSON-925980516-project] 10.222.0.18 "GET /compute/v2.1/servers/a0097d88-6613-416a-9f4d-1bb285e53291" status: 200 len: 1560 microversion: 2.1 time: 0.150233 Dec 15 03:38:38.233717 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: [pid: 116156|app: 0|req: 1024/2033] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 03:38:38 2021] GET /compute/v2.1/servers/a0097d88-6613-416a-9f4d-1bb285e53291 => generated 1560 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 03:38:39.249516 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi [None req-3536b8bb-8157-4dc5-9b69-c55216979f2e tempest-VolumesSnapshotTestJSON-925980516 tempest-VolumesSnapshotTestJSON-925980516-project] Calling method '>' {{(pid=116157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:38:39.250144 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.compute.api [None req-3536b8bb-8157-4dc5-9b69-c55216979f2e tempest-VolumesSnapshotTestJSON-925980516 tempest-VolumesSnapshotTestJSON-925980516-project] [instance: a0097d88-6613-416a-9f4d-1bb285e53291] Fetching instance by UUID {{(pid=116157) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:38:39.256474 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-3536b8bb-8157-4dc5-9b69-c55216979f2e tempest-VolumesSnapshotTestJSON-925980516 tempest-VolumesSnapshotTestJSON-925980516-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:38:39.256929 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-3536b8bb-8157-4dc5-9b69-c55216979f2e tempest-VolumesSnapshotTestJSON-925980516 tempest-VolumesSnapshotTestJSON-925980516-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:38:39.257681 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-3536b8bb-8157-4dc5-9b69-c55216979f2e tempest-VolumesSnapshotTestJSON-925980516 tempest-VolumesSnapshotTestJSON-925980516-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:38:39.258156 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-3536b8bb-8157-4dc5-9b69-c55216979f2e tempest-VolumesSnapshotTestJSON-925980516 tempest-VolumesSnapshotTestJSON-925980516-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:38:39.386315 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.policy [None req-3536b8bb-8157-4dc5-9b69-c55216979f2e tempest-VolumesSnapshotTestJSON-925980516 tempest-VolumesSnapshotTestJSON-925980516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4ffcca165af40abbd93569e7f01acbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ca6934bc24846ad82474c4ef7ba6323', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116157) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:38:39.394038 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: INFO nova.api.openstack.requestlog [None req-3536b8bb-8157-4dc5-9b69-c55216979f2e tempest-VolumesSnapshotTestJSON-925980516 tempest-VolumesSnapshotTestJSON-925980516-project] 10.222.0.18 "GET /compute/v2.1/servers/a0097d88-6613-416a-9f4d-1bb285e53291" status: 200 len: 1560 microversion: 2.1 time: 0.148166 Dec 15 03:38:39.394610 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: [pid: 116157|app: 0|req: 1010/2034] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 03:38:39 2021] GET /compute/v2.1/servers/a0097d88-6613-416a-9f4d-1bb285e53291 => generated 1560 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 03:38:40.411163 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi [None req-cb721555-3156-4aa6-bca5-8550d7f9963d tempest-VolumesSnapshotTestJSON-925980516 tempest-VolumesSnapshotTestJSON-925980516-project] Calling method '>' {{(pid=116156) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:38:40.411795 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.compute.api [None req-cb721555-3156-4aa6-bca5-8550d7f9963d tempest-VolumesSnapshotTestJSON-925980516 tempest-VolumesSnapshotTestJSON-925980516-project] [instance: a0097d88-6613-416a-9f4d-1bb285e53291] Fetching instance by UUID {{(pid=116156) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:38:40.418022 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-cb721555-3156-4aa6-bca5-8550d7f9963d tempest-VolumesSnapshotTestJSON-925980516 tempest-VolumesSnapshotTestJSON-925980516-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:38:40.418475 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-cb721555-3156-4aa6-bca5-8550d7f9963d tempest-VolumesSnapshotTestJSON-925980516 tempest-VolumesSnapshotTestJSON-925980516-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:38:40.419245 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-cb721555-3156-4aa6-bca5-8550d7f9963d tempest-VolumesSnapshotTestJSON-925980516 tempest-VolumesSnapshotTestJSON-925980516-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:38:40.419674 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-cb721555-3156-4aa6-bca5-8550d7f9963d tempest-VolumesSnapshotTestJSON-925980516 tempest-VolumesSnapshotTestJSON-925980516-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:38:40.549297 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.policy [None req-cb721555-3156-4aa6-bca5-8550d7f9963d tempest-VolumesSnapshotTestJSON-925980516 tempest-VolumesSnapshotTestJSON-925980516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4ffcca165af40abbd93569e7f01acbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ca6934bc24846ad82474c4ef7ba6323', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116156) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:38:40.557511 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: INFO nova.api.openstack.requestlog [None req-cb721555-3156-4aa6-bca5-8550d7f9963d tempest-VolumesSnapshotTestJSON-925980516 tempest-VolumesSnapshotTestJSON-925980516-project] 10.222.0.18 "GET /compute/v2.1/servers/a0097d88-6613-416a-9f4d-1bb285e53291" status: 200 len: 1560 microversion: 2.1 time: 0.150292 Dec 15 03:38:40.558102 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: [pid: 116156|app: 0|req: 1025/2035] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 03:38:40 2021] GET /compute/v2.1/servers/a0097d88-6613-416a-9f4d-1bb285e53291 => generated 1560 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 03:38:41.575119 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi [None req-19667fca-ea2a-4aa3-8ebd-3e7b1b2f068a tempest-VolumesSnapshotTestJSON-925980516 tempest-VolumesSnapshotTestJSON-925980516-project] Calling method '>' {{(pid=116157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:38:41.575760 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.compute.api [None req-19667fca-ea2a-4aa3-8ebd-3e7b1b2f068a tempest-VolumesSnapshotTestJSON-925980516 tempest-VolumesSnapshotTestJSON-925980516-project] [instance: a0097d88-6613-416a-9f4d-1bb285e53291] Fetching instance by UUID {{(pid=116157) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:38:41.581874 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-19667fca-ea2a-4aa3-8ebd-3e7b1b2f068a tempest-VolumesSnapshotTestJSON-925980516 tempest-VolumesSnapshotTestJSON-925980516-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:38:41.582354 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-19667fca-ea2a-4aa3-8ebd-3e7b1b2f068a tempest-VolumesSnapshotTestJSON-925980516 tempest-VolumesSnapshotTestJSON-925980516-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:38:41.583124 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-19667fca-ea2a-4aa3-8ebd-3e7b1b2f068a tempest-VolumesSnapshotTestJSON-925980516 tempest-VolumesSnapshotTestJSON-925980516-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:38:41.583555 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-19667fca-ea2a-4aa3-8ebd-3e7b1b2f068a tempest-VolumesSnapshotTestJSON-925980516 tempest-VolumesSnapshotTestJSON-925980516-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:38:41.711066 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.policy [None req-19667fca-ea2a-4aa3-8ebd-3e7b1b2f068a tempest-VolumesSnapshotTestJSON-925980516 tempest-VolumesSnapshotTestJSON-925980516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4ffcca165af40abbd93569e7f01acbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ca6934bc24846ad82474c4ef7ba6323', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116157) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:38:41.718968 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: INFO nova.api.openstack.requestlog [None req-19667fca-ea2a-4aa3-8ebd-3e7b1b2f068a tempest-VolumesSnapshotTestJSON-925980516 tempest-VolumesSnapshotTestJSON-925980516-project] 10.222.0.18 "GET /compute/v2.1/servers/a0097d88-6613-416a-9f4d-1bb285e53291" status: 200 len: 1560 microversion: 2.1 time: 0.147477 Dec 15 03:38:41.719528 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: [pid: 116157|app: 0|req: 1011/2036] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 03:38:41 2021] GET /compute/v2.1/servers/a0097d88-6613-416a-9f4d-1bb285e53291 => generated 1560 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 03:38:42.736437 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi [None req-e0343d1d-2275-4a65-bd11-1e79aeb04cc0 tempest-VolumesSnapshotTestJSON-925980516 tempest-VolumesSnapshotTestJSON-925980516-project] Calling method '>' {{(pid=116156) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:38:42.737074 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.compute.api [None req-e0343d1d-2275-4a65-bd11-1e79aeb04cc0 tempest-VolumesSnapshotTestJSON-925980516 tempest-VolumesSnapshotTestJSON-925980516-project] [instance: a0097d88-6613-416a-9f4d-1bb285e53291] Fetching instance by UUID {{(pid=116156) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:38:42.743768 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-e0343d1d-2275-4a65-bd11-1e79aeb04cc0 tempest-VolumesSnapshotTestJSON-925980516 tempest-VolumesSnapshotTestJSON-925980516-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:38:42.744223 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-e0343d1d-2275-4a65-bd11-1e79aeb04cc0 tempest-VolumesSnapshotTestJSON-925980516 tempest-VolumesSnapshotTestJSON-925980516-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:38:42.745024 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-e0343d1d-2275-4a65-bd11-1e79aeb04cc0 tempest-VolumesSnapshotTestJSON-925980516 tempest-VolumesSnapshotTestJSON-925980516-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:38:42.745455 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-e0343d1d-2275-4a65-bd11-1e79aeb04cc0 tempest-VolumesSnapshotTestJSON-925980516 tempest-VolumesSnapshotTestJSON-925980516-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:38:42.871232 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.policy [None req-e0343d1d-2275-4a65-bd11-1e79aeb04cc0 tempest-VolumesSnapshotTestJSON-925980516 tempest-VolumesSnapshotTestJSON-925980516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4ffcca165af40abbd93569e7f01acbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ca6934bc24846ad82474c4ef7ba6323', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116156) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:38:42.879423 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: INFO nova.api.openstack.requestlog [None req-e0343d1d-2275-4a65-bd11-1e79aeb04cc0 tempest-VolumesSnapshotTestJSON-925980516 tempest-VolumesSnapshotTestJSON-925980516-project] 10.222.0.18 "GET /compute/v2.1/servers/a0097d88-6613-416a-9f4d-1bb285e53291" status: 200 len: 1560 microversion: 2.1 time: 0.146107 Dec 15 03:38:42.879985 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: [pid: 116156|app: 0|req: 1026/2037] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 03:38:42 2021] GET /compute/v2.1/servers/a0097d88-6613-416a-9f4d-1bb285e53291 => generated 1560 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 03:38:43.896295 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi [None req-73318a8b-da0c-43d7-8c8b-ebcc194eb303 tempest-VolumesSnapshotTestJSON-925980516 tempest-VolumesSnapshotTestJSON-925980516-project] Calling method '>' {{(pid=116157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:38:43.896933 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.compute.api [None req-73318a8b-da0c-43d7-8c8b-ebcc194eb303 tempest-VolumesSnapshotTestJSON-925980516 tempest-VolumesSnapshotTestJSON-925980516-project] [instance: a0097d88-6613-416a-9f4d-1bb285e53291] Fetching instance by UUID {{(pid=116157) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:38:43.903291 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-73318a8b-da0c-43d7-8c8b-ebcc194eb303 tempest-VolumesSnapshotTestJSON-925980516 tempest-VolumesSnapshotTestJSON-925980516-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:38:43.903748 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-73318a8b-da0c-43d7-8c8b-ebcc194eb303 tempest-VolumesSnapshotTestJSON-925980516 tempest-VolumesSnapshotTestJSON-925980516-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:38:43.904536 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-73318a8b-da0c-43d7-8c8b-ebcc194eb303 tempest-VolumesSnapshotTestJSON-925980516 tempest-VolumesSnapshotTestJSON-925980516-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:38:43.904976 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-73318a8b-da0c-43d7-8c8b-ebcc194eb303 tempest-VolumesSnapshotTestJSON-925980516 tempest-VolumesSnapshotTestJSON-925980516-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:38:44.032769 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.policy [None req-73318a8b-da0c-43d7-8c8b-ebcc194eb303 tempest-VolumesSnapshotTestJSON-925980516 tempest-VolumesSnapshotTestJSON-925980516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4ffcca165af40abbd93569e7f01acbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ca6934bc24846ad82474c4ef7ba6323', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116157) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:38:44.040987 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: INFO nova.api.openstack.requestlog [None req-73318a8b-da0c-43d7-8c8b-ebcc194eb303 tempest-VolumesSnapshotTestJSON-925980516 tempest-VolumesSnapshotTestJSON-925980516-project] 10.222.0.18 "GET /compute/v2.1/servers/a0097d88-6613-416a-9f4d-1bb285e53291" status: 200 len: 1560 microversion: 2.1 time: 0.148349 Dec 15 03:38:44.041549 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: [pid: 116157|app: 0|req: 1012/2038] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 03:38:43 2021] GET /compute/v2.1/servers/a0097d88-6613-416a-9f4d-1bb285e53291 => generated 1560 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 03:38:45.057593 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi [None req-66cce1b8-10c3-4e26-a367-677f18ab7736 tempest-VolumesSnapshotTestJSON-925980516 tempest-VolumesSnapshotTestJSON-925980516-project] Calling method '>' {{(pid=116156) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:38:45.058233 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.compute.api [None req-66cce1b8-10c3-4e26-a367-677f18ab7736 tempest-VolumesSnapshotTestJSON-925980516 tempest-VolumesSnapshotTestJSON-925980516-project] [instance: a0097d88-6613-416a-9f4d-1bb285e53291] Fetching instance by UUID {{(pid=116156) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:38:45.064544 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-66cce1b8-10c3-4e26-a367-677f18ab7736 tempest-VolumesSnapshotTestJSON-925980516 tempest-VolumesSnapshotTestJSON-925980516-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:38:45.065002 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-66cce1b8-10c3-4e26-a367-677f18ab7736 tempest-VolumesSnapshotTestJSON-925980516 tempest-VolumesSnapshotTestJSON-925980516-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:38:45.065773 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-66cce1b8-10c3-4e26-a367-677f18ab7736 tempest-VolumesSnapshotTestJSON-925980516 tempest-VolumesSnapshotTestJSON-925980516-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:38:45.066857 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-66cce1b8-10c3-4e26-a367-677f18ab7736 tempest-VolumesSnapshotTestJSON-925980516 tempest-VolumesSnapshotTestJSON-925980516-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:38:45.195749 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.policy [None req-66cce1b8-10c3-4e26-a367-677f18ab7736 tempest-VolumesSnapshotTestJSON-925980516 tempest-VolumesSnapshotTestJSON-925980516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4ffcca165af40abbd93569e7f01acbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ca6934bc24846ad82474c4ef7ba6323', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116156) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:38:45.203642 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: INFO nova.api.openstack.requestlog [None req-66cce1b8-10c3-4e26-a367-677f18ab7736 tempest-VolumesSnapshotTestJSON-925980516 tempest-VolumesSnapshotTestJSON-925980516-project] 10.222.0.18 "GET /compute/v2.1/servers/a0097d88-6613-416a-9f4d-1bb285e53291" status: 200 len: 1560 microversion: 2.1 time: 0.149632 Dec 15 03:38:45.204453 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: [pid: 116156|app: 0|req: 1027/2039] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 03:38:45 2021] GET /compute/v2.1/servers/a0097d88-6613-416a-9f4d-1bb285e53291 => generated 1560 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 03:38:46.220668 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi [None req-6cf3137f-58a6-454d-8dc5-23d43f6884ca tempest-VolumesSnapshotTestJSON-925980516 tempest-VolumesSnapshotTestJSON-925980516-project] Calling method '>' {{(pid=116157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:38:46.221278 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.compute.api [None req-6cf3137f-58a6-454d-8dc5-23d43f6884ca tempest-VolumesSnapshotTestJSON-925980516 tempest-VolumesSnapshotTestJSON-925980516-project] [instance: a0097d88-6613-416a-9f4d-1bb285e53291] Fetching instance by UUID {{(pid=116157) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:38:46.227497 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-6cf3137f-58a6-454d-8dc5-23d43f6884ca tempest-VolumesSnapshotTestJSON-925980516 tempest-VolumesSnapshotTestJSON-925980516-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:38:46.227939 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-6cf3137f-58a6-454d-8dc5-23d43f6884ca tempest-VolumesSnapshotTestJSON-925980516 tempest-VolumesSnapshotTestJSON-925980516-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:38:46.228709 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-6cf3137f-58a6-454d-8dc5-23d43f6884ca tempest-VolumesSnapshotTestJSON-925980516 tempest-VolumesSnapshotTestJSON-925980516-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:38:46.229142 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-6cf3137f-58a6-454d-8dc5-23d43f6884ca tempest-VolumesSnapshotTestJSON-925980516 tempest-VolumesSnapshotTestJSON-925980516-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:38:46.353421 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.policy [None req-6cf3137f-58a6-454d-8dc5-23d43f6884ca tempest-VolumesSnapshotTestJSON-925980516 tempest-VolumesSnapshotTestJSON-925980516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4ffcca165af40abbd93569e7f01acbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ca6934bc24846ad82474c4ef7ba6323', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116157) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:38:46.361057 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: INFO nova.api.openstack.requestlog [None req-6cf3137f-58a6-454d-8dc5-23d43f6884ca tempest-VolumesSnapshotTestJSON-925980516 tempest-VolumesSnapshotTestJSON-925980516-project] 10.222.0.18 "GET /compute/v2.1/servers/a0097d88-6613-416a-9f4d-1bb285e53291" status: 200 len: 1560 microversion: 2.1 time: 0.144282 Dec 15 03:38:46.361623 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: [pid: 116157|app: 0|req: 1013/2040] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 03:38:46 2021] GET /compute/v2.1/servers/a0097d88-6613-416a-9f4d-1bb285e53291 => generated 1560 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 03:38:47.377715 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi [None req-c8da4a8b-e6f7-4a12-b5e1-d7583252dd35 tempest-VolumesSnapshotTestJSON-925980516 tempest-VolumesSnapshotTestJSON-925980516-project] Calling method '>' {{(pid=116156) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:38:47.378356 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.compute.api [None req-c8da4a8b-e6f7-4a12-b5e1-d7583252dd35 tempest-VolumesSnapshotTestJSON-925980516 tempest-VolumesSnapshotTestJSON-925980516-project] [instance: a0097d88-6613-416a-9f4d-1bb285e53291] Fetching instance by UUID {{(pid=116156) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:38:47.384577 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-c8da4a8b-e6f7-4a12-b5e1-d7583252dd35 tempest-VolumesSnapshotTestJSON-925980516 tempest-VolumesSnapshotTestJSON-925980516-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:38:47.385026 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-c8da4a8b-e6f7-4a12-b5e1-d7583252dd35 tempest-VolumesSnapshotTestJSON-925980516 tempest-VolumesSnapshotTestJSON-925980516-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:38:47.385795 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-c8da4a8b-e6f7-4a12-b5e1-d7583252dd35 tempest-VolumesSnapshotTestJSON-925980516 tempest-VolumesSnapshotTestJSON-925980516-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:38:47.386262 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-c8da4a8b-e6f7-4a12-b5e1-d7583252dd35 tempest-VolumesSnapshotTestJSON-925980516 tempest-VolumesSnapshotTestJSON-925980516-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:38:47.512251 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.policy [None req-c8da4a8b-e6f7-4a12-b5e1-d7583252dd35 tempest-VolumesSnapshotTestJSON-925980516 tempest-VolumesSnapshotTestJSON-925980516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4ffcca165af40abbd93569e7f01acbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ca6934bc24846ad82474c4ef7ba6323', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116156) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:38:47.520411 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: INFO nova.api.openstack.requestlog [None req-c8da4a8b-e6f7-4a12-b5e1-d7583252dd35 tempest-VolumesSnapshotTestJSON-925980516 tempest-VolumesSnapshotTestJSON-925980516-project] 10.222.0.18 "GET /compute/v2.1/servers/a0097d88-6613-416a-9f4d-1bb285e53291" status: 200 len: 1560 microversion: 2.1 time: 0.146298 Dec 15 03:38:47.520966 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: [pid: 116156|app: 0|req: 1028/2041] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 03:38:47 2021] GET /compute/v2.1/servers/a0097d88-6613-416a-9f4d-1bb285e53291 => generated 1560 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 03:38:48.537701 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi [None req-e4d64243-9adb-44e5-a8aa-a55cd229ae7a tempest-VolumesSnapshotTestJSON-925980516 tempest-VolumesSnapshotTestJSON-925980516-project] Calling method '>' {{(pid=116157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:38:48.538278 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.compute.api [None req-e4d64243-9adb-44e5-a8aa-a55cd229ae7a tempest-VolumesSnapshotTestJSON-925980516 tempest-VolumesSnapshotTestJSON-925980516-project] [instance: a0097d88-6613-416a-9f4d-1bb285e53291] Fetching instance by UUID {{(pid=116157) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:38:48.544524 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-e4d64243-9adb-44e5-a8aa-a55cd229ae7a tempest-VolumesSnapshotTestJSON-925980516 tempest-VolumesSnapshotTestJSON-925980516-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:38:48.544978 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-e4d64243-9adb-44e5-a8aa-a55cd229ae7a tempest-VolumesSnapshotTestJSON-925980516 tempest-VolumesSnapshotTestJSON-925980516-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:38:48.545762 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-e4d64243-9adb-44e5-a8aa-a55cd229ae7a tempest-VolumesSnapshotTestJSON-925980516 tempest-VolumesSnapshotTestJSON-925980516-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:38:48.546242 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-e4d64243-9adb-44e5-a8aa-a55cd229ae7a tempest-VolumesSnapshotTestJSON-925980516 tempest-VolumesSnapshotTestJSON-925980516-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:38:48.675656 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.policy [None req-e4d64243-9adb-44e5-a8aa-a55cd229ae7a tempest-VolumesSnapshotTestJSON-925980516 tempest-VolumesSnapshotTestJSON-925980516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4ffcca165af40abbd93569e7f01acbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ca6934bc24846ad82474c4ef7ba6323', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116157) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:38:48.683307 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: INFO nova.api.openstack.requestlog [None req-e4d64243-9adb-44e5-a8aa-a55cd229ae7a tempest-VolumesSnapshotTestJSON-925980516 tempest-VolumesSnapshotTestJSON-925980516-project] 10.222.0.18 "GET /compute/v2.1/servers/a0097d88-6613-416a-9f4d-1bb285e53291" status: 200 len: 1560 microversion: 2.1 time: 0.149873 Dec 15 03:38:48.683879 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: [pid: 116157|app: 0|req: 1014/2042] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 03:38:48 2021] GET /compute/v2.1/servers/a0097d88-6613-416a-9f4d-1bb285e53291 => generated 1560 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 03:38:49.700037 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi [None req-48eeffe2-0e32-4c0d-989d-9682d7c55408 tempest-VolumesSnapshotTestJSON-925980516 tempest-VolumesSnapshotTestJSON-925980516-project] Calling method '>' {{(pid=116156) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:38:49.700641 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.compute.api [None req-48eeffe2-0e32-4c0d-989d-9682d7c55408 tempest-VolumesSnapshotTestJSON-925980516 tempest-VolumesSnapshotTestJSON-925980516-project] [instance: a0097d88-6613-416a-9f4d-1bb285e53291] Fetching instance by UUID {{(pid=116156) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:38:49.706947 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-48eeffe2-0e32-4c0d-989d-9682d7c55408 tempest-VolumesSnapshotTestJSON-925980516 tempest-VolumesSnapshotTestJSON-925980516-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:38:49.707393 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-48eeffe2-0e32-4c0d-989d-9682d7c55408 tempest-VolumesSnapshotTestJSON-925980516 tempest-VolumesSnapshotTestJSON-925980516-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:38:49.708158 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-48eeffe2-0e32-4c0d-989d-9682d7c55408 tempest-VolumesSnapshotTestJSON-925980516 tempest-VolumesSnapshotTestJSON-925980516-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:38:49.708589 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-48eeffe2-0e32-4c0d-989d-9682d7c55408 tempest-VolumesSnapshotTestJSON-925980516 tempest-VolumesSnapshotTestJSON-925980516-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:38:49.836804 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.policy [None req-48eeffe2-0e32-4c0d-989d-9682d7c55408 tempest-VolumesSnapshotTestJSON-925980516 tempest-VolumesSnapshotTestJSON-925980516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4ffcca165af40abbd93569e7f01acbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ca6934bc24846ad82474c4ef7ba6323', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116156) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:38:49.844679 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: INFO nova.api.openstack.requestlog [None req-48eeffe2-0e32-4c0d-989d-9682d7c55408 tempest-VolumesSnapshotTestJSON-925980516 tempest-VolumesSnapshotTestJSON-925980516-project] 10.222.0.18 "GET /compute/v2.1/servers/a0097d88-6613-416a-9f4d-1bb285e53291" status: 200 len: 1560 microversion: 2.1 time: 0.148271 Dec 15 03:38:49.845233 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: [pid: 116156|app: 0|req: 1029/2043] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 03:38:49 2021] GET /compute/v2.1/servers/a0097d88-6613-416a-9f4d-1bb285e53291 => generated 1560 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 03:38:50.863080 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi [None req-bd2a08ab-f8dd-48c7-803d-409c1ac7be6c tempest-VolumesSnapshotTestJSON-925980516 tempest-VolumesSnapshotTestJSON-925980516-project] Calling method '>' {{(pid=116157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:38:50.863692 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.compute.api [None req-bd2a08ab-f8dd-48c7-803d-409c1ac7be6c tempest-VolumesSnapshotTestJSON-925980516 tempest-VolumesSnapshotTestJSON-925980516-project] [instance: a0097d88-6613-416a-9f4d-1bb285e53291] Fetching instance by UUID {{(pid=116157) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:38:50.869963 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-bd2a08ab-f8dd-48c7-803d-409c1ac7be6c tempest-VolumesSnapshotTestJSON-925980516 tempest-VolumesSnapshotTestJSON-925980516-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:38:50.870441 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-bd2a08ab-f8dd-48c7-803d-409c1ac7be6c tempest-VolumesSnapshotTestJSON-925980516 tempest-VolumesSnapshotTestJSON-925980516-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:38:50.871218 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-bd2a08ab-f8dd-48c7-803d-409c1ac7be6c tempest-VolumesSnapshotTestJSON-925980516 tempest-VolumesSnapshotTestJSON-925980516-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:38:50.871654 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-bd2a08ab-f8dd-48c7-803d-409c1ac7be6c tempest-VolumesSnapshotTestJSON-925980516 tempest-VolumesSnapshotTestJSON-925980516-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:38:50.996828 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.policy [None req-bd2a08ab-f8dd-48c7-803d-409c1ac7be6c tempest-VolumesSnapshotTestJSON-925980516 tempest-VolumesSnapshotTestJSON-925980516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4ffcca165af40abbd93569e7f01acbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ca6934bc24846ad82474c4ef7ba6323', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116157) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:38:51.004499 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: INFO nova.api.openstack.requestlog [None req-bd2a08ab-f8dd-48c7-803d-409c1ac7be6c tempest-VolumesSnapshotTestJSON-925980516 tempest-VolumesSnapshotTestJSON-925980516-project] 10.222.0.18 "GET /compute/v2.1/servers/a0097d88-6613-416a-9f4d-1bb285e53291" status: 200 len: 1560 microversion: 2.1 time: 0.145069 Dec 15 03:38:51.005060 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: [pid: 116157|app: 0|req: 1015/2044] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 03:38:50 2021] GET /compute/v2.1/servers/a0097d88-6613-416a-9f4d-1bb285e53291 => generated 1560 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 03:38:52.021601 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi [None req-594a3b20-2919-4b39-9e0e-6587fe5fcab3 tempest-VolumesSnapshotTestJSON-925980516 tempest-VolumesSnapshotTestJSON-925980516-project] Calling method '>' {{(pid=116156) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:38:52.022239 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.compute.api [None req-594a3b20-2919-4b39-9e0e-6587fe5fcab3 tempest-VolumesSnapshotTestJSON-925980516 tempest-VolumesSnapshotTestJSON-925980516-project] [instance: a0097d88-6613-416a-9f4d-1bb285e53291] Fetching instance by UUID {{(pid=116156) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:38:52.028602 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-594a3b20-2919-4b39-9e0e-6587fe5fcab3 tempest-VolumesSnapshotTestJSON-925980516 tempest-VolumesSnapshotTestJSON-925980516-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:38:52.029046 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-594a3b20-2919-4b39-9e0e-6587fe5fcab3 tempest-VolumesSnapshotTestJSON-925980516 tempest-VolumesSnapshotTestJSON-925980516-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:38:52.029814 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-594a3b20-2919-4b39-9e0e-6587fe5fcab3 tempest-VolumesSnapshotTestJSON-925980516 tempest-VolumesSnapshotTestJSON-925980516-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:38:52.030281 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-594a3b20-2919-4b39-9e0e-6587fe5fcab3 tempest-VolumesSnapshotTestJSON-925980516 tempest-VolumesSnapshotTestJSON-925980516-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:38:52.162958 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.policy [None req-594a3b20-2919-4b39-9e0e-6587fe5fcab3 tempest-VolumesSnapshotTestJSON-925980516 tempest-VolumesSnapshotTestJSON-925980516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4ffcca165af40abbd93569e7f01acbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ca6934bc24846ad82474c4ef7ba6323', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116156) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:38:52.170582 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: INFO nova.api.openstack.requestlog [None req-594a3b20-2919-4b39-9e0e-6587fe5fcab3 tempest-VolumesSnapshotTestJSON-925980516 tempest-VolumesSnapshotTestJSON-925980516-project] 10.222.0.18 "GET /compute/v2.1/servers/a0097d88-6613-416a-9f4d-1bb285e53291" status: 200 len: 1560 microversion: 2.1 time: 0.153172 Dec 15 03:38:52.171133 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: [pid: 116156|app: 0|req: 1030/2045] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 03:38:52 2021] GET /compute/v2.1/servers/a0097d88-6613-416a-9f4d-1bb285e53291 => generated 1560 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 03:38:53.187479 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi [None req-4432d3e2-5554-480d-b3cb-0a6526f2da0f tempest-VolumesSnapshotTestJSON-925980516 tempest-VolumesSnapshotTestJSON-925980516-project] Calling method '>' {{(pid=116157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:38:53.188094 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.compute.api [None req-4432d3e2-5554-480d-b3cb-0a6526f2da0f tempest-VolumesSnapshotTestJSON-925980516 tempest-VolumesSnapshotTestJSON-925980516-project] [instance: a0097d88-6613-416a-9f4d-1bb285e53291] Fetching instance by UUID {{(pid=116157) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:38:53.194380 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-4432d3e2-5554-480d-b3cb-0a6526f2da0f tempest-VolumesSnapshotTestJSON-925980516 tempest-VolumesSnapshotTestJSON-925980516-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:38:53.194831 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-4432d3e2-5554-480d-b3cb-0a6526f2da0f tempest-VolumesSnapshotTestJSON-925980516 tempest-VolumesSnapshotTestJSON-925980516-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:38:53.195610 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-4432d3e2-5554-480d-b3cb-0a6526f2da0f tempest-VolumesSnapshotTestJSON-925980516 tempest-VolumesSnapshotTestJSON-925980516-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:38:53.196042 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-4432d3e2-5554-480d-b3cb-0a6526f2da0f tempest-VolumesSnapshotTestJSON-925980516 tempest-VolumesSnapshotTestJSON-925980516-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:38:53.563500 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.policy [None req-4432d3e2-5554-480d-b3cb-0a6526f2da0f tempest-VolumesSnapshotTestJSON-925980516 tempest-VolumesSnapshotTestJSON-925980516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4ffcca165af40abbd93569e7f01acbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ca6934bc24846ad82474c4ef7ba6323', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116157) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:38:53.571679 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: INFO nova.api.openstack.requestlog [None req-4432d3e2-5554-480d-b3cb-0a6526f2da0f tempest-VolumesSnapshotTestJSON-925980516 tempest-VolumesSnapshotTestJSON-925980516-project] 10.222.0.18 "GET /compute/v2.1/servers/a0097d88-6613-416a-9f4d-1bb285e53291" status: 200 len: 1560 microversion: 2.1 time: 0.387920 Dec 15 03:38:53.572243 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: [pid: 116157|app: 0|req: 1016/2046] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 03:38:53 2021] GET /compute/v2.1/servers/a0097d88-6613-416a-9f4d-1bb285e53291 => generated 1560 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 03:38:54.588779 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi [None req-516aa717-0010-485c-9adb-fa2e2414686d tempest-VolumesSnapshotTestJSON-925980516 tempest-VolumesSnapshotTestJSON-925980516-project] Calling method '>' {{(pid=116156) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:38:54.589388 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.compute.api [None req-516aa717-0010-485c-9adb-fa2e2414686d tempest-VolumesSnapshotTestJSON-925980516 tempest-VolumesSnapshotTestJSON-925980516-project] [instance: a0097d88-6613-416a-9f4d-1bb285e53291] Fetching instance by UUID {{(pid=116156) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:38:54.595918 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-516aa717-0010-485c-9adb-fa2e2414686d tempest-VolumesSnapshotTestJSON-925980516 tempest-VolumesSnapshotTestJSON-925980516-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:38:54.596365 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-516aa717-0010-485c-9adb-fa2e2414686d tempest-VolumesSnapshotTestJSON-925980516 tempest-VolumesSnapshotTestJSON-925980516-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:38:54.597139 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-516aa717-0010-485c-9adb-fa2e2414686d tempest-VolumesSnapshotTestJSON-925980516 tempest-VolumesSnapshotTestJSON-925980516-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:38:54.597572 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-516aa717-0010-485c-9adb-fa2e2414686d tempest-VolumesSnapshotTestJSON-925980516 tempest-VolumesSnapshotTestJSON-925980516-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:38:54.723499 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.policy [None req-516aa717-0010-485c-9adb-fa2e2414686d tempest-VolumesSnapshotTestJSON-925980516 tempest-VolumesSnapshotTestJSON-925980516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4ffcca165af40abbd93569e7f01acbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ca6934bc24846ad82474c4ef7ba6323', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116156) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:38:54.731181 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: INFO nova.api.openstack.requestlog [None req-516aa717-0010-485c-9adb-fa2e2414686d tempest-VolumesSnapshotTestJSON-925980516 tempest-VolumesSnapshotTestJSON-925980516-project] 10.222.0.18 "GET /compute/v2.1/servers/a0097d88-6613-416a-9f4d-1bb285e53291" status: 200 len: 1560 microversion: 2.1 time: 0.146037 Dec 15 03:38:54.731739 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: [pid: 116156|app: 0|req: 1031/2047] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 03:38:54 2021] GET /compute/v2.1/servers/a0097d88-6613-416a-9f4d-1bb285e53291 => generated 1560 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 03:38:55.750282 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi [None req-4e075018-5a0c-4fad-bc65-68b2b0c747cb tempest-VolumesSnapshotTestJSON-925980516 tempest-VolumesSnapshotTestJSON-925980516-project] Calling method '>' {{(pid=116157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:38:55.750940 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.compute.api [None req-4e075018-5a0c-4fad-bc65-68b2b0c747cb tempest-VolumesSnapshotTestJSON-925980516 tempest-VolumesSnapshotTestJSON-925980516-project] [instance: a0097d88-6613-416a-9f4d-1bb285e53291] Fetching instance by UUID {{(pid=116157) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:38:55.757523 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-4e075018-5a0c-4fad-bc65-68b2b0c747cb tempest-VolumesSnapshotTestJSON-925980516 tempest-VolumesSnapshotTestJSON-925980516-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:38:55.757998 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-4e075018-5a0c-4fad-bc65-68b2b0c747cb tempest-VolumesSnapshotTestJSON-925980516 tempest-VolumesSnapshotTestJSON-925980516-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:38:55.758794 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-4e075018-5a0c-4fad-bc65-68b2b0c747cb tempest-VolumesSnapshotTestJSON-925980516 tempest-VolumesSnapshotTestJSON-925980516-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:38:55.759236 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-4e075018-5a0c-4fad-bc65-68b2b0c747cb tempest-VolumesSnapshotTestJSON-925980516 tempest-VolumesSnapshotTestJSON-925980516-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:38:55.884872 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.policy [None req-4e075018-5a0c-4fad-bc65-68b2b0c747cb tempest-VolumesSnapshotTestJSON-925980516 tempest-VolumesSnapshotTestJSON-925980516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4ffcca165af40abbd93569e7f01acbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ca6934bc24846ad82474c4ef7ba6323', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116157) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:38:55.892536 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: INFO nova.api.openstack.requestlog [None req-4e075018-5a0c-4fad-bc65-68b2b0c747cb tempest-VolumesSnapshotTestJSON-925980516 tempest-VolumesSnapshotTestJSON-925980516-project] 10.222.0.18 "GET /compute/v2.1/servers/a0097d88-6613-416a-9f4d-1bb285e53291" status: 200 len: 1560 microversion: 2.1 time: 0.148960 Dec 15 03:38:55.893112 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: [pid: 116157|app: 0|req: 1017/2048] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 03:38:55 2021] GET /compute/v2.1/servers/a0097d88-6613-416a-9f4d-1bb285e53291 => generated 1560 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 03:38:56.908407 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi [None req-c5824f33-c6d4-447b-aa5c-f6f0d50ee283 tempest-VolumesSnapshotTestJSON-925980516 tempest-VolumesSnapshotTestJSON-925980516-project] Calling method '>' {{(pid=116156) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:38:56.909035 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.compute.api [None req-c5824f33-c6d4-447b-aa5c-f6f0d50ee283 tempest-VolumesSnapshotTestJSON-925980516 tempest-VolumesSnapshotTestJSON-925980516-project] [instance: a0097d88-6613-416a-9f4d-1bb285e53291] Fetching instance by UUID {{(pid=116156) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:38:56.915251 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-c5824f33-c6d4-447b-aa5c-f6f0d50ee283 tempest-VolumesSnapshotTestJSON-925980516 tempest-VolumesSnapshotTestJSON-925980516-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:38:56.915704 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-c5824f33-c6d4-447b-aa5c-f6f0d50ee283 tempest-VolumesSnapshotTestJSON-925980516 tempest-VolumesSnapshotTestJSON-925980516-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:38:56.916480 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-c5824f33-c6d4-447b-aa5c-f6f0d50ee283 tempest-VolumesSnapshotTestJSON-925980516 tempest-VolumesSnapshotTestJSON-925980516-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:38:56.916914 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-c5824f33-c6d4-447b-aa5c-f6f0d50ee283 tempest-VolumesSnapshotTestJSON-925980516 tempest-VolumesSnapshotTestJSON-925980516-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:38:57.048873 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.policy [None req-c5824f33-c6d4-447b-aa5c-f6f0d50ee283 tempest-VolumesSnapshotTestJSON-925980516 tempest-VolumesSnapshotTestJSON-925980516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4ffcca165af40abbd93569e7f01acbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ca6934bc24846ad82474c4ef7ba6323', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116156) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:38:57.057253 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: INFO nova.api.openstack.requestlog [None req-c5824f33-c6d4-447b-aa5c-f6f0d50ee283 tempest-VolumesSnapshotTestJSON-925980516 tempest-VolumesSnapshotTestJSON-925980516-project] 10.222.0.18 "GET /compute/v2.1/servers/a0097d88-6613-416a-9f4d-1bb285e53291" status: 200 len: 1560 microversion: 2.1 time: 0.152462 Dec 15 03:38:57.057855 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: [pid: 116156|app: 0|req: 1032/2049] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 03:38:56 2021] GET /compute/v2.1/servers/a0097d88-6613-416a-9f4d-1bb285e53291 => generated 1560 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 03:38:58.074367 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi [None req-54a32cea-b7d6-4080-9976-95e30562bef7 tempest-VolumesSnapshotTestJSON-925980516 tempest-VolumesSnapshotTestJSON-925980516-project] Calling method '>' {{(pid=116157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:38:58.074983 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.compute.api [None req-54a32cea-b7d6-4080-9976-95e30562bef7 tempest-VolumesSnapshotTestJSON-925980516 tempest-VolumesSnapshotTestJSON-925980516-project] [instance: a0097d88-6613-416a-9f4d-1bb285e53291] Fetching instance by UUID {{(pid=116157) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:38:58.081165 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-54a32cea-b7d6-4080-9976-95e30562bef7 tempest-VolumesSnapshotTestJSON-925980516 tempest-VolumesSnapshotTestJSON-925980516-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:38:58.081622 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-54a32cea-b7d6-4080-9976-95e30562bef7 tempest-VolumesSnapshotTestJSON-925980516 tempest-VolumesSnapshotTestJSON-925980516-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:38:58.082444 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-54a32cea-b7d6-4080-9976-95e30562bef7 tempest-VolumesSnapshotTestJSON-925980516 tempest-VolumesSnapshotTestJSON-925980516-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:38:58.082887 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-54a32cea-b7d6-4080-9976-95e30562bef7 tempest-VolumesSnapshotTestJSON-925980516 tempest-VolumesSnapshotTestJSON-925980516-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:38:58.212932 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.policy [None req-54a32cea-b7d6-4080-9976-95e30562bef7 tempest-VolumesSnapshotTestJSON-925980516 tempest-VolumesSnapshotTestJSON-925980516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4ffcca165af40abbd93569e7f01acbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ca6934bc24846ad82474c4ef7ba6323', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116157) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:38:58.221122 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: INFO nova.api.openstack.requestlog [None req-54a32cea-b7d6-4080-9976-95e30562bef7 tempest-VolumesSnapshotTestJSON-925980516 tempest-VolumesSnapshotTestJSON-925980516-project] 10.222.0.18 "GET /compute/v2.1/servers/a0097d88-6613-416a-9f4d-1bb285e53291" status: 200 len: 1560 microversion: 2.1 time: 0.150407 Dec 15 03:38:58.221685 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: [pid: 116157|app: 0|req: 1018/2050] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 03:38:58 2021] GET /compute/v2.1/servers/a0097d88-6613-416a-9f4d-1bb285e53291 => generated 1560 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 03:38:59.237846 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi [None req-4c687793-9923-4a20-bc7c-251b30ee5073 tempest-VolumesSnapshotTestJSON-925980516 tempest-VolumesSnapshotTestJSON-925980516-project] Calling method '>' {{(pid=116156) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:38:59.238536 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.compute.api [None req-4c687793-9923-4a20-bc7c-251b30ee5073 tempest-VolumesSnapshotTestJSON-925980516 tempest-VolumesSnapshotTestJSON-925980516-project] [instance: a0097d88-6613-416a-9f4d-1bb285e53291] Fetching instance by UUID {{(pid=116156) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:38:59.245248 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-4c687793-9923-4a20-bc7c-251b30ee5073 tempest-VolumesSnapshotTestJSON-925980516 tempest-VolumesSnapshotTestJSON-925980516-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:38:59.245702 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-4c687793-9923-4a20-bc7c-251b30ee5073 tempest-VolumesSnapshotTestJSON-925980516 tempest-VolumesSnapshotTestJSON-925980516-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:38:59.246511 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-4c687793-9923-4a20-bc7c-251b30ee5073 tempest-VolumesSnapshotTestJSON-925980516 tempest-VolumesSnapshotTestJSON-925980516-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:38:59.246952 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-4c687793-9923-4a20-bc7c-251b30ee5073 tempest-VolumesSnapshotTestJSON-925980516 tempest-VolumesSnapshotTestJSON-925980516-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:38:59.376297 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.policy [None req-4c687793-9923-4a20-bc7c-251b30ee5073 tempest-VolumesSnapshotTestJSON-925980516 tempest-VolumesSnapshotTestJSON-925980516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4ffcca165af40abbd93569e7f01acbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ca6934bc24846ad82474c4ef7ba6323', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116156) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:38:59.384531 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: INFO nova.api.openstack.requestlog [None req-4c687793-9923-4a20-bc7c-251b30ee5073 tempest-VolumesSnapshotTestJSON-925980516 tempest-VolumesSnapshotTestJSON-925980516-project] 10.222.0.18 "GET /compute/v2.1/servers/a0097d88-6613-416a-9f4d-1bb285e53291" status: 200 len: 1560 microversion: 2.1 time: 0.150310 Dec 15 03:38:59.385091 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: [pid: 116156|app: 0|req: 1033/2051] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 03:38:59 2021] GET /compute/v2.1/servers/a0097d88-6613-416a-9f4d-1bb285e53291 => generated 1560 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 03:39:00.401097 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi [None req-ae4bee9c-7806-41eb-81a4-15c6cfbe8ee4 tempest-VolumesSnapshotTestJSON-925980516 tempest-VolumesSnapshotTestJSON-925980516-project] Calling method '>' {{(pid=116157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:39:00.401705 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.compute.api [None req-ae4bee9c-7806-41eb-81a4-15c6cfbe8ee4 tempest-VolumesSnapshotTestJSON-925980516 tempest-VolumesSnapshotTestJSON-925980516-project] [instance: a0097d88-6613-416a-9f4d-1bb285e53291] Fetching instance by UUID {{(pid=116157) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:39:00.407475 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-ae4bee9c-7806-41eb-81a4-15c6cfbe8ee4 tempest-VolumesSnapshotTestJSON-925980516 tempest-VolumesSnapshotTestJSON-925980516-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:39:00.407955 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-ae4bee9c-7806-41eb-81a4-15c6cfbe8ee4 tempest-VolumesSnapshotTestJSON-925980516 tempest-VolumesSnapshotTestJSON-925980516-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:39:00.408762 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-ae4bee9c-7806-41eb-81a4-15c6cfbe8ee4 tempest-VolumesSnapshotTestJSON-925980516 tempest-VolumesSnapshotTestJSON-925980516-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:39:00.409201 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-ae4bee9c-7806-41eb-81a4-15c6cfbe8ee4 tempest-VolumesSnapshotTestJSON-925980516 tempest-VolumesSnapshotTestJSON-925980516-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:39:00.535035 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.policy [None req-ae4bee9c-7806-41eb-81a4-15c6cfbe8ee4 tempest-VolumesSnapshotTestJSON-925980516 tempest-VolumesSnapshotTestJSON-925980516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4ffcca165af40abbd93569e7f01acbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ca6934bc24846ad82474c4ef7ba6323', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116157) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:39:00.542738 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: INFO nova.api.openstack.requestlog [None req-ae4bee9c-7806-41eb-81a4-15c6cfbe8ee4 tempest-VolumesSnapshotTestJSON-925980516 tempest-VolumesSnapshotTestJSON-925980516-project] 10.222.0.18 "GET /compute/v2.1/servers/a0097d88-6613-416a-9f4d-1bb285e53291" status: 200 len: 1560 microversion: 2.1 time: 0.145430 Dec 15 03:39:00.543304 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: [pid: 116157|app: 0|req: 1019/2052] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 03:39:00 2021] GET /compute/v2.1/servers/a0097d88-6613-416a-9f4d-1bb285e53291 => generated 1560 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 03:39:01.559541 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi [None req-a4c7c3bc-943a-4cfe-9c93-c358b8b9fedc tempest-VolumesSnapshotTestJSON-925980516 tempest-VolumesSnapshotTestJSON-925980516-project] Calling method '>' {{(pid=116156) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:39:01.560203 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.compute.api [None req-a4c7c3bc-943a-4cfe-9c93-c358b8b9fedc tempest-VolumesSnapshotTestJSON-925980516 tempest-VolumesSnapshotTestJSON-925980516-project] [instance: a0097d88-6613-416a-9f4d-1bb285e53291] Fetching instance by UUID {{(pid=116156) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:39:01.566774 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-a4c7c3bc-943a-4cfe-9c93-c358b8b9fedc tempest-VolumesSnapshotTestJSON-925980516 tempest-VolumesSnapshotTestJSON-925980516-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:39:01.567245 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-a4c7c3bc-943a-4cfe-9c93-c358b8b9fedc tempest-VolumesSnapshotTestJSON-925980516 tempest-VolumesSnapshotTestJSON-925980516-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:39:01.568012 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-a4c7c3bc-943a-4cfe-9c93-c358b8b9fedc tempest-VolumesSnapshotTestJSON-925980516 tempest-VolumesSnapshotTestJSON-925980516-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:39:01.568446 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-a4c7c3bc-943a-4cfe-9c93-c358b8b9fedc tempest-VolumesSnapshotTestJSON-925980516 tempest-VolumesSnapshotTestJSON-925980516-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:39:01.694547 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.policy [None req-a4c7c3bc-943a-4cfe-9c93-c358b8b9fedc tempest-VolumesSnapshotTestJSON-925980516 tempest-VolumesSnapshotTestJSON-925980516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4ffcca165af40abbd93569e7f01acbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ca6934bc24846ad82474c4ef7ba6323', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116156) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:39:01.702206 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: INFO nova.api.openstack.requestlog [None req-a4c7c3bc-943a-4cfe-9c93-c358b8b9fedc tempest-VolumesSnapshotTestJSON-925980516 tempest-VolumesSnapshotTestJSON-925980516-project] 10.222.0.18 "GET /compute/v2.1/servers/a0097d88-6613-416a-9f4d-1bb285e53291" status: 200 len: 1560 microversion: 2.1 time: 0.146465 Dec 15 03:39:01.702770 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: [pid: 116156|app: 0|req: 1034/2053] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 03:39:01 2021] GET /compute/v2.1/servers/a0097d88-6613-416a-9f4d-1bb285e53291 => generated 1560 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 03:39:02.719802 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi [None req-e2d28292-98f8-45b3-ac20-0ad12908b5aa tempest-VolumesSnapshotTestJSON-925980516 tempest-VolumesSnapshotTestJSON-925980516-project] Calling method '>' {{(pid=116157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:39:02.720411 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.compute.api [None req-e2d28292-98f8-45b3-ac20-0ad12908b5aa tempest-VolumesSnapshotTestJSON-925980516 tempest-VolumesSnapshotTestJSON-925980516-project] [instance: a0097d88-6613-416a-9f4d-1bb285e53291] Fetching instance by UUID {{(pid=116157) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:39:02.726678 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-e2d28292-98f8-45b3-ac20-0ad12908b5aa tempest-VolumesSnapshotTestJSON-925980516 tempest-VolumesSnapshotTestJSON-925980516-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:39:02.727180 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-e2d28292-98f8-45b3-ac20-0ad12908b5aa tempest-VolumesSnapshotTestJSON-925980516 tempest-VolumesSnapshotTestJSON-925980516-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:39:02.727961 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-e2d28292-98f8-45b3-ac20-0ad12908b5aa tempest-VolumesSnapshotTestJSON-925980516 tempest-VolumesSnapshotTestJSON-925980516-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:39:02.728399 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-e2d28292-98f8-45b3-ac20-0ad12908b5aa tempest-VolumesSnapshotTestJSON-925980516 tempest-VolumesSnapshotTestJSON-925980516-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:39:02.854273 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.policy [None req-e2d28292-98f8-45b3-ac20-0ad12908b5aa tempest-VolumesSnapshotTestJSON-925980516 tempest-VolumesSnapshotTestJSON-925980516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4ffcca165af40abbd93569e7f01acbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ca6934bc24846ad82474c4ef7ba6323', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116157) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:39:02.861838 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: INFO nova.api.openstack.requestlog [None req-e2d28292-98f8-45b3-ac20-0ad12908b5aa tempest-VolumesSnapshotTestJSON-925980516 tempest-VolumesSnapshotTestJSON-925980516-project] 10.222.0.18 "GET /compute/v2.1/servers/a0097d88-6613-416a-9f4d-1bb285e53291" status: 200 len: 1560 microversion: 2.1 time: 0.145940 Dec 15 03:39:02.862437 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: [pid: 116157|app: 0|req: 1020/2054] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 03:39:02 2021] GET /compute/v2.1/servers/a0097d88-6613-416a-9f4d-1bb285e53291 => generated 1560 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 03:39:03.879496 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi [None req-6d6e56ca-6590-4b2d-b080-d1d447f53234 tempest-VolumesSnapshotTestJSON-925980516 tempest-VolumesSnapshotTestJSON-925980516-project] Calling method '>' {{(pid=116156) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:39:03.880099 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.compute.api [None req-6d6e56ca-6590-4b2d-b080-d1d447f53234 tempest-VolumesSnapshotTestJSON-925980516 tempest-VolumesSnapshotTestJSON-925980516-project] [instance: a0097d88-6613-416a-9f4d-1bb285e53291] Fetching instance by UUID {{(pid=116156) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:39:03.886914 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-6d6e56ca-6590-4b2d-b080-d1d447f53234 tempest-VolumesSnapshotTestJSON-925980516 tempest-VolumesSnapshotTestJSON-925980516-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:39:03.887360 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-6d6e56ca-6590-4b2d-b080-d1d447f53234 tempest-VolumesSnapshotTestJSON-925980516 tempest-VolumesSnapshotTestJSON-925980516-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:39:03.888126 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-6d6e56ca-6590-4b2d-b080-d1d447f53234 tempest-VolumesSnapshotTestJSON-925980516 tempest-VolumesSnapshotTestJSON-925980516-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:39:03.888556 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-6d6e56ca-6590-4b2d-b080-d1d447f53234 tempest-VolumesSnapshotTestJSON-925980516 tempest-VolumesSnapshotTestJSON-925980516-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:39:04.018452 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.policy [None req-6d6e56ca-6590-4b2d-b080-d1d447f53234 tempest-VolumesSnapshotTestJSON-925980516 tempest-VolumesSnapshotTestJSON-925980516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4ffcca165af40abbd93569e7f01acbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ca6934bc24846ad82474c4ef7ba6323', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116156) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:39:04.026719 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: INFO nova.api.openstack.requestlog [None req-6d6e56ca-6590-4b2d-b080-d1d447f53234 tempest-VolumesSnapshotTestJSON-925980516 tempest-VolumesSnapshotTestJSON-925980516-project] 10.222.0.18 "GET /compute/v2.1/servers/a0097d88-6613-416a-9f4d-1bb285e53291" status: 200 len: 1560 microversion: 2.1 time: 0.151108 Dec 15 03:39:04.027286 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: [pid: 116156|app: 0|req: 1035/2055] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 03:39:03 2021] GET /compute/v2.1/servers/a0097d88-6613-416a-9f4d-1bb285e53291 => generated 1560 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 03:39:05.044079 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi [None req-5dea5585-6774-4f8e-ae10-bde53fbc8122 tempest-VolumesSnapshotTestJSON-925980516 tempest-VolumesSnapshotTestJSON-925980516-project] Calling method '>' {{(pid=116157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:39:05.044695 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.compute.api [None req-5dea5585-6774-4f8e-ae10-bde53fbc8122 tempest-VolumesSnapshotTestJSON-925980516 tempest-VolumesSnapshotTestJSON-925980516-project] [instance: a0097d88-6613-416a-9f4d-1bb285e53291] Fetching instance by UUID {{(pid=116157) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:39:05.050990 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-5dea5585-6774-4f8e-ae10-bde53fbc8122 tempest-VolumesSnapshotTestJSON-925980516 tempest-VolumesSnapshotTestJSON-925980516-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:39:05.051448 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-5dea5585-6774-4f8e-ae10-bde53fbc8122 tempest-VolumesSnapshotTestJSON-925980516 tempest-VolumesSnapshotTestJSON-925980516-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:39:05.052237 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-5dea5585-6774-4f8e-ae10-bde53fbc8122 tempest-VolumesSnapshotTestJSON-925980516 tempest-VolumesSnapshotTestJSON-925980516-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:39:05.052689 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-5dea5585-6774-4f8e-ae10-bde53fbc8122 tempest-VolumesSnapshotTestJSON-925980516 tempest-VolumesSnapshotTestJSON-925980516-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:39:05.181663 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.policy [None req-5dea5585-6774-4f8e-ae10-bde53fbc8122 tempest-VolumesSnapshotTestJSON-925980516 tempest-VolumesSnapshotTestJSON-925980516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4ffcca165af40abbd93569e7f01acbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ca6934bc24846ad82474c4ef7ba6323', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116157) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:39:05.189918 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: INFO nova.api.openstack.requestlog [None req-5dea5585-6774-4f8e-ae10-bde53fbc8122 tempest-VolumesSnapshotTestJSON-925980516 tempest-VolumesSnapshotTestJSON-925980516-project] 10.222.0.18 "GET /compute/v2.1/servers/a0097d88-6613-416a-9f4d-1bb285e53291" status: 200 len: 1560 microversion: 2.1 time: 0.149486 Dec 15 03:39:05.190534 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: [pid: 116157|app: 0|req: 1021/2056] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 03:39:05 2021] GET /compute/v2.1/servers/a0097d88-6613-416a-9f4d-1bb285e53291 => generated 1560 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 03:39:06.206714 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi [None req-b5cd938d-899f-4b86-9f0b-617cafa8f8a4 tempest-VolumesSnapshotTestJSON-925980516 tempest-VolumesSnapshotTestJSON-925980516-project] Calling method '>' {{(pid=116156) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:39:06.207322 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.compute.api [None req-b5cd938d-899f-4b86-9f0b-617cafa8f8a4 tempest-VolumesSnapshotTestJSON-925980516 tempest-VolumesSnapshotTestJSON-925980516-project] [instance: a0097d88-6613-416a-9f4d-1bb285e53291] Fetching instance by UUID {{(pid=116156) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:39:06.213626 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-b5cd938d-899f-4b86-9f0b-617cafa8f8a4 tempest-VolumesSnapshotTestJSON-925980516 tempest-VolumesSnapshotTestJSON-925980516-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:39:06.214119 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-b5cd938d-899f-4b86-9f0b-617cafa8f8a4 tempest-VolumesSnapshotTestJSON-925980516 tempest-VolumesSnapshotTestJSON-925980516-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:39:06.214896 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-b5cd938d-899f-4b86-9f0b-617cafa8f8a4 tempest-VolumesSnapshotTestJSON-925980516 tempest-VolumesSnapshotTestJSON-925980516-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:39:06.215331 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-b5cd938d-899f-4b86-9f0b-617cafa8f8a4 tempest-VolumesSnapshotTestJSON-925980516 tempest-VolumesSnapshotTestJSON-925980516-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:39:06.340057 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.policy [None req-b5cd938d-899f-4b86-9f0b-617cafa8f8a4 tempest-VolumesSnapshotTestJSON-925980516 tempest-VolumesSnapshotTestJSON-925980516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4ffcca165af40abbd93569e7f01acbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ca6934bc24846ad82474c4ef7ba6323', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116156) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:39:06.347854 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: INFO nova.api.openstack.requestlog [None req-b5cd938d-899f-4b86-9f0b-617cafa8f8a4 tempest-VolumesSnapshotTestJSON-925980516 tempest-VolumesSnapshotTestJSON-925980516-project] 10.222.0.18 "GET /compute/v2.1/servers/a0097d88-6613-416a-9f4d-1bb285e53291" status: 200 len: 1560 microversion: 2.1 time: 0.144784 Dec 15 03:39:06.348422 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: [pid: 116156|app: 0|req: 1036/2057] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 03:39:06 2021] GET /compute/v2.1/servers/a0097d88-6613-416a-9f4d-1bb285e53291 => generated 1560 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 03:39:07.365011 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi [None req-c5da33ef-7f11-4c8f-a429-a84cd4ac266f tempest-VolumesSnapshotTestJSON-925980516 tempest-VolumesSnapshotTestJSON-925980516-project] Calling method '>' {{(pid=116157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:39:07.365632 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.compute.api [None req-c5da33ef-7f11-4c8f-a429-a84cd4ac266f tempest-VolumesSnapshotTestJSON-925980516 tempest-VolumesSnapshotTestJSON-925980516-project] [instance: a0097d88-6613-416a-9f4d-1bb285e53291] Fetching instance by UUID {{(pid=116157) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:39:07.372579 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-c5da33ef-7f11-4c8f-a429-a84cd4ac266f tempest-VolumesSnapshotTestJSON-925980516 tempest-VolumesSnapshotTestJSON-925980516-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:39:07.373034 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-c5da33ef-7f11-4c8f-a429-a84cd4ac266f tempest-VolumesSnapshotTestJSON-925980516 tempest-VolumesSnapshotTestJSON-925980516-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:39:07.373822 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-c5da33ef-7f11-4c8f-a429-a84cd4ac266f tempest-VolumesSnapshotTestJSON-925980516 tempest-VolumesSnapshotTestJSON-925980516-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:39:07.374301 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-c5da33ef-7f11-4c8f-a429-a84cd4ac266f tempest-VolumesSnapshotTestJSON-925980516 tempest-VolumesSnapshotTestJSON-925980516-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:39:07.498436 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.policy [None req-c5da33ef-7f11-4c8f-a429-a84cd4ac266f tempest-VolumesSnapshotTestJSON-925980516 tempest-VolumesSnapshotTestJSON-925980516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4ffcca165af40abbd93569e7f01acbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ca6934bc24846ad82474c4ef7ba6323', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116157) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:39:07.506095 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: INFO nova.api.openstack.requestlog [None req-c5da33ef-7f11-4c8f-a429-a84cd4ac266f tempest-VolumesSnapshotTestJSON-925980516 tempest-VolumesSnapshotTestJSON-925980516-project] 10.222.0.18 "GET /compute/v2.1/servers/a0097d88-6613-416a-9f4d-1bb285e53291" status: 200 len: 1560 microversion: 2.1 time: 0.144679 Dec 15 03:39:07.507278 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: [pid: 116157|app: 0|req: 1022/2058] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 03:39:07 2021] GET /compute/v2.1/servers/a0097d88-6613-416a-9f4d-1bb285e53291 => generated 1560 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 03:39:08.524064 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi [None req-3573aacb-fda9-409b-8031-3f3e93a67e93 tempest-VolumesSnapshotTestJSON-925980516 tempest-VolumesSnapshotTestJSON-925980516-project] Calling method '>' {{(pid=116156) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:39:08.524672 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.compute.api [None req-3573aacb-fda9-409b-8031-3f3e93a67e93 tempest-VolumesSnapshotTestJSON-925980516 tempest-VolumesSnapshotTestJSON-925980516-project] [instance: a0097d88-6613-416a-9f4d-1bb285e53291] Fetching instance by UUID {{(pid=116156) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:39:08.530903 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-3573aacb-fda9-409b-8031-3f3e93a67e93 tempest-VolumesSnapshotTestJSON-925980516 tempest-VolumesSnapshotTestJSON-925980516-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:39:08.531355 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-3573aacb-fda9-409b-8031-3f3e93a67e93 tempest-VolumesSnapshotTestJSON-925980516 tempest-VolumesSnapshotTestJSON-925980516-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:39:08.532158 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-3573aacb-fda9-409b-8031-3f3e93a67e93 tempest-VolumesSnapshotTestJSON-925980516 tempest-VolumesSnapshotTestJSON-925980516-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:39:08.532594 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-3573aacb-fda9-409b-8031-3f3e93a67e93 tempest-VolumesSnapshotTestJSON-925980516 tempest-VolumesSnapshotTestJSON-925980516-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:39:08.663792 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.policy [None req-3573aacb-fda9-409b-8031-3f3e93a67e93 tempest-VolumesSnapshotTestJSON-925980516 tempest-VolumesSnapshotTestJSON-925980516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4ffcca165af40abbd93569e7f01acbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ca6934bc24846ad82474c4ef7ba6323', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116156) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:39:08.671643 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: INFO nova.api.openstack.requestlog [None req-3573aacb-fda9-409b-8031-3f3e93a67e93 tempest-VolumesSnapshotTestJSON-925980516 tempest-VolumesSnapshotTestJSON-925980516-project] 10.222.0.18 "GET /compute/v2.1/servers/a0097d88-6613-416a-9f4d-1bb285e53291" status: 200 len: 1560 microversion: 2.1 time: 0.151794 Dec 15 03:39:08.672217 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: [pid: 116156|app: 0|req: 1037/2059] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 03:39:08 2021] GET /compute/v2.1/servers/a0097d88-6613-416a-9f4d-1bb285e53291 => generated 1560 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 03:39:09.737470 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi [None req-54a87c50-597c-4872-ad69-22b42d12e347 tempest-VolumesSnapshotTestJSON-925980516 tempest-VolumesSnapshotTestJSON-925980516-project] Calling method '>' {{(pid=116157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:39:09.738140 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.compute.api [None req-54a87c50-597c-4872-ad69-22b42d12e347 tempest-VolumesSnapshotTestJSON-925980516 tempest-VolumesSnapshotTestJSON-925980516-project] [instance: a0097d88-6613-416a-9f4d-1bb285e53291] Fetching instance by UUID {{(pid=116157) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:39:09.744873 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-54a87c50-597c-4872-ad69-22b42d12e347 tempest-VolumesSnapshotTestJSON-925980516 tempest-VolumesSnapshotTestJSON-925980516-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:39:09.745328 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-54a87c50-597c-4872-ad69-22b42d12e347 tempest-VolumesSnapshotTestJSON-925980516 tempest-VolumesSnapshotTestJSON-925980516-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:39:09.746146 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-54a87c50-597c-4872-ad69-22b42d12e347 tempest-VolumesSnapshotTestJSON-925980516 tempest-VolumesSnapshotTestJSON-925980516-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:39:09.746584 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-54a87c50-597c-4872-ad69-22b42d12e347 tempest-VolumesSnapshotTestJSON-925980516 tempest-VolumesSnapshotTestJSON-925980516-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:39:09.877061 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.policy [None req-54a87c50-597c-4872-ad69-22b42d12e347 tempest-VolumesSnapshotTestJSON-925980516 tempest-VolumesSnapshotTestJSON-925980516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4ffcca165af40abbd93569e7f01acbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ca6934bc24846ad82474c4ef7ba6323', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116157) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:39:09.884960 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: INFO nova.api.openstack.requestlog [None req-54a87c50-597c-4872-ad69-22b42d12e347 tempest-VolumesSnapshotTestJSON-925980516 tempest-VolumesSnapshotTestJSON-925980516-project] 10.222.0.18 "GET /compute/v2.1/servers/a0097d88-6613-416a-9f4d-1bb285e53291" status: 200 len: 1560 microversion: 2.1 time: 0.151247 Dec 15 03:39:09.885521 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: [pid: 116157|app: 0|req: 1023/2060] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 03:39:09 2021] GET /compute/v2.1/servers/a0097d88-6613-416a-9f4d-1bb285e53291 => generated 1560 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 03:39:10.902755 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi [None req-f0132e0e-1c9a-4d39-b14e-49aa377872a2 tempest-VolumesSnapshotTestJSON-925980516 tempest-VolumesSnapshotTestJSON-925980516-project] Calling method '>' {{(pid=116156) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:39:10.903406 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.compute.api [None req-f0132e0e-1c9a-4d39-b14e-49aa377872a2 tempest-VolumesSnapshotTestJSON-925980516 tempest-VolumesSnapshotTestJSON-925980516-project] [instance: a0097d88-6613-416a-9f4d-1bb285e53291] Fetching instance by UUID {{(pid=116156) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:39:10.909277 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-f0132e0e-1c9a-4d39-b14e-49aa377872a2 tempest-VolumesSnapshotTestJSON-925980516 tempest-VolumesSnapshotTestJSON-925980516-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:39:10.909732 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-f0132e0e-1c9a-4d39-b14e-49aa377872a2 tempest-VolumesSnapshotTestJSON-925980516 tempest-VolumesSnapshotTestJSON-925980516-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:39:10.910533 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-f0132e0e-1c9a-4d39-b14e-49aa377872a2 tempest-VolumesSnapshotTestJSON-925980516 tempest-VolumesSnapshotTestJSON-925980516-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:39:10.910976 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-f0132e0e-1c9a-4d39-b14e-49aa377872a2 tempest-VolumesSnapshotTestJSON-925980516 tempest-VolumesSnapshotTestJSON-925980516-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:39:11.036822 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.policy [None req-f0132e0e-1c9a-4d39-b14e-49aa377872a2 tempest-VolumesSnapshotTestJSON-925980516 tempest-VolumesSnapshotTestJSON-925980516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4ffcca165af40abbd93569e7f01acbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ca6934bc24846ad82474c4ef7ba6323', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116156) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:39:11.044461 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: INFO nova.api.openstack.requestlog [None req-f0132e0e-1c9a-4d39-b14e-49aa377872a2 tempest-VolumesSnapshotTestJSON-925980516 tempest-VolumesSnapshotTestJSON-925980516-project] 10.222.0.18 "GET /compute/v2.1/servers/a0097d88-6613-416a-9f4d-1bb285e53291" status: 200 len: 1560 microversion: 2.1 time: 0.145517 Dec 15 03:39:11.045042 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: [pid: 116156|app: 0|req: 1038/2061] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 03:39:10 2021] GET /compute/v2.1/servers/a0097d88-6613-416a-9f4d-1bb285e53291 => generated 1560 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 03:39:12.061793 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi [None req-e50bdb57-108f-4ba0-9aa2-34e2cf560ef4 tempest-VolumesSnapshotTestJSON-925980516 tempest-VolumesSnapshotTestJSON-925980516-project] Calling method '>' {{(pid=116157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:39:12.062426 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.compute.api [None req-e50bdb57-108f-4ba0-9aa2-34e2cf560ef4 tempest-VolumesSnapshotTestJSON-925980516 tempest-VolumesSnapshotTestJSON-925980516-project] [instance: a0097d88-6613-416a-9f4d-1bb285e53291] Fetching instance by UUID {{(pid=116157) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:39:12.070970 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-e50bdb57-108f-4ba0-9aa2-34e2cf560ef4 tempest-VolumesSnapshotTestJSON-925980516 tempest-VolumesSnapshotTestJSON-925980516-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:39:12.071419 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-e50bdb57-108f-4ba0-9aa2-34e2cf560ef4 tempest-VolumesSnapshotTestJSON-925980516 tempest-VolumesSnapshotTestJSON-925980516-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:39:12.072198 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-e50bdb57-108f-4ba0-9aa2-34e2cf560ef4 tempest-VolumesSnapshotTestJSON-925980516 tempest-VolumesSnapshotTestJSON-925980516-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:39:12.072629 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-e50bdb57-108f-4ba0-9aa2-34e2cf560ef4 tempest-VolumesSnapshotTestJSON-925980516 tempest-VolumesSnapshotTestJSON-925980516-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:39:12.199507 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.policy [None req-e50bdb57-108f-4ba0-9aa2-34e2cf560ef4 tempest-VolumesSnapshotTestJSON-925980516 tempest-VolumesSnapshotTestJSON-925980516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4ffcca165af40abbd93569e7f01acbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ca6934bc24846ad82474c4ef7ba6323', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116157) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:39:12.207291 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: INFO nova.api.openstack.requestlog [None req-e50bdb57-108f-4ba0-9aa2-34e2cf560ef4 tempest-VolumesSnapshotTestJSON-925980516 tempest-VolumesSnapshotTestJSON-925980516-project] 10.222.0.18 "GET /compute/v2.1/servers/a0097d88-6613-416a-9f4d-1bb285e53291" status: 200 len: 1560 microversion: 2.1 time: 0.149185 Dec 15 03:39:12.208102 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: [pid: 116157|app: 0|req: 1024/2062] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 03:39:12 2021] GET /compute/v2.1/servers/a0097d88-6613-416a-9f4d-1bb285e53291 => generated 1560 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 03:39:13.224438 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi [None req-f6da52e5-4933-4e1a-bdcb-02d2e0b9869e tempest-VolumesSnapshotTestJSON-925980516 tempest-VolumesSnapshotTestJSON-925980516-project] Calling method '>' {{(pid=116156) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:39:13.225060 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.compute.api [None req-f6da52e5-4933-4e1a-bdcb-02d2e0b9869e tempest-VolumesSnapshotTestJSON-925980516 tempest-VolumesSnapshotTestJSON-925980516-project] [instance: a0097d88-6613-416a-9f4d-1bb285e53291] Fetching instance by UUID {{(pid=116156) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:39:13.231349 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-f6da52e5-4933-4e1a-bdcb-02d2e0b9869e tempest-VolumesSnapshotTestJSON-925980516 tempest-VolumesSnapshotTestJSON-925980516-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:39:13.231801 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-f6da52e5-4933-4e1a-bdcb-02d2e0b9869e tempest-VolumesSnapshotTestJSON-925980516 tempest-VolumesSnapshotTestJSON-925980516-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:39:13.232609 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-f6da52e5-4933-4e1a-bdcb-02d2e0b9869e tempest-VolumesSnapshotTestJSON-925980516 tempest-VolumesSnapshotTestJSON-925980516-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:39:13.233049 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-f6da52e5-4933-4e1a-bdcb-02d2e0b9869e tempest-VolumesSnapshotTestJSON-925980516 tempest-VolumesSnapshotTestJSON-925980516-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:39:13.365176 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.policy [None req-f6da52e5-4933-4e1a-bdcb-02d2e0b9869e tempest-VolumesSnapshotTestJSON-925980516 tempest-VolumesSnapshotTestJSON-925980516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4ffcca165af40abbd93569e7f01acbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ca6934bc24846ad82474c4ef7ba6323', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116156) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:39:13.373496 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: INFO nova.api.openstack.requestlog [None req-f6da52e5-4933-4e1a-bdcb-02d2e0b9869e tempest-VolumesSnapshotTestJSON-925980516 tempest-VolumesSnapshotTestJSON-925980516-project] 10.222.0.18 "GET /compute/v2.1/servers/a0097d88-6613-416a-9f4d-1bb285e53291" status: 200 len: 1560 microversion: 2.1 time: 0.152764 Dec 15 03:39:13.374082 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: [pid: 116156|app: 0|req: 1039/2063] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 03:39:13 2021] GET /compute/v2.1/servers/a0097d88-6613-416a-9f4d-1bb285e53291 => generated 1560 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 03:39:14.391264 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi [None req-836340f5-f7c1-4a7f-98f5-6cc3450b69af tempest-VolumesSnapshotTestJSON-925980516 tempest-VolumesSnapshotTestJSON-925980516-project] Calling method '>' {{(pid=116157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:39:14.391874 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.compute.api [None req-836340f5-f7c1-4a7f-98f5-6cc3450b69af tempest-VolumesSnapshotTestJSON-925980516 tempest-VolumesSnapshotTestJSON-925980516-project] [instance: a0097d88-6613-416a-9f4d-1bb285e53291] Fetching instance by UUID {{(pid=116157) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:39:14.398771 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-836340f5-f7c1-4a7f-98f5-6cc3450b69af tempest-VolumesSnapshotTestJSON-925980516 tempest-VolumesSnapshotTestJSON-925980516-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:39:14.399217 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-836340f5-f7c1-4a7f-98f5-6cc3450b69af tempest-VolumesSnapshotTestJSON-925980516 tempest-VolumesSnapshotTestJSON-925980516-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:39:14.399991 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-836340f5-f7c1-4a7f-98f5-6cc3450b69af tempest-VolumesSnapshotTestJSON-925980516 tempest-VolumesSnapshotTestJSON-925980516-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:39:14.400424 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-836340f5-f7c1-4a7f-98f5-6cc3450b69af tempest-VolumesSnapshotTestJSON-925980516 tempest-VolumesSnapshotTestJSON-925980516-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:39:14.527526 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.policy [None req-836340f5-f7c1-4a7f-98f5-6cc3450b69af tempest-VolumesSnapshotTestJSON-925980516 tempest-VolumesSnapshotTestJSON-925980516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4ffcca165af40abbd93569e7f01acbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ca6934bc24846ad82474c4ef7ba6323', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116157) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:39:14.535980 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: INFO nova.api.openstack.requestlog [None req-836340f5-f7c1-4a7f-98f5-6cc3450b69af tempest-VolumesSnapshotTestJSON-925980516 tempest-VolumesSnapshotTestJSON-925980516-project] 10.222.0.18 "GET /compute/v2.1/servers/a0097d88-6613-416a-9f4d-1bb285e53291" status: 200 len: 1514 microversion: 2.1 time: 0.148314 Dec 15 03:39:14.536544 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: [pid: 116157|app: 0|req: 1025/2064] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 03:39:14 2021] GET /compute/v2.1/servers/a0097d88-6613-416a-9f4d-1bb285e53291 => generated 1514 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 03:39:15.159875 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi [req-79bac4c9-29f1-461c-8ecc-76a9ca2cd264 req-3096a351-b2fe-4533-8b4f-261c08b4fac6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a0097d88-6613-416a-9f4d-1bb285e53291", "name": "network-vif-deleted", "tag": "69742a90-77de-4208-bba3-942fff47bc87"}]} {{(pid=116156) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 03:39:15.161745 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 15 03:39:15.161745 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: warnings.warn(msg) Dec 15 03:39:15.169506 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [req-79bac4c9-29f1-461c-8ecc-76a9ca2cd264 req-3096a351-b2fe-4533-8b4f-261c08b4fac6 service nova] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:39:15.169930 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [req-79bac4c9-29f1-461c-8ecc-76a9ca2cd264 req-3096a351-b2fe-4533-8b4f-261c08b4fac6 service nova] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:39:15.181807 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: INFO nova.api.openstack.compute.server_external_events [req-79bac4c9-29f1-461c-8ecc-76a9ca2cd264 req-3096a351-b2fe-4533-8b4f-261c08b4fac6 service nova] Creating event network-vif-deleted:69742a90-77de-4208-bba3-942fff47bc87 for instance a0097d88-6613-416a-9f4d-1bb285e53291 on hv-cinder-81803 Dec 15 03:39:15.188624 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: INFO nova.api.openstack.requestlog [req-79bac4c9-29f1-461c-8ecc-76a9ca2cd264 req-3096a351-b2fe-4533-8b4f-261c08b4fac6 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032994 Dec 15 03:39:15.189211 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: [pid: 116156|app: 0|req: 1040/2065] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Dec 15 03:39:15 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 03:39:15.552883 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi [None req-557f5205-0fff-4eda-a07c-9861c8a37023 tempest-VolumesSnapshotTestJSON-925980516 tempest-VolumesSnapshotTestJSON-925980516-project] Calling method '>' {{(pid=116157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:39:15.553523 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.compute.api [None req-557f5205-0fff-4eda-a07c-9861c8a37023 tempest-VolumesSnapshotTestJSON-925980516 tempest-VolumesSnapshotTestJSON-925980516-project] [instance: a0097d88-6613-416a-9f4d-1bb285e53291] Fetching instance by UUID {{(pid=116157) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:39:15.559876 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-557f5205-0fff-4eda-a07c-9861c8a37023 tempest-VolumesSnapshotTestJSON-925980516 tempest-VolumesSnapshotTestJSON-925980516-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:39:15.560317 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-557f5205-0fff-4eda-a07c-9861c8a37023 tempest-VolumesSnapshotTestJSON-925980516 tempest-VolumesSnapshotTestJSON-925980516-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:39:15.561070 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-557f5205-0fff-4eda-a07c-9861c8a37023 tempest-VolumesSnapshotTestJSON-925980516 tempest-VolumesSnapshotTestJSON-925980516-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:39:15.561507 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-557f5205-0fff-4eda-a07c-9861c8a37023 tempest-VolumesSnapshotTestJSON-925980516 tempest-VolumesSnapshotTestJSON-925980516-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:39:15.591072 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-557f5205-0fff-4eda-a07c-9861c8a37023 tempest-VolumesSnapshotTestJSON-925980516 tempest-VolumesSnapshotTestJSON-925980516-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:39:15.591519 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-557f5205-0fff-4eda-a07c-9861c8a37023 tempest-VolumesSnapshotTestJSON-925980516 tempest-VolumesSnapshotTestJSON-925980516-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:39:15.592227 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.objects.instance [None req-557f5205-0fff-4eda-a07c-9861c8a37023 tempest-VolumesSnapshotTestJSON-925980516 tempest-VolumesSnapshotTestJSON-925980516-project] Lazy-loading 'fault' on Instance uuid a0097d88-6613-416a-9f4d-1bb285e53291 {{(pid=116157) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Dec 15 03:39:15.635327 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.policy [None req-557f5205-0fff-4eda-a07c-9861c8a37023 tempest-VolumesSnapshotTestJSON-925980516 tempest-VolumesSnapshotTestJSON-925980516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4ffcca165af40abbd93569e7f01acbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ca6934bc24846ad82474c4ef7ba6323', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116157) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:39:15.642601 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: INFO nova.api.openstack.requestlog [None req-557f5205-0fff-4eda-a07c-9861c8a37023 tempest-VolumesSnapshotTestJSON-925980516 tempest-VolumesSnapshotTestJSON-925980516-project] 10.222.0.18 "GET /compute/v2.1/servers/a0097d88-6613-416a-9f4d-1bb285e53291" status: 200 len: 1309 microversion: 2.1 time: 0.093369 Dec 15 03:39:15.643150 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: [pid: 116157|app: 0|req: 1026/2066] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 03:39:15 2021] GET /compute/v2.1/servers/a0097d88-6613-416a-9f4d-1bb285e53291 => generated 1309 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 03:39:16.660868 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi [None req-67731b1e-c272-46ff-bb78-6dd461f22cda tempest-VolumesSnapshotTestJSON-925980516 tempest-VolumesSnapshotTestJSON-925980516-project] Calling method '>' {{(pid=116156) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:39:16.661560 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.compute.api [None req-67731b1e-c272-46ff-bb78-6dd461f22cda tempest-VolumesSnapshotTestJSON-925980516 tempest-VolumesSnapshotTestJSON-925980516-project] [instance: a0097d88-6613-416a-9f4d-1bb285e53291] Fetching instance by UUID {{(pid=116156) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:39:16.668121 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-67731b1e-c272-46ff-bb78-6dd461f22cda tempest-VolumesSnapshotTestJSON-925980516 tempest-VolumesSnapshotTestJSON-925980516-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:39:16.668602 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-67731b1e-c272-46ff-bb78-6dd461f22cda tempest-VolumesSnapshotTestJSON-925980516 tempest-VolumesSnapshotTestJSON-925980516-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:39:16.669363 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-67731b1e-c272-46ff-bb78-6dd461f22cda tempest-VolumesSnapshotTestJSON-925980516 tempest-VolumesSnapshotTestJSON-925980516-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:39:16.669794 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-67731b1e-c272-46ff-bb78-6dd461f22cda tempest-VolumesSnapshotTestJSON-925980516 tempest-VolumesSnapshotTestJSON-925980516-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:39:16.682959 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: INFO nova.api.openstack.wsgi [None req-67731b1e-c272-46ff-bb78-6dd461f22cda tempest-VolumesSnapshotTestJSON-925980516 tempest-VolumesSnapshotTestJSON-925980516-project] HTTP exception thrown: Instance a0097d88-6613-416a-9f4d-1bb285e53291 could not be found. Dec 15 03:39:16.683523 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi [None req-67731b1e-c272-46ff-bb78-6dd461f22cda tempest-VolumesSnapshotTestJSON-925980516 tempest-VolumesSnapshotTestJSON-925980516-project] Returning 404 to user: Instance a0097d88-6613-416a-9f4d-1bb285e53291 could not be found. {{(pid=116156) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 15 03:39:16.684320 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: INFO nova.api.openstack.requestlog [None req-67731b1e-c272-46ff-bb78-6dd461f22cda tempest-VolumesSnapshotTestJSON-925980516 tempest-VolumesSnapshotTestJSON-925980516-project] 10.222.0.18 "GET /compute/v2.1/servers/a0097d88-6613-416a-9f4d-1bb285e53291" status: 404 len: 111 microversion: 2.1 time: 0.027893 Dec 15 03:39:16.684829 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: [pid: 116156|app: 0|req: 1041/2067] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 03:39:16 2021] GET /compute/v2.1/servers/a0097d88-6613-416a-9f4d-1bb285e53291 => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 15 03:39:26.478672 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi [None req-a3483d5d-11d0-46c5-8b61-db37e3958f6a tempest-VolumesSnapshotTestJSON-925980516 tempest-VolumesSnapshotTestJSON-925980516-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-1349791614", "imageRef": "5195b034-9fa4-468b-a94d-ef3ee79ce449", "flavorRef": "452", "networks": [{"uuid": "66454919-290c-416c-960a-e924b340094c"}]}} {{(pid=116157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 03:39:26.529181 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.network.neutron [None req-a3483d5d-11d0-46c5-8b61-db37e3958f6a tempest-VolumesSnapshotTestJSON-925980516 tempest-VolumesSnapshotTestJSON-925980516-project] validate_networks() for [('66454919-290c-416c-960a-e924b340094c', None, None, None, None, None)] {{(pid=116157) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Dec 15 03:39:26.897032 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.virt.hardware [None req-a3483d5d-11d0-46c5-8b61-db37e3958f6a tempest-VolumesSnapshotTestJSON-925980516 tempest-VolumesSnapshotTestJSON-925980516-project] Flavor limits 0:0:0 {{(pid=116157) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Dec 15 03:39:26.897477 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.virt.hardware [None req-a3483d5d-11d0-46c5-8b61-db37e3958f6a tempest-VolumesSnapshotTestJSON-925980516 tempest-VolumesSnapshotTestJSON-925980516-project] Image limits 0:0:0 {{(pid=116157) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Dec 15 03:39:26.897952 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.virt.hardware [None req-a3483d5d-11d0-46c5-8b61-db37e3958f6a tempest-VolumesSnapshotTestJSON-925980516 tempest-VolumesSnapshotTestJSON-925980516-project] Flavor pref 0:0:0 {{(pid=116157) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Dec 15 03:39:26.898393 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.virt.hardware [None req-a3483d5d-11d0-46c5-8b61-db37e3958f6a tempest-VolumesSnapshotTestJSON-925980516 tempest-VolumesSnapshotTestJSON-925980516-project] Image pref 0:0:0 {{(pid=116157) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Dec 15 03:39:26.898860 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.virt.hardware [None req-a3483d5d-11d0-46c5-8b61-db37e3958f6a tempest-VolumesSnapshotTestJSON-925980516 tempest-VolumesSnapshotTestJSON-925980516-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116157) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Dec 15 03:39:26.908151 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-a3483d5d-11d0-46c5-8b61-db37e3958f6a tempest-VolumesSnapshotTestJSON-925980516 tempest-VolumesSnapshotTestJSON-925980516-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:39:26.908604 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-a3483d5d-11d0-46c5-8b61-db37e3958f6a tempest-VolumesSnapshotTestJSON-925980516 tempest-VolumesSnapshotTestJSON-925980516-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:39:26.909500 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-a3483d5d-11d0-46c5-8b61-db37e3958f6a tempest-VolumesSnapshotTestJSON-925980516 tempest-VolumesSnapshotTestJSON-925980516-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:39:26.909943 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-a3483d5d-11d0-46c5-8b61-db37e3958f6a tempest-VolumesSnapshotTestJSON-925980516 tempest-VolumesSnapshotTestJSON-925980516-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:39:26.926294 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.quota [None req-a3483d5d-11d0-46c5-8b61-db37e3958f6a tempest-VolumesSnapshotTestJSON-925980516 tempest-VolumesSnapshotTestJSON-925980516-project] Getting quotas for project 9ca6934bc24846ad82474c4ef7ba6323. Resources: {'cores', 'instances', 'ram'} {{(pid=116157) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 15 03:39:26.930324 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.quota [None req-a3483d5d-11d0-46c5-8b61-db37e3958f6a tempest-VolumesSnapshotTestJSON-925980516 tempest-VolumesSnapshotTestJSON-925980516-project] Getting quotas for user e4ffcca165af40abbd93569e7f01acbe and project 9ca6934bc24846ad82474c4ef7ba6323. Resources: {'cores', 'instances', 'ram'} {{(pid=116157) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 15 03:39:26.940802 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.compute.api [None req-a3483d5d-11d0-46c5-8b61-db37e3958f6a tempest-VolumesSnapshotTestJSON-925980516 tempest-VolumesSnapshotTestJSON-925980516-project] Going to run 1 instances... {{(pid=116157) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Dec 15 03:39:26.943133 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.compute.api [None req-a3483d5d-11d0-46c5-8b61-db37e3958f6a tempest-VolumesSnapshotTestJSON-925980516 tempest-VolumesSnapshotTestJSON-925980516-project] [instance: e2e24120-a05c-45eb-b35e-920d2e87bb41] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='5195b034-9fa4-468b-a94d-ef3ee79ce449',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=116157) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Dec 15 03:39:26.987740 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: INFO nova.api.openstack.requestlog [None req-a3483d5d-11d0-46c5-8b61-db37e3958f6a tempest-VolumesSnapshotTestJSON-925980516 tempest-VolumesSnapshotTestJSON-925980516-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.513100 Dec 15 03:39:26.988384 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: [pid: 116157|app: 0|req: 1027/2068] 10.222.0.18 () {60 vars in 1146 bytes} [Wed Dec 15 03:39:26 2021] POST /compute/v2.1/servers => generated 380 bytes in 514 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Dec 15 03:39:26.998065 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi [None req-b0039def-bc3e-42a3-a198-6cff38a9d209 tempest-VolumesSnapshotTestJSON-925980516 tempest-VolumesSnapshotTestJSON-925980516-project] Calling method '>' {{(pid=116156) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:39:26.998673 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.compute.api [None req-b0039def-bc3e-42a3-a198-6cff38a9d209 tempest-VolumesSnapshotTestJSON-925980516 tempest-VolumesSnapshotTestJSON-925980516-project] [instance: e2e24120-a05c-45eb-b35e-920d2e87bb41] Fetching instance by UUID {{(pid=116156) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:39:27.057948 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.policy [None req-b0039def-bc3e-42a3-a198-6cff38a9d209 tempest-VolumesSnapshotTestJSON-925980516 tempest-VolumesSnapshotTestJSON-925980516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4ffcca165af40abbd93569e7f01acbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ca6934bc24846ad82474c4ef7ba6323', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116156) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:39:27.064345 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: INFO nova.api.openstack.requestlog [None req-b0039def-bc3e-42a3-a198-6cff38a9d209 tempest-VolumesSnapshotTestJSON-925980516 tempest-VolumesSnapshotTestJSON-925980516-project] 10.222.0.18 "GET /compute/v2.1/servers/e2e24120-a05c-45eb-b35e-920d2e87bb41" status: 200 len: 1219 microversion: 2.1 time: 0.069804 Dec 15 03:39:27.065123 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: [pid: 116156|app: 0|req: 1042/2069] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 03:39:26 2021] GET /compute/v2.1/servers/e2e24120-a05c-45eb-b35e-920d2e87bb41 => generated 1219 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 03:39:28.081433 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi [None req-a6b9d450-b2a5-45b3-b5b0-420afcc564bb tempest-VolumesSnapshotTestJSON-925980516 tempest-VolumesSnapshotTestJSON-925980516-project] Calling method '>' {{(pid=116157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:39:28.082263 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.compute.api [None req-a6b9d450-b2a5-45b3-b5b0-420afcc564bb tempest-VolumesSnapshotTestJSON-925980516 tempest-VolumesSnapshotTestJSON-925980516-project] [instance: e2e24120-a05c-45eb-b35e-920d2e87bb41] Fetching instance by UUID {{(pid=116157) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:39:28.088673 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-a6b9d450-b2a5-45b3-b5b0-420afcc564bb tempest-VolumesSnapshotTestJSON-925980516 tempest-VolumesSnapshotTestJSON-925980516-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:39:28.089132 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-a6b9d450-b2a5-45b3-b5b0-420afcc564bb tempest-VolumesSnapshotTestJSON-925980516 tempest-VolumesSnapshotTestJSON-925980516-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:39:28.090101 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-a6b9d450-b2a5-45b3-b5b0-420afcc564bb tempest-VolumesSnapshotTestJSON-925980516 tempest-VolumesSnapshotTestJSON-925980516-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:39:28.090671 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-a6b9d450-b2a5-45b3-b5b0-420afcc564bb tempest-VolumesSnapshotTestJSON-925980516 tempest-VolumesSnapshotTestJSON-925980516-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:39:28.158071 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.policy [None req-a6b9d450-b2a5-45b3-b5b0-420afcc564bb tempest-VolumesSnapshotTestJSON-925980516 tempest-VolumesSnapshotTestJSON-925980516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4ffcca165af40abbd93569e7f01acbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ca6934bc24846ad82474c4ef7ba6323', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116157) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:39:28.165895 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: INFO nova.api.openstack.requestlog [None req-a6b9d450-b2a5-45b3-b5b0-420afcc564bb tempest-VolumesSnapshotTestJSON-925980516 tempest-VolumesSnapshotTestJSON-925980516-project] 10.222.0.18 "GET /compute/v2.1/servers/e2e24120-a05c-45eb-b35e-920d2e87bb41" status: 200 len: 1277 microversion: 2.1 time: 0.088892 Dec 15 03:39:28.175301 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: [pid: 116157|app: 0|req: 1028/2070] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 03:39:28 2021] GET /compute/v2.1/servers/e2e24120-a05c-45eb-b35e-920d2e87bb41 => generated 1277 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 03:39:29.183019 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi [None req-e2d34c5a-ebc5-4644-9bef-811809c704ac tempest-VolumesSnapshotTestJSON-925980516 tempest-VolumesSnapshotTestJSON-925980516-project] Calling method '>' {{(pid=116156) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:39:29.183628 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.compute.api [None req-e2d34c5a-ebc5-4644-9bef-811809c704ac tempest-VolumesSnapshotTestJSON-925980516 tempest-VolumesSnapshotTestJSON-925980516-project] [instance: e2e24120-a05c-45eb-b35e-920d2e87bb41] Fetching instance by UUID {{(pid=116156) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:39:29.190425 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-e2d34c5a-ebc5-4644-9bef-811809c704ac tempest-VolumesSnapshotTestJSON-925980516 tempest-VolumesSnapshotTestJSON-925980516-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:39:29.190884 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-e2d34c5a-ebc5-4644-9bef-811809c704ac tempest-VolumesSnapshotTestJSON-925980516 tempest-VolumesSnapshotTestJSON-925980516-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:39:29.191665 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-e2d34c5a-ebc5-4644-9bef-811809c704ac tempest-VolumesSnapshotTestJSON-925980516 tempest-VolumesSnapshotTestJSON-925980516-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:39:29.192099 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-e2d34c5a-ebc5-4644-9bef-811809c704ac tempest-VolumesSnapshotTestJSON-925980516 tempest-VolumesSnapshotTestJSON-925980516-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:39:29.225890 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi [req-ae4550f6-10cd-491b-96af-ec100c3d1e1a req-d0c5859b-a0e4-4b0a-a364-4c0f8164a47c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e2e24120-a05c-45eb-b35e-920d2e87bb41", "tag": "b67dff62-560b-403e-8a16-3a3186e4da7b"}]} {{(pid=116157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 03:39:29.228548 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 15 03:39:29.228548 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: warnings.warn(msg) Dec 15 03:39:29.236725 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [req-ae4550f6-10cd-491b-96af-ec100c3d1e1a req-d0c5859b-a0e4-4b0a-a364-4c0f8164a47c service nova] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:39:29.237170 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [req-ae4550f6-10cd-491b-96af-ec100c3d1e1a req-d0c5859b-a0e4-4b0a-a364-4c0f8164a47c service nova] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:39:29.248616 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: INFO nova.api.openstack.compute.server_external_events [req-ae4550f6-10cd-491b-96af-ec100c3d1e1a req-d0c5859b-a0e4-4b0a-a364-4c0f8164a47c service nova] Creating event network-changed:b67dff62-560b-403e-8a16-3a3186e4da7b for instance e2e24120-a05c-45eb-b35e-920d2e87bb41 on hv-cinder-81803 Dec 15 03:39:29.253758 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: INFO nova.api.openstack.requestlog [req-ae4550f6-10cd-491b-96af-ec100c3d1e1a req-d0c5859b-a0e4-4b0a-a364-4c0f8164a47c service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031313 Dec 15 03:39:29.254370 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: [pid: 116157|app: 0|req: 1029/2071] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Dec 15 03:39:29 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 03:39:29.408393 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.policy [None req-e2d34c5a-ebc5-4644-9bef-811809c704ac tempest-VolumesSnapshotTestJSON-925980516 tempest-VolumesSnapshotTestJSON-925980516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4ffcca165af40abbd93569e7f01acbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ca6934bc24846ad82474c4ef7ba6323', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116156) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:39:29.416322 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: INFO nova.api.openstack.requestlog [None req-e2d34c5a-ebc5-4644-9bef-811809c704ac tempest-VolumesSnapshotTestJSON-925980516 tempest-VolumesSnapshotTestJSON-925980516-project] 10.222.0.18 "GET /compute/v2.1/servers/e2e24120-a05c-45eb-b35e-920d2e87bb41" status: 200 len: 1319 microversion: 2.1 time: 0.236888 Dec 15 03:39:29.417175 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: [pid: 116156|app: 0|req: 1043/2072] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 03:39:29 2021] GET /compute/v2.1/servers/e2e24120-a05c-45eb-b35e-920d2e87bb41 => generated 1319 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 03:39:30.433844 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi [None req-07046047-b9f7-4284-85a3-7385ae4d22ce tempest-VolumesSnapshotTestJSON-925980516 tempest-VolumesSnapshotTestJSON-925980516-project] Calling method '>' {{(pid=116157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:39:30.434573 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.compute.api [None req-07046047-b9f7-4284-85a3-7385ae4d22ce tempest-VolumesSnapshotTestJSON-925980516 tempest-VolumesSnapshotTestJSON-925980516-project] [instance: e2e24120-a05c-45eb-b35e-920d2e87bb41] Fetching instance by UUID {{(pid=116157) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:39:30.440593 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-07046047-b9f7-4284-85a3-7385ae4d22ce tempest-VolumesSnapshotTestJSON-925980516 tempest-VolumesSnapshotTestJSON-925980516-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:39:30.441045 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-07046047-b9f7-4284-85a3-7385ae4d22ce tempest-VolumesSnapshotTestJSON-925980516 tempest-VolumesSnapshotTestJSON-925980516-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:39:30.441822 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-07046047-b9f7-4284-85a3-7385ae4d22ce tempest-VolumesSnapshotTestJSON-925980516 tempest-VolumesSnapshotTestJSON-925980516-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:39:30.442286 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-07046047-b9f7-4284-85a3-7385ae4d22ce tempest-VolumesSnapshotTestJSON-925980516 tempest-VolumesSnapshotTestJSON-925980516-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:39:30.573600 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.policy [None req-07046047-b9f7-4284-85a3-7385ae4d22ce tempest-VolumesSnapshotTestJSON-925980516 tempest-VolumesSnapshotTestJSON-925980516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4ffcca165af40abbd93569e7f01acbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ca6934bc24846ad82474c4ef7ba6323', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116157) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:39:30.580706 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: INFO nova.api.openstack.requestlog [None req-07046047-b9f7-4284-85a3-7385ae4d22ce tempest-VolumesSnapshotTestJSON-925980516 tempest-VolumesSnapshotTestJSON-925980516-project] 10.222.0.18 "GET /compute/v2.1/servers/e2e24120-a05c-45eb-b35e-920d2e87bb41" status: 200 len: 1319 microversion: 2.1 time: 0.151363 Dec 15 03:39:30.581270 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: [pid: 116157|app: 0|req: 1030/2073] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 03:39:30 2021] GET /compute/v2.1/servers/e2e24120-a05c-45eb-b35e-920d2e87bb41 => generated 1319 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 03:39:31.596328 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi [None req-da27b3ac-f25a-45bd-a876-21e90ac7ac2b tempest-VolumesSnapshotTestJSON-925980516 tempest-VolumesSnapshotTestJSON-925980516-project] Calling method '>' {{(pid=116156) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:39:31.596936 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.compute.api [None req-da27b3ac-f25a-45bd-a876-21e90ac7ac2b tempest-VolumesSnapshotTestJSON-925980516 tempest-VolumesSnapshotTestJSON-925980516-project] [instance: e2e24120-a05c-45eb-b35e-920d2e87bb41] Fetching instance by UUID {{(pid=116156) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:39:31.603771 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-da27b3ac-f25a-45bd-a876-21e90ac7ac2b tempest-VolumesSnapshotTestJSON-925980516 tempest-VolumesSnapshotTestJSON-925980516-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:39:31.604224 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-da27b3ac-f25a-45bd-a876-21e90ac7ac2b tempest-VolumesSnapshotTestJSON-925980516 tempest-VolumesSnapshotTestJSON-925980516-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:39:31.604997 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-da27b3ac-f25a-45bd-a876-21e90ac7ac2b tempest-VolumesSnapshotTestJSON-925980516 tempest-VolumesSnapshotTestJSON-925980516-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:39:31.605430 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-da27b3ac-f25a-45bd-a876-21e90ac7ac2b tempest-VolumesSnapshotTestJSON-925980516 tempest-VolumesSnapshotTestJSON-925980516-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:39:31.733119 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.policy [None req-da27b3ac-f25a-45bd-a876-21e90ac7ac2b tempest-VolumesSnapshotTestJSON-925980516 tempest-VolumesSnapshotTestJSON-925980516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4ffcca165af40abbd93569e7f01acbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ca6934bc24846ad82474c4ef7ba6323', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116156) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:39:31.740364 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: INFO nova.api.openstack.requestlog [None req-da27b3ac-f25a-45bd-a876-21e90ac7ac2b tempest-VolumesSnapshotTestJSON-925980516 tempest-VolumesSnapshotTestJSON-925980516-project] 10.222.0.18 "GET /compute/v2.1/servers/e2e24120-a05c-45eb-b35e-920d2e87bb41" status: 200 len: 1319 microversion: 2.1 time: 0.147539 Dec 15 03:39:31.740927 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: [pid: 116156|app: 0|req: 1044/2074] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 03:39:31 2021] GET /compute/v2.1/servers/e2e24120-a05c-45eb-b35e-920d2e87bb41 => generated 1319 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 03:39:32.756388 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi [None req-261001df-77fc-478c-a1a3-fd9b291f6dea tempest-VolumesSnapshotTestJSON-925980516 tempest-VolumesSnapshotTestJSON-925980516-project] Calling method '>' {{(pid=116157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:39:32.757029 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.compute.api [None req-261001df-77fc-478c-a1a3-fd9b291f6dea tempest-VolumesSnapshotTestJSON-925980516 tempest-VolumesSnapshotTestJSON-925980516-project] [instance: e2e24120-a05c-45eb-b35e-920d2e87bb41] Fetching instance by UUID {{(pid=116157) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:39:32.763500 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-261001df-77fc-478c-a1a3-fd9b291f6dea tempest-VolumesSnapshotTestJSON-925980516 tempest-VolumesSnapshotTestJSON-925980516-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:39:32.763944 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-261001df-77fc-478c-a1a3-fd9b291f6dea tempest-VolumesSnapshotTestJSON-925980516 tempest-VolumesSnapshotTestJSON-925980516-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:39:32.764713 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-261001df-77fc-478c-a1a3-fd9b291f6dea tempest-VolumesSnapshotTestJSON-925980516 tempest-VolumesSnapshotTestJSON-925980516-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:39:32.765145 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-261001df-77fc-478c-a1a3-fd9b291f6dea tempest-VolumesSnapshotTestJSON-925980516 tempest-VolumesSnapshotTestJSON-925980516-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:39:32.889068 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.policy [None req-261001df-77fc-478c-a1a3-fd9b291f6dea tempest-VolumesSnapshotTestJSON-925980516 tempest-VolumesSnapshotTestJSON-925980516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4ffcca165af40abbd93569e7f01acbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ca6934bc24846ad82474c4ef7ba6323', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116157) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:39:32.896092 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: INFO nova.api.openstack.requestlog [None req-261001df-77fc-478c-a1a3-fd9b291f6dea tempest-VolumesSnapshotTestJSON-925980516 tempest-VolumesSnapshotTestJSON-925980516-project] 10.222.0.18 "GET /compute/v2.1/servers/e2e24120-a05c-45eb-b35e-920d2e87bb41" status: 200 len: 1319 microversion: 2.1 time: 0.143501 Dec 15 03:39:32.897174 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: [pid: 116157|app: 0|req: 1031/2075] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 03:39:32 2021] GET /compute/v2.1/servers/e2e24120-a05c-45eb-b35e-920d2e87bb41 => generated 1319 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 03:39:33.913484 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi [None req-b20be193-e060-437e-8ddd-e7b2a1813050 tempest-VolumesSnapshotTestJSON-925980516 tempest-VolumesSnapshotTestJSON-925980516-project] Calling method '>' {{(pid=116156) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:39:33.914121 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.compute.api [None req-b20be193-e060-437e-8ddd-e7b2a1813050 tempest-VolumesSnapshotTestJSON-925980516 tempest-VolumesSnapshotTestJSON-925980516-project] [instance: e2e24120-a05c-45eb-b35e-920d2e87bb41] Fetching instance by UUID {{(pid=116156) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:39:33.926430 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-b20be193-e060-437e-8ddd-e7b2a1813050 tempest-VolumesSnapshotTestJSON-925980516 tempest-VolumesSnapshotTestJSON-925980516-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:39:33.926884 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-b20be193-e060-437e-8ddd-e7b2a1813050 tempest-VolumesSnapshotTestJSON-925980516 tempest-VolumesSnapshotTestJSON-925980516-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:39:33.927663 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-b20be193-e060-437e-8ddd-e7b2a1813050 tempest-VolumesSnapshotTestJSON-925980516 tempest-VolumesSnapshotTestJSON-925980516-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:39:33.928099 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-b20be193-e060-437e-8ddd-e7b2a1813050 tempest-VolumesSnapshotTestJSON-925980516 tempest-VolumesSnapshotTestJSON-925980516-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:39:34.060803 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.policy [None req-b20be193-e060-437e-8ddd-e7b2a1813050 tempest-VolumesSnapshotTestJSON-925980516 tempest-VolumesSnapshotTestJSON-925980516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4ffcca165af40abbd93569e7f01acbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ca6934bc24846ad82474c4ef7ba6323', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116156) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:39:34.068022 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: INFO nova.api.openstack.requestlog [None req-b20be193-e060-437e-8ddd-e7b2a1813050 tempest-VolumesSnapshotTestJSON-925980516 tempest-VolumesSnapshotTestJSON-925980516-project] 10.222.0.18 "GET /compute/v2.1/servers/e2e24120-a05c-45eb-b35e-920d2e87bb41" status: 200 len: 1319 microversion: 2.1 time: 0.158152 Dec 15 03:39:34.069080 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: [pid: 116156|app: 0|req: 1045/2076] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 03:39:33 2021] GET /compute/v2.1/servers/e2e24120-a05c-45eb-b35e-920d2e87bb41 => generated 1319 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 03:39:35.084957 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi [None req-0734fad1-ad5a-47af-93c8-d9688d5224a0 tempest-VolumesSnapshotTestJSON-925980516 tempest-VolumesSnapshotTestJSON-925980516-project] Calling method '>' {{(pid=116157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:39:35.085604 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.compute.api [None req-0734fad1-ad5a-47af-93c8-d9688d5224a0 tempest-VolumesSnapshotTestJSON-925980516 tempest-VolumesSnapshotTestJSON-925980516-project] [instance: e2e24120-a05c-45eb-b35e-920d2e87bb41] Fetching instance by UUID {{(pid=116157) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:39:35.092008 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-0734fad1-ad5a-47af-93c8-d9688d5224a0 tempest-VolumesSnapshotTestJSON-925980516 tempest-VolumesSnapshotTestJSON-925980516-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:39:35.092462 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-0734fad1-ad5a-47af-93c8-d9688d5224a0 tempest-VolumesSnapshotTestJSON-925980516 tempest-VolumesSnapshotTestJSON-925980516-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:39:35.093244 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-0734fad1-ad5a-47af-93c8-d9688d5224a0 tempest-VolumesSnapshotTestJSON-925980516 tempest-VolumesSnapshotTestJSON-925980516-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:39:35.093672 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-0734fad1-ad5a-47af-93c8-d9688d5224a0 tempest-VolumesSnapshotTestJSON-925980516 tempest-VolumesSnapshotTestJSON-925980516-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:39:35.233350 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.policy [None req-0734fad1-ad5a-47af-93c8-d9688d5224a0 tempest-VolumesSnapshotTestJSON-925980516 tempest-VolumesSnapshotTestJSON-925980516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4ffcca165af40abbd93569e7f01acbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ca6934bc24846ad82474c4ef7ba6323', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116157) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:39:35.241775 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: INFO nova.api.openstack.requestlog [None req-0734fad1-ad5a-47af-93c8-d9688d5224a0 tempest-VolumesSnapshotTestJSON-925980516 tempest-VolumesSnapshotTestJSON-925980516-project] 10.222.0.18 "GET /compute/v2.1/servers/e2e24120-a05c-45eb-b35e-920d2e87bb41" status: 200 len: 1319 microversion: 2.1 time: 0.160951 Dec 15 03:39:35.243037 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: [pid: 116157|app: 0|req: 1032/2077] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 03:39:35 2021] GET /compute/v2.1/servers/e2e24120-a05c-45eb-b35e-920d2e87bb41 => generated 1319 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 03:39:35.322368 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi [req-a5209de5-29f8-4917-aa67-4ea5d98aaedd req-d9baa9b8-23af-40bf-9708-21f6651ff84a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e2e24120-a05c-45eb-b35e-920d2e87bb41", "name": "network-vif-plugged", "status": "completed", "tag": "b67dff62-560b-403e-8a16-3a3186e4da7b"}]} {{(pid=116156) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 03:39:35.323959 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 15 03:39:35.323959 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: warnings.warn(msg) Dec 15 03:39:35.330560 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [req-a5209de5-29f8-4917-aa67-4ea5d98aaedd req-d9baa9b8-23af-40bf-9708-21f6651ff84a service nova] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:39:35.331007 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [req-a5209de5-29f8-4917-aa67-4ea5d98aaedd req-d9baa9b8-23af-40bf-9708-21f6651ff84a service nova] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:39:35.342148 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: INFO nova.api.openstack.compute.server_external_events [req-a5209de5-29f8-4917-aa67-4ea5d98aaedd req-d9baa9b8-23af-40bf-9708-21f6651ff84a service nova] Creating event network-vif-plugged:b67dff62-560b-403e-8a16-3a3186e4da7b for instance e2e24120-a05c-45eb-b35e-920d2e87bb41 on hv-cinder-81803 Dec 15 03:39:35.347063 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: INFO nova.api.openstack.requestlog [req-a5209de5-29f8-4917-aa67-4ea5d98aaedd req-d9baa9b8-23af-40bf-9708-21f6651ff84a service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.125427 Dec 15 03:39:35.347617 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: [pid: 116156|app: 0|req: 1046/2078] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Dec 15 03:39:35 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 15 03:39:36.258661 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi [None req-f1c7402b-416f-48d0-890a-3c3aa47b3afb tempest-VolumesSnapshotTestJSON-925980516 tempest-VolumesSnapshotTestJSON-925980516-project] Calling method '>' {{(pid=116157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:39:36.259277 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.compute.api [None req-f1c7402b-416f-48d0-890a-3c3aa47b3afb tempest-VolumesSnapshotTestJSON-925980516 tempest-VolumesSnapshotTestJSON-925980516-project] [instance: e2e24120-a05c-45eb-b35e-920d2e87bb41] Fetching instance by UUID {{(pid=116157) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:39:36.265558 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-f1c7402b-416f-48d0-890a-3c3aa47b3afb tempest-VolumesSnapshotTestJSON-925980516 tempest-VolumesSnapshotTestJSON-925980516-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:39:36.266037 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-f1c7402b-416f-48d0-890a-3c3aa47b3afb tempest-VolumesSnapshotTestJSON-925980516 tempest-VolumesSnapshotTestJSON-925980516-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:39:36.266818 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-f1c7402b-416f-48d0-890a-3c3aa47b3afb tempest-VolumesSnapshotTestJSON-925980516 tempest-VolumesSnapshotTestJSON-925980516-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:39:36.267258 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-f1c7402b-416f-48d0-890a-3c3aa47b3afb tempest-VolumesSnapshotTestJSON-925980516 tempest-VolumesSnapshotTestJSON-925980516-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:39:36.393440 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.policy [None req-f1c7402b-416f-48d0-890a-3c3aa47b3afb tempest-VolumesSnapshotTestJSON-925980516 tempest-VolumesSnapshotTestJSON-925980516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4ffcca165af40abbd93569e7f01acbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ca6934bc24846ad82474c4ef7ba6323', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116157) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:39:36.400611 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: INFO nova.api.openstack.requestlog [None req-f1c7402b-416f-48d0-890a-3c3aa47b3afb tempest-VolumesSnapshotTestJSON-925980516 tempest-VolumesSnapshotTestJSON-925980516-project] 10.222.0.18 "GET /compute/v2.1/servers/e2e24120-a05c-45eb-b35e-920d2e87bb41" status: 200 len: 1319 microversion: 2.1 time: 0.145624 Dec 15 03:39:36.401171 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: [pid: 116157|app: 0|req: 1033/2079] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 03:39:36 2021] GET /compute/v2.1/servers/e2e24120-a05c-45eb-b35e-920d2e87bb41 => generated 1319 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 03:39:37.418243 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi [None req-bc642773-ce21-4e67-b140-aef1d76ff7fd tempest-VolumesSnapshotTestJSON-925980516 tempest-VolumesSnapshotTestJSON-925980516-project] Calling method '>' {{(pid=116156) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:39:37.418933 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.compute.api [None req-bc642773-ce21-4e67-b140-aef1d76ff7fd tempest-VolumesSnapshotTestJSON-925980516 tempest-VolumesSnapshotTestJSON-925980516-project] [instance: e2e24120-a05c-45eb-b35e-920d2e87bb41] Fetching instance by UUID {{(pid=116156) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:39:37.424866 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-bc642773-ce21-4e67-b140-aef1d76ff7fd tempest-VolumesSnapshotTestJSON-925980516 tempest-VolumesSnapshotTestJSON-925980516-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:39:37.425313 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-bc642773-ce21-4e67-b140-aef1d76ff7fd tempest-VolumesSnapshotTestJSON-925980516 tempest-VolumesSnapshotTestJSON-925980516-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:39:37.426097 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-bc642773-ce21-4e67-b140-aef1d76ff7fd tempest-VolumesSnapshotTestJSON-925980516 tempest-VolumesSnapshotTestJSON-925980516-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:39:37.426526 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-bc642773-ce21-4e67-b140-aef1d76ff7fd tempest-VolumesSnapshotTestJSON-925980516 tempest-VolumesSnapshotTestJSON-925980516-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:39:37.552168 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.policy [None req-bc642773-ce21-4e67-b140-aef1d76ff7fd tempest-VolumesSnapshotTestJSON-925980516 tempest-VolumesSnapshotTestJSON-925980516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4ffcca165af40abbd93569e7f01acbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ca6934bc24846ad82474c4ef7ba6323', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116156) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:39:37.559870 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: INFO nova.api.openstack.requestlog [None req-bc642773-ce21-4e67-b140-aef1d76ff7fd tempest-VolumesSnapshotTestJSON-925980516 tempest-VolumesSnapshotTestJSON-925980516-project] 10.222.0.18 "GET /compute/v2.1/servers/e2e24120-a05c-45eb-b35e-920d2e87bb41" status: 200 len: 1509 microversion: 2.1 time: 0.146106 Dec 15 03:39:37.560444 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: [pid: 116156|app: 0|req: 1047/2080] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 03:39:37 2021] GET /compute/v2.1/servers/e2e24120-a05c-45eb-b35e-920d2e87bb41 => generated 1509 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 03:39:37.576496 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi [None req-0705c948-8119-4f95-b2ca-eb51077ceb86 tempest-VolumesSnapshotTestJSON-925980516 tempest-VolumesSnapshotTestJSON-925980516-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "9399f0da-2812-4d00-b115-d8ced02092ae", "device": "/dev/sdb"}} {{(pid=116157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 03:39:37.578249 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.compute.api [None req-0705c948-8119-4f95-b2ca-eb51077ceb86 tempest-VolumesSnapshotTestJSON-925980516 tempest-VolumesSnapshotTestJSON-925980516-project] [instance: e2e24120-a05c-45eb-b35e-920d2e87bb41] Fetching instance by UUID {{(pid=116157) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:39:37.584356 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-0705c948-8119-4f95-b2ca-eb51077ceb86 tempest-VolumesSnapshotTestJSON-925980516 tempest-VolumesSnapshotTestJSON-925980516-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:39:37.584800 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-0705c948-8119-4f95-b2ca-eb51077ceb86 tempest-VolumesSnapshotTestJSON-925980516 tempest-VolumesSnapshotTestJSON-925980516-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:39:37.585567 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-0705c948-8119-4f95-b2ca-eb51077ceb86 tempest-VolumesSnapshotTestJSON-925980516 tempest-VolumesSnapshotTestJSON-925980516-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:39:37.586021 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-0705c948-8119-4f95-b2ca-eb51077ceb86 tempest-VolumesSnapshotTestJSON-925980516 tempest-VolumesSnapshotTestJSON-925980516-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:39:37.820402 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: INFO nova.api.openstack.requestlog [None req-0705c948-8119-4f95-b2ca-eb51077ceb86 tempest-VolumesSnapshotTestJSON-925980516 tempest-VolumesSnapshotTestJSON-925980516-project] 10.222.0.18 "POST /compute/v2.1/servers/e2e24120-a05c-45eb-b35e-920d2e87bb41/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.247368 Dec 15 03:39:37.821292 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: [pid: 116157|app: 0|req: 1034/2081] 10.222.0.18 () {60 vars in 1322 bytes} [Wed Dec 15 03:39:37 2021] POST /compute/v2.1/servers/e2e24120-a05c-45eb-b35e-920d2e87bb41/os-volume_attachments => generated 194 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 03:39:48.881461 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Dec 15 03:39:48.882072 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: Wed Dec 15 03:39:48 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Dec 15 03:39:57.003807 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi [None req-e1492e55-5038-4375-8f43-c8cdf0620930 tempest-VolumesSnapshotTestJSON-925980516 tempest-VolumesSnapshotTestJSON-925980516-project] Calling method '>' {{(pid=116156) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:39:57.004386 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.compute.api [None req-e1492e55-5038-4375-8f43-c8cdf0620930 tempest-VolumesSnapshotTestJSON-925980516 tempest-VolumesSnapshotTestJSON-925980516-project] [instance: e2e24120-a05c-45eb-b35e-920d2e87bb41] Fetching instance by UUID {{(pid=116156) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:39:57.010643 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-e1492e55-5038-4375-8f43-c8cdf0620930 tempest-VolumesSnapshotTestJSON-925980516 tempest-VolumesSnapshotTestJSON-925980516-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:39:57.011092 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-e1492e55-5038-4375-8f43-c8cdf0620930 tempest-VolumesSnapshotTestJSON-925980516 tempest-VolumesSnapshotTestJSON-925980516-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:39:57.011853 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-e1492e55-5038-4375-8f43-c8cdf0620930 tempest-VolumesSnapshotTestJSON-925980516 tempest-VolumesSnapshotTestJSON-925980516-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:39:57.012283 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-e1492e55-5038-4375-8f43-c8cdf0620930 tempest-VolumesSnapshotTestJSON-925980516 tempest-VolumesSnapshotTestJSON-925980516-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:39:57.086425 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.objects.instance [None req-e1492e55-5038-4375-8f43-c8cdf0620930 tempest-VolumesSnapshotTestJSON-925980516 tempest-VolumesSnapshotTestJSON-925980516-project] Lazy-loading 'services' on Instance uuid e2e24120-a05c-45eb-b35e-920d2e87bb41 {{(pid=116156) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Dec 15 03:39:57.152849 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: INFO nova.api.openstack.requestlog [None req-e1492e55-5038-4375-8f43-c8cdf0620930 tempest-VolumesSnapshotTestJSON-925980516 tempest-VolumesSnapshotTestJSON-925980516-project] 10.222.0.18 "DELETE /compute/v2.1/servers/e2e24120-a05c-45eb-b35e-920d2e87bb41/os-volume_attachments/9399f0da-2812-4d00-b115-d8ced02092ae" status: 202 len: 0 microversion: 2.1 time: 0.152619 Dec 15 03:39:57.153466 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: [pid: 116156|app: 0|req: 1048/2082] 10.222.0.18 () {58 vars in 1415 bytes} [Wed Dec 15 03:39:56 2021] DELETE /compute/v2.1/servers/e2e24120-a05c-45eb-b35e-920d2e87bb41/os-volume_attachments/9399f0da-2812-4d00-b115-d8ced02092ae => generated 0 bytes in 154 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Dec 15 03:39:58.261762 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi [None req-e7a60535-4b4a-4e79-9f51-0aa8ce0b46ab tempest-VolumesSnapshotTestJSON-925980516 tempest-VolumesSnapshotTestJSON-925980516-project] Calling method '>' {{(pid=116157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:39:58.262799 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.compute.api [None req-e7a60535-4b4a-4e79-9f51-0aa8ce0b46ab tempest-VolumesSnapshotTestJSON-925980516 tempest-VolumesSnapshotTestJSON-925980516-project] [instance: e2e24120-a05c-45eb-b35e-920d2e87bb41] Fetching instance by UUID {{(pid=116157) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:39:58.269872 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-e7a60535-4b4a-4e79-9f51-0aa8ce0b46ab tempest-VolumesSnapshotTestJSON-925980516 tempest-VolumesSnapshotTestJSON-925980516-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:39:58.270348 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-e7a60535-4b4a-4e79-9f51-0aa8ce0b46ab tempest-VolumesSnapshotTestJSON-925980516 tempest-VolumesSnapshotTestJSON-925980516-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:39:58.271136 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-e7a60535-4b4a-4e79-9f51-0aa8ce0b46ab tempest-VolumesSnapshotTestJSON-925980516 tempest-VolumesSnapshotTestJSON-925980516-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:39:58.271595 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-e7a60535-4b4a-4e79-9f51-0aa8ce0b46ab tempest-VolumesSnapshotTestJSON-925980516 tempest-VolumesSnapshotTestJSON-925980516-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:39:58.296246 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.compute.api [None req-e7a60535-4b4a-4e79-9f51-0aa8ce0b46ab tempest-VolumesSnapshotTestJSON-925980516 tempest-VolumesSnapshotTestJSON-925980516-project] [instance: e2e24120-a05c-45eb-b35e-920d2e87bb41] Going to try to terminate instance {{(pid=116157) delete /opt/stack/nova/nova/compute/api.py:2614}} Dec 15 03:39:58.371779 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: INFO nova.api.openstack.requestlog [None req-e7a60535-4b4a-4e79-9f51-0aa8ce0b46ab tempest-VolumesSnapshotTestJSON-925980516 tempest-VolumesSnapshotTestJSON-925980516-project] 10.222.0.18 "DELETE /compute/v2.1/servers/e2e24120-a05c-45eb-b35e-920d2e87bb41" status: 204 len: 0 microversion: 2.1 time: 0.114697 Dec 15 03:39:58.372371 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: [pid: 116157|app: 0|req: 1035/2083] 10.222.0.18 () {58 vars in 1238 bytes} [Wed Dec 15 03:39:58 2021] DELETE /compute/v2.1/servers/e2e24120-a05c-45eb-b35e-920d2e87bb41 => generated 0 bytes in 116 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Dec 15 03:39:58.384044 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi [None req-0681895b-c984-4531-be22-51d201d73168 tempest-VolumesSnapshotTestJSON-925980516 tempest-VolumesSnapshotTestJSON-925980516-project] Calling method '>' {{(pid=116156) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:39:58.384752 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.compute.api [None req-0681895b-c984-4531-be22-51d201d73168 tempest-VolumesSnapshotTestJSON-925980516 tempest-VolumesSnapshotTestJSON-925980516-project] [instance: e2e24120-a05c-45eb-b35e-920d2e87bb41] Fetching instance by UUID {{(pid=116156) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:39:58.390825 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-0681895b-c984-4531-be22-51d201d73168 tempest-VolumesSnapshotTestJSON-925980516 tempest-VolumesSnapshotTestJSON-925980516-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:39:58.391278 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-0681895b-c984-4531-be22-51d201d73168 tempest-VolumesSnapshotTestJSON-925980516 tempest-VolumesSnapshotTestJSON-925980516-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:39:58.392062 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-0681895b-c984-4531-be22-51d201d73168 tempest-VolumesSnapshotTestJSON-925980516 tempest-VolumesSnapshotTestJSON-925980516-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:39:58.392502 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-0681895b-c984-4531-be22-51d201d73168 tempest-VolumesSnapshotTestJSON-925980516 tempest-VolumesSnapshotTestJSON-925980516-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:39:58.524497 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.policy [None req-0681895b-c984-4531-be22-51d201d73168 tempest-VolumesSnapshotTestJSON-925980516 tempest-VolumesSnapshotTestJSON-925980516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4ffcca165af40abbd93569e7f01acbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ca6934bc24846ad82474c4ef7ba6323', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116156) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:39:58.531789 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: INFO nova.api.openstack.requestlog [None req-0681895b-c984-4531-be22-51d201d73168 tempest-VolumesSnapshotTestJSON-925980516 tempest-VolumesSnapshotTestJSON-925980516-project] 10.222.0.18 "GET /compute/v2.1/servers/e2e24120-a05c-45eb-b35e-920d2e87bb41" status: 200 len: 1515 microversion: 2.1 time: 0.154149 Dec 15 03:39:58.532359 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: [pid: 116156|app: 0|req: 1049/2084] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 03:39:58 2021] GET /compute/v2.1/servers/e2e24120-a05c-45eb-b35e-920d2e87bb41 => generated 1515 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 03:39:58.571127 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Dec 15 03:39:58.571302 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: Wed Dec 15 03:39:58 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Dec 15 03:39:59.549063 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi [None req-22a7684c-8039-4ff4-875b-005f1ff8d2d6 tempest-VolumesSnapshotTestJSON-925980516 tempest-VolumesSnapshotTestJSON-925980516-project] Calling method '>' {{(pid=116157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:39:59.549769 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.compute.api [None req-22a7684c-8039-4ff4-875b-005f1ff8d2d6 tempest-VolumesSnapshotTestJSON-925980516 tempest-VolumesSnapshotTestJSON-925980516-project] [instance: e2e24120-a05c-45eb-b35e-920d2e87bb41] Fetching instance by UUID {{(pid=116157) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:39:59.556036 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-22a7684c-8039-4ff4-875b-005f1ff8d2d6 tempest-VolumesSnapshotTestJSON-925980516 tempest-VolumesSnapshotTestJSON-925980516-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:39:59.556494 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-22a7684c-8039-4ff4-875b-005f1ff8d2d6 tempest-VolumesSnapshotTestJSON-925980516 tempest-VolumesSnapshotTestJSON-925980516-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:39:59.557269 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-22a7684c-8039-4ff4-875b-005f1ff8d2d6 tempest-VolumesSnapshotTestJSON-925980516 tempest-VolumesSnapshotTestJSON-925980516-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:39:59.557706 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-22a7684c-8039-4ff4-875b-005f1ff8d2d6 tempest-VolumesSnapshotTestJSON-925980516 tempest-VolumesSnapshotTestJSON-925980516-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:39:59.691208 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.policy [None req-22a7684c-8039-4ff4-875b-005f1ff8d2d6 tempest-VolumesSnapshotTestJSON-925980516 tempest-VolumesSnapshotTestJSON-925980516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4ffcca165af40abbd93569e7f01acbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ca6934bc24846ad82474c4ef7ba6323', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116157) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:39:59.698964 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: INFO nova.api.openstack.requestlog [None req-22a7684c-8039-4ff4-875b-005f1ff8d2d6 tempest-VolumesSnapshotTestJSON-925980516 tempest-VolumesSnapshotTestJSON-925980516-project] 10.222.0.18 "GET /compute/v2.1/servers/e2e24120-a05c-45eb-b35e-920d2e87bb41" status: 200 len: 1515 microversion: 2.1 time: 0.153969 Dec 15 03:39:59.699520 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: [pid: 116157|app: 0|req: 1036/2085] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 03:39:59 2021] GET /compute/v2.1/servers/e2e24120-a05c-45eb-b35e-920d2e87bb41 => generated 1515 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 03:40:00.667749 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi [req-b3caf0b8-e6b7-49bb-b6af-a0fa81acbc51 req-6fb36853-2944-4395-8137-e80ec2380291 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e2e24120-a05c-45eb-b35e-920d2e87bb41", "name": "network-vif-deleted", "tag": "b67dff62-560b-403e-8a16-3a3186e4da7b"}]} {{(pid=116156) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 03:40:00.669475 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 15 03:40:00.669475 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: warnings.warn(msg) Dec 15 03:40:00.677232 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [req-b3caf0b8-e6b7-49bb-b6af-a0fa81acbc51 req-6fb36853-2944-4395-8137-e80ec2380291 service nova] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:40:00.677675 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [req-b3caf0b8-e6b7-49bb-b6af-a0fa81acbc51 req-6fb36853-2944-4395-8137-e80ec2380291 service nova] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:40:00.689272 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: INFO nova.api.openstack.compute.server_external_events [req-b3caf0b8-e6b7-49bb-b6af-a0fa81acbc51 req-6fb36853-2944-4395-8137-e80ec2380291 service nova] Creating event network-vif-deleted:b67dff62-560b-403e-8a16-3a3186e4da7b for instance e2e24120-a05c-45eb-b35e-920d2e87bb41 on hv-cinder-81803 Dec 15 03:40:00.694182 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: INFO nova.api.openstack.requestlog [req-b3caf0b8-e6b7-49bb-b6af-a0fa81acbc51 req-6fb36853-2944-4395-8137-e80ec2380291 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030747 Dec 15 03:40:00.695326 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: [pid: 116156|app: 0|req: 1050/2086] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Dec 15 03:40:00 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 15 03:40:00.715578 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi [None req-0f54a938-84b9-4836-a612-5e67e4b99f8b tempest-VolumesSnapshotTestJSON-925980516 tempest-VolumesSnapshotTestJSON-925980516-project] Calling method '>' {{(pid=116157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:40:00.716439 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.compute.api [None req-0f54a938-84b9-4836-a612-5e67e4b99f8b tempest-VolumesSnapshotTestJSON-925980516 tempest-VolumesSnapshotTestJSON-925980516-project] [instance: e2e24120-a05c-45eb-b35e-920d2e87bb41] Fetching instance by UUID {{(pid=116157) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:40:00.723321 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-0f54a938-84b9-4836-a612-5e67e4b99f8b tempest-VolumesSnapshotTestJSON-925980516 tempest-VolumesSnapshotTestJSON-925980516-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:40:00.723991 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-0f54a938-84b9-4836-a612-5e67e4b99f8b tempest-VolumesSnapshotTestJSON-925980516 tempest-VolumesSnapshotTestJSON-925980516-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:40:00.724778 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-0f54a938-84b9-4836-a612-5e67e4b99f8b tempest-VolumesSnapshotTestJSON-925980516 tempest-VolumesSnapshotTestJSON-925980516-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:40:00.725392 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-0f54a938-84b9-4836-a612-5e67e4b99f8b tempest-VolumesSnapshotTestJSON-925980516 tempest-VolumesSnapshotTestJSON-925980516-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:40:00.786225 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.policy [None req-0f54a938-84b9-4836-a612-5e67e4b99f8b tempest-VolumesSnapshotTestJSON-925980516 tempest-VolumesSnapshotTestJSON-925980516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4ffcca165af40abbd93569e7f01acbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ca6934bc24846ad82474c4ef7ba6323', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116157) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:40:00.794195 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: INFO nova.api.openstack.requestlog [None req-0f54a938-84b9-4836-a612-5e67e4b99f8b tempest-VolumesSnapshotTestJSON-925980516 tempest-VolumesSnapshotTestJSON-925980516-project] 10.222.0.18 "GET /compute/v2.1/servers/e2e24120-a05c-45eb-b35e-920d2e87bb41" status: 200 len: 1304 microversion: 2.1 time: 0.082192 Dec 15 03:40:00.794773 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: [pid: 116157|app: 0|req: 1037/2087] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 03:40:00 2021] GET /compute/v2.1/servers/e2e24120-a05c-45eb-b35e-920d2e87bb41 => generated 1304 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 03:40:01.811253 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi [None req-fb235010-ab96-4bd7-8d1d-fb87cfa7e642 tempest-VolumesSnapshotTestJSON-925980516 tempest-VolumesSnapshotTestJSON-925980516-project] Calling method '>' {{(pid=116156) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:40:01.811951 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.compute.api [None req-fb235010-ab96-4bd7-8d1d-fb87cfa7e642 tempest-VolumesSnapshotTestJSON-925980516 tempest-VolumesSnapshotTestJSON-925980516-project] [instance: e2e24120-a05c-45eb-b35e-920d2e87bb41] Fetching instance by UUID {{(pid=116156) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:40:01.817960 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-fb235010-ab96-4bd7-8d1d-fb87cfa7e642 tempest-VolumesSnapshotTestJSON-925980516 tempest-VolumesSnapshotTestJSON-925980516-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:40:01.818431 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-fb235010-ab96-4bd7-8d1d-fb87cfa7e642 tempest-VolumesSnapshotTestJSON-925980516 tempest-VolumesSnapshotTestJSON-925980516-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:40:01.819692 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-fb235010-ab96-4bd7-8d1d-fb87cfa7e642 tempest-VolumesSnapshotTestJSON-925980516 tempest-VolumesSnapshotTestJSON-925980516-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:40:01.820125 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-fb235010-ab96-4bd7-8d1d-fb87cfa7e642 tempest-VolumesSnapshotTestJSON-925980516 tempest-VolumesSnapshotTestJSON-925980516-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:40:01.832642 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: INFO nova.api.openstack.wsgi [None req-fb235010-ab96-4bd7-8d1d-fb87cfa7e642 tempest-VolumesSnapshotTestJSON-925980516 tempest-VolumesSnapshotTestJSON-925980516-project] HTTP exception thrown: Instance e2e24120-a05c-45eb-b35e-920d2e87bb41 could not be found. Dec 15 03:40:01.833212 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi [None req-fb235010-ab96-4bd7-8d1d-fb87cfa7e642 tempest-VolumesSnapshotTestJSON-925980516 tempest-VolumesSnapshotTestJSON-925980516-project] Returning 404 to user: Instance e2e24120-a05c-45eb-b35e-920d2e87bb41 could not be found. {{(pid=116156) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 15 03:40:01.834028 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: INFO nova.api.openstack.requestlog [None req-fb235010-ab96-4bd7-8d1d-fb87cfa7e642 tempest-VolumesSnapshotTestJSON-925980516 tempest-VolumesSnapshotTestJSON-925980516-project] 10.222.0.18 "GET /compute/v2.1/servers/e2e24120-a05c-45eb-b35e-920d2e87bb41" status: 404 len: 111 microversion: 2.1 time: 0.027181 Dec 15 03:40:01.834531 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: [pid: 116156|app: 0|req: 1051/2088] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 03:40:01 2021] GET /compute/v2.1/servers/e2e24120-a05c-45eb-b35e-920d2e87bb41 => generated 111 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 15 03:41:13.318621 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi [None req-6fab616c-d931-40c0-90b7-9d6fb7daa896 tempest-AttachVolumeTestJSON-244989543 tempest-AttachVolumeTestJSON-244989543-project] Calling method '>' {{(pid=116157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:41:13.319158 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.compute.api [None req-6fab616c-d931-40c0-90b7-9d6fb7daa896 tempest-AttachVolumeTestJSON-244989543 tempest-AttachVolumeTestJSON-244989543-project] [instance: f22dfea6-4599-43e4-93d5-d99f1db3b4fb] Fetching instance by UUID {{(pid=116157) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:41:13.324900 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-6fab616c-d931-40c0-90b7-9d6fb7daa896 tempest-AttachVolumeTestJSON-244989543 tempest-AttachVolumeTestJSON-244989543-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:41:13.325332 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-6fab616c-d931-40c0-90b7-9d6fb7daa896 tempest-AttachVolumeTestJSON-244989543 tempest-AttachVolumeTestJSON-244989543-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:41:13.326135 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-6fab616c-d931-40c0-90b7-9d6fb7daa896 tempest-AttachVolumeTestJSON-244989543 tempest-AttachVolumeTestJSON-244989543-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:41:13.326575 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-6fab616c-d931-40c0-90b7-9d6fb7daa896 tempest-AttachVolumeTestJSON-244989543 tempest-AttachVolumeTestJSON-244989543-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:41:13.351211 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.compute.api [None req-6fab616c-d931-40c0-90b7-9d6fb7daa896 tempest-AttachVolumeTestJSON-244989543 tempest-AttachVolumeTestJSON-244989543-project] [instance: f22dfea6-4599-43e4-93d5-d99f1db3b4fb] Going to try to terminate instance {{(pid=116157) delete /opt/stack/nova/nova/compute/api.py:2614}} Dec 15 03:41:13.423448 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: INFO nova.api.openstack.requestlog [None req-6fab616c-d931-40c0-90b7-9d6fb7daa896 tempest-AttachVolumeTestJSON-244989543 tempest-AttachVolumeTestJSON-244989543-project] 10.222.0.18 "DELETE /compute/v2.1/servers/f22dfea6-4599-43e4-93d5-d99f1db3b4fb" status: 204 len: 0 microversion: 2.1 time: 0.109069 Dec 15 03:41:13.424173 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: [pid: 116157|app: 0|req: 1038/2089] 10.222.0.18 () {58 vars in 1238 bytes} [Wed Dec 15 03:41:13 2021] DELETE /compute/v2.1/servers/f22dfea6-4599-43e4-93d5-d99f1db3b4fb => generated 0 bytes in 111 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Dec 15 03:41:13.434186 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi [None req-e5a04be1-a703-43f9-a58f-047f4b10d115 tempest-AttachVolumeTestJSON-244989543 tempest-AttachVolumeTestJSON-244989543-project] Calling method '>' {{(pid=116156) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:41:13.434795 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.compute.api [None req-e5a04be1-a703-43f9-a58f-047f4b10d115 tempest-AttachVolumeTestJSON-244989543 tempest-AttachVolumeTestJSON-244989543-project] [instance: f22dfea6-4599-43e4-93d5-d99f1db3b4fb] Fetching instance by UUID {{(pid=116156) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:41:13.440519 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-e5a04be1-a703-43f9-a58f-047f4b10d115 tempest-AttachVolumeTestJSON-244989543 tempest-AttachVolumeTestJSON-244989543-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:41:13.440963 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-e5a04be1-a703-43f9-a58f-047f4b10d115 tempest-AttachVolumeTestJSON-244989543 tempest-AttachVolumeTestJSON-244989543-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:41:13.441725 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-e5a04be1-a703-43f9-a58f-047f4b10d115 tempest-AttachVolumeTestJSON-244989543 tempest-AttachVolumeTestJSON-244989543-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:41:13.442183 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-e5a04be1-a703-43f9-a58f-047f4b10d115 tempest-AttachVolumeTestJSON-244989543 tempest-AttachVolumeTestJSON-244989543-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:41:13.569927 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.policy [None req-e5a04be1-a703-43f9-a58f-047f4b10d115 tempest-AttachVolumeTestJSON-244989543 tempest-AttachVolumeTestJSON-244989543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5fb31c3d4874e13ba22e0242d4aaa58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00e76c2a092544e1a51928f1d84879b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116156) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:41:13.577511 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: INFO nova.api.openstack.requestlog [None req-e5a04be1-a703-43f9-a58f-047f4b10d115 tempest-AttachVolumeTestJSON-244989543 tempest-AttachVolumeTestJSON-244989543-project] 10.222.0.18 "GET /compute/v2.1/servers/f22dfea6-4599-43e4-93d5-d99f1db3b4fb" status: 200 len: 1719 microversion: 2.1 time: 0.148038 Dec 15 03:41:13.578094 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: [pid: 116156|app: 0|req: 1052/2090] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 03:41:13 2021] GET /compute/v2.1/servers/f22dfea6-4599-43e4-93d5-d99f1db3b4fb => generated 1719 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 03:41:13.910881 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi [None req-4df0492d-0c8d-4a3f-a25d-b8f72fdc4457 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Calling method '>' {{(pid=116157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:41:13.911579 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.compute.api [None req-4df0492d-0c8d-4a3f-a25d-b8f72fdc4457 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] [instance: b89094ac-aee1-4bd6-a33d-8c4347cebfc7] Fetching instance by UUID {{(pid=116157) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:41:13.918315 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-4df0492d-0c8d-4a3f-a25d-b8f72fdc4457 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:41:13.918757 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-4df0492d-0c8d-4a3f-a25d-b8f72fdc4457 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:41:13.919536 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-4df0492d-0c8d-4a3f-a25d-b8f72fdc4457 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:41:13.919964 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-4df0492d-0c8d-4a3f-a25d-b8f72fdc4457 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:41:13.933592 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: INFO nova.api.openstack.wsgi [None req-4df0492d-0c8d-4a3f-a25d-b8f72fdc4457 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] HTTP exception thrown: Instance b89094ac-aee1-4bd6-a33d-8c4347cebfc7 could not be found. Dec 15 03:41:13.934219 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi [None req-4df0492d-0c8d-4a3f-a25d-b8f72fdc4457 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Returning 404 to user: Instance b89094ac-aee1-4bd6-a33d-8c4347cebfc7 could not be found. {{(pid=116157) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 15 03:41:13.935061 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: INFO nova.api.openstack.requestlog [None req-4df0492d-0c8d-4a3f-a25d-b8f72fdc4457 tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] 10.222.0.18 "DELETE /compute/v2.1/servers/b89094ac-aee1-4bd6-a33d-8c4347cebfc7" status: 404 len: 111 microversion: 2.20 time: 0.028169 Dec 15 03:41:13.935574 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: [pid: 116157|app: 0|req: 1039/2091] 10.222.0.18 () {60 vars in 1279 bytes} [Wed Dec 15 03:41:13 2021] DELETE /compute/v2.1/servers/b89094ac-aee1-4bd6-a33d-8c4347cebfc7 => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Dec 15 03:41:13.943225 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi [None req-b68335c8-28f0-4310-af68-8176e8ebc76a tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Calling method '>' {{(pid=116156) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:41:13.944487 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.compute.api [None req-b68335c8-28f0-4310-af68-8176e8ebc76a tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] [instance: b89094ac-aee1-4bd6-a33d-8c4347cebfc7] Fetching instance by UUID {{(pid=116156) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:41:13.950271 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-b68335c8-28f0-4310-af68-8176e8ebc76a tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:41:13.950722 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-b68335c8-28f0-4310-af68-8176e8ebc76a tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:41:13.951497 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-b68335c8-28f0-4310-af68-8176e8ebc76a tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:41:13.951962 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-b68335c8-28f0-4310-af68-8176e8ebc76a tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:41:13.965133 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: INFO nova.api.openstack.wsgi [None req-b68335c8-28f0-4310-af68-8176e8ebc76a tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] HTTP exception thrown: Instance b89094ac-aee1-4bd6-a33d-8c4347cebfc7 could not be found. Dec 15 03:41:13.965715 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi [None req-b68335c8-28f0-4310-af68-8176e8ebc76a tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] Returning 404 to user: Instance b89094ac-aee1-4bd6-a33d-8c4347cebfc7 could not be found. {{(pid=116156) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 15 03:41:13.966552 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: INFO nova.api.openstack.requestlog [None req-b68335c8-28f0-4310-af68-8176e8ebc76a tempest-AttachVolumeShelveTestJSON-1023921506 tempest-AttachVolumeShelveTestJSON-1023921506-project] 10.222.0.18 "GET /compute/v2.1/servers/b89094ac-aee1-4bd6-a33d-8c4347cebfc7" status: 404 len: 111 microversion: 2.20 time: 0.026935 Dec 15 03:41:13.967064 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: [pid: 116156|app: 0|req: 1053/2092] 10.222.0.18 () {60 vars in 1276 bytes} [Wed Dec 15 03:41:13 2021] GET /compute/v2.1/servers/b89094ac-aee1-4bd6-a33d-8c4347cebfc7 => generated 111 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Dec 15 03:41:14.595584 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi [None req-1cc8ef3a-8c92-4f06-95c0-b14222c79556 tempest-AttachVolumeTestJSON-244989543 tempest-AttachVolumeTestJSON-244989543-project] Calling method '>' {{(pid=116157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:41:14.596221 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.compute.api [None req-1cc8ef3a-8c92-4f06-95c0-b14222c79556 tempest-AttachVolumeTestJSON-244989543 tempest-AttachVolumeTestJSON-244989543-project] [instance: f22dfea6-4599-43e4-93d5-d99f1db3b4fb] Fetching instance by UUID {{(pid=116157) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:41:14.602519 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-1cc8ef3a-8c92-4f06-95c0-b14222c79556 tempest-AttachVolumeTestJSON-244989543 tempest-AttachVolumeTestJSON-244989543-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:41:14.602963 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-1cc8ef3a-8c92-4f06-95c0-b14222c79556 tempest-AttachVolumeTestJSON-244989543 tempest-AttachVolumeTestJSON-244989543-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:41:14.603735 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-1cc8ef3a-8c92-4f06-95c0-b14222c79556 tempest-AttachVolumeTestJSON-244989543 tempest-AttachVolumeTestJSON-244989543-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:41:14.604164 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-1cc8ef3a-8c92-4f06-95c0-b14222c79556 tempest-AttachVolumeTestJSON-244989543 tempest-AttachVolumeTestJSON-244989543-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:41:14.742866 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.policy [None req-1cc8ef3a-8c92-4f06-95c0-b14222c79556 tempest-AttachVolumeTestJSON-244989543 tempest-AttachVolumeTestJSON-244989543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5fb31c3d4874e13ba22e0242d4aaa58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00e76c2a092544e1a51928f1d84879b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116157) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:41:14.750661 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: INFO nova.api.openstack.requestlog [None req-1cc8ef3a-8c92-4f06-95c0-b14222c79556 tempest-AttachVolumeTestJSON-244989543 tempest-AttachVolumeTestJSON-244989543-project] 10.222.0.18 "GET /compute/v2.1/servers/f22dfea6-4599-43e4-93d5-d99f1db3b4fb" status: 200 len: 1719 microversion: 2.1 time: 0.158765 Dec 15 03:41:14.751227 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: [pid: 116157|app: 0|req: 1040/2093] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 03:41:14 2021] GET /compute/v2.1/servers/f22dfea6-4599-43e4-93d5-d99f1db3b4fb => generated 1719 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 03:41:15.768495 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi [None req-6ae52cea-d75b-4abf-8e5b-097c6d6f6713 tempest-AttachVolumeTestJSON-244989543 tempest-AttachVolumeTestJSON-244989543-project] Calling method '>' {{(pid=116156) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:41:15.770066 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.compute.api [None req-6ae52cea-d75b-4abf-8e5b-097c6d6f6713 tempest-AttachVolumeTestJSON-244989543 tempest-AttachVolumeTestJSON-244989543-project] [instance: f22dfea6-4599-43e4-93d5-d99f1db3b4fb] Fetching instance by UUID {{(pid=116156) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:41:15.780681 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-6ae52cea-d75b-4abf-8e5b-097c6d6f6713 tempest-AttachVolumeTestJSON-244989543 tempest-AttachVolumeTestJSON-244989543-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:41:15.784509 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-6ae52cea-d75b-4abf-8e5b-097c6d6f6713 tempest-AttachVolumeTestJSON-244989543 tempest-AttachVolumeTestJSON-244989543-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:41:15.785739 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-6ae52cea-d75b-4abf-8e5b-097c6d6f6713 tempest-AttachVolumeTestJSON-244989543 tempest-AttachVolumeTestJSON-244989543-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:41:15.786464 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-6ae52cea-d75b-4abf-8e5b-097c6d6f6713 tempest-AttachVolumeTestJSON-244989543 tempest-AttachVolumeTestJSON-244989543-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:41:16.001167 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.policy [None req-6ae52cea-d75b-4abf-8e5b-097c6d6f6713 tempest-AttachVolumeTestJSON-244989543 tempest-AttachVolumeTestJSON-244989543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5fb31c3d4874e13ba22e0242d4aaa58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00e76c2a092544e1a51928f1d84879b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116156) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:41:16.025595 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: INFO nova.api.openstack.requestlog [None req-6ae52cea-d75b-4abf-8e5b-097c6d6f6713 tempest-AttachVolumeTestJSON-244989543 tempest-AttachVolumeTestJSON-244989543-project] 10.222.0.18 "GET /compute/v2.1/servers/f22dfea6-4599-43e4-93d5-d99f1db3b4fb" status: 200 len: 1652 microversion: 2.1 time: 0.260070 Dec 15 03:41:16.027004 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: [pid: 116156|app: 0|req: 1054/2094] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 03:41:15 2021] GET /compute/v2.1/servers/f22dfea6-4599-43e4-93d5-d99f1db3b4fb => generated 1652 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 03:41:16.257179 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi [req-999708cc-4369-4558-ab09-1de98e24517c req-50d66b83-b91c-423a-9229-784c7ca59031 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f22dfea6-4599-43e4-93d5-d99f1db3b4fb", "name": "network-vif-deleted", "tag": "7cca5c1a-379b-494a-bcfb-406b62828d76"}]} {{(pid=116157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 03:41:16.259839 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 15 03:41:16.259839 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: warnings.warn(msg) Dec 15 03:41:16.267534 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [req-999708cc-4369-4558-ab09-1de98e24517c req-50d66b83-b91c-423a-9229-784c7ca59031 service nova] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:41:16.267820 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [req-999708cc-4369-4558-ab09-1de98e24517c req-50d66b83-b91c-423a-9229-784c7ca59031 service nova] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:41:16.291893 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: INFO nova.api.openstack.compute.server_external_events [req-999708cc-4369-4558-ab09-1de98e24517c req-50d66b83-b91c-423a-9229-784c7ca59031 service nova] Creating event network-vif-deleted:7cca5c1a-379b-494a-bcfb-406b62828d76 for instance f22dfea6-4599-43e4-93d5-d99f1db3b4fb on hv-cinder-81803 Dec 15 03:41:16.295279 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Dec 15 03:41:16.295610 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: Wed Dec 15 03:41:16 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-server-external-events (ip 10.222.0.18) !!! Dec 15 03:41:16.312165 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: INFO nova.api.openstack.requestlog [req-999708cc-4369-4558-ab09-1de98e24517c req-50d66b83-b91c-423a-9229-784c7ca59031 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.307691 Dec 15 03:41:16.313078 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: [pid: 116157|app: 0|req: 1041/2095] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Dec 15 03:41:16 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 15 03:41:17.043463 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi [None req-f3623a54-f443-4f39-98e9-b019d600755a tempest-AttachVolumeTestJSON-244989543 tempest-AttachVolumeTestJSON-244989543-project] Calling method '>' {{(pid=116156) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:41:17.044123 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.compute.api [None req-f3623a54-f443-4f39-98e9-b019d600755a tempest-AttachVolumeTestJSON-244989543 tempest-AttachVolumeTestJSON-244989543-project] [instance: f22dfea6-4599-43e4-93d5-d99f1db3b4fb] Fetching instance by UUID {{(pid=116156) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:41:17.050724 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-f3623a54-f443-4f39-98e9-b019d600755a tempest-AttachVolumeTestJSON-244989543 tempest-AttachVolumeTestJSON-244989543-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:41:17.051612 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-f3623a54-f443-4f39-98e9-b019d600755a tempest-AttachVolumeTestJSON-244989543 tempest-AttachVolumeTestJSON-244989543-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:41:17.052807 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-f3623a54-f443-4f39-98e9-b019d600755a tempest-AttachVolumeTestJSON-244989543 tempest-AttachVolumeTestJSON-244989543-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:41:17.054056 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-f3623a54-f443-4f39-98e9-b019d600755a tempest-AttachVolumeTestJSON-244989543 tempest-AttachVolumeTestJSON-244989543-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:41:17.068735 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: INFO nova.api.openstack.wsgi [None req-f3623a54-f443-4f39-98e9-b019d600755a tempest-AttachVolumeTestJSON-244989543 tempest-AttachVolumeTestJSON-244989543-project] HTTP exception thrown: Instance f22dfea6-4599-43e4-93d5-d99f1db3b4fb could not be found. Dec 15 03:41:17.070385 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi [None req-f3623a54-f443-4f39-98e9-b019d600755a tempest-AttachVolumeTestJSON-244989543 tempest-AttachVolumeTestJSON-244989543-project] Returning 404 to user: Instance f22dfea6-4599-43e4-93d5-d99f1db3b4fb could not be found. {{(pid=116156) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 15 03:41:17.071457 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: INFO nova.api.openstack.requestlog [None req-f3623a54-f443-4f39-98e9-b019d600755a tempest-AttachVolumeTestJSON-244989543 tempest-AttachVolumeTestJSON-244989543-project] 10.222.0.18 "GET /compute/v2.1/servers/f22dfea6-4599-43e4-93d5-d99f1db3b4fb" status: 404 len: 111 microversion: 2.1 time: 0.031753 Dec 15 03:41:17.072545 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: [pid: 116156|app: 0|req: 1055/2096] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 03:41:17 2021] GET /compute/v2.1/servers/f22dfea6-4599-43e4-93d5-d99f1db3b4fb => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 15 03:41:17.086219 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi [None req-cb9c4abc-679a-498e-a45e-336f27d34db2 tempest-AttachVolumeTestJSON-244989543 tempest-AttachVolumeTestJSON-244989543-project] Calling method '.version_select at 0x7f12698c5310>' {{(pid=116157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:41:17.116557 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: INFO nova.api.openstack.requestlog [None req-cb9c4abc-679a-498e-a45e-336f27d34db2 tempest-AttachVolumeTestJSON-244989543 tempest-AttachVolumeTestJSON-244989543-project] 10.222.0.18 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-595314316" status: 202 len: 0 microversion: 2.1 time: 0.038559 Dec 15 03:41:17.117562 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: [pid: 116157|app: 0|req: 1042/2097] 10.222.0.18 () {58 vars in 1217 bytes} [Wed Dec 15 03:41:17 2021] DELETE /compute/v2.1/os-keypairs/tempest-keypair-595314316 => generated 0 bytes in 41 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Dec 15 03:41:17.858525 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi [None req-404a332b-e2d9-4350-968f-2d0501980a38 tempest-AttachVolumeTestJSON-244989543 tempest-AttachVolumeTestJSON-244989543-project] Action: 'create', calling method: .version_select at 0x7f126a38faf0>, body: {"keypair": {"name": "tempest-keypair-1140182986"}} {{(pid=116156) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 03:41:17.872426 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.quota [None req-404a332b-e2d9-4350-968f-2d0501980a38 tempest-AttachVolumeTestJSON-244989543 tempest-AttachVolumeTestJSON-244989543-project] Getting quotas for project 00e76c2a092544e1a51928f1d84879b2. Resources: {'key_pairs'} {{(pid=116156) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 15 03:41:17.876175 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.quota [None req-404a332b-e2d9-4350-968f-2d0501980a38 tempest-AttachVolumeTestJSON-244989543 tempest-AttachVolumeTestJSON-244989543-project] Getting quotas for user a5fb31c3d4874e13ba22e0242d4aaa58 and project 00e76c2a092544e1a51928f1d84879b2. Resources: {'key_pairs'} {{(pid=116156) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 15 03:41:18.379908 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.quota [None req-404a332b-e2d9-4350-968f-2d0501980a38 tempest-AttachVolumeTestJSON-244989543 tempest-AttachVolumeTestJSON-244989543-project] Getting quotas for project 00e76c2a092544e1a51928f1d84879b2. Resources: {'key_pairs'} {{(pid=116156) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 15 03:41:18.385338 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.quota [None req-404a332b-e2d9-4350-968f-2d0501980a38 tempest-AttachVolumeTestJSON-244989543 tempest-AttachVolumeTestJSON-244989543-project] Getting quotas for user a5fb31c3d4874e13ba22e0242d4aaa58 and project 00e76c2a092544e1a51928f1d84879b2. Resources: {'key_pairs'} {{(pid=116156) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 15 03:41:18.404043 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: INFO nova.api.openstack.requestlog [None req-404a332b-e2d9-4350-968f-2d0501980a38 tempest-AttachVolumeTestJSON-244989543 tempest-AttachVolumeTestJSON-244989543-project] 10.222.0.18 "POST /compute/v2.1/os-keypairs" status: 200 len: 2305 microversion: 2.1 time: 0.549053 Dec 15 03:41:18.404635 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: [pid: 116156|app: 0|req: 1056/2098] 10.222.0.18 () {60 vars in 1157 bytes} [Wed Dec 15 03:41:17 2021] POST /compute/v2.1/os-keypairs => generated 2305 bytes in 550 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 03:41:19.453261 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi [None req-a7d572ce-24f7-4f90-a8d7-263e99a4dc8b tempest-VolumesNegativeTest-776658314 tempest-VolumesNegativeTest-776658314-project] Action: 'create', calling method: .version_select at 0x7f126e825b80>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-1219347928", "metadata": {"Type": "work"}}} {{(pid=116157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 03:41:19.454755 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi [None req-a7d572ce-24f7-4f90-a8d7-263e99a4dc8b tempest-VolumesNegativeTest-776658314 tempest-VolumesNegativeTest-776658314-project] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=116157) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 15 03:41:19.455557 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: INFO nova.api.openstack.requestlog [None req-a7d572ce-24f7-4f90-a8d7-263e99a4dc8b tempest-VolumesNegativeTest-776658314 tempest-VolumesNegativeTest-776658314-project] 10.222.0.18 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 0.120526 Dec 15 03:41:19.456079 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: [pid: 116157|app: 0|req: 1043/2099] 10.222.0.18 () {60 vars in 1155 bytes} [Wed Dec 15 03:41:19 2021] POST /compute/v2.1/os-volumes => generated 127 bytes in 122 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Dec 15 03:41:19.466081 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi [None req-33f819c1-1d57-4502-a336-562dc400c624 tempest-VolumesNegativeTest-776658314 tempest-VolumesNegativeTest-776658314-project] Action: 'create', calling method: .version_select at 0x7f126985ad30>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-231065711", "metadata": {"Type": "work"}}} {{(pid=116156) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 03:41:19.467457 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi [None req-33f819c1-1d57-4502-a336-562dc400c624 tempest-VolumesNegativeTest-776658314 tempest-VolumesNegativeTest-776658314-project] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=116156) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 15 03:41:19.468247 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: INFO nova.api.openstack.requestlog [None req-33f819c1-1d57-4502-a336-562dc400c624 tempest-VolumesNegativeTest-776658314 tempest-VolumesNegativeTest-776658314-project] 10.222.0.18 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.006836 Dec 15 03:41:19.468783 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: [pid: 116156|app: 0|req: 1057/2100] 10.222.0.18 () {60 vars in 1155 bytes} [Wed Dec 15 03:41:19 2021] POST /compute/v2.1/os-volumes => generated 125 bytes in 8 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Dec 15 03:41:19.478617 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi [None req-7988a3d5-efcb-40b9-a0a8-f84c5856a523 tempest-VolumesNegativeTest-776658314 tempest-VolumesNegativeTest-776658314-project] Action: 'create', calling method: .version_select at 0x7f126e864700>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-1165369165", "metadata": {"Type": "work"}}} {{(pid=116157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 03:41:19.479751 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi [None req-7988a3d5-efcb-40b9-a0a8-f84c5856a523 tempest-VolumesNegativeTest-776658314 tempest-VolumesNegativeTest-776658314-project] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=116157) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 15 03:41:19.480673 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: INFO nova.api.openstack.requestlog [None req-7988a3d5-efcb-40b9-a0a8-f84c5856a523 tempest-VolumesNegativeTest-776658314 tempest-VolumesNegativeTest-776658314-project] 10.222.0.18 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.006871 Dec 15 03:41:19.481188 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: [pid: 116157|app: 0|req: 1044/2101] 10.222.0.18 () {60 vars in 1155 bytes} [Wed Dec 15 03:41:19 2021] POST /compute/v2.1/os-volumes => generated 121 bytes in 8 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Dec 15 03:41:19.491573 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi [None req-b09631aa-2b42-43c7-9458-c32daecf3c73 tempest-VolumesNegativeTest-776658314 tempest-VolumesNegativeTest-776658314-project] Calling method '.version_select at 0x7f126a3ca0d0>' {{(pid=116156) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:41:19.519646 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: INFO nova.api.openstack.wsgi [None req-b09631aa-2b42-43c7-9458-c32daecf3c73 tempest-VolumesNegativeTest-776658314 tempest-VolumesNegativeTest-776658314-project] HTTP exception thrown: Volume tempest-invalid-36031239 could not be found. Dec 15 03:41:19.520347 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi [None req-b09631aa-2b42-43c7-9458-c32daecf3c73 tempest-VolumesNegativeTest-776658314 tempest-VolumesNegativeTest-776658314-project] Returning 404 to user: Volume tempest-invalid-36031239 could not be found. {{(pid=116156) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 15 03:41:19.521444 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: INFO nova.api.openstack.requestlog [None req-b09631aa-2b42-43c7-9458-c32daecf3c73 tempest-VolumesNegativeTest-776658314 tempest-VolumesNegativeTest-776658314-project] 10.222.0.18 "DELETE /compute/v2.1/os-volumes/tempest-invalid-36031239" status: 404 len: 97 microversion: 2.1 time: 0.034915 Dec 15 03:41:19.522160 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: [pid: 116156|app: 0|req: 1058/2102] 10.222.0.18 () {58 vars in 1211 bytes} [Wed Dec 15 03:41:19 2021] DELETE /compute/v2.1/os-volumes/tempest-invalid-36031239 => generated 97 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Dec 15 03:41:19.530905 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: INFO nova.api.openstack.requestlog [None req-a68b87d4-e64e-4770-a02a-fa81660b48b3 tempest-VolumesNegativeTest-776658314 tempest-VolumesNegativeTest-776658314-project] 10.222.0.18 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.003655 Dec 15 03:41:19.531401 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: [pid: 116157|app: 0|req: 1045/2103] 10.222.0.18 () {58 vars in 1139 bytes} [Wed Dec 15 03:41:19 2021] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 5 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Dec 15 03:41:19.540216 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: INFO nova.api.openstack.requestlog [None req-ac78e8fd-90b2-44be-8790-a8b4d5abff53 tempest-VolumesNegativeTest-776658314 tempest-VolumesNegativeTest-776658314-project] 10.222.0.18 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.004108 Dec 15 03:41:19.540711 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: [pid: 116156|app: 0|req: 1059/2104] 10.222.0.18 () {58 vars in 1136 bytes} [Wed Dec 15 03:41:19 2021] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 5 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Dec 15 03:41:19.549043 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi [None req-86bc2d51-9b35-4997-a8ba-8c574db1fc06 tempest-VolumesNegativeTest-776658314 tempest-VolumesNegativeTest-776658314-project] Calling method '.version_select at 0x7f126e880790>' {{(pid=116157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:41:19.577336 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: INFO nova.api.openstack.wsgi [None req-86bc2d51-9b35-4997-a8ba-8c574db1fc06 tempest-VolumesNegativeTest-776658314 tempest-VolumesNegativeTest-776658314-project] HTTP exception thrown: Volume 534d3401-4b50-49ca-b836-e0b357bf6acf could not be found. Dec 15 03:41:19.577974 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi [None req-86bc2d51-9b35-4997-a8ba-8c574db1fc06 tempest-VolumesNegativeTest-776658314 tempest-VolumesNegativeTest-776658314-project] Returning 404 to user: Volume 534d3401-4b50-49ca-b836-e0b357bf6acf could not be found. {{(pid=116157) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 15 03:41:19.578998 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: INFO nova.api.openstack.requestlog [None req-86bc2d51-9b35-4997-a8ba-8c574db1fc06 tempest-VolumesNegativeTest-776658314 tempest-VolumesNegativeTest-776658314-project] 10.222.0.18 "DELETE /compute/v2.1/os-volumes/534d3401-4b50-49ca-b836-e0b357bf6acf" status: 404 len: 109 microversion: 2.1 time: 0.033493 Dec 15 03:41:19.579852 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: [pid: 116157|app: 0|req: 1046/2105] 10.222.0.18 () {58 vars in 1247 bytes} [Wed Dec 15 03:41:19 2021] DELETE /compute/v2.1/os-volumes/534d3401-4b50-49ca-b836-e0b357bf6acf => generated 109 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Dec 15 03:41:19.588823 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi [None req-723bae34-ad71-43c8-91b7-d6a7a368a76b tempest-VolumesNegativeTest-776658314 tempest-VolumesNegativeTest-776658314-project] Calling method '.version_select at 0x7f126985a1f0>' {{(pid=116156) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:41:19.616751 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: INFO nova.api.openstack.wsgi [None req-723bae34-ad71-43c8-91b7-d6a7a368a76b tempest-VolumesNegativeTest-776658314 tempest-VolumesNegativeTest-776658314-project] HTTP exception thrown: Volume 1bba60b6-e15c-432d-8262-6f2f61a32e0c could not be found. Dec 15 03:41:19.617351 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi [None req-723bae34-ad71-43c8-91b7-d6a7a368a76b tempest-VolumesNegativeTest-776658314 tempest-VolumesNegativeTest-776658314-project] Returning 404 to user: Volume 1bba60b6-e15c-432d-8262-6f2f61a32e0c could not be found. {{(pid=116156) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 15 03:41:19.618211 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: INFO nova.api.openstack.requestlog [None req-723bae34-ad71-43c8-91b7-d6a7a368a76b tempest-VolumesNegativeTest-776658314 tempest-VolumesNegativeTest-776658314-project] 10.222.0.18 "GET /compute/v2.1/os-volumes/1bba60b6-e15c-432d-8262-6f2f61a32e0c" status: 404 len: 109 microversion: 2.1 time: 0.032895 Dec 15 03:41:19.618745 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: [pid: 116156|app: 0|req: 1060/2106] 10.222.0.18 () {58 vars in 1244 bytes} [Wed Dec 15 03:41:19 2021] GET /compute/v2.1/os-volumes/1bba60b6-e15c-432d-8262-6f2f61a32e0c => generated 109 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 15 03:41:19.736322 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi [None req-4cc5bc71-6db7-42f8-b535-758e7ef993f6 tempest-AttachVolumeTestJSON-244989543 tempest-AttachVolumeTestJSON-244989543-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-1678703451", "imageRef": "5195b034-9fa4-468b-a94d-ef3ee79ce449", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "aedd89e5-7e2d-4810-95c0-a87228c5c673"}], "security_groups": [{"name": "tempest-securitygroup--1129999007"}], "key_name": "tempest-keypair-1140182986", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=116157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 03:41:19.840079 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.network.neutron [None req-4cc5bc71-6db7-42f8-b535-758e7ef993f6 tempest-AttachVolumeTestJSON-244989543 tempest-AttachVolumeTestJSON-244989543-project] validate_networks() for [('aedd89e5-7e2d-4810-95c0-a87228c5c673', None, None, None, None, None)] {{(pid=116157) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Dec 15 03:41:20.264231 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.virt.hardware [None req-4cc5bc71-6db7-42f8-b535-758e7ef993f6 tempest-AttachVolumeTestJSON-244989543 tempest-AttachVolumeTestJSON-244989543-project] Flavor limits 0:0:0 {{(pid=116157) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Dec 15 03:41:20.264657 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.virt.hardware [None req-4cc5bc71-6db7-42f8-b535-758e7ef993f6 tempest-AttachVolumeTestJSON-244989543 tempest-AttachVolumeTestJSON-244989543-project] Image limits 0:0:0 {{(pid=116157) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Dec 15 03:41:20.265131 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.virt.hardware [None req-4cc5bc71-6db7-42f8-b535-758e7ef993f6 tempest-AttachVolumeTestJSON-244989543 tempest-AttachVolumeTestJSON-244989543-project] Flavor pref 0:0:0 {{(pid=116157) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Dec 15 03:41:20.265542 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.virt.hardware [None req-4cc5bc71-6db7-42f8-b535-758e7ef993f6 tempest-AttachVolumeTestJSON-244989543 tempest-AttachVolumeTestJSON-244989543-project] Image pref 0:0:0 {{(pid=116157) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Dec 15 03:41:20.265952 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.virt.hardware [None req-4cc5bc71-6db7-42f8-b535-758e7ef993f6 tempest-AttachVolumeTestJSON-244989543 tempest-AttachVolumeTestJSON-244989543-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116157) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Dec 15 03:41:20.274923 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-4cc5bc71-6db7-42f8-b535-758e7ef993f6 tempest-AttachVolumeTestJSON-244989543 tempest-AttachVolumeTestJSON-244989543-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:41:20.275373 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-4cc5bc71-6db7-42f8-b535-758e7ef993f6 tempest-AttachVolumeTestJSON-244989543 tempest-AttachVolumeTestJSON-244989543-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:41:20.276186 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-4cc5bc71-6db7-42f8-b535-758e7ef993f6 tempest-AttachVolumeTestJSON-244989543 tempest-AttachVolumeTestJSON-244989543-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:41:20.276624 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-4cc5bc71-6db7-42f8-b535-758e7ef993f6 tempest-AttachVolumeTestJSON-244989543 tempest-AttachVolumeTestJSON-244989543-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:41:20.292981 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.quota [None req-4cc5bc71-6db7-42f8-b535-758e7ef993f6 tempest-AttachVolumeTestJSON-244989543 tempest-AttachVolumeTestJSON-244989543-project] Getting quotas for project 00e76c2a092544e1a51928f1d84879b2. Resources: {'cores', 'instances', 'ram'} {{(pid=116157) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 15 03:41:20.296861 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.quota [None req-4cc5bc71-6db7-42f8-b535-758e7ef993f6 tempest-AttachVolumeTestJSON-244989543 tempest-AttachVolumeTestJSON-244989543-project] Getting quotas for user a5fb31c3d4874e13ba22e0242d4aaa58 and project 00e76c2a092544e1a51928f1d84879b2. Resources: {'cores', 'instances', 'ram'} {{(pid=116157) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 15 03:41:20.308117 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.compute.api [None req-4cc5bc71-6db7-42f8-b535-758e7ef993f6 tempest-AttachVolumeTestJSON-244989543 tempest-AttachVolumeTestJSON-244989543-project] Going to run 1 instances... {{(pid=116157) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Dec 15 03:41:20.310593 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.compute.api [None req-4cc5bc71-6db7-42f8-b535-758e7ef993f6 tempest-AttachVolumeTestJSON-244989543 tempest-AttachVolumeTestJSON-244989543-project] [instance: e0ad8879-83dd-40e5-a0b4-4c8d1f25e3b5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='5195b034-9fa4-468b-a94d-ef3ee79ce449',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=116157) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Dec 15 03:41:20.364231 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: INFO nova.api.openstack.requestlog [None req-4cc5bc71-6db7-42f8-b535-758e7ef993f6 tempest-AttachVolumeTestJSON-244989543 tempest-AttachVolumeTestJSON-244989543-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.632956 Dec 15 03:41:20.365093 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: [pid: 116157|app: 0|req: 1047/2107] 10.222.0.18 () {60 vars in 1146 bytes} [Wed Dec 15 03:41:19 2021] POST /compute/v2.1/servers => generated 402 bytes in 634 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Dec 15 03:41:20.376211 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi [None req-ba4f9d86-ba8e-4606-9180-ab286321cf71 tempest-AttachVolumeTestJSON-244989543 tempest-AttachVolumeTestJSON-244989543-project] Calling method '>' {{(pid=116156) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:41:20.377320 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.compute.api [None req-ba4f9d86-ba8e-4606-9180-ab286321cf71 tempest-AttachVolumeTestJSON-244989543 tempest-AttachVolumeTestJSON-244989543-project] [instance: e0ad8879-83dd-40e5-a0b4-4c8d1f25e3b5] Fetching instance by UUID {{(pid=116156) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:41:20.434760 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.policy [None req-ba4f9d86-ba8e-4606-9180-ab286321cf71 tempest-AttachVolumeTestJSON-244989543 tempest-AttachVolumeTestJSON-244989543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5fb31c3d4874e13ba22e0242d4aaa58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00e76c2a092544e1a51928f1d84879b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116156) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:41:20.437646 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: INFO nova.api.openstack.requestlog [None req-ba4f9d86-ba8e-4606-9180-ab286321cf71 tempest-AttachVolumeTestJSON-244989543 tempest-AttachVolumeTestJSON-244989543-project] 10.222.0.18 "GET /compute/v2.1/servers/e0ad8879-83dd-40e5-a0b4-4c8d1f25e3b5" status: 200 len: 1238 microversion: 2.1 time: 0.065042 Dec 15 03:41:20.438237 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: [pid: 116156|app: 0|req: 1061/2108] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 03:41:20 2021] GET /compute/v2.1/servers/e0ad8879-83dd-40e5-a0b4-4c8d1f25e3b5 => generated 1238 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 03:41:21.457318 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi [None req-1037bfa6-5bd4-45b9-bc24-380b2673925b tempest-AttachVolumeTestJSON-244989543 tempest-AttachVolumeTestJSON-244989543-project] Calling method '>' {{(pid=116157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:41:21.458863 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.compute.api [None req-1037bfa6-5bd4-45b9-bc24-380b2673925b tempest-AttachVolumeTestJSON-244989543 tempest-AttachVolumeTestJSON-244989543-project] [instance: e0ad8879-83dd-40e5-a0b4-4c8d1f25e3b5] Fetching instance by UUID {{(pid=116157) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:41:21.466692 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-1037bfa6-5bd4-45b9-bc24-380b2673925b tempest-AttachVolumeTestJSON-244989543 tempest-AttachVolumeTestJSON-244989543-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:41:21.467949 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-1037bfa6-5bd4-45b9-bc24-380b2673925b tempest-AttachVolumeTestJSON-244989543 tempest-AttachVolumeTestJSON-244989543-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:41:21.469616 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-1037bfa6-5bd4-45b9-bc24-380b2673925b tempest-AttachVolumeTestJSON-244989543 tempest-AttachVolumeTestJSON-244989543-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:41:21.470307 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-1037bfa6-5bd4-45b9-bc24-380b2673925b tempest-AttachVolumeTestJSON-244989543 tempest-AttachVolumeTestJSON-244989543-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:41:21.543258 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.policy [None req-1037bfa6-5bd4-45b9-bc24-380b2673925b tempest-AttachVolumeTestJSON-244989543 tempest-AttachVolumeTestJSON-244989543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5fb31c3d4874e13ba22e0242d4aaa58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00e76c2a092544e1a51928f1d84879b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116157) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:41:21.550435 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: INFO nova.api.openstack.requestlog [None req-1037bfa6-5bd4-45b9-bc24-380b2673925b tempest-AttachVolumeTestJSON-244989543 tempest-AttachVolumeTestJSON-244989543-project] 10.222.0.18 "GET /compute/v2.1/servers/e0ad8879-83dd-40e5-a0b4-4c8d1f25e3b5" status: 200 len: 1296 microversion: 2.1 time: 0.099219 Dec 15 03:41:21.551109 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: [pid: 116157|app: 0|req: 1048/2109] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 03:41:21 2021] GET /compute/v2.1/servers/e0ad8879-83dd-40e5-a0b4-4c8d1f25e3b5 => generated 1296 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 03:41:22.569289 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi [None req-944bfba4-8467-4cf9-b4a2-15a0b786c1bf tempest-AttachVolumeTestJSON-244989543 tempest-AttachVolumeTestJSON-244989543-project] Calling method '>' {{(pid=116156) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:41:22.569849 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.compute.api [None req-944bfba4-8467-4cf9-b4a2-15a0b786c1bf tempest-AttachVolumeTestJSON-244989543 tempest-AttachVolumeTestJSON-244989543-project] [instance: e0ad8879-83dd-40e5-a0b4-4c8d1f25e3b5] Fetching instance by UUID {{(pid=116156) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:41:22.585675 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-944bfba4-8467-4cf9-b4a2-15a0b786c1bf tempest-AttachVolumeTestJSON-244989543 tempest-AttachVolumeTestJSON-244989543-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:41:22.586172 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-944bfba4-8467-4cf9-b4a2-15a0b786c1bf tempest-AttachVolumeTestJSON-244989543 tempest-AttachVolumeTestJSON-244989543-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:41:22.586972 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-944bfba4-8467-4cf9-b4a2-15a0b786c1bf tempest-AttachVolumeTestJSON-244989543 tempest-AttachVolumeTestJSON-244989543-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:41:22.589254 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-944bfba4-8467-4cf9-b4a2-15a0b786c1bf tempest-AttachVolumeTestJSON-244989543 tempest-AttachVolumeTestJSON-244989543-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:41:22.812140 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi [req-cb2c6781-2b8c-4f44-9890-6a5d29de48ab req-281e18ee-dd16-4241-8ef0-71d0be8cb5af service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e0ad8879-83dd-40e5-a0b4-4c8d1f25e3b5", "tag": "410a400e-6c2f-44c9-9f22-1b43ae92fdcf"}]} {{(pid=116157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 03:41:22.815077 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 15 03:41:22.815077 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: warnings.warn(msg) Dec 15 03:41:22.829303 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [req-cb2c6781-2b8c-4f44-9890-6a5d29de48ab req-281e18ee-dd16-4241-8ef0-71d0be8cb5af service nova] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:41:22.835235 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [req-cb2c6781-2b8c-4f44-9890-6a5d29de48ab req-281e18ee-dd16-4241-8ef0-71d0be8cb5af service nova] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:41:22.867535 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: INFO nova.api.openstack.compute.server_external_events [req-cb2c6781-2b8c-4f44-9890-6a5d29de48ab req-281e18ee-dd16-4241-8ef0-71d0be8cb5af service nova] Creating event network-changed:410a400e-6c2f-44c9-9f22-1b43ae92fdcf for instance e0ad8879-83dd-40e5-a0b4-4c8d1f25e3b5 on hv-cinder-81803 Dec 15 03:41:22.874695 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: INFO nova.api.openstack.requestlog [req-cb2c6781-2b8c-4f44-9890-6a5d29de48ab req-281e18ee-dd16-4241-8ef0-71d0be8cb5af service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.066242 Dec 15 03:41:22.875297 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: [pid: 116157|app: 0|req: 1049/2110] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Dec 15 03:41:22 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 15 03:41:22.923324 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.policy [None req-944bfba4-8467-4cf9-b4a2-15a0b786c1bf tempest-AttachVolumeTestJSON-244989543 tempest-AttachVolumeTestJSON-244989543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5fb31c3d4874e13ba22e0242d4aaa58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00e76c2a092544e1a51928f1d84879b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116156) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:41:22.938266 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: INFO nova.api.openstack.requestlog [None req-944bfba4-8467-4cf9-b4a2-15a0b786c1bf tempest-AttachVolumeTestJSON-244989543 tempest-AttachVolumeTestJSON-244989543-project] 10.222.0.18 "GET /compute/v2.1/servers/e0ad8879-83dd-40e5-a0b4-4c8d1f25e3b5" status: 200 len: 1364 microversion: 2.1 time: 0.373513 Dec 15 03:41:22.938946 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: [pid: 116156|app: 0|req: 1062/2111] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 03:41:22 2021] GET /compute/v2.1/servers/e0ad8879-83dd-40e5-a0b4-4c8d1f25e3b5 => generated 1364 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 03:41:23.956107 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi [None req-b6e17d9a-a989-4096-bd77-c794a9bfa0ee tempest-AttachVolumeTestJSON-244989543 tempest-AttachVolumeTestJSON-244989543-project] Calling method '>' {{(pid=116157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:41:23.956801 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.compute.api [None req-b6e17d9a-a989-4096-bd77-c794a9bfa0ee tempest-AttachVolumeTestJSON-244989543 tempest-AttachVolumeTestJSON-244989543-project] [instance: e0ad8879-83dd-40e5-a0b4-4c8d1f25e3b5] Fetching instance by UUID {{(pid=116157) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:41:23.963901 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-b6e17d9a-a989-4096-bd77-c794a9bfa0ee tempest-AttachVolumeTestJSON-244989543 tempest-AttachVolumeTestJSON-244989543-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:41:23.964348 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-b6e17d9a-a989-4096-bd77-c794a9bfa0ee tempest-AttachVolumeTestJSON-244989543 tempest-AttachVolumeTestJSON-244989543-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:41:23.965389 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-b6e17d9a-a989-4096-bd77-c794a9bfa0ee tempest-AttachVolumeTestJSON-244989543 tempest-AttachVolumeTestJSON-244989543-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:41:23.965817 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-b6e17d9a-a989-4096-bd77-c794a9bfa0ee tempest-AttachVolumeTestJSON-244989543 tempest-AttachVolumeTestJSON-244989543-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:41:24.100785 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.policy [None req-b6e17d9a-a989-4096-bd77-c794a9bfa0ee tempest-AttachVolumeTestJSON-244989543 tempest-AttachVolumeTestJSON-244989543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5fb31c3d4874e13ba22e0242d4aaa58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00e76c2a092544e1a51928f1d84879b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116157) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:41:24.108387 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: INFO nova.api.openstack.requestlog [None req-b6e17d9a-a989-4096-bd77-c794a9bfa0ee tempest-AttachVolumeTestJSON-244989543 tempest-AttachVolumeTestJSON-244989543-project] 10.222.0.18 "GET /compute/v2.1/servers/e0ad8879-83dd-40e5-a0b4-4c8d1f25e3b5" status: 200 len: 1364 microversion: 2.1 time: 0.156908 Dec 15 03:41:24.108948 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: [pid: 116157|app: 0|req: 1050/2112] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 03:41:23 2021] GET /compute/v2.1/servers/e0ad8879-83dd-40e5-a0b4-4c8d1f25e3b5 => generated 1364 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 03:41:25.125222 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi [None req-b13c6d29-3f66-4af3-beca-67cc30805c78 tempest-AttachVolumeTestJSON-244989543 tempest-AttachVolumeTestJSON-244989543-project] Calling method '>' {{(pid=116156) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:41:25.125750 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.compute.api [None req-b13c6d29-3f66-4af3-beca-67cc30805c78 tempest-AttachVolumeTestJSON-244989543 tempest-AttachVolumeTestJSON-244989543-project] [instance: e0ad8879-83dd-40e5-a0b4-4c8d1f25e3b5] Fetching instance by UUID {{(pid=116156) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:41:25.132234 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-b13c6d29-3f66-4af3-beca-67cc30805c78 tempest-AttachVolumeTestJSON-244989543 tempest-AttachVolumeTestJSON-244989543-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:41:25.132721 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-b13c6d29-3f66-4af3-beca-67cc30805c78 tempest-AttachVolumeTestJSON-244989543 tempest-AttachVolumeTestJSON-244989543-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:41:25.133452 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-b13c6d29-3f66-4af3-beca-67cc30805c78 tempest-AttachVolumeTestJSON-244989543 tempest-AttachVolumeTestJSON-244989543-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:41:25.133910 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-b13c6d29-3f66-4af3-beca-67cc30805c78 tempest-AttachVolumeTestJSON-244989543 tempest-AttachVolumeTestJSON-244989543-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:41:25.264170 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.policy [None req-b13c6d29-3f66-4af3-beca-67cc30805c78 tempest-AttachVolumeTestJSON-244989543 tempest-AttachVolumeTestJSON-244989543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5fb31c3d4874e13ba22e0242d4aaa58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00e76c2a092544e1a51928f1d84879b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116156) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:41:25.271397 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: INFO nova.api.openstack.requestlog [None req-b13c6d29-3f66-4af3-beca-67cc30805c78 tempest-AttachVolumeTestJSON-244989543 tempest-AttachVolumeTestJSON-244989543-project] 10.222.0.18 "GET /compute/v2.1/servers/e0ad8879-83dd-40e5-a0b4-4c8d1f25e3b5" status: 200 len: 1364 microversion: 2.1 time: 0.149806 Dec 15 03:41:25.272444 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: [pid: 116156|app: 0|req: 1063/2113] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 03:41:25 2021] GET /compute/v2.1/servers/e0ad8879-83dd-40e5-a0b4-4c8d1f25e3b5 => generated 1364 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 03:41:26.289038 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi [None req-8ef8ccf3-5ed7-4daf-8438-6f2b78f0dc33 tempest-AttachVolumeTestJSON-244989543 tempest-AttachVolumeTestJSON-244989543-project] Calling method '>' {{(pid=116157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:41:26.289650 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.compute.api [None req-8ef8ccf3-5ed7-4daf-8438-6f2b78f0dc33 tempest-AttachVolumeTestJSON-244989543 tempest-AttachVolumeTestJSON-244989543-project] [instance: e0ad8879-83dd-40e5-a0b4-4c8d1f25e3b5] Fetching instance by UUID {{(pid=116157) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:41:26.295991 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-8ef8ccf3-5ed7-4daf-8438-6f2b78f0dc33 tempest-AttachVolumeTestJSON-244989543 tempest-AttachVolumeTestJSON-244989543-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:41:26.296441 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-8ef8ccf3-5ed7-4daf-8438-6f2b78f0dc33 tempest-AttachVolumeTestJSON-244989543 tempest-AttachVolumeTestJSON-244989543-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:41:26.297216 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-8ef8ccf3-5ed7-4daf-8438-6f2b78f0dc33 tempest-AttachVolumeTestJSON-244989543 tempest-AttachVolumeTestJSON-244989543-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:41:26.297652 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-8ef8ccf3-5ed7-4daf-8438-6f2b78f0dc33 tempest-AttachVolumeTestJSON-244989543 tempest-AttachVolumeTestJSON-244989543-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:41:26.425129 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.policy [None req-8ef8ccf3-5ed7-4daf-8438-6f2b78f0dc33 tempest-AttachVolumeTestJSON-244989543 tempest-AttachVolumeTestJSON-244989543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5fb31c3d4874e13ba22e0242d4aaa58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00e76c2a092544e1a51928f1d84879b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116157) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:41:26.432815 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: INFO nova.api.openstack.requestlog [None req-8ef8ccf3-5ed7-4daf-8438-6f2b78f0dc33 tempest-AttachVolumeTestJSON-244989543 tempest-AttachVolumeTestJSON-244989543-project] 10.222.0.18 "GET /compute/v2.1/servers/e0ad8879-83dd-40e5-a0b4-4c8d1f25e3b5" status: 200 len: 1364 microversion: 2.1 time: 0.147997 Dec 15 03:41:26.433377 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: [pid: 116157|app: 0|req: 1051/2114] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 03:41:26 2021] GET /compute/v2.1/servers/e0ad8879-83dd-40e5-a0b4-4c8d1f25e3b5 => generated 1364 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 03:41:27.449257 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi [None req-3f0036d0-a123-4932-bfa2-9c39f0472305 tempest-AttachVolumeTestJSON-244989543 tempest-AttachVolumeTestJSON-244989543-project] Calling method '>' {{(pid=116156) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:41:27.449871 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.compute.api [None req-3f0036d0-a123-4932-bfa2-9c39f0472305 tempest-AttachVolumeTestJSON-244989543 tempest-AttachVolumeTestJSON-244989543-project] [instance: e0ad8879-83dd-40e5-a0b4-4c8d1f25e3b5] Fetching instance by UUID {{(pid=116156) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:41:27.456143 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-3f0036d0-a123-4932-bfa2-9c39f0472305 tempest-AttachVolumeTestJSON-244989543 tempest-AttachVolumeTestJSON-244989543-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:41:27.456592 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-3f0036d0-a123-4932-bfa2-9c39f0472305 tempest-AttachVolumeTestJSON-244989543 tempest-AttachVolumeTestJSON-244989543-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:41:27.457365 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-3f0036d0-a123-4932-bfa2-9c39f0472305 tempest-AttachVolumeTestJSON-244989543 tempest-AttachVolumeTestJSON-244989543-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:41:27.457804 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-3f0036d0-a123-4932-bfa2-9c39f0472305 tempest-AttachVolumeTestJSON-244989543 tempest-AttachVolumeTestJSON-244989543-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:41:27.587479 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.policy [None req-3f0036d0-a123-4932-bfa2-9c39f0472305 tempest-AttachVolumeTestJSON-244989543 tempest-AttachVolumeTestJSON-244989543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5fb31c3d4874e13ba22e0242d4aaa58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00e76c2a092544e1a51928f1d84879b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116156) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:41:27.594910 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: INFO nova.api.openstack.requestlog [None req-3f0036d0-a123-4932-bfa2-9c39f0472305 tempest-AttachVolumeTestJSON-244989543 tempest-AttachVolumeTestJSON-244989543-project] 10.222.0.18 "GET /compute/v2.1/servers/e0ad8879-83dd-40e5-a0b4-4c8d1f25e3b5" status: 200 len: 1364 microversion: 2.1 time: 0.149253 Dec 15 03:41:27.595465 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: [pid: 116156|app: 0|req: 1064/2115] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 03:41:27 2021] GET /compute/v2.1/servers/e0ad8879-83dd-40e5-a0b4-4c8d1f25e3b5 => generated 1364 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 03:41:27.775103 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi [req-716b8796-84fd-4f5f-a688-6fa7063ad043 req-23c29eeb-bb4d-478c-8db2-f875697a29a4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e0ad8879-83dd-40e5-a0b4-4c8d1f25e3b5", "name": "network-vif-plugged", "status": "completed", "tag": "410a400e-6c2f-44c9-9f22-1b43ae92fdcf"}]} {{(pid=116157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 03:41:27.776775 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 15 03:41:27.776775 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: warnings.warn(msg) Dec 15 03:41:27.784416 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [req-716b8796-84fd-4f5f-a688-6fa7063ad043 req-23c29eeb-bb4d-478c-8db2-f875697a29a4 service nova] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:41:27.784869 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [req-716b8796-84fd-4f5f-a688-6fa7063ad043 req-23c29eeb-bb4d-478c-8db2-f875697a29a4 service nova] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:41:27.796913 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: INFO nova.api.openstack.compute.server_external_events [req-716b8796-84fd-4f5f-a688-6fa7063ad043 req-23c29eeb-bb4d-478c-8db2-f875697a29a4 service nova] Creating event network-vif-plugged:410a400e-6c2f-44c9-9f22-1b43ae92fdcf for instance e0ad8879-83dd-40e5-a0b4-4c8d1f25e3b5 on hv-cinder-81803 Dec 15 03:41:27.801618 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: INFO nova.api.openstack.requestlog [req-716b8796-84fd-4f5f-a688-6fa7063ad043 req-23c29eeb-bb4d-478c-8db2-f875697a29a4 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030848 Dec 15 03:41:27.802230 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: [pid: 116157|app: 0|req: 1052/2116] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Dec 15 03:41:27 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 03:41:28.612215 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi [None req-b469b901-1a75-419f-ace7-c38364120469 tempest-AttachVolumeTestJSON-244989543 tempest-AttachVolumeTestJSON-244989543-project] Calling method '>' {{(pid=116156) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:41:28.612839 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.compute.api [None req-b469b901-1a75-419f-ace7-c38364120469 tempest-AttachVolumeTestJSON-244989543 tempest-AttachVolumeTestJSON-244989543-project] [instance: e0ad8879-83dd-40e5-a0b4-4c8d1f25e3b5] Fetching instance by UUID {{(pid=116156) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:41:28.619214 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-b469b901-1a75-419f-ace7-c38364120469 tempest-AttachVolumeTestJSON-244989543 tempest-AttachVolumeTestJSON-244989543-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:41:28.619741 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-b469b901-1a75-419f-ace7-c38364120469 tempest-AttachVolumeTestJSON-244989543 tempest-AttachVolumeTestJSON-244989543-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:41:28.620613 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-b469b901-1a75-419f-ace7-c38364120469 tempest-AttachVolumeTestJSON-244989543 tempest-AttachVolumeTestJSON-244989543-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:41:28.621123 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-b469b901-1a75-419f-ace7-c38364120469 tempest-AttachVolumeTestJSON-244989543 tempest-AttachVolumeTestJSON-244989543-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:41:28.754995 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.policy [None req-b469b901-1a75-419f-ace7-c38364120469 tempest-AttachVolumeTestJSON-244989543 tempest-AttachVolumeTestJSON-244989543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5fb31c3d4874e13ba22e0242d4aaa58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00e76c2a092544e1a51928f1d84879b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116156) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:41:28.763226 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: INFO nova.api.openstack.requestlog [None req-b469b901-1a75-419f-ace7-c38364120469 tempest-AttachVolumeTestJSON-244989543 tempest-AttachVolumeTestJSON-244989543-project] 10.222.0.18 "GET /compute/v2.1/servers/e0ad8879-83dd-40e5-a0b4-4c8d1f25e3b5" status: 200 len: 1364 microversion: 2.1 time: 0.154637 Dec 15 03:41:28.763790 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: [pid: 116156|app: 0|req: 1065/2117] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 03:41:28 2021] GET /compute/v2.1/servers/e0ad8879-83dd-40e5-a0b4-4c8d1f25e3b5 => generated 1364 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 03:41:29.780973 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi [None req-02358701-5379-4d3b-b814-2ab84b45f5b4 tempest-AttachVolumeTestJSON-244989543 tempest-AttachVolumeTestJSON-244989543-project] Calling method '>' {{(pid=116157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:41:29.781592 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.compute.api [None req-02358701-5379-4d3b-b814-2ab84b45f5b4 tempest-AttachVolumeTestJSON-244989543 tempest-AttachVolumeTestJSON-244989543-project] [instance: e0ad8879-83dd-40e5-a0b4-4c8d1f25e3b5] Fetching instance by UUID {{(pid=116157) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:41:29.788621 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-02358701-5379-4d3b-b814-2ab84b45f5b4 tempest-AttachVolumeTestJSON-244989543 tempest-AttachVolumeTestJSON-244989543-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:41:29.789069 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-02358701-5379-4d3b-b814-2ab84b45f5b4 tempest-AttachVolumeTestJSON-244989543 tempest-AttachVolumeTestJSON-244989543-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:41:29.789856 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-02358701-5379-4d3b-b814-2ab84b45f5b4 tempest-AttachVolumeTestJSON-244989543 tempest-AttachVolumeTestJSON-244989543-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:41:29.790342 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-02358701-5379-4d3b-b814-2ab84b45f5b4 tempest-AttachVolumeTestJSON-244989543 tempest-AttachVolumeTestJSON-244989543-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:41:29.919472 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.policy [None req-02358701-5379-4d3b-b814-2ab84b45f5b4 tempest-AttachVolumeTestJSON-244989543 tempest-AttachVolumeTestJSON-244989543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5fb31c3d4874e13ba22e0242d4aaa58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00e76c2a092544e1a51928f1d84879b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116157) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:41:29.926915 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: INFO nova.api.openstack.requestlog [None req-02358701-5379-4d3b-b814-2ab84b45f5b4 tempest-AttachVolumeTestJSON-244989543 tempest-AttachVolumeTestJSON-244989543-project] 10.222.0.18 "GET /compute/v2.1/servers/e0ad8879-83dd-40e5-a0b4-4c8d1f25e3b5" status: 200 len: 1551 microversion: 2.1 time: 0.149845 Dec 15 03:41:29.927292 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: [pid: 116157|app: 0|req: 1053/2118] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 03:41:29 2021] GET /compute/v2.1/servers/e0ad8879-83dd-40e5-a0b4-4c8d1f25e3b5 => generated 1551 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 03:41:29.942951 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi [None req-6ffdd61f-2209-4343-b346-04b63002bdc8 tempest-AttachVolumeTestJSON-244989543 tempest-AttachVolumeTestJSON-244989543-project] Calling method '>' {{(pid=116156) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:41:29.943430 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.compute.api [None req-6ffdd61f-2209-4343-b346-04b63002bdc8 tempest-AttachVolumeTestJSON-244989543 tempest-AttachVolumeTestJSON-244989543-project] [instance: e0ad8879-83dd-40e5-a0b4-4c8d1f25e3b5] Fetching instance by UUID {{(pid=116156) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:41:29.950337 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-6ffdd61f-2209-4343-b346-04b63002bdc8 tempest-AttachVolumeTestJSON-244989543 tempest-AttachVolumeTestJSON-244989543-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:41:29.950871 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-6ffdd61f-2209-4343-b346-04b63002bdc8 tempest-AttachVolumeTestJSON-244989543 tempest-AttachVolumeTestJSON-244989543-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:41:29.951745 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-6ffdd61f-2209-4343-b346-04b63002bdc8 tempest-AttachVolumeTestJSON-244989543 tempest-AttachVolumeTestJSON-244989543-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:41:29.952251 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-6ffdd61f-2209-4343-b346-04b63002bdc8 tempest-AttachVolumeTestJSON-244989543 tempest-AttachVolumeTestJSON-244989543-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:41:30.031460 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: INFO nova.api.openstack.requestlog [None req-6ffdd61f-2209-4343-b346-04b63002bdc8 tempest-AttachVolumeTestJSON-244989543 tempest-AttachVolumeTestJSON-244989543-project] 10.222.0.18 "GET /compute/v2.1/servers/e0ad8879-83dd-40e5-a0b4-4c8d1f25e3b5/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.091977 Dec 15 03:41:30.032089 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: [pid: 116156|app: 0|req: 1066/2119] 10.222.0.18 () {58 vars in 1274 bytes} [Wed Dec 15 03:41:29 2021] GET /compute/v2.1/servers/e0ad8879-83dd-40e5-a0b4-4c8d1f25e3b5/os-interface => generated 285 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 03:41:31.229140 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi [None req-a4dd6b59-adc8-4927-880e-8698ea27a150 tempest-AttachVolumeTestJSON-244989543 tempest-AttachVolumeTestJSON-244989543-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 03:41:31.230814 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.compute.api [None req-a4dd6b59-adc8-4927-880e-8698ea27a150 tempest-AttachVolumeTestJSON-244989543 tempest-AttachVolumeTestJSON-244989543-project] [instance: e0ad8879-83dd-40e5-a0b4-4c8d1f25e3b5] Fetching instance by UUID {{(pid=116157) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:41:31.237228 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-a4dd6b59-adc8-4927-880e-8698ea27a150 tempest-AttachVolumeTestJSON-244989543 tempest-AttachVolumeTestJSON-244989543-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:41:31.238094 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-a4dd6b59-adc8-4927-880e-8698ea27a150 tempest-AttachVolumeTestJSON-244989543 tempest-AttachVolumeTestJSON-244989543-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:41:31.239167 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-a4dd6b59-adc8-4927-880e-8698ea27a150 tempest-AttachVolumeTestJSON-244989543 tempest-AttachVolumeTestJSON-244989543-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:41:31.239320 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-a4dd6b59-adc8-4927-880e-8698ea27a150 tempest-AttachVolumeTestJSON-244989543 tempest-AttachVolumeTestJSON-244989543-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:41:31.337322 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: INFO nova.api.openstack.requestlog [None req-a4dd6b59-adc8-4927-880e-8698ea27a150 tempest-AttachVolumeTestJSON-244989543 tempest-AttachVolumeTestJSON-244989543-project] 10.222.0.18 "POST /compute/v2.1/servers/e0ad8879-83dd-40e5-a0b4-4c8d1f25e3b5/action" status: 200 len: 14 microversion: 2.1 time: 0.112267 Dec 15 03:41:31.338377 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: [pid: 116157|app: 0|req: 1054/2120] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Dec 15 03:41:31 2021] POST /compute/v2.1/servers/e0ad8879-83dd-40e5-a0b4-4c8d1f25e3b5/action => generated 14 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Dec 15 03:41:31.461363 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi [req-52682b9a-97d7-4b7b-ac95-83db154e5acd req-2a15c3e9-b18a-463b-ac85-5b5bb0c425d0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e0ad8879-83dd-40e5-a0b4-4c8d1f25e3b5", "tag": "410a400e-6c2f-44c9-9f22-1b43ae92fdcf"}]} {{(pid=116156) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 03:41:31.462920 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 15 03:41:31.462920 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: warnings.warn(msg) Dec 15 03:41:31.469831 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [req-52682b9a-97d7-4b7b-ac95-83db154e5acd req-2a15c3e9-b18a-463b-ac85-5b5bb0c425d0 service nova] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:41:31.470368 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [req-52682b9a-97d7-4b7b-ac95-83db154e5acd req-2a15c3e9-b18a-463b-ac85-5b5bb0c425d0 service nova] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:41:31.481599 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: INFO nova.api.openstack.compute.server_external_events [req-52682b9a-97d7-4b7b-ac95-83db154e5acd req-2a15c3e9-b18a-463b-ac85-5b5bb0c425d0 service nova] Creating event network-changed:410a400e-6c2f-44c9-9f22-1b43ae92fdcf for instance e0ad8879-83dd-40e5-a0b4-4c8d1f25e3b5 on hv-cinder-81803 Dec 15 03:41:31.487634 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: INFO nova.api.openstack.requestlog [req-52682b9a-97d7-4b7b-ac95-83db154e5acd req-2a15c3e9-b18a-463b-ac85-5b5bb0c425d0 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.255670 Dec 15 03:41:31.488682 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: [pid: 116156|app: 0|req: 1067/2121] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Dec 15 03:41:31 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 03:41:32.352221 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi [None req-7d90e4eb-1555-4b4e-bc53-76be5bd72637 tempest-AttachVolumeTestJSON-244989543 tempest-AttachVolumeTestJSON-244989543-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 03:41:32.356412 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.compute.api [None req-7d90e4eb-1555-4b4e-bc53-76be5bd72637 tempest-AttachVolumeTestJSON-244989543 tempest-AttachVolumeTestJSON-244989543-project] [instance: e0ad8879-83dd-40e5-a0b4-4c8d1f25e3b5] Fetching instance by UUID {{(pid=116157) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:41:32.366438 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-7d90e4eb-1555-4b4e-bc53-76be5bd72637 tempest-AttachVolumeTestJSON-244989543 tempest-AttachVolumeTestJSON-244989543-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:41:32.368100 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-7d90e4eb-1555-4b4e-bc53-76be5bd72637 tempest-AttachVolumeTestJSON-244989543 tempest-AttachVolumeTestJSON-244989543-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:41:32.369265 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-7d90e4eb-1555-4b4e-bc53-76be5bd72637 tempest-AttachVolumeTestJSON-244989543 tempest-AttachVolumeTestJSON-244989543-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:41:32.369956 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-7d90e4eb-1555-4b4e-bc53-76be5bd72637 tempest-AttachVolumeTestJSON-244989543 tempest-AttachVolumeTestJSON-244989543-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:41:32.454322 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: INFO nova.api.openstack.requestlog [None req-7d90e4eb-1555-4b4e-bc53-76be5bd72637 tempest-AttachVolumeTestJSON-244989543 tempest-AttachVolumeTestJSON-244989543-project] 10.222.0.18 "POST /compute/v2.1/servers/e0ad8879-83dd-40e5-a0b4-4c8d1f25e3b5/action" status: 200 len: 14 microversion: 2.1 time: 0.107858 Dec 15 03:41:32.455067 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: [pid: 116157|app: 0|req: 1055/2122] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Dec 15 03:41:32 2021] POST /compute/v2.1/servers/e0ad8879-83dd-40e5-a0b4-4c8d1f25e3b5/action => generated 14 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Dec 15 03:41:33.468808 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi [None req-4267c190-0fea-4d25-af75-97b93c286c6b tempest-AttachVolumeTestJSON-244989543 tempest-AttachVolumeTestJSON-244989543-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116156) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 03:41:33.469845 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.compute.api [None req-4267c190-0fea-4d25-af75-97b93c286c6b tempest-AttachVolumeTestJSON-244989543 tempest-AttachVolumeTestJSON-244989543-project] [instance: e0ad8879-83dd-40e5-a0b4-4c8d1f25e3b5] Fetching instance by UUID {{(pid=116156) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:41:33.477353 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-4267c190-0fea-4d25-af75-97b93c286c6b tempest-AttachVolumeTestJSON-244989543 tempest-AttachVolumeTestJSON-244989543-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:41:33.478017 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-4267c190-0fea-4d25-af75-97b93c286c6b tempest-AttachVolumeTestJSON-244989543 tempest-AttachVolumeTestJSON-244989543-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:41:33.478657 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-4267c190-0fea-4d25-af75-97b93c286c6b tempest-AttachVolumeTestJSON-244989543 tempest-AttachVolumeTestJSON-244989543-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:41:33.479095 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-4267c190-0fea-4d25-af75-97b93c286c6b tempest-AttachVolumeTestJSON-244989543 tempest-AttachVolumeTestJSON-244989543-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:41:33.570737 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: INFO nova.api.openstack.requestlog [None req-4267c190-0fea-4d25-af75-97b93c286c6b tempest-AttachVolumeTestJSON-244989543 tempest-AttachVolumeTestJSON-244989543-project] 10.222.0.18 "POST /compute/v2.1/servers/e0ad8879-83dd-40e5-a0b4-4c8d1f25e3b5/action" status: 200 len: 14 microversion: 2.1 time: 0.108905 Dec 15 03:41:33.571368 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: [pid: 116156|app: 0|req: 1068/2123] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Dec 15 03:41:33 2021] POST /compute/v2.1/servers/e0ad8879-83dd-40e5-a0b4-4c8d1f25e3b5/action => generated 14 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Dec 15 03:41:34.583905 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi [None req-686f0f8d-d09e-4737-9d79-be1c8cd500a1 tempest-AttachVolumeTestJSON-244989543 tempest-AttachVolumeTestJSON-244989543-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 03:41:34.588862 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.compute.api [None req-686f0f8d-d09e-4737-9d79-be1c8cd500a1 tempest-AttachVolumeTestJSON-244989543 tempest-AttachVolumeTestJSON-244989543-project] [instance: e0ad8879-83dd-40e5-a0b4-4c8d1f25e3b5] Fetching instance by UUID {{(pid=116157) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:41:34.597342 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-686f0f8d-d09e-4737-9d79-be1c8cd500a1 tempest-AttachVolumeTestJSON-244989543 tempest-AttachVolumeTestJSON-244989543-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:41:34.598173 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-686f0f8d-d09e-4737-9d79-be1c8cd500a1 tempest-AttachVolumeTestJSON-244989543 tempest-AttachVolumeTestJSON-244989543-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:41:34.599508 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-686f0f8d-d09e-4737-9d79-be1c8cd500a1 tempest-AttachVolumeTestJSON-244989543 tempest-AttachVolumeTestJSON-244989543-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:41:34.600172 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-686f0f8d-d09e-4737-9d79-be1c8cd500a1 tempest-AttachVolumeTestJSON-244989543 tempest-AttachVolumeTestJSON-244989543-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:41:34.681582 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: INFO nova.api.openstack.requestlog [None req-686f0f8d-d09e-4737-9d79-be1c8cd500a1 tempest-AttachVolumeTestJSON-244989543 tempest-AttachVolumeTestJSON-244989543-project] 10.222.0.18 "POST /compute/v2.1/servers/e0ad8879-83dd-40e5-a0b4-4c8d1f25e3b5/action" status: 200 len: 14 microversion: 2.1 time: 0.101810 Dec 15 03:41:34.685098 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: [pid: 116157|app: 0|req: 1056/2124] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Dec 15 03:41:34 2021] POST /compute/v2.1/servers/e0ad8879-83dd-40e5-a0b4-4c8d1f25e3b5/action => generated 14 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Dec 15 03:41:35.694164 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi [None req-790c1f73-d4fd-4f9f-bedc-266ea5f79ab7 tempest-AttachVolumeTestJSON-244989543 tempest-AttachVolumeTestJSON-244989543-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116156) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 03:41:35.695382 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.compute.api [None req-790c1f73-d4fd-4f9f-bedc-266ea5f79ab7 tempest-AttachVolumeTestJSON-244989543 tempest-AttachVolumeTestJSON-244989543-project] [instance: e0ad8879-83dd-40e5-a0b4-4c8d1f25e3b5] Fetching instance by UUID {{(pid=116156) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:41:35.703034 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-790c1f73-d4fd-4f9f-bedc-266ea5f79ab7 tempest-AttachVolumeTestJSON-244989543 tempest-AttachVolumeTestJSON-244989543-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:41:35.703642 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-790c1f73-d4fd-4f9f-bedc-266ea5f79ab7 tempest-AttachVolumeTestJSON-244989543 tempest-AttachVolumeTestJSON-244989543-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:41:35.704462 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-790c1f73-d4fd-4f9f-bedc-266ea5f79ab7 tempest-AttachVolumeTestJSON-244989543 tempest-AttachVolumeTestJSON-244989543-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:41:35.704904 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-790c1f73-d4fd-4f9f-bedc-266ea5f79ab7 tempest-AttachVolumeTestJSON-244989543 tempest-AttachVolumeTestJSON-244989543-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:41:35.789225 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: INFO nova.api.openstack.requestlog [None req-790c1f73-d4fd-4f9f-bedc-266ea5f79ab7 tempest-AttachVolumeTestJSON-244989543 tempest-AttachVolumeTestJSON-244989543-project] 10.222.0.18 "POST /compute/v2.1/servers/e0ad8879-83dd-40e5-a0b4-4c8d1f25e3b5/action" status: 200 len: 14 microversion: 2.1 time: 0.099454 Dec 15 03:41:35.792289 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: [pid: 116156|app: 0|req: 1069/2125] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Dec 15 03:41:35 2021] POST /compute/v2.1/servers/e0ad8879-83dd-40e5-a0b4-4c8d1f25e3b5/action => generated 14 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Dec 15 03:41:36.800463 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi [None req-1712dc7d-2ec6-48aa-bc8b-cd17424ef5de tempest-AttachVolumeTestJSON-244989543 tempest-AttachVolumeTestJSON-244989543-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 03:41:36.801567 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.compute.api [None req-1712dc7d-2ec6-48aa-bc8b-cd17424ef5de tempest-AttachVolumeTestJSON-244989543 tempest-AttachVolumeTestJSON-244989543-project] [instance: e0ad8879-83dd-40e5-a0b4-4c8d1f25e3b5] Fetching instance by UUID {{(pid=116157) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:41:36.809140 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-1712dc7d-2ec6-48aa-bc8b-cd17424ef5de tempest-AttachVolumeTestJSON-244989543 tempest-AttachVolumeTestJSON-244989543-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:41:36.809665 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-1712dc7d-2ec6-48aa-bc8b-cd17424ef5de tempest-AttachVolumeTestJSON-244989543 tempest-AttachVolumeTestJSON-244989543-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:41:36.810556 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-1712dc7d-2ec6-48aa-bc8b-cd17424ef5de tempest-AttachVolumeTestJSON-244989543 tempest-AttachVolumeTestJSON-244989543-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:41:36.811062 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-1712dc7d-2ec6-48aa-bc8b-cd17424ef5de tempest-AttachVolumeTestJSON-244989543 tempest-AttachVolumeTestJSON-244989543-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:41:36.891956 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: INFO nova.api.openstack.requestlog [None req-1712dc7d-2ec6-48aa-bc8b-cd17424ef5de tempest-AttachVolumeTestJSON-244989543 tempest-AttachVolumeTestJSON-244989543-project] 10.222.0.18 "POST /compute/v2.1/servers/e0ad8879-83dd-40e5-a0b4-4c8d1f25e3b5/action" status: 200 len: 14 microversion: 2.1 time: 0.095453 Dec 15 03:41:36.895733 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: [pid: 116157|app: 0|req: 1057/2126] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Dec 15 03:41:36 2021] POST /compute/v2.1/servers/e0ad8879-83dd-40e5-a0b4-4c8d1f25e3b5/action => generated 14 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Dec 15 03:41:37.904170 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi [None req-5f1c4072-57fc-4f65-ae92-41e6470438ec tempest-AttachVolumeTestJSON-244989543 tempest-AttachVolumeTestJSON-244989543-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116156) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 03:41:37.905315 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.compute.api [None req-5f1c4072-57fc-4f65-ae92-41e6470438ec tempest-AttachVolumeTestJSON-244989543 tempest-AttachVolumeTestJSON-244989543-project] [instance: e0ad8879-83dd-40e5-a0b4-4c8d1f25e3b5] Fetching instance by UUID {{(pid=116156) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:41:37.913671 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-5f1c4072-57fc-4f65-ae92-41e6470438ec tempest-AttachVolumeTestJSON-244989543 tempest-AttachVolumeTestJSON-244989543-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:41:37.914213 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-5f1c4072-57fc-4f65-ae92-41e6470438ec tempest-AttachVolumeTestJSON-244989543 tempest-AttachVolumeTestJSON-244989543-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:41:37.915191 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-5f1c4072-57fc-4f65-ae92-41e6470438ec tempest-AttachVolumeTestJSON-244989543 tempest-AttachVolumeTestJSON-244989543-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:41:37.915636 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-5f1c4072-57fc-4f65-ae92-41e6470438ec tempest-AttachVolumeTestJSON-244989543 tempest-AttachVolumeTestJSON-244989543-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:41:38.004913 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: INFO nova.api.openstack.requestlog [None req-5f1c4072-57fc-4f65-ae92-41e6470438ec tempest-AttachVolumeTestJSON-244989543 tempest-AttachVolumeTestJSON-244989543-project] 10.222.0.18 "POST /compute/v2.1/servers/e0ad8879-83dd-40e5-a0b4-4c8d1f25e3b5/action" status: 200 len: 14 microversion: 2.1 time: 0.104741 Dec 15 03:41:38.006449 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: [pid: 116156|app: 0|req: 1070/2127] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Dec 15 03:41:37 2021] POST /compute/v2.1/servers/e0ad8879-83dd-40e5-a0b4-4c8d1f25e3b5/action => generated 14 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Dec 15 03:41:39.019284 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi [None req-bd4db4f4-8394-44fa-b376-f8726db7d4b3 tempest-AttachVolumeTestJSON-244989543 tempest-AttachVolumeTestJSON-244989543-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 03:41:39.027704 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.compute.api [None req-bd4db4f4-8394-44fa-b376-f8726db7d4b3 tempest-AttachVolumeTestJSON-244989543 tempest-AttachVolumeTestJSON-244989543-project] [instance: e0ad8879-83dd-40e5-a0b4-4c8d1f25e3b5] Fetching instance by UUID {{(pid=116157) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:41:39.040426 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-bd4db4f4-8394-44fa-b376-f8726db7d4b3 tempest-AttachVolumeTestJSON-244989543 tempest-AttachVolumeTestJSON-244989543-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:41:39.041225 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-bd4db4f4-8394-44fa-b376-f8726db7d4b3 tempest-AttachVolumeTestJSON-244989543 tempest-AttachVolumeTestJSON-244989543-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:41:39.042295 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-bd4db4f4-8394-44fa-b376-f8726db7d4b3 tempest-AttachVolumeTestJSON-244989543 tempest-AttachVolumeTestJSON-244989543-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:41:39.043865 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-bd4db4f4-8394-44fa-b376-f8726db7d4b3 tempest-AttachVolumeTestJSON-244989543 tempest-AttachVolumeTestJSON-244989543-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:41:39.212193 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: INFO nova.api.openstack.requestlog [None req-bd4db4f4-8394-44fa-b376-f8726db7d4b3 tempest-AttachVolumeTestJSON-244989543 tempest-AttachVolumeTestJSON-244989543-project] 10.222.0.18 "POST /compute/v2.1/servers/e0ad8879-83dd-40e5-a0b4-4c8d1f25e3b5/action" status: 200 len: 14 microversion: 2.1 time: 0.199472 Dec 15 03:41:39.213095 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: [pid: 116157|app: 0|req: 1058/2128] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Dec 15 03:41:39 2021] POST /compute/v2.1/servers/e0ad8879-83dd-40e5-a0b4-4c8d1f25e3b5/action => generated 14 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Dec 15 03:41:40.229678 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi [None req-7543c7df-3d11-428a-920c-b76ac124d27f tempest-AttachVolumeTestJSON-244989543 tempest-AttachVolumeTestJSON-244989543-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116156) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 03:41:40.230808 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.compute.api [None req-7543c7df-3d11-428a-920c-b76ac124d27f tempest-AttachVolumeTestJSON-244989543 tempest-AttachVolumeTestJSON-244989543-project] [instance: e0ad8879-83dd-40e5-a0b4-4c8d1f25e3b5] Fetching instance by UUID {{(pid=116156) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:41:40.253335 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-7543c7df-3d11-428a-920c-b76ac124d27f tempest-AttachVolumeTestJSON-244989543 tempest-AttachVolumeTestJSON-244989543-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:41:40.253793 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-7543c7df-3d11-428a-920c-b76ac124d27f tempest-AttachVolumeTestJSON-244989543 tempest-AttachVolumeTestJSON-244989543-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:41:40.254641 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-7543c7df-3d11-428a-920c-b76ac124d27f tempest-AttachVolumeTestJSON-244989543 tempest-AttachVolumeTestJSON-244989543-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:41:40.255090 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-7543c7df-3d11-428a-920c-b76ac124d27f tempest-AttachVolumeTestJSON-244989543 tempest-AttachVolumeTestJSON-244989543-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:41:40.374638 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: INFO nova.api.openstack.requestlog [None req-7543c7df-3d11-428a-920c-b76ac124d27f tempest-AttachVolumeTestJSON-244989543 tempest-AttachVolumeTestJSON-244989543-project] 10.222.0.18 "POST /compute/v2.1/servers/e0ad8879-83dd-40e5-a0b4-4c8d1f25e3b5/action" status: 200 len: 14 microversion: 2.1 time: 0.151081 Dec 15 03:41:40.377767 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: [pid: 116156|app: 0|req: 1071/2129] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Dec 15 03:41:40 2021] POST /compute/v2.1/servers/e0ad8879-83dd-40e5-a0b4-4c8d1f25e3b5/action => generated 14 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Dec 15 03:41:41.385729 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi [None req-fc66ee58-3ba5-477b-8b66-c6d1819a1daa tempest-AttachVolumeTestJSON-244989543 tempest-AttachVolumeTestJSON-244989543-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 03:41:41.386797 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.compute.api [None req-fc66ee58-3ba5-477b-8b66-c6d1819a1daa tempest-AttachVolumeTestJSON-244989543 tempest-AttachVolumeTestJSON-244989543-project] [instance: e0ad8879-83dd-40e5-a0b4-4c8d1f25e3b5] Fetching instance by UUID {{(pid=116157) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:41:41.394074 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-fc66ee58-3ba5-477b-8b66-c6d1819a1daa tempest-AttachVolumeTestJSON-244989543 tempest-AttachVolumeTestJSON-244989543-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:41:41.394522 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-fc66ee58-3ba5-477b-8b66-c6d1819a1daa tempest-AttachVolumeTestJSON-244989543 tempest-AttachVolumeTestJSON-244989543-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:41:41.395871 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-fc66ee58-3ba5-477b-8b66-c6d1819a1daa tempest-AttachVolumeTestJSON-244989543 tempest-AttachVolumeTestJSON-244989543-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:41:41.396533 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-fc66ee58-3ba5-477b-8b66-c6d1819a1daa tempest-AttachVolumeTestJSON-244989543 tempest-AttachVolumeTestJSON-244989543-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:41:41.493917 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: INFO nova.api.openstack.requestlog [None req-fc66ee58-3ba5-477b-8b66-c6d1819a1daa tempest-AttachVolumeTestJSON-244989543 tempest-AttachVolumeTestJSON-244989543-project] 10.222.0.18 "POST /compute/v2.1/servers/e0ad8879-83dd-40e5-a0b4-4c8d1f25e3b5/action" status: 200 len: 12498 microversion: 2.1 time: 0.112329 Dec 15 03:41:41.494649 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: [pid: 116157|app: 0|req: 1059/2130] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Dec 15 03:41:41 2021] POST /compute/v2.1/servers/e0ad8879-83dd-40e5-a0b4-4c8d1f25e3b5/action => generated 12498 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 03:41:42.505601 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi [None req-a477b311-a25d-4b11-9d4e-4870a89eef3a tempest-AttachVolumeTestJSON-244989543 tempest-AttachVolumeTestJSON-244989543-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116156) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 03:41:42.507724 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.compute.api [None req-a477b311-a25d-4b11-9d4e-4870a89eef3a tempest-AttachVolumeTestJSON-244989543 tempest-AttachVolumeTestJSON-244989543-project] [instance: e0ad8879-83dd-40e5-a0b4-4c8d1f25e3b5] Fetching instance by UUID {{(pid=116156) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:41:42.515025 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-a477b311-a25d-4b11-9d4e-4870a89eef3a tempest-AttachVolumeTestJSON-244989543 tempest-AttachVolumeTestJSON-244989543-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:41:42.515763 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-a477b311-a25d-4b11-9d4e-4870a89eef3a tempest-AttachVolumeTestJSON-244989543 tempest-AttachVolumeTestJSON-244989543-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:41:42.517034 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-a477b311-a25d-4b11-9d4e-4870a89eef3a tempest-AttachVolumeTestJSON-244989543 tempest-AttachVolumeTestJSON-244989543-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:41:42.517711 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-a477b311-a25d-4b11-9d4e-4870a89eef3a tempest-AttachVolumeTestJSON-244989543 tempest-AttachVolumeTestJSON-244989543-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:41:42.616111 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: INFO nova.api.openstack.requestlog [None req-a477b311-a25d-4b11-9d4e-4870a89eef3a tempest-AttachVolumeTestJSON-244989543 tempest-AttachVolumeTestJSON-244989543-project] 10.222.0.18 "POST /compute/v2.1/servers/e0ad8879-83dd-40e5-a0b4-4c8d1f25e3b5/action" status: 200 len: 18608 microversion: 2.1 time: 0.113762 Dec 15 03:41:42.616948 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: [pid: 116156|app: 0|req: 1072/2131] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Dec 15 03:41:42 2021] POST /compute/v2.1/servers/e0ad8879-83dd-40e5-a0b4-4c8d1f25e3b5/action => generated 18608 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 03:41:43.628647 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi [None req-9e647d6b-8c90-4a9f-9d7a-07e6d757bba5 tempest-AttachVolumeTestJSON-244989543 tempest-AttachVolumeTestJSON-244989543-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 03:41:43.630012 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.compute.api [None req-9e647d6b-8c90-4a9f-9d7a-07e6d757bba5 tempest-AttachVolumeTestJSON-244989543 tempest-AttachVolumeTestJSON-244989543-project] [instance: e0ad8879-83dd-40e5-a0b4-4c8d1f25e3b5] Fetching instance by UUID {{(pid=116157) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:41:43.637025 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-9e647d6b-8c90-4a9f-9d7a-07e6d757bba5 tempest-AttachVolumeTestJSON-244989543 tempest-AttachVolumeTestJSON-244989543-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:41:43.637478 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-9e647d6b-8c90-4a9f-9d7a-07e6d757bba5 tempest-AttachVolumeTestJSON-244989543 tempest-AttachVolumeTestJSON-244989543-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:41:43.638295 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-9e647d6b-8c90-4a9f-9d7a-07e6d757bba5 tempest-AttachVolumeTestJSON-244989543 tempest-AttachVolumeTestJSON-244989543-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:41:43.638737 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-9e647d6b-8c90-4a9f-9d7a-07e6d757bba5 tempest-AttachVolumeTestJSON-244989543 tempest-AttachVolumeTestJSON-244989543-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:41:43.736365 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: INFO nova.api.openstack.requestlog [None req-9e647d6b-8c90-4a9f-9d7a-07e6d757bba5 tempest-AttachVolumeTestJSON-244989543 tempest-AttachVolumeTestJSON-244989543-project] 10.222.0.18 "POST /compute/v2.1/servers/e0ad8879-83dd-40e5-a0b4-4c8d1f25e3b5/action" status: 200 len: 19342 microversion: 2.1 time: 0.111491 Dec 15 03:41:43.741268 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: [pid: 116157|app: 0|req: 1060/2132] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Dec 15 03:41:43 2021] POST /compute/v2.1/servers/e0ad8879-83dd-40e5-a0b4-4c8d1f25e3b5/action => generated 19342 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 03:41:44.752249 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi [None req-92bbfbde-b10a-4d51-addd-0db18080f901 tempest-AttachVolumeTestJSON-244989543 tempest-AttachVolumeTestJSON-244989543-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116156) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 03:41:44.753551 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.compute.api [None req-92bbfbde-b10a-4d51-addd-0db18080f901 tempest-AttachVolumeTestJSON-244989543 tempest-AttachVolumeTestJSON-244989543-project] [instance: e0ad8879-83dd-40e5-a0b4-4c8d1f25e3b5] Fetching instance by UUID {{(pid=116156) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:41:44.765096 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-92bbfbde-b10a-4d51-addd-0db18080f901 tempest-AttachVolumeTestJSON-244989543 tempest-AttachVolumeTestJSON-244989543-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:41:44.765709 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-92bbfbde-b10a-4d51-addd-0db18080f901 tempest-AttachVolumeTestJSON-244989543 tempest-AttachVolumeTestJSON-244989543-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:41:44.766555 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-92bbfbde-b10a-4d51-addd-0db18080f901 tempest-AttachVolumeTestJSON-244989543 tempest-AttachVolumeTestJSON-244989543-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:41:44.766990 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-92bbfbde-b10a-4d51-addd-0db18080f901 tempest-AttachVolumeTestJSON-244989543 tempest-AttachVolumeTestJSON-244989543-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:41:44.899650 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: INFO nova.api.openstack.requestlog [None req-92bbfbde-b10a-4d51-addd-0db18080f901 tempest-AttachVolumeTestJSON-244989543 tempest-AttachVolumeTestJSON-244989543-project] 10.222.0.18 "POST /compute/v2.1/servers/e0ad8879-83dd-40e5-a0b4-4c8d1f25e3b5/action" status: 200 len: 22119 microversion: 2.1 time: 0.152754 Dec 15 03:41:44.900314 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: [pid: 116156|app: 0|req: 1073/2133] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Dec 15 03:41:44 2021] POST /compute/v2.1/servers/e0ad8879-83dd-40e5-a0b4-4c8d1f25e3b5/action => generated 22119 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 03:41:45.917208 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi [None req-5cfdb2b2-5c3d-41db-83f9-eb373c8763cd tempest-AttachVolumeTestJSON-244989543 tempest-AttachVolumeTestJSON-244989543-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 03:41:45.918333 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.compute.api [None req-5cfdb2b2-5c3d-41db-83f9-eb373c8763cd tempest-AttachVolumeTestJSON-244989543 tempest-AttachVolumeTestJSON-244989543-project] [instance: e0ad8879-83dd-40e5-a0b4-4c8d1f25e3b5] Fetching instance by UUID {{(pid=116157) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:41:45.926810 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-5cfdb2b2-5c3d-41db-83f9-eb373c8763cd tempest-AttachVolumeTestJSON-244989543 tempest-AttachVolumeTestJSON-244989543-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:41:45.928884 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-5cfdb2b2-5c3d-41db-83f9-eb373c8763cd tempest-AttachVolumeTestJSON-244989543 tempest-AttachVolumeTestJSON-244989543-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:41:45.930021 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-5cfdb2b2-5c3d-41db-83f9-eb373c8763cd tempest-AttachVolumeTestJSON-244989543 tempest-AttachVolumeTestJSON-244989543-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:41:45.930684 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-5cfdb2b2-5c3d-41db-83f9-eb373c8763cd tempest-AttachVolumeTestJSON-244989543 tempest-AttachVolumeTestJSON-244989543-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:41:46.028797 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: INFO nova.api.openstack.requestlog [None req-5cfdb2b2-5c3d-41db-83f9-eb373c8763cd tempest-AttachVolumeTestJSON-244989543 tempest-AttachVolumeTestJSON-244989543-project] 10.222.0.18 "POST /compute/v2.1/servers/e0ad8879-83dd-40e5-a0b4-4c8d1f25e3b5/action" status: 200 len: 23804 microversion: 2.1 time: 0.115529 Dec 15 03:41:46.029453 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: [pid: 116157|app: 0|req: 1061/2134] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Dec 15 03:41:45 2021] POST /compute/v2.1/servers/e0ad8879-83dd-40e5-a0b4-4c8d1f25e3b5/action => generated 23804 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Dec 15 03:41:47.047223 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi [None req-2e6d3e08-645a-4d8f-a19c-790e52098a36 tempest-AttachVolumeTestJSON-244989543 tempest-AttachVolumeTestJSON-244989543-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116156) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 03:41:47.048656 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.compute.api [None req-2e6d3e08-645a-4d8f-a19c-790e52098a36 tempest-AttachVolumeTestJSON-244989543 tempest-AttachVolumeTestJSON-244989543-project] [instance: e0ad8879-83dd-40e5-a0b4-4c8d1f25e3b5] Fetching instance by UUID {{(pid=116156) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:41:47.058964 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-2e6d3e08-645a-4d8f-a19c-790e52098a36 tempest-AttachVolumeTestJSON-244989543 tempest-AttachVolumeTestJSON-244989543-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:41:47.059414 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-2e6d3e08-645a-4d8f-a19c-790e52098a36 tempest-AttachVolumeTestJSON-244989543 tempest-AttachVolumeTestJSON-244989543-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:41:47.060204 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-2e6d3e08-645a-4d8f-a19c-790e52098a36 tempest-AttachVolumeTestJSON-244989543 tempest-AttachVolumeTestJSON-244989543-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:41:47.060634 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-2e6d3e08-645a-4d8f-a19c-790e52098a36 tempest-AttachVolumeTestJSON-244989543 tempest-AttachVolumeTestJSON-244989543-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:41:47.164995 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: INFO nova.api.openstack.requestlog [None req-2e6d3e08-645a-4d8f-a19c-790e52098a36 tempest-AttachVolumeTestJSON-244989543 tempest-AttachVolumeTestJSON-244989543-project] 10.222.0.18 "POST /compute/v2.1/servers/e0ad8879-83dd-40e5-a0b4-4c8d1f25e3b5/action" status: 200 len: 25284 microversion: 2.1 time: 0.125215 Dec 15 03:41:47.166615 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: [pid: 116156|app: 0|req: 1074/2135] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Dec 15 03:41:47 2021] POST /compute/v2.1/servers/e0ad8879-83dd-40e5-a0b4-4c8d1f25e3b5/action => generated 25284 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 03:41:48.177228 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi [None req-a7717784-397c-4924-a845-0eea04f02159 tempest-AttachVolumeTestJSON-244989543 tempest-AttachVolumeTestJSON-244989543-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 03:41:48.178768 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.compute.api [None req-a7717784-397c-4924-a845-0eea04f02159 tempest-AttachVolumeTestJSON-244989543 tempest-AttachVolumeTestJSON-244989543-project] [instance: e0ad8879-83dd-40e5-a0b4-4c8d1f25e3b5] Fetching instance by UUID {{(pid=116157) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:41:48.185371 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-a7717784-397c-4924-a845-0eea04f02159 tempest-AttachVolumeTestJSON-244989543 tempest-AttachVolumeTestJSON-244989543-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:41:48.185819 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-a7717784-397c-4924-a845-0eea04f02159 tempest-AttachVolumeTestJSON-244989543 tempest-AttachVolumeTestJSON-244989543-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:41:48.186862 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-a7717784-397c-4924-a845-0eea04f02159 tempest-AttachVolumeTestJSON-244989543 tempest-AttachVolumeTestJSON-244989543-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:41:48.187295 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-a7717784-397c-4924-a845-0eea04f02159 tempest-AttachVolumeTestJSON-244989543 tempest-AttachVolumeTestJSON-244989543-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:41:48.290185 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: INFO nova.api.openstack.requestlog [None req-a7717784-397c-4924-a845-0eea04f02159 tempest-AttachVolumeTestJSON-244989543 tempest-AttachVolumeTestJSON-244989543-project] 10.222.0.18 "POST /compute/v2.1/servers/e0ad8879-83dd-40e5-a0b4-4c8d1f25e3b5/action" status: 200 len: 26865 microversion: 2.1 time: 0.116786 Dec 15 03:41:48.290968 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: [pid: 116157|app: 0|req: 1062/2136] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Dec 15 03:41:48 2021] POST /compute/v2.1/servers/e0ad8879-83dd-40e5-a0b4-4c8d1f25e3b5/action => generated 26865 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 03:41:49.303497 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi [None req-ce9b09c1-7015-44cf-9492-2928c9ea9c5b tempest-AttachVolumeTestJSON-244989543 tempest-AttachVolumeTestJSON-244989543-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116156) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 03:41:49.304756 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.compute.api [None req-ce9b09c1-7015-44cf-9492-2928c9ea9c5b tempest-AttachVolumeTestJSON-244989543 tempest-AttachVolumeTestJSON-244989543-project] [instance: e0ad8879-83dd-40e5-a0b4-4c8d1f25e3b5] Fetching instance by UUID {{(pid=116156) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:41:49.311593 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-ce9b09c1-7015-44cf-9492-2928c9ea9c5b tempest-AttachVolumeTestJSON-244989543 tempest-AttachVolumeTestJSON-244989543-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:41:49.312145 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-ce9b09c1-7015-44cf-9492-2928c9ea9c5b tempest-AttachVolumeTestJSON-244989543 tempest-AttachVolumeTestJSON-244989543-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:41:49.312941 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-ce9b09c1-7015-44cf-9492-2928c9ea9c5b tempest-AttachVolumeTestJSON-244989543 tempest-AttachVolumeTestJSON-244989543-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:41:49.313377 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-ce9b09c1-7015-44cf-9492-2928c9ea9c5b tempest-AttachVolumeTestJSON-244989543 tempest-AttachVolumeTestJSON-244989543-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:41:49.413833 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: INFO nova.api.openstack.requestlog [None req-ce9b09c1-7015-44cf-9492-2928c9ea9c5b tempest-AttachVolumeTestJSON-244989543 tempest-AttachVolumeTestJSON-244989543-project] 10.222.0.18 "POST /compute/v2.1/servers/e0ad8879-83dd-40e5-a0b4-4c8d1f25e3b5/action" status: 200 len: 27710 microversion: 2.1 time: 0.114747 Dec 15 03:41:49.415252 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: [pid: 116156|app: 0|req: 1075/2137] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Dec 15 03:41:49 2021] POST /compute/v2.1/servers/e0ad8879-83dd-40e5-a0b4-4c8d1f25e3b5/action => generated 27710 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 03:41:50.426382 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi [None req-56660659-e2a0-4be1-8cd6-aa596f5a2ec1 tempest-AttachVolumeTestJSON-244989543 tempest-AttachVolumeTestJSON-244989543-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 03:41:50.427916 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.compute.api [None req-56660659-e2a0-4be1-8cd6-aa596f5a2ec1 tempest-AttachVolumeTestJSON-244989543 tempest-AttachVolumeTestJSON-244989543-project] [instance: e0ad8879-83dd-40e5-a0b4-4c8d1f25e3b5] Fetching instance by UUID {{(pid=116157) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:41:50.434982 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-56660659-e2a0-4be1-8cd6-aa596f5a2ec1 tempest-AttachVolumeTestJSON-244989543 tempest-AttachVolumeTestJSON-244989543-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:41:50.435431 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-56660659-e2a0-4be1-8cd6-aa596f5a2ec1 tempest-AttachVolumeTestJSON-244989543 tempest-AttachVolumeTestJSON-244989543-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:41:50.436205 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-56660659-e2a0-4be1-8cd6-aa596f5a2ec1 tempest-AttachVolumeTestJSON-244989543 tempest-AttachVolumeTestJSON-244989543-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:41:50.436809 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-56660659-e2a0-4be1-8cd6-aa596f5a2ec1 tempest-AttachVolumeTestJSON-244989543 tempest-AttachVolumeTestJSON-244989543-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:41:50.539787 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: INFO nova.api.openstack.requestlog [None req-56660659-e2a0-4be1-8cd6-aa596f5a2ec1 tempest-AttachVolumeTestJSON-244989543 tempest-AttachVolumeTestJSON-244989543-project] 10.222.0.18 "POST /compute/v2.1/servers/e0ad8879-83dd-40e5-a0b4-4c8d1f25e3b5/action" status: 200 len: 28240 microversion: 2.1 time: 0.117181 Dec 15 03:41:50.541281 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: [pid: 116157|app: 0|req: 1063/2138] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Dec 15 03:41:50 2021] POST /compute/v2.1/servers/e0ad8879-83dd-40e5-a0b4-4c8d1f25e3b5/action => generated 28240 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 03:41:50.936874 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi [None req-e54b3bc2-3c41-4119-b88a-a3ab6406019b tempest-TestMinimumBasicScenario-1385142937 tempest-TestMinimumBasicScenario-1385142937-project] Action: 'create', calling method: .version_select at 0x7f126e82a430>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-978013863"}} {{(pid=116156) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 03:41:50.951802 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.quota [None req-e54b3bc2-3c41-4119-b88a-a3ab6406019b tempest-TestMinimumBasicScenario-1385142937 tempest-TestMinimumBasicScenario-1385142937-project] Getting quotas for project 0f9dcbfd69bc450691e2b036e864f7d9. Resources: {'key_pairs'} {{(pid=116156) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 15 03:41:50.955570 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.quota [None req-e54b3bc2-3c41-4119-b88a-a3ab6406019b tempest-TestMinimumBasicScenario-1385142937 tempest-TestMinimumBasicScenario-1385142937-project] Getting quotas for user 478d1c76208642f89d96afdf22f79829 and project 0f9dcbfd69bc450691e2b036e864f7d9. Resources: {'key_pairs'} {{(pid=116156) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 15 03:41:51.360346 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.quota [None req-e54b3bc2-3c41-4119-b88a-a3ab6406019b tempest-TestMinimumBasicScenario-1385142937 tempest-TestMinimumBasicScenario-1385142937-project] Getting quotas for project 0f9dcbfd69bc450691e2b036e864f7d9. Resources: {'key_pairs'} {{(pid=116156) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 15 03:41:51.363973 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.quota [None req-e54b3bc2-3c41-4119-b88a-a3ab6406019b tempest-TestMinimumBasicScenario-1385142937 tempest-TestMinimumBasicScenario-1385142937-project] Getting quotas for user 478d1c76208642f89d96afdf22f79829 and project 0f9dcbfd69bc450691e2b036e864f7d9. Resources: {'key_pairs'} {{(pid=116156) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 15 03:41:51.377359 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: INFO nova.api.openstack.requestlog [None req-e54b3bc2-3c41-4119-b88a-a3ab6406019b tempest-TestMinimumBasicScenario-1385142937 tempest-TestMinimumBasicScenario-1385142937-project] 10.222.0.18 "POST /compute/v2.1/os-keypairs" status: 200 len: 2321 microversion: 2.1 time: 0.444482 Dec 15 03:41:51.378172 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: [pid: 116156|app: 0|req: 1076/2139] 10.222.0.18 () {60 vars in 1157 bytes} [Wed Dec 15 03:41:50 2021] POST /compute/v2.1/os-keypairs => generated 2321 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 03:41:51.426370 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi [None req-ed33b1ca-65cb-427b-8abd-4f5d5f03c343 tempest-TestMinimumBasicScenario-1385142937 tempest-TestMinimumBasicScenario-1385142937-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-627979150", "imageRef": "4f121076-e798-4390-ab47-bc121d4040df", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-978013863", "networks": [{"uuid": "b236e34a-a7ba-4da1-a214-845eaa2ee1d1"}]}} {{(pid=116157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 03:41:51.481454 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.network.neutron [None req-ed33b1ca-65cb-427b-8abd-4f5d5f03c343 tempest-TestMinimumBasicScenario-1385142937 tempest-TestMinimumBasicScenario-1385142937-project] validate_networks() for [('b236e34a-a7ba-4da1-a214-845eaa2ee1d1', None, None, None, None, None)] {{(pid=116157) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Dec 15 03:41:51.551737 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi [None req-1a0db7c8-7e57-4efd-a4d9-d450c832be4e tempest-AttachVolumeTestJSON-244989543 tempest-AttachVolumeTestJSON-244989543-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116156) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 03:41:51.552832 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.compute.api [None req-1a0db7c8-7e57-4efd-a4d9-d450c832be4e tempest-AttachVolumeTestJSON-244989543 tempest-AttachVolumeTestJSON-244989543-project] [instance: e0ad8879-83dd-40e5-a0b4-4c8d1f25e3b5] Fetching instance by UUID {{(pid=116156) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:41:51.558689 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-1a0db7c8-7e57-4efd-a4d9-d450c832be4e tempest-AttachVolumeTestJSON-244989543 tempest-AttachVolumeTestJSON-244989543-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:41:51.559140 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-1a0db7c8-7e57-4efd-a4d9-d450c832be4e tempest-AttachVolumeTestJSON-244989543 tempest-AttachVolumeTestJSON-244989543-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:41:51.559920 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-1a0db7c8-7e57-4efd-a4d9-d450c832be4e tempest-AttachVolumeTestJSON-244989543 tempest-AttachVolumeTestJSON-244989543-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:41:51.560347 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-1a0db7c8-7e57-4efd-a4d9-d450c832be4e tempest-AttachVolumeTestJSON-244989543 tempest-AttachVolumeTestJSON-244989543-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:41:51.650445 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: INFO nova.api.openstack.requestlog [None req-1a0db7c8-7e57-4efd-a4d9-d450c832be4e tempest-AttachVolumeTestJSON-244989543 tempest-AttachVolumeTestJSON-244989543-project] 10.222.0.18 "POST /compute/v2.1/servers/e0ad8879-83dd-40e5-a0b4-4c8d1f25e3b5/action" status: 200 len: 28240 microversion: 2.1 time: 0.102441 Dec 15 03:41:51.651267 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: [pid: 116156|app: 0|req: 1077/2140] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Dec 15 03:41:51 2021] POST /compute/v2.1/servers/e0ad8879-83dd-40e5-a0b4-4c8d1f25e3b5/action => generated 28240 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Dec 15 03:41:51.837384 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.virt.hardware [None req-ed33b1ca-65cb-427b-8abd-4f5d5f03c343 tempest-TestMinimumBasicScenario-1385142937 tempest-TestMinimumBasicScenario-1385142937-project] Flavor limits 0:0:0 {{(pid=116157) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Dec 15 03:41:51.837802 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.virt.hardware [None req-ed33b1ca-65cb-427b-8abd-4f5d5f03c343 tempest-TestMinimumBasicScenario-1385142937 tempest-TestMinimumBasicScenario-1385142937-project] Image limits 0:0:0 {{(pid=116157) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Dec 15 03:41:51.838299 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.virt.hardware [None req-ed33b1ca-65cb-427b-8abd-4f5d5f03c343 tempest-TestMinimumBasicScenario-1385142937 tempest-TestMinimumBasicScenario-1385142937-project] Flavor pref 0:0:0 {{(pid=116157) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Dec 15 03:41:51.838701 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.virt.hardware [None req-ed33b1ca-65cb-427b-8abd-4f5d5f03c343 tempest-TestMinimumBasicScenario-1385142937 tempest-TestMinimumBasicScenario-1385142937-project] Image pref 0:0:0 {{(pid=116157) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Dec 15 03:41:51.839356 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.virt.hardware [None req-ed33b1ca-65cb-427b-8abd-4f5d5f03c343 tempest-TestMinimumBasicScenario-1385142937 tempest-TestMinimumBasicScenario-1385142937-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116157) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Dec 15 03:41:51.847663 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-ed33b1ca-65cb-427b-8abd-4f5d5f03c343 tempest-TestMinimumBasicScenario-1385142937 tempest-TestMinimumBasicScenario-1385142937-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:41:51.848110 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-ed33b1ca-65cb-427b-8abd-4f5d5f03c343 tempest-TestMinimumBasicScenario-1385142937 tempest-TestMinimumBasicScenario-1385142937-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:41:51.848905 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-ed33b1ca-65cb-427b-8abd-4f5d5f03c343 tempest-TestMinimumBasicScenario-1385142937 tempest-TestMinimumBasicScenario-1385142937-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:41:51.849336 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-ed33b1ca-65cb-427b-8abd-4f5d5f03c343 tempest-TestMinimumBasicScenario-1385142937 tempest-TestMinimumBasicScenario-1385142937-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:41:51.865338 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.quota [None req-ed33b1ca-65cb-427b-8abd-4f5d5f03c343 tempest-TestMinimumBasicScenario-1385142937 tempest-TestMinimumBasicScenario-1385142937-project] Getting quotas for project 0f9dcbfd69bc450691e2b036e864f7d9. Resources: {'cores', 'instances', 'ram'} {{(pid=116157) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 15 03:41:51.869183 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.quota [None req-ed33b1ca-65cb-427b-8abd-4f5d5f03c343 tempest-TestMinimumBasicScenario-1385142937 tempest-TestMinimumBasicScenario-1385142937-project] Getting quotas for user 478d1c76208642f89d96afdf22f79829 and project 0f9dcbfd69bc450691e2b036e864f7d9. Resources: {'cores', 'instances', 'ram'} {{(pid=116157) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 15 03:41:51.879651 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.compute.api [None req-ed33b1ca-65cb-427b-8abd-4f5d5f03c343 tempest-TestMinimumBasicScenario-1385142937 tempest-TestMinimumBasicScenario-1385142937-project] Going to run 1 instances... {{(pid=116157) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Dec 15 03:41:51.882453 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.compute.api [None req-ed33b1ca-65cb-427b-8abd-4f5d5f03c343 tempest-TestMinimumBasicScenario-1385142937 tempest-TestMinimumBasicScenario-1385142937-project] [instance: 7a4d04ca-0909-481f-b859-bd99b327ddc3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='4f121076-e798-4390-ab47-bc121d4040df',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=116157) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Dec 15 03:41:51.927247 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: INFO nova.api.openstack.requestlog [None req-ed33b1ca-65cb-427b-8abd-4f5d5f03c343 tempest-TestMinimumBasicScenario-1385142937 tempest-TestMinimumBasicScenario-1385142937-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.504930 Dec 15 03:41:51.932351 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: [pid: 116157|app: 0|req: 1064/2141] 10.222.0.18 () {60 vars in 1146 bytes} [Wed Dec 15 03:41:51 2021] POST /compute/v2.1/servers => generated 380 bytes in 507 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Dec 15 03:41:51.938722 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi [None req-47f7517e-141f-4a26-b726-ce2841e19ece tempest-TestMinimumBasicScenario-1385142937 tempest-TestMinimumBasicScenario-1385142937-project] Calling method '>' {{(pid=116156) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:41:51.939421 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.compute.api [None req-47f7517e-141f-4a26-b726-ce2841e19ece tempest-TestMinimumBasicScenario-1385142937 tempest-TestMinimumBasicScenario-1385142937-project] [instance: 7a4d04ca-0909-481f-b859-bd99b327ddc3] Fetching instance by UUID {{(pid=116156) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:41:51.993459 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.policy [None req-47f7517e-141f-4a26-b726-ce2841e19ece tempest-TestMinimumBasicScenario-1385142937 tempest-TestMinimumBasicScenario-1385142937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '478d1c76208642f89d96afdf22f79829', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f9dcbfd69bc450691e2b036e864f7d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116156) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:41:52.000676 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: INFO nova.api.openstack.requestlog [None req-47f7517e-141f-4a26-b726-ce2841e19ece tempest-TestMinimumBasicScenario-1385142937 tempest-TestMinimumBasicScenario-1385142937-project] 10.222.0.18 "GET /compute/v2.1/servers/7a4d04ca-0909-481f-b859-bd99b327ddc3" status: 200 len: 1257 microversion: 2.1 time: 0.066637 Dec 15 03:41:52.001237 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: [pid: 116156|app: 0|req: 1078/2142] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 03:41:51 2021] GET /compute/v2.1/servers/7a4d04ca-0909-481f-b859-bd99b327ddc3 => generated 1257 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 03:41:52.662781 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi [None req-054ef14b-192c-476c-a395-75b889e90b72 tempest-AttachVolumeTestJSON-244989543 tempest-AttachVolumeTestJSON-244989543-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 03:41:52.663799 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.compute.api [None req-054ef14b-192c-476c-a395-75b889e90b72 tempest-AttachVolumeTestJSON-244989543 tempest-AttachVolumeTestJSON-244989543-project] [instance: e0ad8879-83dd-40e5-a0b4-4c8d1f25e3b5] Fetching instance by UUID {{(pid=116157) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:41:52.670073 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-054ef14b-192c-476c-a395-75b889e90b72 tempest-AttachVolumeTestJSON-244989543 tempest-AttachVolumeTestJSON-244989543-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:41:52.670540 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-054ef14b-192c-476c-a395-75b889e90b72 tempest-AttachVolumeTestJSON-244989543 tempest-AttachVolumeTestJSON-244989543-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:41:52.671325 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-054ef14b-192c-476c-a395-75b889e90b72 tempest-AttachVolumeTestJSON-244989543 tempest-AttachVolumeTestJSON-244989543-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:41:52.671770 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-054ef14b-192c-476c-a395-75b889e90b72 tempest-AttachVolumeTestJSON-244989543 tempest-AttachVolumeTestJSON-244989543-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:41:52.764455 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: INFO nova.api.openstack.requestlog [None req-054ef14b-192c-476c-a395-75b889e90b72 tempest-AttachVolumeTestJSON-244989543 tempest-AttachVolumeTestJSON-244989543-project] 10.222.0.18 "POST /compute/v2.1/servers/e0ad8879-83dd-40e5-a0b4-4c8d1f25e3b5/action" status: 200 len: 28531 microversion: 2.1 time: 0.106137 Dec 15 03:41:52.764994 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: [pid: 116157|app: 0|req: 1065/2143] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Dec 15 03:41:52 2021] POST /compute/v2.1/servers/e0ad8879-83dd-40e5-a0b4-4c8d1f25e3b5/action => generated 28531 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 03:41:53.018013 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi [None req-91055267-a62e-424c-8f7f-08ecfad82aff tempest-TestMinimumBasicScenario-1385142937 tempest-TestMinimumBasicScenario-1385142937-project] Calling method '>' {{(pid=116156) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:41:53.018581 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.compute.api [None req-91055267-a62e-424c-8f7f-08ecfad82aff tempest-TestMinimumBasicScenario-1385142937 tempest-TestMinimumBasicScenario-1385142937-project] [instance: 7a4d04ca-0909-481f-b859-bd99b327ddc3] Fetching instance by UUID {{(pid=116156) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:41:53.025836 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-91055267-a62e-424c-8f7f-08ecfad82aff tempest-TestMinimumBasicScenario-1385142937 tempest-TestMinimumBasicScenario-1385142937-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:41:53.026325 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-91055267-a62e-424c-8f7f-08ecfad82aff tempest-TestMinimumBasicScenario-1385142937 tempest-TestMinimumBasicScenario-1385142937-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:41:53.027137 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-91055267-a62e-424c-8f7f-08ecfad82aff tempest-TestMinimumBasicScenario-1385142937 tempest-TestMinimumBasicScenario-1385142937-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:41:53.027561 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-91055267-a62e-424c-8f7f-08ecfad82aff tempest-TestMinimumBasicScenario-1385142937 tempest-TestMinimumBasicScenario-1385142937-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:41:53.090940 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.policy [None req-91055267-a62e-424c-8f7f-08ecfad82aff tempest-TestMinimumBasicScenario-1385142937 tempest-TestMinimumBasicScenario-1385142937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '478d1c76208642f89d96afdf22f79829', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f9dcbfd69bc450691e2b036e864f7d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116156) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:41:53.098694 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: INFO nova.api.openstack.requestlog [None req-91055267-a62e-424c-8f7f-08ecfad82aff tempest-TestMinimumBasicScenario-1385142937 tempest-TestMinimumBasicScenario-1385142937-project] 10.222.0.18 "GET /compute/v2.1/servers/7a4d04ca-0909-481f-b859-bd99b327ddc3" status: 200 len: 1327 microversion: 2.1 time: 0.084579 Dec 15 03:41:53.099821 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: [pid: 116156|app: 0|req: 1079/2144] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 03:41:53 2021] GET /compute/v2.1/servers/7a4d04ca-0909-481f-b859-bd99b327ddc3 => generated 1327 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 03:41:53.776485 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi [None req-d2079211-6d7a-4992-ba3d-74ec2a700fc1 tempest-AttachVolumeTestJSON-244989543 tempest-AttachVolumeTestJSON-244989543-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 03:41:53.777755 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.compute.api [None req-d2079211-6d7a-4992-ba3d-74ec2a700fc1 tempest-AttachVolumeTestJSON-244989543 tempest-AttachVolumeTestJSON-244989543-project] [instance: e0ad8879-83dd-40e5-a0b4-4c8d1f25e3b5] Fetching instance by UUID {{(pid=116157) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:41:53.787250 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-d2079211-6d7a-4992-ba3d-74ec2a700fc1 tempest-AttachVolumeTestJSON-244989543 tempest-AttachVolumeTestJSON-244989543-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:41:53.787694 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-d2079211-6d7a-4992-ba3d-74ec2a700fc1 tempest-AttachVolumeTestJSON-244989543 tempest-AttachVolumeTestJSON-244989543-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:41:53.788545 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-d2079211-6d7a-4992-ba3d-74ec2a700fc1 tempest-AttachVolumeTestJSON-244989543 tempest-AttachVolumeTestJSON-244989543-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:41:53.789396 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-d2079211-6d7a-4992-ba3d-74ec2a700fc1 tempest-AttachVolumeTestJSON-244989543 tempest-AttachVolumeTestJSON-244989543-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:41:54.117160 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi [None req-90d1e964-7e52-4604-8bd6-bb8ccaba5018 tempest-TestMinimumBasicScenario-1385142937 tempest-TestMinimumBasicScenario-1385142937-project] Calling method '>' {{(pid=116156) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:41:54.117715 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.compute.api [None req-90d1e964-7e52-4604-8bd6-bb8ccaba5018 tempest-TestMinimumBasicScenario-1385142937 tempest-TestMinimumBasicScenario-1385142937-project] [instance: 7a4d04ca-0909-481f-b859-bd99b327ddc3] Fetching instance by UUID {{(pid=116156) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:41:54.123988 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-90d1e964-7e52-4604-8bd6-bb8ccaba5018 tempest-TestMinimumBasicScenario-1385142937 tempest-TestMinimumBasicScenario-1385142937-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:41:54.124443 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-90d1e964-7e52-4604-8bd6-bb8ccaba5018 tempest-TestMinimumBasicScenario-1385142937 tempest-TestMinimumBasicScenario-1385142937-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:41:54.125243 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-90d1e964-7e52-4604-8bd6-bb8ccaba5018 tempest-TestMinimumBasicScenario-1385142937 tempest-TestMinimumBasicScenario-1385142937-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:41:54.125679 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-90d1e964-7e52-4604-8bd6-bb8ccaba5018 tempest-TestMinimumBasicScenario-1385142937 tempest-TestMinimumBasicScenario-1385142937-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:41:54.266901 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.policy [None req-90d1e964-7e52-4604-8bd6-bb8ccaba5018 tempest-TestMinimumBasicScenario-1385142937 tempest-TestMinimumBasicScenario-1385142937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '478d1c76208642f89d96afdf22f79829', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f9dcbfd69bc450691e2b036e864f7d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116156) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:41:54.275351 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: INFO nova.api.openstack.requestlog [None req-90d1e964-7e52-4604-8bd6-bb8ccaba5018 tempest-TestMinimumBasicScenario-1385142937 tempest-TestMinimumBasicScenario-1385142937-project] 10.222.0.18 "GET /compute/v2.1/servers/7a4d04ca-0909-481f-b859-bd99b327ddc3" status: 200 len: 1357 microversion: 2.1 time: 0.162499 Dec 15 03:41:54.275921 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: [pid: 116156|app: 0|req: 1080/2145] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 03:41:54 2021] GET /compute/v2.1/servers/7a4d04ca-0909-481f-b859-bd99b327ddc3 => generated 1357 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 03:41:55.293760 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi [None req-cd9193e7-0a70-421f-82b4-5868e5888c1c tempest-TestMinimumBasicScenario-1385142937 tempest-TestMinimumBasicScenario-1385142937-project] Calling method '>' {{(pid=116156) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:41:55.294827 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.compute.api [None req-cd9193e7-0a70-421f-82b4-5868e5888c1c tempest-TestMinimumBasicScenario-1385142937 tempest-TestMinimumBasicScenario-1385142937-project] [instance: 7a4d04ca-0909-481f-b859-bd99b327ddc3] Fetching instance by UUID {{(pid=116156) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:41:55.301520 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-cd9193e7-0a70-421f-82b4-5868e5888c1c tempest-TestMinimumBasicScenario-1385142937 tempest-TestMinimumBasicScenario-1385142937-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:41:55.301997 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-cd9193e7-0a70-421f-82b4-5868e5888c1c tempest-TestMinimumBasicScenario-1385142937 tempest-TestMinimumBasicScenario-1385142937-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:41:55.302794 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-cd9193e7-0a70-421f-82b4-5868e5888c1c tempest-TestMinimumBasicScenario-1385142937 tempest-TestMinimumBasicScenario-1385142937-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:41:55.303727 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-cd9193e7-0a70-421f-82b4-5868e5888c1c tempest-TestMinimumBasicScenario-1385142937 tempest-TestMinimumBasicScenario-1385142937-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:41:55.435788 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.policy [None req-cd9193e7-0a70-421f-82b4-5868e5888c1c tempest-TestMinimumBasicScenario-1385142937 tempest-TestMinimumBasicScenario-1385142937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '478d1c76208642f89d96afdf22f79829', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f9dcbfd69bc450691e2b036e864f7d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116156) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:41:55.442900 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: INFO nova.api.openstack.requestlog [None req-cd9193e7-0a70-421f-82b4-5868e5888c1c tempest-TestMinimumBasicScenario-1385142937 tempest-TestMinimumBasicScenario-1385142937-project] 10.222.0.18 "GET /compute/v2.1/servers/7a4d04ca-0909-481f-b859-bd99b327ddc3" status: 200 len: 1357 microversion: 2.1 time: 0.153655 Dec 15 03:41:55.443460 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: [pid: 116156|app: 0|req: 1081/2146] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 03:41:55 2021] GET /compute/v2.1/servers/7a4d04ca-0909-481f-b859-bd99b327ddc3 => generated 1357 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 03:41:56.460606 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi [None req-ca205cac-a874-45b1-80ea-429a3fea8767 tempest-TestMinimumBasicScenario-1385142937 tempest-TestMinimumBasicScenario-1385142937-project] Calling method '>' {{(pid=116156) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:41:56.461264 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.compute.api [None req-ca205cac-a874-45b1-80ea-429a3fea8767 tempest-TestMinimumBasicScenario-1385142937 tempest-TestMinimumBasicScenario-1385142937-project] [instance: 7a4d04ca-0909-481f-b859-bd99b327ddc3] Fetching instance by UUID {{(pid=116156) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:41:56.467563 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-ca205cac-a874-45b1-80ea-429a3fea8767 tempest-TestMinimumBasicScenario-1385142937 tempest-TestMinimumBasicScenario-1385142937-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:41:56.468038 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-ca205cac-a874-45b1-80ea-429a3fea8767 tempest-TestMinimumBasicScenario-1385142937 tempest-TestMinimumBasicScenario-1385142937-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:41:56.468808 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-ca205cac-a874-45b1-80ea-429a3fea8767 tempest-TestMinimumBasicScenario-1385142937 tempest-TestMinimumBasicScenario-1385142937-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:41:56.469239 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-ca205cac-a874-45b1-80ea-429a3fea8767 tempest-TestMinimumBasicScenario-1385142937 tempest-TestMinimumBasicScenario-1385142937-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:41:56.607127 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.policy [None req-ca205cac-a874-45b1-80ea-429a3fea8767 tempest-TestMinimumBasicScenario-1385142937 tempest-TestMinimumBasicScenario-1385142937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '478d1c76208642f89d96afdf22f79829', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f9dcbfd69bc450691e2b036e864f7d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116156) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:41:56.614610 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: INFO nova.api.openstack.requestlog [None req-ca205cac-a874-45b1-80ea-429a3fea8767 tempest-TestMinimumBasicScenario-1385142937 tempest-TestMinimumBasicScenario-1385142937-project] 10.222.0.18 "GET /compute/v2.1/servers/7a4d04ca-0909-481f-b859-bd99b327ddc3" status: 200 len: 1357 microversion: 2.1 time: 0.157882 Dec 15 03:41:56.615186 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: [pid: 116156|app: 0|req: 1082/2147] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 03:41:56 2021] GET /compute/v2.1/servers/7a4d04ca-0909-481f-b859-bd99b327ddc3 => generated 1357 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 03:41:57.631945 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi [None req-2c43c872-d203-4d27-999d-d8f911dd1644 tempest-TestMinimumBasicScenario-1385142937 tempest-TestMinimumBasicScenario-1385142937-project] Calling method '>' {{(pid=116156) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:41:57.632651 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.compute.api [None req-2c43c872-d203-4d27-999d-d8f911dd1644 tempest-TestMinimumBasicScenario-1385142937 tempest-TestMinimumBasicScenario-1385142937-project] [instance: 7a4d04ca-0909-481f-b859-bd99b327ddc3] Fetching instance by UUID {{(pid=116156) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:41:57.638691 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-2c43c872-d203-4d27-999d-d8f911dd1644 tempest-TestMinimumBasicScenario-1385142937 tempest-TestMinimumBasicScenario-1385142937-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:41:57.639143 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-2c43c872-d203-4d27-999d-d8f911dd1644 tempest-TestMinimumBasicScenario-1385142937 tempest-TestMinimumBasicScenario-1385142937-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:41:57.639922 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-2c43c872-d203-4d27-999d-d8f911dd1644 tempest-TestMinimumBasicScenario-1385142937 tempest-TestMinimumBasicScenario-1385142937-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:41:57.640360 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-2c43c872-d203-4d27-999d-d8f911dd1644 tempest-TestMinimumBasicScenario-1385142937 tempest-TestMinimumBasicScenario-1385142937-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:41:57.774530 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.policy [None req-2c43c872-d203-4d27-999d-d8f911dd1644 tempest-TestMinimumBasicScenario-1385142937 tempest-TestMinimumBasicScenario-1385142937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '478d1c76208642f89d96afdf22f79829', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f9dcbfd69bc450691e2b036e864f7d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116156) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:41:57.781686 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: INFO nova.api.openstack.requestlog [None req-2c43c872-d203-4d27-999d-d8f911dd1644 tempest-TestMinimumBasicScenario-1385142937 tempest-TestMinimumBasicScenario-1385142937-project] 10.222.0.18 "GET /compute/v2.1/servers/7a4d04ca-0909-481f-b859-bd99b327ddc3" status: 200 len: 1357 microversion: 2.1 time: 0.153417 Dec 15 03:41:57.782297 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: [pid: 116156|app: 0|req: 1083/2148] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 03:41:57 2021] GET /compute/v2.1/servers/7a4d04ca-0909-481f-b859-bd99b327ddc3 => generated 1357 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 03:41:58.800392 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi [None req-e39aa3f8-b839-4632-aec7-b90f496b3af5 tempest-TestMinimumBasicScenario-1385142937 tempest-TestMinimumBasicScenario-1385142937-project] Calling method '>' {{(pid=116156) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:41:58.801270 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.compute.api [None req-e39aa3f8-b839-4632-aec7-b90f496b3af5 tempest-TestMinimumBasicScenario-1385142937 tempest-TestMinimumBasicScenario-1385142937-project] [instance: 7a4d04ca-0909-481f-b859-bd99b327ddc3] Fetching instance by UUID {{(pid=116156) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:41:58.814680 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-e39aa3f8-b839-4632-aec7-b90f496b3af5 tempest-TestMinimumBasicScenario-1385142937 tempest-TestMinimumBasicScenario-1385142937-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:41:58.815170 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-e39aa3f8-b839-4632-aec7-b90f496b3af5 tempest-TestMinimumBasicScenario-1385142937 tempest-TestMinimumBasicScenario-1385142937-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:41:58.816023 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-e39aa3f8-b839-4632-aec7-b90f496b3af5 tempest-TestMinimumBasicScenario-1385142937 tempest-TestMinimumBasicScenario-1385142937-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:41:58.816023 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-e39aa3f8-b839-4632-aec7-b90f496b3af5 tempest-TestMinimumBasicScenario-1385142937 tempest-TestMinimumBasicScenario-1385142937-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:41:58.966882 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.policy [None req-e39aa3f8-b839-4632-aec7-b90f496b3af5 tempest-TestMinimumBasicScenario-1385142937 tempest-TestMinimumBasicScenario-1385142937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '478d1c76208642f89d96afdf22f79829', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f9dcbfd69bc450691e2b036e864f7d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116156) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:41:58.974195 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: INFO nova.api.openstack.requestlog [None req-e39aa3f8-b839-4632-aec7-b90f496b3af5 tempest-TestMinimumBasicScenario-1385142937 tempest-TestMinimumBasicScenario-1385142937-project] 10.222.0.18 "GET /compute/v2.1/servers/7a4d04ca-0909-481f-b859-bd99b327ddc3" status: 200 len: 1357 microversion: 2.1 time: 0.178053 Dec 15 03:41:58.974769 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: [pid: 116156|app: 0|req: 1084/2149] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 03:41:58 2021] GET /compute/v2.1/servers/7a4d04ca-0909-481f-b859-bd99b327ddc3 => generated 1357 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 03:41:59.991174 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi [None req-731955cf-d06d-4295-a27c-09e8edb3516c tempest-TestMinimumBasicScenario-1385142937 tempest-TestMinimumBasicScenario-1385142937-project] Calling method '>' {{(pid=116156) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:41:59.991912 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.compute.api [None req-731955cf-d06d-4295-a27c-09e8edb3516c tempest-TestMinimumBasicScenario-1385142937 tempest-TestMinimumBasicScenario-1385142937-project] [instance: 7a4d04ca-0909-481f-b859-bd99b327ddc3] Fetching instance by UUID {{(pid=116156) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:41:59.999044 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-731955cf-d06d-4295-a27c-09e8edb3516c tempest-TestMinimumBasicScenario-1385142937 tempest-TestMinimumBasicScenario-1385142937-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:41:59.999890 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-731955cf-d06d-4295-a27c-09e8edb3516c tempest-TestMinimumBasicScenario-1385142937 tempest-TestMinimumBasicScenario-1385142937-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:42:00.000682 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-731955cf-d06d-4295-a27c-09e8edb3516c tempest-TestMinimumBasicScenario-1385142937 tempest-TestMinimumBasicScenario-1385142937-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:42:00.001344 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-731955cf-d06d-4295-a27c-09e8edb3516c tempest-TestMinimumBasicScenario-1385142937 tempest-TestMinimumBasicScenario-1385142937-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:42:00.146908 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.policy [None req-731955cf-d06d-4295-a27c-09e8edb3516c tempest-TestMinimumBasicScenario-1385142937 tempest-TestMinimumBasicScenario-1385142937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '478d1c76208642f89d96afdf22f79829', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f9dcbfd69bc450691e2b036e864f7d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116156) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:42:00.154464 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: INFO nova.api.openstack.requestlog [None req-731955cf-d06d-4295-a27c-09e8edb3516c tempest-TestMinimumBasicScenario-1385142937 tempest-TestMinimumBasicScenario-1385142937-project] 10.222.0.18 "GET /compute/v2.1/servers/7a4d04ca-0909-481f-b859-bd99b327ddc3" status: 200 len: 1357 microversion: 2.1 time: 0.167535 Dec 15 03:42:00.155027 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: [pid: 116156|app: 0|req: 1085/2150] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 03:41:59 2021] GET /compute/v2.1/servers/7a4d04ca-0909-481f-b859-bd99b327ddc3 => generated 1357 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 03:42:01.171758 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi [None req-14d670dd-304d-46bf-b459-1d1b3937477c tempest-TestMinimumBasicScenario-1385142937 tempest-TestMinimumBasicScenario-1385142937-project] Calling method '>' {{(pid=116156) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:42:01.172488 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.compute.api [None req-14d670dd-304d-46bf-b459-1d1b3937477c tempest-TestMinimumBasicScenario-1385142937 tempest-TestMinimumBasicScenario-1385142937-project] [instance: 7a4d04ca-0909-481f-b859-bd99b327ddc3] Fetching instance by UUID {{(pid=116156) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:42:01.179066 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-14d670dd-304d-46bf-b459-1d1b3937477c tempest-TestMinimumBasicScenario-1385142937 tempest-TestMinimumBasicScenario-1385142937-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:42:01.179518 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-14d670dd-304d-46bf-b459-1d1b3937477c tempest-TestMinimumBasicScenario-1385142937 tempest-TestMinimumBasicScenario-1385142937-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:42:01.180284 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-14d670dd-304d-46bf-b459-1d1b3937477c tempest-TestMinimumBasicScenario-1385142937 tempest-TestMinimumBasicScenario-1385142937-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:42:01.180724 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-14d670dd-304d-46bf-b459-1d1b3937477c tempest-TestMinimumBasicScenario-1385142937 tempest-TestMinimumBasicScenario-1385142937-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:42:01.325965 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.policy [None req-14d670dd-304d-46bf-b459-1d1b3937477c tempest-TestMinimumBasicScenario-1385142937 tempest-TestMinimumBasicScenario-1385142937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '478d1c76208642f89d96afdf22f79829', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f9dcbfd69bc450691e2b036e864f7d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116156) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:42:01.333177 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: INFO nova.api.openstack.requestlog [None req-14d670dd-304d-46bf-b459-1d1b3937477c tempest-TestMinimumBasicScenario-1385142937 tempest-TestMinimumBasicScenario-1385142937-project] 10.222.0.18 "GET /compute/v2.1/servers/7a4d04ca-0909-481f-b859-bd99b327ddc3" status: 200 len: 1357 microversion: 2.1 time: 0.165033 Dec 15 03:42:01.333732 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: [pid: 116156|app: 0|req: 1086/2151] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 03:42:01 2021] GET /compute/v2.1/servers/7a4d04ca-0909-481f-b859-bd99b327ddc3 => generated 1357 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 03:42:02.351559 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi [None req-e74ff956-e765-47d1-b623-f16f3b73bf09 tempest-TestMinimumBasicScenario-1385142937 tempest-TestMinimumBasicScenario-1385142937-project] Calling method '>' {{(pid=116156) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:42:02.352267 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.compute.api [None req-e74ff956-e765-47d1-b623-f16f3b73bf09 tempest-TestMinimumBasicScenario-1385142937 tempest-TestMinimumBasicScenario-1385142937-project] [instance: 7a4d04ca-0909-481f-b859-bd99b327ddc3] Fetching instance by UUID {{(pid=116156) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:42:02.358391 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-e74ff956-e765-47d1-b623-f16f3b73bf09 tempest-TestMinimumBasicScenario-1385142937 tempest-TestMinimumBasicScenario-1385142937-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:42:02.358840 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-e74ff956-e765-47d1-b623-f16f3b73bf09 tempest-TestMinimumBasicScenario-1385142937 tempest-TestMinimumBasicScenario-1385142937-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:42:02.359606 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-e74ff956-e765-47d1-b623-f16f3b73bf09 tempest-TestMinimumBasicScenario-1385142937 tempest-TestMinimumBasicScenario-1385142937-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:42:02.360040 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-e74ff956-e765-47d1-b623-f16f3b73bf09 tempest-TestMinimumBasicScenario-1385142937 tempest-TestMinimumBasicScenario-1385142937-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:42:02.501507 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.policy [None req-e74ff956-e765-47d1-b623-f16f3b73bf09 tempest-TestMinimumBasicScenario-1385142937 tempest-TestMinimumBasicScenario-1385142937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '478d1c76208642f89d96afdf22f79829', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f9dcbfd69bc450691e2b036e864f7d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116156) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:42:02.509775 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: INFO nova.api.openstack.requestlog [None req-e74ff956-e765-47d1-b623-f16f3b73bf09 tempest-TestMinimumBasicScenario-1385142937 tempest-TestMinimumBasicScenario-1385142937-project] 10.222.0.18 "GET /compute/v2.1/servers/7a4d04ca-0909-481f-b859-bd99b327ddc3" status: 200 len: 1357 microversion: 2.1 time: 0.161861 Dec 15 03:42:02.510337 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: [pid: 116156|app: 0|req: 1087/2152] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 03:42:02 2021] GET /compute/v2.1/servers/7a4d04ca-0909-481f-b859-bd99b327ddc3 => generated 1357 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 03:42:03.526809 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi [None req-0028db5e-a811-4e7f-8900-5a60ec60c38c tempest-TestMinimumBasicScenario-1385142937 tempest-TestMinimumBasicScenario-1385142937-project] Calling method '>' {{(pid=116156) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:42:03.527557 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.compute.api [None req-0028db5e-a811-4e7f-8900-5a60ec60c38c tempest-TestMinimumBasicScenario-1385142937 tempest-TestMinimumBasicScenario-1385142937-project] [instance: 7a4d04ca-0909-481f-b859-bd99b327ddc3] Fetching instance by UUID {{(pid=116156) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:42:03.533886 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-0028db5e-a811-4e7f-8900-5a60ec60c38c tempest-TestMinimumBasicScenario-1385142937 tempest-TestMinimumBasicScenario-1385142937-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:42:03.534375 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-0028db5e-a811-4e7f-8900-5a60ec60c38c tempest-TestMinimumBasicScenario-1385142937 tempest-TestMinimumBasicScenario-1385142937-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:42:03.535145 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-0028db5e-a811-4e7f-8900-5a60ec60c38c tempest-TestMinimumBasicScenario-1385142937 tempest-TestMinimumBasicScenario-1385142937-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:42:03.535597 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-0028db5e-a811-4e7f-8900-5a60ec60c38c tempest-TestMinimumBasicScenario-1385142937 tempest-TestMinimumBasicScenario-1385142937-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:42:03.675472 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.policy [None req-0028db5e-a811-4e7f-8900-5a60ec60c38c tempest-TestMinimumBasicScenario-1385142937 tempest-TestMinimumBasicScenario-1385142937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '478d1c76208642f89d96afdf22f79829', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f9dcbfd69bc450691e2b036e864f7d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116156) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:42:03.682813 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: INFO nova.api.openstack.requestlog [None req-0028db5e-a811-4e7f-8900-5a60ec60c38c tempest-TestMinimumBasicScenario-1385142937 tempest-TestMinimumBasicScenario-1385142937-project] 10.222.0.18 "GET /compute/v2.1/servers/7a4d04ca-0909-481f-b859-bd99b327ddc3" status: 200 len: 1357 microversion: 2.1 time: 0.159608 Dec 15 03:42:03.683549 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: [pid: 116156|app: 0|req: 1088/2153] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 03:42:03 2021] GET /compute/v2.1/servers/7a4d04ca-0909-481f-b859-bd99b327ddc3 => generated 1357 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 03:42:04.699999 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi [None req-464dbdb6-5eed-4505-b12c-06748ed8e9a7 tempest-TestMinimumBasicScenario-1385142937 tempest-TestMinimumBasicScenario-1385142937-project] Calling method '>' {{(pid=116156) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:42:04.700724 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.compute.api [None req-464dbdb6-5eed-4505-b12c-06748ed8e9a7 tempest-TestMinimumBasicScenario-1385142937 tempest-TestMinimumBasicScenario-1385142937-project] [instance: 7a4d04ca-0909-481f-b859-bd99b327ddc3] Fetching instance by UUID {{(pid=116156) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:42:04.706941 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-464dbdb6-5eed-4505-b12c-06748ed8e9a7 tempest-TestMinimumBasicScenario-1385142937 tempest-TestMinimumBasicScenario-1385142937-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:42:04.707333 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-464dbdb6-5eed-4505-b12c-06748ed8e9a7 tempest-TestMinimumBasicScenario-1385142937 tempest-TestMinimumBasicScenario-1385142937-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:42:04.708116 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-464dbdb6-5eed-4505-b12c-06748ed8e9a7 tempest-TestMinimumBasicScenario-1385142937 tempest-TestMinimumBasicScenario-1385142937-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:42:04.708554 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-464dbdb6-5eed-4505-b12c-06748ed8e9a7 tempest-TestMinimumBasicScenario-1385142937 tempest-TestMinimumBasicScenario-1385142937-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:42:04.833213 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.policy [None req-464dbdb6-5eed-4505-b12c-06748ed8e9a7 tempest-TestMinimumBasicScenario-1385142937 tempest-TestMinimumBasicScenario-1385142937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '478d1c76208642f89d96afdf22f79829', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f9dcbfd69bc450691e2b036e864f7d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116156) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:42:04.840990 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: INFO nova.api.openstack.requestlog [None req-464dbdb6-5eed-4505-b12c-06748ed8e9a7 tempest-TestMinimumBasicScenario-1385142937 tempest-TestMinimumBasicScenario-1385142937-project] 10.222.0.18 "GET /compute/v2.1/servers/7a4d04ca-0909-481f-b859-bd99b327ddc3" status: 200 len: 1357 microversion: 2.1 time: 0.144668 Dec 15 03:42:04.841541 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: [pid: 116156|app: 0|req: 1089/2154] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 03:42:04 2021] GET /compute/v2.1/servers/7a4d04ca-0909-481f-b859-bd99b327ddc3 => generated 1357 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 03:42:05.095565 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: INFO nova.api.openstack.requestlog [None req-d2079211-6d7a-4992-ba3d-74ec2a700fc1 tempest-AttachVolumeTestJSON-244989543 tempest-AttachVolumeTestJSON-244989543-project] 10.222.0.18 "POST /compute/v2.1/servers/e0ad8879-83dd-40e5-a0b4-4c8d1f25e3b5/action" status: 200 len: 38233 microversion: 2.1 time: 11.322963 Dec 15 03:42:05.096507 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: [pid: 116157|app: 0|req: 1066/2155] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Dec 15 03:41:53 2021] POST /compute/v2.1/servers/e0ad8879-83dd-40e5-a0b4-4c8d1f25e3b5/action => generated 38233 bytes in 11325 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 03:42:05.650562 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi [req-a3fc4408-1ff3-45f6-8bcb-9187b98c9de6 req-13915b0a-fcd0-4895-b1af-85135b1c7537 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7a4d04ca-0909-481f-b859-bd99b327ddc3", "tag": "25341a86-6728-46c3-8081-411876e42f16"}]} {{(pid=116156) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 03:42:05.652120 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 15 03:42:05.652120 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: warnings.warn(msg) Dec 15 03:42:05.661865 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [req-a3fc4408-1ff3-45f6-8bcb-9187b98c9de6 req-13915b0a-fcd0-4895-b1af-85135b1c7537 service nova] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:42:05.662912 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [req-a3fc4408-1ff3-45f6-8bcb-9187b98c9de6 req-13915b0a-fcd0-4895-b1af-85135b1c7537 service nova] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:42:05.674276 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: INFO nova.api.openstack.compute.server_external_events [req-a3fc4408-1ff3-45f6-8bcb-9187b98c9de6 req-13915b0a-fcd0-4895-b1af-85135b1c7537 service nova] Creating event network-changed:25341a86-6728-46c3-8081-411876e42f16 for instance 7a4d04ca-0909-481f-b859-bd99b327ddc3 on hv-cinder-81803 Dec 15 03:42:05.679274 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: INFO nova.api.openstack.requestlog [req-a3fc4408-1ff3-45f6-8bcb-9187b98c9de6 req-13915b0a-fcd0-4895-b1af-85135b1c7537 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033238 Dec 15 03:42:05.680209 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: [pid: 116156|app: 0|req: 1090/2156] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Dec 15 03:42:05 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 03:42:05.858547 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi [None req-5c778493-f22f-4c6d-a08e-088a83fe5759 tempest-TestMinimumBasicScenario-1385142937 tempest-TestMinimumBasicScenario-1385142937-project] Calling method '>' {{(pid=116157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:42:05.859241 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.compute.api [None req-5c778493-f22f-4c6d-a08e-088a83fe5759 tempest-TestMinimumBasicScenario-1385142937 tempest-TestMinimumBasicScenario-1385142937-project] [instance: 7a4d04ca-0909-481f-b859-bd99b327ddc3] Fetching instance by UUID {{(pid=116157) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:42:05.866034 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-5c778493-f22f-4c6d-a08e-088a83fe5759 tempest-TestMinimumBasicScenario-1385142937 tempest-TestMinimumBasicScenario-1385142937-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:42:05.866487 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-5c778493-f22f-4c6d-a08e-088a83fe5759 tempest-TestMinimumBasicScenario-1385142937 tempest-TestMinimumBasicScenario-1385142937-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:42:05.867260 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-5c778493-f22f-4c6d-a08e-088a83fe5759 tempest-TestMinimumBasicScenario-1385142937 tempest-TestMinimumBasicScenario-1385142937-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:42:05.867691 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-5c778493-f22f-4c6d-a08e-088a83fe5759 tempest-TestMinimumBasicScenario-1385142937 tempest-TestMinimumBasicScenario-1385142937-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:42:06.007516 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.policy [None req-5c778493-f22f-4c6d-a08e-088a83fe5759 tempest-TestMinimumBasicScenario-1385142937 tempest-TestMinimumBasicScenario-1385142937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '478d1c76208642f89d96afdf22f79829', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f9dcbfd69bc450691e2b036e864f7d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116157) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:42:06.016079 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: INFO nova.api.openstack.requestlog [None req-5c778493-f22f-4c6d-a08e-088a83fe5759 tempest-TestMinimumBasicScenario-1385142937 tempest-TestMinimumBasicScenario-1385142937-project] 10.222.0.18 "GET /compute/v2.1/servers/7a4d04ca-0909-481f-b859-bd99b327ddc3" status: 200 len: 1357 microversion: 2.1 time: 0.161487 Dec 15 03:42:06.016659 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: [pid: 116157|app: 0|req: 1067/2157] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 03:42:05 2021] GET /compute/v2.1/servers/7a4d04ca-0909-481f-b859-bd99b327ddc3 => generated 1357 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 03:42:06.108885 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi [None req-11a7f8c7-ae6f-447f-a6c0-f6ff69ba33e9 tempest-AttachVolumeTestJSON-244989543 tempest-AttachVolumeTestJSON-244989543-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116156) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 03:42:06.110077 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.compute.api [None req-11a7f8c7-ae6f-447f-a6c0-f6ff69ba33e9 tempest-AttachVolumeTestJSON-244989543 tempest-AttachVolumeTestJSON-244989543-project] [instance: e0ad8879-83dd-40e5-a0b4-4c8d1f25e3b5] Fetching instance by UUID {{(pid=116156) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:42:06.116097 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-11a7f8c7-ae6f-447f-a6c0-f6ff69ba33e9 tempest-AttachVolumeTestJSON-244989543 tempest-AttachVolumeTestJSON-244989543-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:42:06.116548 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-11a7f8c7-ae6f-447f-a6c0-f6ff69ba33e9 tempest-AttachVolumeTestJSON-244989543 tempest-AttachVolumeTestJSON-244989543-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:42:06.117515 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-11a7f8c7-ae6f-447f-a6c0-f6ff69ba33e9 tempest-AttachVolumeTestJSON-244989543 tempest-AttachVolumeTestJSON-244989543-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:42:06.118166 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-11a7f8c7-ae6f-447f-a6c0-f6ff69ba33e9 tempest-AttachVolumeTestJSON-244989543 tempest-AttachVolumeTestJSON-244989543-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:42:06.261591 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: INFO nova.api.openstack.requestlog [None req-11a7f8c7-ae6f-447f-a6c0-f6ff69ba33e9 tempest-AttachVolumeTestJSON-244989543 tempest-AttachVolumeTestJSON-244989543-project] 10.222.0.18 "POST /compute/v2.1/servers/e0ad8879-83dd-40e5-a0b4-4c8d1f25e3b5/action" status: 200 len: 38233 microversion: 2.1 time: 0.156897 Dec 15 03:42:06.262266 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: [pid: 116156|app: 0|req: 1091/2158] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Dec 15 03:42:06 2021] POST /compute/v2.1/servers/e0ad8879-83dd-40e5-a0b4-4c8d1f25e3b5/action => generated 38233 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 03:42:07.033438 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi [None req-88fa63a7-1e5c-48c5-a909-ccb059274381 tempest-TestMinimumBasicScenario-1385142937 tempest-TestMinimumBasicScenario-1385142937-project] Calling method '>' {{(pid=116157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:42:07.034106 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.compute.api [None req-88fa63a7-1e5c-48c5-a909-ccb059274381 tempest-TestMinimumBasicScenario-1385142937 tempest-TestMinimumBasicScenario-1385142937-project] [instance: 7a4d04ca-0909-481f-b859-bd99b327ddc3] Fetching instance by UUID {{(pid=116157) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:42:07.040886 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-88fa63a7-1e5c-48c5-a909-ccb059274381 tempest-TestMinimumBasicScenario-1385142937 tempest-TestMinimumBasicScenario-1385142937-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:42:07.041343 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-88fa63a7-1e5c-48c5-a909-ccb059274381 tempest-TestMinimumBasicScenario-1385142937 tempest-TestMinimumBasicScenario-1385142937-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:42:07.042156 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-88fa63a7-1e5c-48c5-a909-ccb059274381 tempest-TestMinimumBasicScenario-1385142937 tempest-TestMinimumBasicScenario-1385142937-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:42:07.042596 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-88fa63a7-1e5c-48c5-a909-ccb059274381 tempest-TestMinimumBasicScenario-1385142937 tempest-TestMinimumBasicScenario-1385142937-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:42:07.174469 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.policy [None req-88fa63a7-1e5c-48c5-a909-ccb059274381 tempest-TestMinimumBasicScenario-1385142937 tempest-TestMinimumBasicScenario-1385142937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '478d1c76208642f89d96afdf22f79829', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f9dcbfd69bc450691e2b036e864f7d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116157) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:42:07.181665 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: INFO nova.api.openstack.requestlog [None req-88fa63a7-1e5c-48c5-a909-ccb059274381 tempest-TestMinimumBasicScenario-1385142937 tempest-TestMinimumBasicScenario-1385142937-project] 10.222.0.18 "GET /compute/v2.1/servers/7a4d04ca-0909-481f-b859-bd99b327ddc3" status: 200 len: 1357 microversion: 2.1 time: 0.151899 Dec 15 03:42:07.182258 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: [pid: 116157|app: 0|req: 1068/2159] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 03:42:07 2021] GET /compute/v2.1/servers/7a4d04ca-0909-481f-b859-bd99b327ddc3 => generated 1357 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 03:42:07.274319 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi [None req-c3940754-9a0d-48f6-a5ff-9cbb135c9309 tempest-AttachVolumeTestJSON-244989543 tempest-AttachVolumeTestJSON-244989543-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116156) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 03:42:07.275326 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.compute.api [None req-c3940754-9a0d-48f6-a5ff-9cbb135c9309 tempest-AttachVolumeTestJSON-244989543 tempest-AttachVolumeTestJSON-244989543-project] [instance: e0ad8879-83dd-40e5-a0b4-4c8d1f25e3b5] Fetching instance by UUID {{(pid=116156) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:42:07.282107 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-c3940754-9a0d-48f6-a5ff-9cbb135c9309 tempest-AttachVolumeTestJSON-244989543 tempest-AttachVolumeTestJSON-244989543-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:42:07.282567 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-c3940754-9a0d-48f6-a5ff-9cbb135c9309 tempest-AttachVolumeTestJSON-244989543 tempest-AttachVolumeTestJSON-244989543-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:42:07.283347 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-c3940754-9a0d-48f6-a5ff-9cbb135c9309 tempest-AttachVolumeTestJSON-244989543 tempest-AttachVolumeTestJSON-244989543-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:42:07.283836 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-c3940754-9a0d-48f6-a5ff-9cbb135c9309 tempest-AttachVolumeTestJSON-244989543 tempest-AttachVolumeTestJSON-244989543-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:42:07.362924 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: INFO nova.api.openstack.requestlog [None req-c3940754-9a0d-48f6-a5ff-9cbb135c9309 tempest-AttachVolumeTestJSON-244989543 tempest-AttachVolumeTestJSON-244989543-project] 10.222.0.18 "POST /compute/v2.1/servers/e0ad8879-83dd-40e5-a0b4-4c8d1f25e3b5/action" status: 200 len: 38233 microversion: 2.1 time: 0.092991 Dec 15 03:42:07.363808 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: [pid: 116156|app: 0|req: 1092/2160] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Dec 15 03:42:07 2021] POST /compute/v2.1/servers/e0ad8879-83dd-40e5-a0b4-4c8d1f25e3b5/action => generated 38233 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 03:42:08.200262 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi [None req-888d2cdd-6d8d-49fb-9e9c-3fe65e3b81ad tempest-TestMinimumBasicScenario-1385142937 tempest-TestMinimumBasicScenario-1385142937-project] Calling method '>' {{(pid=116157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:42:08.200871 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.compute.api [None req-888d2cdd-6d8d-49fb-9e9c-3fe65e3b81ad tempest-TestMinimumBasicScenario-1385142937 tempest-TestMinimumBasicScenario-1385142937-project] [instance: 7a4d04ca-0909-481f-b859-bd99b327ddc3] Fetching instance by UUID {{(pid=116157) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:42:08.206968 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-888d2cdd-6d8d-49fb-9e9c-3fe65e3b81ad tempest-TestMinimumBasicScenario-1385142937 tempest-TestMinimumBasicScenario-1385142937-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:42:08.207433 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-888d2cdd-6d8d-49fb-9e9c-3fe65e3b81ad tempest-TestMinimumBasicScenario-1385142937 tempest-TestMinimumBasicScenario-1385142937-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:42:08.208202 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-888d2cdd-6d8d-49fb-9e9c-3fe65e3b81ad tempest-TestMinimumBasicScenario-1385142937 tempest-TestMinimumBasicScenario-1385142937-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:42:08.208633 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-888d2cdd-6d8d-49fb-9e9c-3fe65e3b81ad tempest-TestMinimumBasicScenario-1385142937 tempest-TestMinimumBasicScenario-1385142937-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:42:08.335150 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.policy [None req-888d2cdd-6d8d-49fb-9e9c-3fe65e3b81ad tempest-TestMinimumBasicScenario-1385142937 tempest-TestMinimumBasicScenario-1385142937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '478d1c76208642f89d96afdf22f79829', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f9dcbfd69bc450691e2b036e864f7d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116157) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:42:08.342590 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: INFO nova.api.openstack.requestlog [None req-888d2cdd-6d8d-49fb-9e9c-3fe65e3b81ad tempest-TestMinimumBasicScenario-1385142937 tempest-TestMinimumBasicScenario-1385142937-project] 10.222.0.18 "GET /compute/v2.1/servers/7a4d04ca-0909-481f-b859-bd99b327ddc3" status: 200 len: 1357 microversion: 2.1 time: 0.145926 Dec 15 03:42:08.343165 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: [pid: 116157|app: 0|req: 1069/2161] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 03:42:08 2021] GET /compute/v2.1/servers/7a4d04ca-0909-481f-b859-bd99b327ddc3 => generated 1357 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 03:42:08.375105 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi [None req-98a1b419-01b3-4490-a129-5a36621ef6ef tempest-AttachVolumeTestJSON-244989543 tempest-AttachVolumeTestJSON-244989543-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116156) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 03:42:08.376106 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.compute.api [None req-98a1b419-01b3-4490-a129-5a36621ef6ef tempest-AttachVolumeTestJSON-244989543 tempest-AttachVolumeTestJSON-244989543-project] [instance: e0ad8879-83dd-40e5-a0b4-4c8d1f25e3b5] Fetching instance by UUID {{(pid=116156) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:42:08.383675 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-98a1b419-01b3-4490-a129-5a36621ef6ef tempest-AttachVolumeTestJSON-244989543 tempest-AttachVolumeTestJSON-244989543-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:42:08.384277 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-98a1b419-01b3-4490-a129-5a36621ef6ef tempest-AttachVolumeTestJSON-244989543 tempest-AttachVolumeTestJSON-244989543-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:42:08.385054 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-98a1b419-01b3-4490-a129-5a36621ef6ef tempest-AttachVolumeTestJSON-244989543 tempest-AttachVolumeTestJSON-244989543-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:42:08.385487 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-98a1b419-01b3-4490-a129-5a36621ef6ef tempest-AttachVolumeTestJSON-244989543 tempest-AttachVolumeTestJSON-244989543-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:42:08.465280 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: INFO nova.api.openstack.requestlog [None req-98a1b419-01b3-4490-a129-5a36621ef6ef tempest-AttachVolumeTestJSON-244989543 tempest-AttachVolumeTestJSON-244989543-project] 10.222.0.18 "POST /compute/v2.1/servers/e0ad8879-83dd-40e5-a0b4-4c8d1f25e3b5/action" status: 200 len: 38233 microversion: 2.1 time: 0.094049 Dec 15 03:42:08.466224 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: [pid: 116156|app: 0|req: 1093/2162] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Dec 15 03:42:08 2021] POST /compute/v2.1/servers/e0ad8879-83dd-40e5-a0b4-4c8d1f25e3b5/action => generated 38233 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 03:42:09.359250 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi [None req-ba9f3358-2372-4c8e-bc10-ac15d2c85b79 tempest-TestMinimumBasicScenario-1385142937 tempest-TestMinimumBasicScenario-1385142937-project] Calling method '>' {{(pid=116157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:42:09.359859 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.compute.api [None req-ba9f3358-2372-4c8e-bc10-ac15d2c85b79 tempest-TestMinimumBasicScenario-1385142937 tempest-TestMinimumBasicScenario-1385142937-project] [instance: 7a4d04ca-0909-481f-b859-bd99b327ddc3] Fetching instance by UUID {{(pid=116157) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:42:09.366736 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-ba9f3358-2372-4c8e-bc10-ac15d2c85b79 tempest-TestMinimumBasicScenario-1385142937 tempest-TestMinimumBasicScenario-1385142937-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:42:09.367181 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-ba9f3358-2372-4c8e-bc10-ac15d2c85b79 tempest-TestMinimumBasicScenario-1385142937 tempest-TestMinimumBasicScenario-1385142937-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:42:09.367941 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-ba9f3358-2372-4c8e-bc10-ac15d2c85b79 tempest-TestMinimumBasicScenario-1385142937 tempest-TestMinimumBasicScenario-1385142937-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:42:09.368370 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-ba9f3358-2372-4c8e-bc10-ac15d2c85b79 tempest-TestMinimumBasicScenario-1385142937 tempest-TestMinimumBasicScenario-1385142937-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:42:09.477865 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi [None req-1dc13e80-a1aa-46d5-ba05-87a986594eef tempest-AttachVolumeTestJSON-244989543 tempest-AttachVolumeTestJSON-244989543-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116156) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 03:42:09.478809 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.compute.api [None req-1dc13e80-a1aa-46d5-ba05-87a986594eef tempest-AttachVolumeTestJSON-244989543 tempest-AttachVolumeTestJSON-244989543-project] [instance: e0ad8879-83dd-40e5-a0b4-4c8d1f25e3b5] Fetching instance by UUID {{(pid=116156) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:42:09.485889 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-1dc13e80-a1aa-46d5-ba05-87a986594eef tempest-AttachVolumeTestJSON-244989543 tempest-AttachVolumeTestJSON-244989543-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:42:09.486485 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-1dc13e80-a1aa-46d5-ba05-87a986594eef tempest-AttachVolumeTestJSON-244989543 tempest-AttachVolumeTestJSON-244989543-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:42:09.487350 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-1dc13e80-a1aa-46d5-ba05-87a986594eef tempest-AttachVolumeTestJSON-244989543 tempest-AttachVolumeTestJSON-244989543-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:42:09.487986 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-1dc13e80-a1aa-46d5-ba05-87a986594eef tempest-AttachVolumeTestJSON-244989543 tempest-AttachVolumeTestJSON-244989543-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:42:09.504590 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.policy [None req-ba9f3358-2372-4c8e-bc10-ac15d2c85b79 tempest-TestMinimumBasicScenario-1385142937 tempest-TestMinimumBasicScenario-1385142937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '478d1c76208642f89d96afdf22f79829', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f9dcbfd69bc450691e2b036e864f7d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116157) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:42:09.512221 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: INFO nova.api.openstack.requestlog [None req-ba9f3358-2372-4c8e-bc10-ac15d2c85b79 tempest-TestMinimumBasicScenario-1385142937 tempest-TestMinimumBasicScenario-1385142937-project] 10.222.0.18 "GET /compute/v2.1/servers/7a4d04ca-0909-481f-b859-bd99b327ddc3" status: 200 len: 1357 microversion: 2.1 time: 0.156611 Dec 15 03:42:09.512802 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: [pid: 116157|app: 0|req: 1070/2163] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 03:42:09 2021] GET /compute/v2.1/servers/7a4d04ca-0909-481f-b859-bd99b327ddc3 => generated 1357 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 03:42:09.578658 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: INFO nova.api.openstack.requestlog [None req-1dc13e80-a1aa-46d5-ba05-87a986594eef tempest-AttachVolumeTestJSON-244989543 tempest-AttachVolumeTestJSON-244989543-project] 10.222.0.18 "POST /compute/v2.1/servers/e0ad8879-83dd-40e5-a0b4-4c8d1f25e3b5/action" status: 200 len: 38364 microversion: 2.1 time: 0.104967 Dec 15 03:42:09.579419 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: [pid: 116156|app: 0|req: 1094/2164] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Dec 15 03:42:09 2021] POST /compute/v2.1/servers/e0ad8879-83dd-40e5-a0b4-4c8d1f25e3b5/action => generated 38364 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Dec 15 03:42:09.589538 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi [None req-d90f98f1-1bb0-4bd2-b130-46abdd9b989f tempest-AttachVolumeTestJSON-244989543 tempest-AttachVolumeTestJSON-244989543-project] Calling method '>' {{(pid=116157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:42:09.590062 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.compute.api [None req-d90f98f1-1bb0-4bd2-b130-46abdd9b989f tempest-AttachVolumeTestJSON-244989543 tempest-AttachVolumeTestJSON-244989543-project] [instance: e0ad8879-83dd-40e5-a0b4-4c8d1f25e3b5] Fetching instance by UUID {{(pid=116157) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:42:09.595814 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-d90f98f1-1bb0-4bd2-b130-46abdd9b989f tempest-AttachVolumeTestJSON-244989543 tempest-AttachVolumeTestJSON-244989543-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:42:09.596263 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-d90f98f1-1bb0-4bd2-b130-46abdd9b989f tempest-AttachVolumeTestJSON-244989543 tempest-AttachVolumeTestJSON-244989543-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:42:09.597028 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-d90f98f1-1bb0-4bd2-b130-46abdd9b989f tempest-AttachVolumeTestJSON-244989543 tempest-AttachVolumeTestJSON-244989543-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:42:09.597464 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-d90f98f1-1bb0-4bd2-b130-46abdd9b989f tempest-AttachVolumeTestJSON-244989543 tempest-AttachVolumeTestJSON-244989543-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:42:09.622120 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: INFO nova.api.openstack.requestlog [None req-d90f98f1-1bb0-4bd2-b130-46abdd9b989f tempest-AttachVolumeTestJSON-244989543 tempest-AttachVolumeTestJSON-244989543-project] 10.222.0.18 "GET /compute/v2.1/servers/e0ad8879-83dd-40e5-a0b4-4c8d1f25e3b5/ips" status: 200 len: 147 microversion: 2.1 time: 0.036354 Dec 15 03:42:09.622689 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: [pid: 116157|app: 0|req: 1071/2165] 10.222.0.18 () {58 vars in 1247 bytes} [Wed Dec 15 03:42:09 2021] GET /compute/v2.1/servers/e0ad8879-83dd-40e5-a0b4-4c8d1f25e3b5/ips => generated 147 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 03:42:10.024300 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi [req-881301cf-e36a-4ea8-be9c-b9bf277ab1da req-716e98fc-c5e2-49bb-9491-38fde39e5cde service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7a4d04ca-0909-481f-b859-bd99b327ddc3", "name": "network-vif-plugged", "status": "completed", "tag": "25341a86-6728-46c3-8081-411876e42f16"}]} {{(pid=116156) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 03:42:10.025758 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 15 03:42:10.025758 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: warnings.warn(msg) Dec 15 03:42:10.033657 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [req-881301cf-e36a-4ea8-be9c-b9bf277ab1da req-716e98fc-c5e2-49bb-9491-38fde39e5cde service nova] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:42:10.034136 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [req-881301cf-e36a-4ea8-be9c-b9bf277ab1da req-716e98fc-c5e2-49bb-9491-38fde39e5cde service nova] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:42:10.045447 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: INFO nova.api.openstack.compute.server_external_events [req-881301cf-e36a-4ea8-be9c-b9bf277ab1da req-716e98fc-c5e2-49bb-9491-38fde39e5cde service nova] Creating event network-vif-plugged:25341a86-6728-46c3-8081-411876e42f16 for instance 7a4d04ca-0909-481f-b859-bd99b327ddc3 on hv-cinder-81803 Dec 15 03:42:10.050074 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: INFO nova.api.openstack.requestlog [req-881301cf-e36a-4ea8-be9c-b9bf277ab1da req-716e98fc-c5e2-49bb-9491-38fde39e5cde service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029800 Dec 15 03:42:10.050834 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: [pid: 116156|app: 0|req: 1095/2166] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Dec 15 03:42:10 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 03:42:10.529045 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi [None req-8e70a9cd-dfb3-4a8c-beb0-fad6ff450bf4 tempest-TestMinimumBasicScenario-1385142937 tempest-TestMinimumBasicScenario-1385142937-project] Calling method '>' {{(pid=116157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:42:10.529573 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.compute.api [None req-8e70a9cd-dfb3-4a8c-beb0-fad6ff450bf4 tempest-TestMinimumBasicScenario-1385142937 tempest-TestMinimumBasicScenario-1385142937-project] [instance: 7a4d04ca-0909-481f-b859-bd99b327ddc3] Fetching instance by UUID {{(pid=116157) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:42:10.535780 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-8e70a9cd-dfb3-4a8c-beb0-fad6ff450bf4 tempest-TestMinimumBasicScenario-1385142937 tempest-TestMinimumBasicScenario-1385142937-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:42:10.536230 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-8e70a9cd-dfb3-4a8c-beb0-fad6ff450bf4 tempest-TestMinimumBasicScenario-1385142937 tempest-TestMinimumBasicScenario-1385142937-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:42:10.537031 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-8e70a9cd-dfb3-4a8c-beb0-fad6ff450bf4 tempest-TestMinimumBasicScenario-1385142937 tempest-TestMinimumBasicScenario-1385142937-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:42:10.537461 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-8e70a9cd-dfb3-4a8c-beb0-fad6ff450bf4 tempest-TestMinimumBasicScenario-1385142937 tempest-TestMinimumBasicScenario-1385142937-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:42:10.667723 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.policy [None req-8e70a9cd-dfb3-4a8c-beb0-fad6ff450bf4 tempest-TestMinimumBasicScenario-1385142937 tempest-TestMinimumBasicScenario-1385142937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '478d1c76208642f89d96afdf22f79829', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f9dcbfd69bc450691e2b036e864f7d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116157) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:42:10.674811 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: INFO nova.api.openstack.requestlog [None req-8e70a9cd-dfb3-4a8c-beb0-fad6ff450bf4 tempest-TestMinimumBasicScenario-1385142937 tempest-TestMinimumBasicScenario-1385142937-project] 10.222.0.18 "GET /compute/v2.1/servers/7a4d04ca-0909-481f-b859-bd99b327ddc3" status: 200 len: 1357 microversion: 2.1 time: 0.149447 Dec 15 03:42:10.675366 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: [pid: 116157|app: 0|req: 1072/2167] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 03:42:10 2021] GET /compute/v2.1/servers/7a4d04ca-0909-481f-b859-bd99b327ddc3 => generated 1357 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 03:42:10.918409 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi [None req-5bd0b5a2-68e0-4dd2-91fb-39df446ec234 tempest-AttachVolumeTestJSON-244989543 tempest-AttachVolumeTestJSON-244989543-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "59b5d267-50a5-4dfe-b5c3-b3b1f47ea002"}} {{(pid=116156) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 03:42:10.919531 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.compute.api [None req-5bd0b5a2-68e0-4dd2-91fb-39df446ec234 tempest-AttachVolumeTestJSON-244989543 tempest-AttachVolumeTestJSON-244989543-project] [instance: e0ad8879-83dd-40e5-a0b4-4c8d1f25e3b5] Fetching instance by UUID {{(pid=116156) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:42:10.925479 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-5bd0b5a2-68e0-4dd2-91fb-39df446ec234 tempest-AttachVolumeTestJSON-244989543 tempest-AttachVolumeTestJSON-244989543-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:42:10.925923 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-5bd0b5a2-68e0-4dd2-91fb-39df446ec234 tempest-AttachVolumeTestJSON-244989543 tempest-AttachVolumeTestJSON-244989543-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:42:10.926729 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-5bd0b5a2-68e0-4dd2-91fb-39df446ec234 tempest-AttachVolumeTestJSON-244989543 tempest-AttachVolumeTestJSON-244989543-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:42:10.927160 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-5bd0b5a2-68e0-4dd2-91fb-39df446ec234 tempest-AttachVolumeTestJSON-244989543 tempest-AttachVolumeTestJSON-244989543-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:42:11.178911 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: INFO nova.api.openstack.requestlog [None req-5bd0b5a2-68e0-4dd2-91fb-39df446ec234 tempest-AttachVolumeTestJSON-244989543 tempest-AttachVolumeTestJSON-244989543-project] 10.222.0.18 "POST /compute/v2.1/servers/e0ad8879-83dd-40e5-a0b4-4c8d1f25e3b5/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.264783 Dec 15 03:42:11.179528 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: [pid: 116156|app: 0|req: 1096/2168] 10.222.0.18 () {60 vars in 1322 bytes} [Wed Dec 15 03:42:10 2021] POST /compute/v2.1/servers/e0ad8879-83dd-40e5-a0b4-4c8d1f25e3b5/os-volume_attachments => generated 194 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 03:42:11.691645 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi [None req-cc45bc8f-ddb7-4b0a-88da-8ee454b3e240 tempest-TestMinimumBasicScenario-1385142937 tempest-TestMinimumBasicScenario-1385142937-project] Calling method '>' {{(pid=116157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:42:11.692188 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.compute.api [None req-cc45bc8f-ddb7-4b0a-88da-8ee454b3e240 tempest-TestMinimumBasicScenario-1385142937 tempest-TestMinimumBasicScenario-1385142937-project] [instance: 7a4d04ca-0909-481f-b859-bd99b327ddc3] Fetching instance by UUID {{(pid=116157) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:42:11.698390 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-cc45bc8f-ddb7-4b0a-88da-8ee454b3e240 tempest-TestMinimumBasicScenario-1385142937 tempest-TestMinimumBasicScenario-1385142937-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:42:11.698842 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-cc45bc8f-ddb7-4b0a-88da-8ee454b3e240 tempest-TestMinimumBasicScenario-1385142937 tempest-TestMinimumBasicScenario-1385142937-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:42:11.699623 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-cc45bc8f-ddb7-4b0a-88da-8ee454b3e240 tempest-TestMinimumBasicScenario-1385142937 tempest-TestMinimumBasicScenario-1385142937-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:42:11.700064 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-cc45bc8f-ddb7-4b0a-88da-8ee454b3e240 tempest-TestMinimumBasicScenario-1385142937 tempest-TestMinimumBasicScenario-1385142937-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:42:11.827939 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.policy [None req-cc45bc8f-ddb7-4b0a-88da-8ee454b3e240 tempest-TestMinimumBasicScenario-1385142937 tempest-TestMinimumBasicScenario-1385142937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '478d1c76208642f89d96afdf22f79829', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f9dcbfd69bc450691e2b036e864f7d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116157) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:42:11.835753 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: INFO nova.api.openstack.requestlog [None req-cc45bc8f-ddb7-4b0a-88da-8ee454b3e240 tempest-TestMinimumBasicScenario-1385142937 tempest-TestMinimumBasicScenario-1385142937-project] 10.222.0.18 "GET /compute/v2.1/servers/7a4d04ca-0909-481f-b859-bd99b327ddc3" status: 200 len: 1547 microversion: 2.1 time: 0.147967 Dec 15 03:42:11.836320 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: [pid: 116157|app: 0|req: 1073/2169] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 03:42:11 2021] GET /compute/v2.1/servers/7a4d04ca-0909-481f-b859-bd99b327ddc3 => generated 1547 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 03:42:11.853444 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi [None req-60ae1914-28ab-400e-af71-b14eea446abc tempest-TestMinimumBasicScenario-1385142937 tempest-TestMinimumBasicScenario-1385142937-project] Calling method '>' {{(pid=116156) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:42:11.854161 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.compute.api [None req-60ae1914-28ab-400e-af71-b14eea446abc tempest-TestMinimumBasicScenario-1385142937 tempest-TestMinimumBasicScenario-1385142937-project] [instance: 7a4d04ca-0909-481f-b859-bd99b327ddc3] Fetching instance by UUID {{(pid=116156) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:42:11.860067 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-60ae1914-28ab-400e-af71-b14eea446abc tempest-TestMinimumBasicScenario-1385142937 tempest-TestMinimumBasicScenario-1385142937-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:42:11.860520 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-60ae1914-28ab-400e-af71-b14eea446abc tempest-TestMinimumBasicScenario-1385142937 tempest-TestMinimumBasicScenario-1385142937-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:42:11.861282 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-60ae1914-28ab-400e-af71-b14eea446abc tempest-TestMinimumBasicScenario-1385142937 tempest-TestMinimumBasicScenario-1385142937-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:42:11.861714 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-60ae1914-28ab-400e-af71-b14eea446abc tempest-TestMinimumBasicScenario-1385142937 tempest-TestMinimumBasicScenario-1385142937-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:42:11.992367 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.policy [None req-60ae1914-28ab-400e-af71-b14eea446abc tempest-TestMinimumBasicScenario-1385142937 tempest-TestMinimumBasicScenario-1385142937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '478d1c76208642f89d96afdf22f79829', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f9dcbfd69bc450691e2b036e864f7d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116156) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:42:11.999447 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: INFO nova.api.openstack.requestlog [None req-60ae1914-28ab-400e-af71-b14eea446abc tempest-TestMinimumBasicScenario-1385142937 tempest-TestMinimumBasicScenario-1385142937-project] 10.222.0.18 "GET /compute/v2.1/servers/7a4d04ca-0909-481f-b859-bd99b327ddc3" status: 200 len: 1547 microversion: 2.1 time: 0.150932 Dec 15 03:42:11.999999 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: [pid: 116156|app: 0|req: 1097/2170] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 03:42:11 2021] GET /compute/v2.1/servers/7a4d04ca-0909-481f-b859-bd99b327ddc3 => generated 1547 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 03:42:12.015452 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi [None req-0a7c40c4-4000-4e8d-abe1-4b225ba656ba tempest-TestMinimumBasicScenario-1385142937 tempest-TestMinimumBasicScenario-1385142937-project] Calling method '>' {{(pid=116157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:42:12.018793 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:servers:allow_all_filters": "rule:system_reader_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 15 03:42:12.018793 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: warnings.warn(msg) Dec 15 03:42:12.019789 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.policy [None req-0a7c40c4-4000-4e8d-abe1-4b225ba656ba tempest-TestMinimumBasicScenario-1385142937 tempest-TestMinimumBasicScenario-1385142937-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '478d1c76208642f89d96afdf22f79829', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f9dcbfd69bc450691e2b036e864f7d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116157) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:42:12.020534 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.compute.api [None req-0a7c40c4-4000-4e8d-abe1-4b225ba656ba tempest-TestMinimumBasicScenario-1385142937 tempest-TestMinimumBasicScenario-1385142937-project] Searching by: {'deleted': False, 'project_id': '0f9dcbfd69bc450691e2b036e864f7d9'} {{(pid=116157) get_all /opt/stack/nova/nova/compute/api.py:2907}} Dec 15 03:42:12.027694 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-0a7c40c4-4000-4e8d-abe1-4b225ba656ba tempest-TestMinimumBasicScenario-1385142937 tempest-TestMinimumBasicScenario-1385142937-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:42:12.028152 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-0a7c40c4-4000-4e8d-abe1-4b225ba656ba tempest-TestMinimumBasicScenario-1385142937 tempest-TestMinimumBasicScenario-1385142937-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:42:12.028970 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-0a7c40c4-4000-4e8d-abe1-4b225ba656ba tempest-TestMinimumBasicScenario-1385142937 tempest-TestMinimumBasicScenario-1385142937-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:42:12.029409 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-0a7c40c4-4000-4e8d-abe1-4b225ba656ba tempest-TestMinimumBasicScenario-1385142937 tempest-TestMinimumBasicScenario-1385142937-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:42:12.115327 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.compute.multi_cell_list [None req-0a7c40c4-4000-4e8d-abe1-4b225ba656ba tempest-TestMinimumBasicScenario-1385142937 tempest-TestMinimumBasicScenario-1385142937-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=116157) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Dec 15 03:42:12.204895 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: INFO nova.api.openstack.requestlog [None req-0a7c40c4-4000-4e8d-abe1-4b225ba656ba tempest-TestMinimumBasicScenario-1385142937 tempest-TestMinimumBasicScenario-1385142937-project] 10.222.0.18 "GET /compute/v2.1/servers" status: 200 len: 342 microversion: 2.1 time: 0.192868 Dec 15 03:42:12.205577 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: [pid: 116157|app: 0|req: 1074/2171] 10.222.0.18 () {58 vars in 1124 bytes} [Wed Dec 15 03:42:12 2021] GET /compute/v2.1/servers => generated 342 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 03:42:12.216183 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi [None req-5e12e031-9de3-4569-b73f-0d76897aaaad tempest-TestMinimumBasicScenario-1385142937 tempest-TestMinimumBasicScenario-1385142937-project] Calling method '>' {{(pid=116156) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:42:12.216789 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.compute.api [None req-5e12e031-9de3-4569-b73f-0d76897aaaad tempest-TestMinimumBasicScenario-1385142937 tempest-TestMinimumBasicScenario-1385142937-project] [instance: 7a4d04ca-0909-481f-b859-bd99b327ddc3] Fetching instance by UUID {{(pid=116156) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:42:12.222539 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-5e12e031-9de3-4569-b73f-0d76897aaaad tempest-TestMinimumBasicScenario-1385142937 tempest-TestMinimumBasicScenario-1385142937-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:42:12.222987 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-5e12e031-9de3-4569-b73f-0d76897aaaad tempest-TestMinimumBasicScenario-1385142937 tempest-TestMinimumBasicScenario-1385142937-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:42:12.223749 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-5e12e031-9de3-4569-b73f-0d76897aaaad tempest-TestMinimumBasicScenario-1385142937 tempest-TestMinimumBasicScenario-1385142937-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:42:12.224181 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-5e12e031-9de3-4569-b73f-0d76897aaaad tempest-TestMinimumBasicScenario-1385142937 tempest-TestMinimumBasicScenario-1385142937-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:42:12.349510 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.policy [None req-5e12e031-9de3-4569-b73f-0d76897aaaad tempest-TestMinimumBasicScenario-1385142937 tempest-TestMinimumBasicScenario-1385142937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '478d1c76208642f89d96afdf22f79829', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f9dcbfd69bc450691e2b036e864f7d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116156) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:42:12.356555 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: INFO nova.api.openstack.requestlog [None req-5e12e031-9de3-4569-b73f-0d76897aaaad tempest-TestMinimumBasicScenario-1385142937 tempest-TestMinimumBasicScenario-1385142937-project] 10.222.0.18 "GET /compute/v2.1/servers/7a4d04ca-0909-481f-b859-bd99b327ddc3" status: 200 len: 1547 microversion: 2.1 time: 0.144177 Dec 15 03:42:12.357108 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: [pid: 116156|app: 0|req: 1098/2172] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 03:42:12 2021] GET /compute/v2.1/servers/7a4d04ca-0909-481f-b859-bd99b327ddc3 => generated 1547 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 03:42:13.826836 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi [None req-cdcf1e5a-bcf2-4fcd-b0e5-62ab7570d9fa tempest-TestMinimumBasicScenario-1385142937 tempest-TestMinimumBasicScenario-1385142937-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "4c507a20-4e4d-48fd-9194-aa36a670fa35"}} {{(pid=116157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 03:42:13.827892 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.compute.api [None req-cdcf1e5a-bcf2-4fcd-b0e5-62ab7570d9fa tempest-TestMinimumBasicScenario-1385142937 tempest-TestMinimumBasicScenario-1385142937-project] [instance: 7a4d04ca-0909-481f-b859-bd99b327ddc3] Fetching instance by UUID {{(pid=116157) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:42:13.834796 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-cdcf1e5a-bcf2-4fcd-b0e5-62ab7570d9fa tempest-TestMinimumBasicScenario-1385142937 tempest-TestMinimumBasicScenario-1385142937-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:42:13.835245 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-cdcf1e5a-bcf2-4fcd-b0e5-62ab7570d9fa tempest-TestMinimumBasicScenario-1385142937 tempest-TestMinimumBasicScenario-1385142937-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:42:13.836026 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-cdcf1e5a-bcf2-4fcd-b0e5-62ab7570d9fa tempest-TestMinimumBasicScenario-1385142937 tempest-TestMinimumBasicScenario-1385142937-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:42:13.836460 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-cdcf1e5a-bcf2-4fcd-b0e5-62ab7570d9fa tempest-TestMinimumBasicScenario-1385142937 tempest-TestMinimumBasicScenario-1385142937-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:42:14.079098 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: INFO nova.api.openstack.requestlog [None req-cdcf1e5a-bcf2-4fcd-b0e5-62ab7570d9fa tempest-TestMinimumBasicScenario-1385142937 tempest-TestMinimumBasicScenario-1385142937-project] 10.222.0.18 "POST /compute/v2.1/servers/7a4d04ca-0909-481f-b859-bd99b327ddc3/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.255910 Dec 15 03:42:14.079875 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: [pid: 116157|app: 0|req: 1075/2173] 10.222.0.18 () {60 vars in 1322 bytes} [Wed Dec 15 03:42:13 2021] POST /compute/v2.1/servers/7a4d04ca-0909-481f-b859-bd99b327ddc3/os-volume_attachments => generated 194 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 03:42:18.771477 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi [None req-1c578199-9b4e-4234-bacc-6b0934af660a tempest-AttachVolumeTestJSON-244989543 tempest-AttachVolumeTestJSON-244989543-project] Calling method '>' {{(pid=116156) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:42:18.772385 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.compute.api [None req-1c578199-9b4e-4234-bacc-6b0934af660a tempest-AttachVolumeTestJSON-244989543 tempest-AttachVolumeTestJSON-244989543-project] [instance: e0ad8879-83dd-40e5-a0b4-4c8d1f25e3b5] Fetching instance by UUID {{(pid=116156) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:42:18.778573 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-1c578199-9b4e-4234-bacc-6b0934af660a tempest-AttachVolumeTestJSON-244989543 tempest-AttachVolumeTestJSON-244989543-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:42:18.779021 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-1c578199-9b4e-4234-bacc-6b0934af660a tempest-AttachVolumeTestJSON-244989543 tempest-AttachVolumeTestJSON-244989543-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:42:18.779789 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-1c578199-9b4e-4234-bacc-6b0934af660a tempest-AttachVolumeTestJSON-244989543 tempest-AttachVolumeTestJSON-244989543-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:42:18.780216 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-1c578199-9b4e-4234-bacc-6b0934af660a tempest-AttachVolumeTestJSON-244989543 tempest-AttachVolumeTestJSON-244989543-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:42:18.808917 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: INFO nova.api.openstack.requestlog [None req-1c578199-9b4e-4234-bacc-6b0934af660a tempest-AttachVolumeTestJSON-244989543 tempest-AttachVolumeTestJSON-244989543-project] 10.222.0.18 "GET /compute/v2.1/servers/e0ad8879-83dd-40e5-a0b4-4c8d1f25e3b5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041124 Dec 15 03:42:18.809455 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: [pid: 116156|app: 0|req: 1099/2174] 10.222.0.18 () {58 vars in 1301 bytes} [Wed Dec 15 03:42:18 2021] GET /compute/v2.1/servers/e0ad8879-83dd-40e5-a0b4-4c8d1f25e3b5/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 03:42:18.819380 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi [None req-781445d4-19d5-4680-88fb-37015b06896e tempest-AttachVolumeTestJSON-244989543 tempest-AttachVolumeTestJSON-244989543-project] Calling method '>' {{(pid=116157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:42:18.819944 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.compute.api [None req-781445d4-19d5-4680-88fb-37015b06896e tempest-AttachVolumeTestJSON-244989543 tempest-AttachVolumeTestJSON-244989543-project] [instance: e0ad8879-83dd-40e5-a0b4-4c8d1f25e3b5] Fetching instance by UUID {{(pid=116157) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:42:18.826264 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-781445d4-19d5-4680-88fb-37015b06896e tempest-AttachVolumeTestJSON-244989543 tempest-AttachVolumeTestJSON-244989543-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:42:18.826711 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-781445d4-19d5-4680-88fb-37015b06896e tempest-AttachVolumeTestJSON-244989543 tempest-AttachVolumeTestJSON-244989543-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:42:18.827508 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-781445d4-19d5-4680-88fb-37015b06896e tempest-AttachVolumeTestJSON-244989543 tempest-AttachVolumeTestJSON-244989543-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:42:18.827942 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-781445d4-19d5-4680-88fb-37015b06896e tempest-AttachVolumeTestJSON-244989543 tempest-AttachVolumeTestJSON-244989543-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:42:18.856746 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: INFO nova.api.openstack.requestlog [None req-781445d4-19d5-4680-88fb-37015b06896e tempest-AttachVolumeTestJSON-244989543 tempest-AttachVolumeTestJSON-244989543-project] 10.222.0.18 "GET /compute/v2.1/servers/e0ad8879-83dd-40e5-a0b4-4c8d1f25e3b5/os-volume_attachments/59b5d267-50a5-4dfe-b5c3-b3b1f47ea002" status: 200 len: 194 microversion: 2.1 time: 0.041447 Dec 15 03:42:18.857324 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: [pid: 116157|app: 0|req: 1076/2175] 10.222.0.18 () {58 vars in 1412 bytes} [Wed Dec 15 03:42:18 2021] GET /compute/v2.1/servers/e0ad8879-83dd-40e5-a0b4-4c8d1f25e3b5/os-volume_attachments/59b5d267-50a5-4dfe-b5c3-b3b1f47ea002 => generated 194 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 03:42:20.143180 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi [None req-c7b3afdd-1128-441b-b30b-00f4d3d92c78 tempest-AttachVolumeTestJSON-244989543 tempest-AttachVolumeTestJSON-244989543-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "04d4f9ce-2629-4cb7-97e3-ba63999e10e1"}} {{(pid=116156) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 03:42:20.144218 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.compute.api [None req-c7b3afdd-1128-441b-b30b-00f4d3d92c78 tempest-AttachVolumeTestJSON-244989543 tempest-AttachVolumeTestJSON-244989543-project] [instance: e0ad8879-83dd-40e5-a0b4-4c8d1f25e3b5] Fetching instance by UUID {{(pid=116156) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:42:20.151162 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-c7b3afdd-1128-441b-b30b-00f4d3d92c78 tempest-AttachVolumeTestJSON-244989543 tempest-AttachVolumeTestJSON-244989543-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:42:20.151671 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-c7b3afdd-1128-441b-b30b-00f4d3d92c78 tempest-AttachVolumeTestJSON-244989543 tempest-AttachVolumeTestJSON-244989543-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:42:20.152374 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-c7b3afdd-1128-441b-b30b-00f4d3d92c78 tempest-AttachVolumeTestJSON-244989543 tempest-AttachVolumeTestJSON-244989543-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:42:20.152810 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-c7b3afdd-1128-441b-b30b-00f4d3d92c78 tempest-AttachVolumeTestJSON-244989543 tempest-AttachVolumeTestJSON-244989543-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:42:20.526095 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: INFO nova.api.openstack.requestlog [None req-c7b3afdd-1128-441b-b30b-00f4d3d92c78 tempest-AttachVolumeTestJSON-244989543 tempest-AttachVolumeTestJSON-244989543-project] 10.222.0.18 "POST /compute/v2.1/servers/e0ad8879-83dd-40e5-a0b4-4c8d1f25e3b5/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.386404 Dec 15 03:42:20.526687 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: [pid: 116156|app: 0|req: 1100/2176] 10.222.0.18 () {60 vars in 1322 bytes} [Wed Dec 15 03:42:20 2021] POST /compute/v2.1/servers/e0ad8879-83dd-40e5-a0b4-4c8d1f25e3b5/os-volume_attachments => generated 194 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 03:42:24.722403 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi [None req-ae191acc-c52a-4c55-be46-82046d1467c6 tempest-TestMinimumBasicScenario-1385142937 tempest-TestMinimumBasicScenario-1385142937-project] Calling method '>' {{(pid=116157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:42:24.723140 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.compute.api [None req-ae191acc-c52a-4c55-be46-82046d1467c6 tempest-TestMinimumBasicScenario-1385142937 tempest-TestMinimumBasicScenario-1385142937-project] [instance: 7a4d04ca-0909-481f-b859-bd99b327ddc3] Fetching instance by UUID {{(pid=116157) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:42:24.730333 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-ae191acc-c52a-4c55-be46-82046d1467c6 tempest-TestMinimumBasicScenario-1385142937 tempest-TestMinimumBasicScenario-1385142937-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:42:24.730895 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-ae191acc-c52a-4c55-be46-82046d1467c6 tempest-TestMinimumBasicScenario-1385142937 tempest-TestMinimumBasicScenario-1385142937-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:42:24.731698 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-ae191acc-c52a-4c55-be46-82046d1467c6 tempest-TestMinimumBasicScenario-1385142937 tempest-TestMinimumBasicScenario-1385142937-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:42:24.732174 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-ae191acc-c52a-4c55-be46-82046d1467c6 tempest-TestMinimumBasicScenario-1385142937 tempest-TestMinimumBasicScenario-1385142937-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:42:24.951045 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.policy [None req-ae191acc-c52a-4c55-be46-82046d1467c6 tempest-TestMinimumBasicScenario-1385142937 tempest-TestMinimumBasicScenario-1385142937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '478d1c76208642f89d96afdf22f79829', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f9dcbfd69bc450691e2b036e864f7d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116157) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:42:24.958705 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: INFO nova.api.openstack.requestlog [None req-ae191acc-c52a-4c55-be46-82046d1467c6 tempest-TestMinimumBasicScenario-1385142937 tempest-TestMinimumBasicScenario-1385142937-project] 10.222.0.18 "GET /compute/v2.1/servers/7a4d04ca-0909-481f-b859-bd99b327ddc3" status: 200 len: 1593 microversion: 2.1 time: 0.240087 Dec 15 03:42:24.959274 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: [pid: 116157|app: 0|req: 1077/2177] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 03:42:24 2021] GET /compute/v2.1/servers/7a4d04ca-0909-481f-b859-bd99b327ddc3 => generated 1593 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 03:42:26.780401 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi [req-1da0f7f5-7da0-4b7f-a15a-2befdb362c47 req-401174e7-dcb5-4591-adc9-53c601cde508 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7a4d04ca-0909-481f-b859-bd99b327ddc3", "tag": "25341a86-6728-46c3-8081-411876e42f16"}]} {{(pid=116156) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 03:42:26.781932 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 15 03:42:26.781932 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: warnings.warn(msg) Dec 15 03:42:26.789466 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [req-1da0f7f5-7da0-4b7f-a15a-2befdb362c47 req-401174e7-dcb5-4591-adc9-53c601cde508 service nova] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:42:26.790184 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [req-1da0f7f5-7da0-4b7f-a15a-2befdb362c47 req-401174e7-dcb5-4591-adc9-53c601cde508 service nova] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:42:26.802709 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: INFO nova.api.openstack.compute.server_external_events [req-1da0f7f5-7da0-4b7f-a15a-2befdb362c47 req-401174e7-dcb5-4591-adc9-53c601cde508 service nova] Creating event network-changed:25341a86-6728-46c3-8081-411876e42f16 for instance 7a4d04ca-0909-481f-b859-bd99b327ddc3 on hv-cinder-81803 Dec 15 03:42:26.808453 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: INFO nova.api.openstack.requestlog [req-1da0f7f5-7da0-4b7f-a15a-2befdb362c47 req-401174e7-dcb5-4591-adc9-53c601cde508 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032383 Dec 15 03:42:26.809049 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: [pid: 116156|app: 0|req: 1101/2178] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Dec 15 03:42:26 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 15 03:42:27.758754 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi [None req-23647543-53d5-4cda-994c-667cfe71727c tempest-TestMinimumBasicScenario-1385142937 tempest-TestMinimumBasicScenario-1385142937-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-1147248688"}} {{(pid=116157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 03:42:27.759302 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.compute.api [None req-23647543-53d5-4cda-994c-667cfe71727c tempest-TestMinimumBasicScenario-1385142937 tempest-TestMinimumBasicScenario-1385142937-project] [instance: 7a4d04ca-0909-481f-b859-bd99b327ddc3] Fetching instance by UUID {{(pid=116157) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:42:27.765738 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-23647543-53d5-4cda-994c-667cfe71727c tempest-TestMinimumBasicScenario-1385142937 tempest-TestMinimumBasicScenario-1385142937-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:42:27.766226 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-23647543-53d5-4cda-994c-667cfe71727c tempest-TestMinimumBasicScenario-1385142937 tempest-TestMinimumBasicScenario-1385142937-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:42:27.767021 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-23647543-53d5-4cda-994c-667cfe71727c tempest-TestMinimumBasicScenario-1385142937 tempest-TestMinimumBasicScenario-1385142937-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:42:27.767455 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-23647543-53d5-4cda-994c-667cfe71727c tempest-TestMinimumBasicScenario-1385142937 tempest-TestMinimumBasicScenario-1385142937-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:42:27.900988 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: INFO nova.network.security_group_api [None req-23647543-53d5-4cda-994c-667cfe71727c tempest-TestMinimumBasicScenario-1385142937 tempest-TestMinimumBasicScenario-1385142937-project] Adding security group 285496d4-9f29-4a58-9223-f64d8465dd5d to port 25341a86-6728-46c3-8081-411876e42f16 Dec 15 03:42:28.240943 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: INFO nova.api.openstack.requestlog [None req-23647543-53d5-4cda-994c-667cfe71727c tempest-TestMinimumBasicScenario-1385142937 tempest-TestMinimumBasicScenario-1385142937-project] 10.222.0.18 "POST /compute/v2.1/servers/7a4d04ca-0909-481f-b859-bd99b327ddc3/action" status: 202 len: 0 microversion: 2.1 time: 0.486844 Dec 15 03:42:28.242739 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: [pid: 116157|app: 0|req: 1078/2179] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Dec 15 03:42:27 2021] POST /compute/v2.1/servers/7a4d04ca-0909-481f-b859-bd99b327ddc3/action => generated 0 bytes in 489 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Dec 15 03:42:28.257777 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi [None req-d98fa2e4-2d83-4bd2-ad11-901d4133a2d1 tempest-TestMinimumBasicScenario-1385142937 tempest-TestMinimumBasicScenario-1385142937-project] Calling method '>' {{(pid=116156) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:42:28.259785 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.compute.api [None req-d98fa2e4-2d83-4bd2-ad11-901d4133a2d1 tempest-TestMinimumBasicScenario-1385142937 tempest-TestMinimumBasicScenario-1385142937-project] [instance: 7a4d04ca-0909-481f-b859-bd99b327ddc3] Fetching instance by UUID {{(pid=116156) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:42:28.267227 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-d98fa2e4-2d83-4bd2-ad11-901d4133a2d1 tempest-TestMinimumBasicScenario-1385142937 tempest-TestMinimumBasicScenario-1385142937-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:42:28.267903 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-d98fa2e4-2d83-4bd2-ad11-901d4133a2d1 tempest-TestMinimumBasicScenario-1385142937 tempest-TestMinimumBasicScenario-1385142937-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:42:28.268881 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-d98fa2e4-2d83-4bd2-ad11-901d4133a2d1 tempest-TestMinimumBasicScenario-1385142937 tempest-TestMinimumBasicScenario-1385142937-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:42:28.269500 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-d98fa2e4-2d83-4bd2-ad11-901d4133a2d1 tempest-TestMinimumBasicScenario-1385142937 tempest-TestMinimumBasicScenario-1385142937-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:42:28.428842 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.policy [None req-d98fa2e4-2d83-4bd2-ad11-901d4133a2d1 tempest-TestMinimumBasicScenario-1385142937 tempest-TestMinimumBasicScenario-1385142937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '478d1c76208642f89d96afdf22f79829', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f9dcbfd69bc450691e2b036e864f7d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116156) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:42:28.436596 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: INFO nova.api.openstack.requestlog [None req-d98fa2e4-2d83-4bd2-ad11-901d4133a2d1 tempest-TestMinimumBasicScenario-1385142937 tempest-TestMinimumBasicScenario-1385142937-project] 10.222.0.18 "GET /compute/v2.1/servers/7a4d04ca-0909-481f-b859-bd99b327ddc3" status: 200 len: 1758 microversion: 2.1 time: 0.189030 Dec 15 03:42:28.437349 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: [pid: 116156|app: 0|req: 1102/2180] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 03:42:28 2021] GET /compute/v2.1/servers/7a4d04ca-0909-481f-b859-bd99b327ddc3 => generated 1758 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 03:42:28.823536 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi [req-2e514bc1-e191-4cf5-9ce7-01116a68247d req-20b18503-c2ce-46f9-8f60-4c7881c5408a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7a4d04ca-0909-481f-b859-bd99b327ddc3", "tag": "25341a86-6728-46c3-8081-411876e42f16"}]} {{(pid=116157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 03:42:28.825071 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 15 03:42:28.825071 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: warnings.warn(msg) Dec 15 03:42:28.832039 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [req-2e514bc1-e191-4cf5-9ce7-01116a68247d req-20b18503-c2ce-46f9-8f60-4c7881c5408a service nova] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:42:28.832483 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [req-2e514bc1-e191-4cf5-9ce7-01116a68247d req-20b18503-c2ce-46f9-8f60-4c7881c5408a service nova] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:42:28.844250 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: INFO nova.api.openstack.compute.server_external_events [req-2e514bc1-e191-4cf5-9ce7-01116a68247d req-20b18503-c2ce-46f9-8f60-4c7881c5408a service nova] Creating event network-changed:25341a86-6728-46c3-8081-411876e42f16 for instance 7a4d04ca-0909-481f-b859-bd99b327ddc3 on hv-cinder-81803 Dec 15 03:42:28.849723 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: INFO nova.api.openstack.requestlog [req-2e514bc1-e191-4cf5-9ce7-01116a68247d req-20b18503-c2ce-46f9-8f60-4c7881c5408a service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029584 Dec 15 03:42:28.850348 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: [pid: 116157|app: 0|req: 1079/2181] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Dec 15 03:42:28 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 03:42:31.133204 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi [None req-212350da-0e0b-477f-8092-a3b87c2d36fb tempest-AttachVolumeTestJSON-244989543 tempest-AttachVolumeTestJSON-244989543-project] Calling method '>' {{(pid=116156) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:42:31.134155 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.compute.api [None req-212350da-0e0b-477f-8092-a3b87c2d36fb tempest-AttachVolumeTestJSON-244989543 tempest-AttachVolumeTestJSON-244989543-project] [instance: e0ad8879-83dd-40e5-a0b4-4c8d1f25e3b5] Fetching instance by UUID {{(pid=116156) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:42:31.140283 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-212350da-0e0b-477f-8092-a3b87c2d36fb tempest-AttachVolumeTestJSON-244989543 tempest-AttachVolumeTestJSON-244989543-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:42:31.140739 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-212350da-0e0b-477f-8092-a3b87c2d36fb tempest-AttachVolumeTestJSON-244989543 tempest-AttachVolumeTestJSON-244989543-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:42:31.141519 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-212350da-0e0b-477f-8092-a3b87c2d36fb tempest-AttachVolumeTestJSON-244989543 tempest-AttachVolumeTestJSON-244989543-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:42:31.141958 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-212350da-0e0b-477f-8092-a3b87c2d36fb tempest-AttachVolumeTestJSON-244989543 tempest-AttachVolumeTestJSON-244989543-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:42:31.171362 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: INFO nova.api.openstack.requestlog [None req-212350da-0e0b-477f-8092-a3b87c2d36fb tempest-AttachVolumeTestJSON-244989543 tempest-AttachVolumeTestJSON-244989543-project] 10.222.0.18 "GET /compute/v2.1/servers/e0ad8879-83dd-40e5-a0b4-4c8d1f25e3b5/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.041878 Dec 15 03:42:31.171903 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: [pid: 116156|app: 0|req: 1103/2182] 10.222.0.18 () {58 vars in 1301 bytes} [Wed Dec 15 03:42:31 2021] GET /compute/v2.1/servers/e0ad8879-83dd-40e5-a0b4-4c8d1f25e3b5/os-volume_attachments => generated 371 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 03:42:31.441872 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi [None req-cc061838-217b-4c6b-a1f4-6e0f1128e6ac tempest-AttachVolumeTestJSON-244989543 tempest-AttachVolumeTestJSON-244989543-project] Calling method '>' {{(pid=116157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:42:31.442497 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.compute.api [None req-cc061838-217b-4c6b-a1f4-6e0f1128e6ac tempest-AttachVolumeTestJSON-244989543 tempest-AttachVolumeTestJSON-244989543-project] [instance: e0ad8879-83dd-40e5-a0b4-4c8d1f25e3b5] Fetching instance by UUID {{(pid=116157) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:42:31.448510 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-cc061838-217b-4c6b-a1f4-6e0f1128e6ac tempest-AttachVolumeTestJSON-244989543 tempest-AttachVolumeTestJSON-244989543-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:42:31.448955 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-cc061838-217b-4c6b-a1f4-6e0f1128e6ac tempest-AttachVolumeTestJSON-244989543 tempest-AttachVolumeTestJSON-244989543-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:42:31.449720 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-cc061838-217b-4c6b-a1f4-6e0f1128e6ac tempest-AttachVolumeTestJSON-244989543 tempest-AttachVolumeTestJSON-244989543-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:42:31.450181 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-cc061838-217b-4c6b-a1f4-6e0f1128e6ac tempest-AttachVolumeTestJSON-244989543 tempest-AttachVolumeTestJSON-244989543-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:42:31.478550 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: INFO nova.api.openstack.requestlog [None req-cc061838-217b-4c6b-a1f4-6e0f1128e6ac tempest-AttachVolumeTestJSON-244989543 tempest-AttachVolumeTestJSON-244989543-project] 10.222.0.18 "GET /compute/v2.1/servers/e0ad8879-83dd-40e5-a0b4-4c8d1f25e3b5/os-volume_attachments/59b5d267-50a5-4dfe-b5c3-b3b1f47ea002" status: 200 len: 194 microversion: 2.1 time: 0.041205 Dec 15 03:42:31.479129 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: [pid: 116157|app: 0|req: 1080/2183] 10.222.0.18 () {58 vars in 1412 bytes} [Wed Dec 15 03:42:31 2021] GET /compute/v2.1/servers/e0ad8879-83dd-40e5-a0b4-4c8d1f25e3b5/os-volume_attachments/59b5d267-50a5-4dfe-b5c3-b3b1f47ea002 => generated 194 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 03:42:31.488311 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi [None req-050a56c6-6614-4563-912a-d245957d9738 tempest-AttachVolumeTestJSON-244989543 tempest-AttachVolumeTestJSON-244989543-project] Calling method '>' {{(pid=116156) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:42:31.488794 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.compute.api [None req-050a56c6-6614-4563-912a-d245957d9738 tempest-AttachVolumeTestJSON-244989543 tempest-AttachVolumeTestJSON-244989543-project] [instance: e0ad8879-83dd-40e5-a0b4-4c8d1f25e3b5] Fetching instance by UUID {{(pid=116156) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:42:31.494456 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-050a56c6-6614-4563-912a-d245957d9738 tempest-AttachVolumeTestJSON-244989543 tempest-AttachVolumeTestJSON-244989543-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:42:31.494897 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-050a56c6-6614-4563-912a-d245957d9738 tempest-AttachVolumeTestJSON-244989543 tempest-AttachVolumeTestJSON-244989543-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:42:31.495660 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-050a56c6-6614-4563-912a-d245957d9738 tempest-AttachVolumeTestJSON-244989543 tempest-AttachVolumeTestJSON-244989543-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:42:31.496094 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-050a56c6-6614-4563-912a-d245957d9738 tempest-AttachVolumeTestJSON-244989543 tempest-AttachVolumeTestJSON-244989543-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:42:31.570383 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.objects.instance [None req-050a56c6-6614-4563-912a-d245957d9738 tempest-AttachVolumeTestJSON-244989543 tempest-AttachVolumeTestJSON-244989543-project] Lazy-loading 'services' on Instance uuid e0ad8879-83dd-40e5-a0b4-4c8d1f25e3b5 {{(pid=116156) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Dec 15 03:42:31.636394 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: INFO nova.api.openstack.requestlog [None req-050a56c6-6614-4563-912a-d245957d9738 tempest-AttachVolumeTestJSON-244989543 tempest-AttachVolumeTestJSON-244989543-project] 10.222.0.18 "DELETE /compute/v2.1/servers/e0ad8879-83dd-40e5-a0b4-4c8d1f25e3b5/os-volume_attachments/59b5d267-50a5-4dfe-b5c3-b3b1f47ea002" status: 202 len: 0 microversion: 2.1 time: 0.151545 Dec 15 03:42:31.636994 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: [pid: 116156|app: 0|req: 1104/2184] 10.222.0.18 () {58 vars in 1415 bytes} [Wed Dec 15 03:42:31 2021] DELETE /compute/v2.1/servers/e0ad8879-83dd-40e5-a0b4-4c8d1f25e3b5/os-volume_attachments/59b5d267-50a5-4dfe-b5c3-b3b1f47ea002 => generated 0 bytes in 153 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Dec 15 03:42:32.740946 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi [None req-600bf78e-b590-41c5-bfab-f76238e86f21 tempest-AttachVolumeTestJSON-244989543 tempest-AttachVolumeTestJSON-244989543-project] Calling method '>' {{(pid=116157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:42:32.741510 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.compute.api [None req-600bf78e-b590-41c5-bfab-f76238e86f21 tempest-AttachVolumeTestJSON-244989543 tempest-AttachVolumeTestJSON-244989543-project] [instance: e0ad8879-83dd-40e5-a0b4-4c8d1f25e3b5] Fetching instance by UUID {{(pid=116157) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:42:32.748120 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-600bf78e-b590-41c5-bfab-f76238e86f21 tempest-AttachVolumeTestJSON-244989543 tempest-AttachVolumeTestJSON-244989543-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:42:32.748574 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-600bf78e-b590-41c5-bfab-f76238e86f21 tempest-AttachVolumeTestJSON-244989543 tempest-AttachVolumeTestJSON-244989543-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:42:32.749363 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-600bf78e-b590-41c5-bfab-f76238e86f21 tempest-AttachVolumeTestJSON-244989543 tempest-AttachVolumeTestJSON-244989543-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:42:32.749804 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-600bf78e-b590-41c5-bfab-f76238e86f21 tempest-AttachVolumeTestJSON-244989543 tempest-AttachVolumeTestJSON-244989543-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:42:32.779589 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: INFO nova.api.openstack.requestlog [None req-600bf78e-b590-41c5-bfab-f76238e86f21 tempest-AttachVolumeTestJSON-244989543 tempest-AttachVolumeTestJSON-244989543-project] 10.222.0.18 "GET /compute/v2.1/servers/e0ad8879-83dd-40e5-a0b4-4c8d1f25e3b5/os-volume_attachments/04d4f9ce-2629-4cb7-97e3-ba63999e10e1" status: 200 len: 194 microversion: 2.1 time: 0.042380 Dec 15 03:42:32.780180 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: [pid: 116157|app: 0|req: 1081/2185] 10.222.0.18 () {58 vars in 1412 bytes} [Wed Dec 15 03:42:32 2021] GET /compute/v2.1/servers/e0ad8879-83dd-40e5-a0b4-4c8d1f25e3b5/os-volume_attachments/04d4f9ce-2629-4cb7-97e3-ba63999e10e1 => generated 194 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 03:42:32.791331 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi [None req-2b634c9d-764f-4fd7-81cc-84f890450609 tempest-AttachVolumeTestJSON-244989543 tempest-AttachVolumeTestJSON-244989543-project] Calling method '>' {{(pid=116156) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:42:32.791894 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.compute.api [None req-2b634c9d-764f-4fd7-81cc-84f890450609 tempest-AttachVolumeTestJSON-244989543 tempest-AttachVolumeTestJSON-244989543-project] [instance: e0ad8879-83dd-40e5-a0b4-4c8d1f25e3b5] Fetching instance by UUID {{(pid=116156) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:42:32.798837 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-2b634c9d-764f-4fd7-81cc-84f890450609 tempest-AttachVolumeTestJSON-244989543 tempest-AttachVolumeTestJSON-244989543-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:42:32.799274 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-2b634c9d-764f-4fd7-81cc-84f890450609 tempest-AttachVolumeTestJSON-244989543 tempest-AttachVolumeTestJSON-244989543-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:42:32.800059 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-2b634c9d-764f-4fd7-81cc-84f890450609 tempest-AttachVolumeTestJSON-244989543 tempest-AttachVolumeTestJSON-244989543-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:42:32.800500 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-2b634c9d-764f-4fd7-81cc-84f890450609 tempest-AttachVolumeTestJSON-244989543 tempest-AttachVolumeTestJSON-244989543-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:42:32.891064 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.objects.instance [None req-2b634c9d-764f-4fd7-81cc-84f890450609 tempest-AttachVolumeTestJSON-244989543 tempest-AttachVolumeTestJSON-244989543-project] Lazy-loading 'services' on Instance uuid e0ad8879-83dd-40e5-a0b4-4c8d1f25e3b5 {{(pid=116156) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Dec 15 03:42:32.959845 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: INFO nova.api.openstack.requestlog [None req-2b634c9d-764f-4fd7-81cc-84f890450609 tempest-AttachVolumeTestJSON-244989543 tempest-AttachVolumeTestJSON-244989543-project] 10.222.0.18 "DELETE /compute/v2.1/servers/e0ad8879-83dd-40e5-a0b4-4c8d1f25e3b5/os-volume_attachments/04d4f9ce-2629-4cb7-97e3-ba63999e10e1" status: 202 len: 0 microversion: 2.1 time: 0.173505 Dec 15 03:42:32.960506 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: [pid: 116156|app: 0|req: 1105/2186] 10.222.0.18 () {58 vars in 1415 bytes} [Wed Dec 15 03:42:32 2021] DELETE /compute/v2.1/servers/e0ad8879-83dd-40e5-a0b4-4c8d1f25e3b5/os-volume_attachments/04d4f9ce-2629-4cb7-97e3-ba63999e10e1 => generated 0 bytes in 175 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Dec 15 03:42:34.107670 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi [None req-6bafc33a-9100-4ee0-864e-d0420aa57039 tempest-AttachVolumeTestJSON-244989543 tempest-AttachVolumeTestJSON-244989543-project] Calling method '>' {{(pid=116157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:42:34.108578 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.compute.api [None req-6bafc33a-9100-4ee0-864e-d0420aa57039 tempest-AttachVolumeTestJSON-244989543 tempest-AttachVolumeTestJSON-244989543-project] [instance: e0ad8879-83dd-40e5-a0b4-4c8d1f25e3b5] Fetching instance by UUID {{(pid=116157) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:42:34.114777 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-6bafc33a-9100-4ee0-864e-d0420aa57039 tempest-AttachVolumeTestJSON-244989543 tempest-AttachVolumeTestJSON-244989543-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:42:34.115229 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-6bafc33a-9100-4ee0-864e-d0420aa57039 tempest-AttachVolumeTestJSON-244989543 tempest-AttachVolumeTestJSON-244989543-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:42:34.116013 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-6bafc33a-9100-4ee0-864e-d0420aa57039 tempest-AttachVolumeTestJSON-244989543 tempest-AttachVolumeTestJSON-244989543-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:42:34.116481 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-6bafc33a-9100-4ee0-864e-d0420aa57039 tempest-AttachVolumeTestJSON-244989543 tempest-AttachVolumeTestJSON-244989543-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:42:34.143685 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: INFO nova.api.openstack.requestlog [None req-6bafc33a-9100-4ee0-864e-d0420aa57039 tempest-AttachVolumeTestJSON-244989543 tempest-AttachVolumeTestJSON-244989543-project] 10.222.0.18 "GET /compute/v2.1/servers/e0ad8879-83dd-40e5-a0b4-4c8d1f25e3b5/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.039699 Dec 15 03:42:34.144231 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: [pid: 116157|app: 0|req: 1082/2187] 10.222.0.18 () {58 vars in 1301 bytes} [Wed Dec 15 03:42:34 2021] GET /compute/v2.1/servers/e0ad8879-83dd-40e5-a0b4-4c8d1f25e3b5/os-volume_attachments => generated 25 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Dec 15 03:42:34.242667 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi [None req-3175d117-928f-4ad6-8279-f58e617266a4 tempest-AttachVolumeTestJSON-244989543 tempest-AttachVolumeTestJSON-244989543-project] Calling method '>' {{(pid=116156) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:42:34.243700 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.compute.api [None req-3175d117-928f-4ad6-8279-f58e617266a4 tempest-AttachVolumeTestJSON-244989543 tempest-AttachVolumeTestJSON-244989543-project] [instance: e0ad8879-83dd-40e5-a0b4-4c8d1f25e3b5] Fetching instance by UUID {{(pid=116156) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:42:34.249519 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-3175d117-928f-4ad6-8279-f58e617266a4 tempest-AttachVolumeTestJSON-244989543 tempest-AttachVolumeTestJSON-244989543-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:42:34.249966 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-3175d117-928f-4ad6-8279-f58e617266a4 tempest-AttachVolumeTestJSON-244989543 tempest-AttachVolumeTestJSON-244989543-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:42:34.250758 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-3175d117-928f-4ad6-8279-f58e617266a4 tempest-AttachVolumeTestJSON-244989543 tempest-AttachVolumeTestJSON-244989543-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:42:34.251189 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-3175d117-928f-4ad6-8279-f58e617266a4 tempest-AttachVolumeTestJSON-244989543 tempest-AttachVolumeTestJSON-244989543-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:42:34.278729 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: INFO nova.api.openstack.requestlog [None req-3175d117-928f-4ad6-8279-f58e617266a4 tempest-AttachVolumeTestJSON-244989543 tempest-AttachVolumeTestJSON-244989543-project] 10.222.0.18 "GET /compute/v2.1/servers/e0ad8879-83dd-40e5-a0b4-4c8d1f25e3b5/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.040597 Dec 15 03:42:34.279260 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: [pid: 116156|app: 0|req: 1106/2188] 10.222.0.18 () {58 vars in 1301 bytes} [Wed Dec 15 03:42:34 2021] GET /compute/v2.1/servers/e0ad8879-83dd-40e5-a0b4-4c8d1f25e3b5/os-volume_attachments => generated 25 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Dec 15 03:42:34.331685 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi [None req-7bed0f7d-fae0-4ce2-aa03-b1de66e6bb6a tempest-AttachVolumeTestJSON-244989543 tempest-AttachVolumeTestJSON-244989543-project] Calling method '>' {{(pid=116157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:42:34.332221 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.compute.api [None req-7bed0f7d-fae0-4ce2-aa03-b1de66e6bb6a tempest-AttachVolumeTestJSON-244989543 tempest-AttachVolumeTestJSON-244989543-project] [instance: e0ad8879-83dd-40e5-a0b4-4c8d1f25e3b5] Fetching instance by UUID {{(pid=116157) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:42:34.338706 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-7bed0f7d-fae0-4ce2-aa03-b1de66e6bb6a tempest-AttachVolumeTestJSON-244989543 tempest-AttachVolumeTestJSON-244989543-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:42:34.339160 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-7bed0f7d-fae0-4ce2-aa03-b1de66e6bb6a tempest-AttachVolumeTestJSON-244989543 tempest-AttachVolumeTestJSON-244989543-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:42:34.339935 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-7bed0f7d-fae0-4ce2-aa03-b1de66e6bb6a tempest-AttachVolumeTestJSON-244989543 tempest-AttachVolumeTestJSON-244989543-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:42:34.340372 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-7bed0f7d-fae0-4ce2-aa03-b1de66e6bb6a tempest-AttachVolumeTestJSON-244989543 tempest-AttachVolumeTestJSON-244989543-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:42:34.363946 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.compute.api [None req-7bed0f7d-fae0-4ce2-aa03-b1de66e6bb6a tempest-AttachVolumeTestJSON-244989543 tempest-AttachVolumeTestJSON-244989543-project] [instance: e0ad8879-83dd-40e5-a0b4-4c8d1f25e3b5] Going to try to terminate instance {{(pid=116157) delete /opt/stack/nova/nova/compute/api.py:2614}} Dec 15 03:42:34.434233 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: INFO nova.api.openstack.requestlog [None req-7bed0f7d-fae0-4ce2-aa03-b1de66e6bb6a tempest-AttachVolumeTestJSON-244989543 tempest-AttachVolumeTestJSON-244989543-project] 10.222.0.18 "DELETE /compute/v2.1/servers/e0ad8879-83dd-40e5-a0b4-4c8d1f25e3b5" status: 204 len: 0 microversion: 2.1 time: 0.105832 Dec 15 03:42:34.435200 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: [pid: 116157|app: 0|req: 1083/2189] 10.222.0.18 () {58 vars in 1238 bytes} [Wed Dec 15 03:42:34 2021] DELETE /compute/v2.1/servers/e0ad8879-83dd-40e5-a0b4-4c8d1f25e3b5 => generated 0 bytes in 107 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Dec 15 03:42:34.445347 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi [None req-db68d909-0dd3-482f-b4d2-399df20f9e27 tempest-AttachVolumeTestJSON-244989543 tempest-AttachVolumeTestJSON-244989543-project] Calling method '>' {{(pid=116156) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:42:34.446149 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.compute.api [None req-db68d909-0dd3-482f-b4d2-399df20f9e27 tempest-AttachVolumeTestJSON-244989543 tempest-AttachVolumeTestJSON-244989543-project] [instance: e0ad8879-83dd-40e5-a0b4-4c8d1f25e3b5] Fetching instance by UUID {{(pid=116156) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:42:34.452989 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-db68d909-0dd3-482f-b4d2-399df20f9e27 tempest-AttachVolumeTestJSON-244989543 tempest-AttachVolumeTestJSON-244989543-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:42:34.453571 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-db68d909-0dd3-482f-b4d2-399df20f9e27 tempest-AttachVolumeTestJSON-244989543 tempest-AttachVolumeTestJSON-244989543-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:42:34.454551 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-db68d909-0dd3-482f-b4d2-399df20f9e27 tempest-AttachVolumeTestJSON-244989543 tempest-AttachVolumeTestJSON-244989543-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:42:34.455082 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-db68d909-0dd3-482f-b4d2-399df20f9e27 tempest-AttachVolumeTestJSON-244989543 tempest-AttachVolumeTestJSON-244989543-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:42:34.586888 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.policy [None req-db68d909-0dd3-482f-b4d2-399df20f9e27 tempest-AttachVolumeTestJSON-244989543 tempest-AttachVolumeTestJSON-244989543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5fb31c3d4874e13ba22e0242d4aaa58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00e76c2a092544e1a51928f1d84879b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116156) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:42:34.594298 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: INFO nova.api.openstack.requestlog [None req-db68d909-0dd3-482f-b4d2-399df20f9e27 tempest-AttachVolumeTestJSON-244989543 tempest-AttachVolumeTestJSON-244989543-project] 10.222.0.18 "GET /compute/v2.1/servers/e0ad8879-83dd-40e5-a0b4-4c8d1f25e3b5" status: 200 len: 1676 microversion: 2.1 time: 0.152975 Dec 15 03:42:34.594854 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: [pid: 116156|app: 0|req: 1107/2190] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 03:42:34 2021] GET /compute/v2.1/servers/e0ad8879-83dd-40e5-a0b4-4c8d1f25e3b5 => generated 1676 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 03:42:35.611814 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi [None req-4f41a244-4e7c-482e-ae53-a88478001357 tempest-AttachVolumeTestJSON-244989543 tempest-AttachVolumeTestJSON-244989543-project] Calling method '>' {{(pid=116157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:42:35.612503 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.compute.api [None req-4f41a244-4e7c-482e-ae53-a88478001357 tempest-AttachVolumeTestJSON-244989543 tempest-AttachVolumeTestJSON-244989543-project] [instance: e0ad8879-83dd-40e5-a0b4-4c8d1f25e3b5] Fetching instance by UUID {{(pid=116157) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:42:35.618747 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-4f41a244-4e7c-482e-ae53-a88478001357 tempest-AttachVolumeTestJSON-244989543 tempest-AttachVolumeTestJSON-244989543-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:42:35.619190 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-4f41a244-4e7c-482e-ae53-a88478001357 tempest-AttachVolumeTestJSON-244989543 tempest-AttachVolumeTestJSON-244989543-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:42:35.619959 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-4f41a244-4e7c-482e-ae53-a88478001357 tempest-AttachVolumeTestJSON-244989543 tempest-AttachVolumeTestJSON-244989543-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:42:35.620387 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-4f41a244-4e7c-482e-ae53-a88478001357 tempest-AttachVolumeTestJSON-244989543 tempest-AttachVolumeTestJSON-244989543-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:42:35.748898 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.policy [None req-4f41a244-4e7c-482e-ae53-a88478001357 tempest-AttachVolumeTestJSON-244989543 tempest-AttachVolumeTestJSON-244989543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5fb31c3d4874e13ba22e0242d4aaa58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00e76c2a092544e1a51928f1d84879b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116157) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:42:35.756038 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: INFO nova.api.openstack.requestlog [None req-4f41a244-4e7c-482e-ae53-a88478001357 tempest-AttachVolumeTestJSON-244989543 tempest-AttachVolumeTestJSON-244989543-project] 10.222.0.18 "GET /compute/v2.1/servers/e0ad8879-83dd-40e5-a0b4-4c8d1f25e3b5" status: 200 len: 1676 microversion: 2.1 time: 0.148249 Dec 15 03:42:35.756588 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: [pid: 116157|app: 0|req: 1084/2191] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 03:42:35 2021] GET /compute/v2.1/servers/e0ad8879-83dd-40e5-a0b4-4c8d1f25e3b5 => generated 1676 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 03:42:36.772731 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi [None req-f735f7c2-0e04-46bd-a2e0-cd97fac60336 tempest-AttachVolumeTestJSON-244989543 tempest-AttachVolumeTestJSON-244989543-project] Calling method '>' {{(pid=116156) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:42:36.773368 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.compute.api [None req-f735f7c2-0e04-46bd-a2e0-cd97fac60336 tempest-AttachVolumeTestJSON-244989543 tempest-AttachVolumeTestJSON-244989543-project] [instance: e0ad8879-83dd-40e5-a0b4-4c8d1f25e3b5] Fetching instance by UUID {{(pid=116156) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:42:36.779926 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-f735f7c2-0e04-46bd-a2e0-cd97fac60336 tempest-AttachVolumeTestJSON-244989543 tempest-AttachVolumeTestJSON-244989543-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:42:36.780374 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-f735f7c2-0e04-46bd-a2e0-cd97fac60336 tempest-AttachVolumeTestJSON-244989543 tempest-AttachVolumeTestJSON-244989543-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:42:36.781147 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-f735f7c2-0e04-46bd-a2e0-cd97fac60336 tempest-AttachVolumeTestJSON-244989543 tempest-AttachVolumeTestJSON-244989543-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:42:36.781595 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-f735f7c2-0e04-46bd-a2e0-cd97fac60336 tempest-AttachVolumeTestJSON-244989543 tempest-AttachVolumeTestJSON-244989543-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:42:36.978326 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.policy [None req-f735f7c2-0e04-46bd-a2e0-cd97fac60336 tempest-AttachVolumeTestJSON-244989543 tempest-AttachVolumeTestJSON-244989543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5fb31c3d4874e13ba22e0242d4aaa58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00e76c2a092544e1a51928f1d84879b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116156) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:42:36.986107 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: INFO nova.api.openstack.requestlog [None req-f735f7c2-0e04-46bd-a2e0-cd97fac60336 tempest-AttachVolumeTestJSON-244989543 tempest-AttachVolumeTestJSON-244989543-project] 10.222.0.18 "GET /compute/v2.1/servers/e0ad8879-83dd-40e5-a0b4-4c8d1f25e3b5" status: 200 len: 1676 microversion: 2.1 time: 0.217279 Dec 15 03:42:36.996636 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: [pid: 116156|app: 0|req: 1108/2192] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 03:42:36 2021] GET /compute/v2.1/servers/e0ad8879-83dd-40e5-a0b4-4c8d1f25e3b5 => generated 1676 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 03:42:37.532431 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi [req-97ab3c44-0306-4137-8039-7c1997b9c714 req-702bd58e-b345-41d2-98ab-c0ea06af24d5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e0ad8879-83dd-40e5-a0b4-4c8d1f25e3b5", "name": "network-vif-deleted", "tag": "410a400e-6c2f-44c9-9f22-1b43ae92fdcf"}]} {{(pid=116157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 03:42:37.534456 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 15 03:42:37.534456 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: warnings.warn(msg) Dec 15 03:42:37.541932 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [req-97ab3c44-0306-4137-8039-7c1997b9c714 req-702bd58e-b345-41d2-98ab-c0ea06af24d5 service nova] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:42:37.542408 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [req-97ab3c44-0306-4137-8039-7c1997b9c714 req-702bd58e-b345-41d2-98ab-c0ea06af24d5 service nova] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:42:37.554457 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: INFO nova.api.openstack.compute.server_external_events [req-97ab3c44-0306-4137-8039-7c1997b9c714 req-702bd58e-b345-41d2-98ab-c0ea06af24d5 service nova] Creating event network-vif-deleted:410a400e-6c2f-44c9-9f22-1b43ae92fdcf for instance e0ad8879-83dd-40e5-a0b4-4c8d1f25e3b5 on hv-cinder-81803 Dec 15 03:42:37.559792 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: INFO nova.api.openstack.requestlog [req-97ab3c44-0306-4137-8039-7c1997b9c714 req-702bd58e-b345-41d2-98ab-c0ea06af24d5 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030975 Dec 15 03:42:37.560485 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: [pid: 116157|app: 0|req: 1085/2193] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Dec 15 03:42:37 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 03:42:38.005469 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi [None req-a69d022f-c6d2-4aa3-804e-ad5235972556 tempest-AttachVolumeTestJSON-244989543 tempest-AttachVolumeTestJSON-244989543-project] Calling method '>' {{(pid=116156) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:42:38.006159 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.compute.api [None req-a69d022f-c6d2-4aa3-804e-ad5235972556 tempest-AttachVolumeTestJSON-244989543 tempest-AttachVolumeTestJSON-244989543-project] [instance: e0ad8879-83dd-40e5-a0b4-4c8d1f25e3b5] Fetching instance by UUID {{(pid=116156) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:42:38.013147 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-a69d022f-c6d2-4aa3-804e-ad5235972556 tempest-AttachVolumeTestJSON-244989543 tempest-AttachVolumeTestJSON-244989543-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:42:38.013606 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-a69d022f-c6d2-4aa3-804e-ad5235972556 tempest-AttachVolumeTestJSON-244989543 tempest-AttachVolumeTestJSON-244989543-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:42:38.014540 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-a69d022f-c6d2-4aa3-804e-ad5235972556 tempest-AttachVolumeTestJSON-244989543 tempest-AttachVolumeTestJSON-244989543-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:42:38.015150 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-a69d022f-c6d2-4aa3-804e-ad5235972556 tempest-AttachVolumeTestJSON-244989543 tempest-AttachVolumeTestJSON-244989543-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:42:38.047576 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-a69d022f-c6d2-4aa3-804e-ad5235972556 tempest-AttachVolumeTestJSON-244989543 tempest-AttachVolumeTestJSON-244989543-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:42:38.048001 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-a69d022f-c6d2-4aa3-804e-ad5235972556 tempest-AttachVolumeTestJSON-244989543 tempest-AttachVolumeTestJSON-244989543-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:42:38.048680 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.objects.instance [None req-a69d022f-c6d2-4aa3-804e-ad5235972556 tempest-AttachVolumeTestJSON-244989543 tempest-AttachVolumeTestJSON-244989543-project] Lazy-loading 'fault' on Instance uuid e0ad8879-83dd-40e5-a0b4-4c8d1f25e3b5 {{(pid=116156) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Dec 15 03:42:38.095938 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.policy [None req-a69d022f-c6d2-4aa3-804e-ad5235972556 tempest-AttachVolumeTestJSON-244989543 tempest-AttachVolumeTestJSON-244989543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5fb31c3d4874e13ba22e0242d4aaa58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00e76c2a092544e1a51928f1d84879b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116156) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:42:38.102946 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: INFO nova.api.openstack.requestlog [None req-a69d022f-c6d2-4aa3-804e-ad5235972556 tempest-AttachVolumeTestJSON-244989543 tempest-AttachVolumeTestJSON-244989543-project] 10.222.0.18 "GET /compute/v2.1/servers/e0ad8879-83dd-40e5-a0b4-4c8d1f25e3b5" status: 200 len: 1328 microversion: 2.1 time: 0.102471 Dec 15 03:42:38.113627 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: [pid: 116156|app: 0|req: 1109/2194] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 03:42:37 2021] GET /compute/v2.1/servers/e0ad8879-83dd-40e5-a0b4-4c8d1f25e3b5 => generated 1328 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 03:42:39.120808 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi [None req-f8fd6c75-9ba4-466c-8f9e-29dbd2c330c4 tempest-AttachVolumeTestJSON-244989543 tempest-AttachVolumeTestJSON-244989543-project] Calling method '>' {{(pid=116157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:42:39.121510 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.compute.api [None req-f8fd6c75-9ba4-466c-8f9e-29dbd2c330c4 tempest-AttachVolumeTestJSON-244989543 tempest-AttachVolumeTestJSON-244989543-project] [instance: e0ad8879-83dd-40e5-a0b4-4c8d1f25e3b5] Fetching instance by UUID {{(pid=116157) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:42:39.127952 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-f8fd6c75-9ba4-466c-8f9e-29dbd2c330c4 tempest-AttachVolumeTestJSON-244989543 tempest-AttachVolumeTestJSON-244989543-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:42:39.128406 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-f8fd6c75-9ba4-466c-8f9e-29dbd2c330c4 tempest-AttachVolumeTestJSON-244989543 tempest-AttachVolumeTestJSON-244989543-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:42:39.129189 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-f8fd6c75-9ba4-466c-8f9e-29dbd2c330c4 tempest-AttachVolumeTestJSON-244989543 tempest-AttachVolumeTestJSON-244989543-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:42:39.129630 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-f8fd6c75-9ba4-466c-8f9e-29dbd2c330c4 tempest-AttachVolumeTestJSON-244989543 tempest-AttachVolumeTestJSON-244989543-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:42:39.142584 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: INFO nova.api.openstack.wsgi [None req-f8fd6c75-9ba4-466c-8f9e-29dbd2c330c4 tempest-AttachVolumeTestJSON-244989543 tempest-AttachVolumeTestJSON-244989543-project] HTTP exception thrown: Instance e0ad8879-83dd-40e5-a0b4-4c8d1f25e3b5 could not be found. Dec 15 03:42:39.143172 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi [None req-f8fd6c75-9ba4-466c-8f9e-29dbd2c330c4 tempest-AttachVolumeTestJSON-244989543 tempest-AttachVolumeTestJSON-244989543-project] Returning 404 to user: Instance e0ad8879-83dd-40e5-a0b4-4c8d1f25e3b5 could not be found. {{(pid=116157) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 15 03:42:39.143982 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: INFO nova.api.openstack.requestlog [None req-f8fd6c75-9ba4-466c-8f9e-29dbd2c330c4 tempest-AttachVolumeTestJSON-244989543 tempest-AttachVolumeTestJSON-244989543-project] 10.222.0.18 "GET /compute/v2.1/servers/e0ad8879-83dd-40e5-a0b4-4c8d1f25e3b5" status: 404 len: 111 microversion: 2.1 time: 0.027198 Dec 15 03:42:39.144493 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: [pid: 116157|app: 0|req: 1086/2195] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 03:42:39 2021] GET /compute/v2.1/servers/e0ad8879-83dd-40e5-a0b4-4c8d1f25e3b5 => generated 111 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 15 03:42:39.153158 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi [None req-4fa5c90b-082f-48e2-9ab9-85c0a186bad6 tempest-AttachVolumeTestJSON-244989543 tempest-AttachVolumeTestJSON-244989543-project] Calling method '.version_select at 0x7f1269866c10>' {{(pid=116156) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:42:39.171197 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: INFO nova.api.openstack.requestlog [None req-4fa5c90b-082f-48e2-9ab9-85c0a186bad6 tempest-AttachVolumeTestJSON-244989543 tempest-AttachVolumeTestJSON-244989543-project] 10.222.0.18 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1140182986" status: 202 len: 0 microversion: 2.1 time: 0.021524 Dec 15 03:42:39.171750 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: [pid: 116156|app: 0|req: 1110/2196] 10.222.0.18 () {58 vars in 1220 bytes} [Wed Dec 15 03:42:39 2021] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1140182986 => generated 0 bytes in 23 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Dec 15 03:42:41.999876 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi [None req-fb5704d4-1a62-496e-b600-74454ac47e77 tempest-AttachVolumeTestJSON-244989543 tempest-AttachVolumeTestJSON-244989543-project] Calling method '>' {{(pid=116157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:42:42.000372 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.compute.api [None req-fb5704d4-1a62-496e-b600-74454ac47e77 tempest-AttachVolumeTestJSON-244989543 tempest-AttachVolumeTestJSON-244989543-project] [instance: e0ad8879-83dd-40e5-a0b4-4c8d1f25e3b5] Fetching instance by UUID {{(pid=116157) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:42:42.007108 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-fb5704d4-1a62-496e-b600-74454ac47e77 tempest-AttachVolumeTestJSON-244989543 tempest-AttachVolumeTestJSON-244989543-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:42:42.007565 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-fb5704d4-1a62-496e-b600-74454ac47e77 tempest-AttachVolumeTestJSON-244989543 tempest-AttachVolumeTestJSON-244989543-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:42:42.008347 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-fb5704d4-1a62-496e-b600-74454ac47e77 tempest-AttachVolumeTestJSON-244989543 tempest-AttachVolumeTestJSON-244989543-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:42:42.008790 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-fb5704d4-1a62-496e-b600-74454ac47e77 tempest-AttachVolumeTestJSON-244989543 tempest-AttachVolumeTestJSON-244989543-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:42:42.022163 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: INFO nova.api.openstack.wsgi [None req-fb5704d4-1a62-496e-b600-74454ac47e77 tempest-AttachVolumeTestJSON-244989543 tempest-AttachVolumeTestJSON-244989543-project] HTTP exception thrown: Instance e0ad8879-83dd-40e5-a0b4-4c8d1f25e3b5 could not be found. Dec 15 03:42:42.022747 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi [None req-fb5704d4-1a62-496e-b600-74454ac47e77 tempest-AttachVolumeTestJSON-244989543 tempest-AttachVolumeTestJSON-244989543-project] Returning 404 to user: Instance e0ad8879-83dd-40e5-a0b4-4c8d1f25e3b5 could not be found. {{(pid=116157) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 15 03:42:42.023560 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: INFO nova.api.openstack.requestlog [None req-fb5704d4-1a62-496e-b600-74454ac47e77 tempest-AttachVolumeTestJSON-244989543 tempest-AttachVolumeTestJSON-244989543-project] 10.222.0.18 "DELETE /compute/v2.1/servers/e0ad8879-83dd-40e5-a0b4-4c8d1f25e3b5" status: 404 len: 111 microversion: 2.1 time: 0.027406 Dec 15 03:42:42.024075 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: [pid: 116157|app: 0|req: 1087/2197] 10.222.0.18 () {58 vars in 1238 bytes} [Wed Dec 15 03:42:41 2021] DELETE /compute/v2.1/servers/e0ad8879-83dd-40e5-a0b4-4c8d1f25e3b5 => generated 111 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 15 03:42:42.032197 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi [None req-e60aba56-4863-468d-978d-42386f93784e tempest-AttachVolumeTestJSON-244989543 tempest-AttachVolumeTestJSON-244989543-project] Calling method '>' {{(pid=116156) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:42:42.032810 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.compute.api [None req-e60aba56-4863-468d-978d-42386f93784e tempest-AttachVolumeTestJSON-244989543 tempest-AttachVolumeTestJSON-244989543-project] [instance: e0ad8879-83dd-40e5-a0b4-4c8d1f25e3b5] Fetching instance by UUID {{(pid=116156) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:42:42.039517 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-e60aba56-4863-468d-978d-42386f93784e tempest-AttachVolumeTestJSON-244989543 tempest-AttachVolumeTestJSON-244989543-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:42:42.039978 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-e60aba56-4863-468d-978d-42386f93784e tempest-AttachVolumeTestJSON-244989543 tempest-AttachVolumeTestJSON-244989543-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:42:42.040760 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-e60aba56-4863-468d-978d-42386f93784e tempest-AttachVolumeTestJSON-244989543 tempest-AttachVolumeTestJSON-244989543-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:42:42.041202 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-e60aba56-4863-468d-978d-42386f93784e tempest-AttachVolumeTestJSON-244989543 tempest-AttachVolumeTestJSON-244989543-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:42:42.053697 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: INFO nova.api.openstack.wsgi [None req-e60aba56-4863-468d-978d-42386f93784e tempest-AttachVolumeTestJSON-244989543 tempest-AttachVolumeTestJSON-244989543-project] HTTP exception thrown: Instance e0ad8879-83dd-40e5-a0b4-4c8d1f25e3b5 could not be found. Dec 15 03:42:42.054323 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi [None req-e60aba56-4863-468d-978d-42386f93784e tempest-AttachVolumeTestJSON-244989543 tempest-AttachVolumeTestJSON-244989543-project] Returning 404 to user: Instance e0ad8879-83dd-40e5-a0b4-4c8d1f25e3b5 could not be found. {{(pid=116156) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 15 03:42:42.055136 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: INFO nova.api.openstack.requestlog [None req-e60aba56-4863-468d-978d-42386f93784e tempest-AttachVolumeTestJSON-244989543 tempest-AttachVolumeTestJSON-244989543-project] 10.222.0.18 "GET /compute/v2.1/servers/e0ad8879-83dd-40e5-a0b4-4c8d1f25e3b5" status: 404 len: 111 microversion: 2.1 time: 0.027039 Dec 15 03:42:42.055646 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: [pid: 116156|app: 0|req: 1111/2198] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 03:42:42 2021] GET /compute/v2.1/servers/e0ad8879-83dd-40e5-a0b4-4c8d1f25e3b5 => generated 111 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Dec 15 03:42:43.179412 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi [None req-d1e99d78-752a-49c2-8fb5-d640e002af7b tempest-AttachVolumeTestJSON-244989543 tempest-AttachVolumeTestJSON-244989543-project] Calling method '>' {{(pid=116157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:42:43.179955 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.compute.api [None req-d1e99d78-752a-49c2-8fb5-d640e002af7b tempest-AttachVolumeTestJSON-244989543 tempest-AttachVolumeTestJSON-244989543-project] [instance: f22dfea6-4599-43e4-93d5-d99f1db3b4fb] Fetching instance by UUID {{(pid=116157) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:42:43.186360 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-d1e99d78-752a-49c2-8fb5-d640e002af7b tempest-AttachVolumeTestJSON-244989543 tempest-AttachVolumeTestJSON-244989543-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:42:43.186803 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-d1e99d78-752a-49c2-8fb5-d640e002af7b tempest-AttachVolumeTestJSON-244989543 tempest-AttachVolumeTestJSON-244989543-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:42:43.187575 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-d1e99d78-752a-49c2-8fb5-d640e002af7b tempest-AttachVolumeTestJSON-244989543 tempest-AttachVolumeTestJSON-244989543-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:42:43.188009 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-d1e99d78-752a-49c2-8fb5-d640e002af7b tempest-AttachVolumeTestJSON-244989543 tempest-AttachVolumeTestJSON-244989543-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:42:43.200683 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: INFO nova.api.openstack.wsgi [None req-d1e99d78-752a-49c2-8fb5-d640e002af7b tempest-AttachVolumeTestJSON-244989543 tempest-AttachVolumeTestJSON-244989543-project] HTTP exception thrown: Instance f22dfea6-4599-43e4-93d5-d99f1db3b4fb could not be found. Dec 15 03:42:43.201269 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi [None req-d1e99d78-752a-49c2-8fb5-d640e002af7b tempest-AttachVolumeTestJSON-244989543 tempest-AttachVolumeTestJSON-244989543-project] Returning 404 to user: Instance f22dfea6-4599-43e4-93d5-d99f1db3b4fb could not be found. {{(pid=116157) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 15 03:42:43.202106 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: INFO nova.api.openstack.requestlog [None req-d1e99d78-752a-49c2-8fb5-d640e002af7b tempest-AttachVolumeTestJSON-244989543 tempest-AttachVolumeTestJSON-244989543-project] 10.222.0.18 "DELETE /compute/v2.1/servers/f22dfea6-4599-43e4-93d5-d99f1db3b4fb" status: 404 len: 111 microversion: 2.1 time: 0.026420 Dec 15 03:42:43.202646 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: [pid: 116157|app: 0|req: 1088/2199] 10.222.0.18 () {58 vars in 1238 bytes} [Wed Dec 15 03:42:43 2021] DELETE /compute/v2.1/servers/f22dfea6-4599-43e4-93d5-d99f1db3b4fb => generated 111 bytes in 27 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 15 03:42:43.210753 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi [None req-26cd95a9-1d65-4bc6-8ac9-a407609e05d5 tempest-AttachVolumeTestJSON-244989543 tempest-AttachVolumeTestJSON-244989543-project] Calling method '>' {{(pid=116156) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:42:43.211364 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.compute.api [None req-26cd95a9-1d65-4bc6-8ac9-a407609e05d5 tempest-AttachVolumeTestJSON-244989543 tempest-AttachVolumeTestJSON-244989543-project] [instance: f22dfea6-4599-43e4-93d5-d99f1db3b4fb] Fetching instance by UUID {{(pid=116156) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:42:43.217783 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-26cd95a9-1d65-4bc6-8ac9-a407609e05d5 tempest-AttachVolumeTestJSON-244989543 tempest-AttachVolumeTestJSON-244989543-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:42:43.218268 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-26cd95a9-1d65-4bc6-8ac9-a407609e05d5 tempest-AttachVolumeTestJSON-244989543 tempest-AttachVolumeTestJSON-244989543-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:42:43.219037 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-26cd95a9-1d65-4bc6-8ac9-a407609e05d5 tempest-AttachVolumeTestJSON-244989543 tempest-AttachVolumeTestJSON-244989543-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:42:43.219469 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-26cd95a9-1d65-4bc6-8ac9-a407609e05d5 tempest-AttachVolumeTestJSON-244989543 tempest-AttachVolumeTestJSON-244989543-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:42:43.232536 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: INFO nova.api.openstack.wsgi [None req-26cd95a9-1d65-4bc6-8ac9-a407609e05d5 tempest-AttachVolumeTestJSON-244989543 tempest-AttachVolumeTestJSON-244989543-project] HTTP exception thrown: Instance f22dfea6-4599-43e4-93d5-d99f1db3b4fb could not be found. Dec 15 03:42:43.233105 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi [None req-26cd95a9-1d65-4bc6-8ac9-a407609e05d5 tempest-AttachVolumeTestJSON-244989543 tempest-AttachVolumeTestJSON-244989543-project] Returning 404 to user: Instance f22dfea6-4599-43e4-93d5-d99f1db3b4fb could not be found. {{(pid=116156) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 15 03:42:43.233900 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: INFO nova.api.openstack.requestlog [None req-26cd95a9-1d65-4bc6-8ac9-a407609e05d5 tempest-AttachVolumeTestJSON-244989543 tempest-AttachVolumeTestJSON-244989543-project] 10.222.0.18 "GET /compute/v2.1/servers/f22dfea6-4599-43e4-93d5-d99f1db3b4fb" status: 404 len: 111 microversion: 2.1 time: 0.027280 Dec 15 03:42:43.234435 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: [pid: 116156|app: 0|req: 1112/2200] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 03:42:43 2021] GET /compute/v2.1/servers/f22dfea6-4599-43e4-93d5-d99f1db3b4fb => generated 111 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 15 03:42:45.442821 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi [None req-d86e7f16-1a27-44e2-bfcc-d16cc7806954 tempest-TestMinimumBasicScenario-1385142937 tempest-TestMinimumBasicScenario-1385142937-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=116157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 03:42:45.443981 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.compute.api [None req-d86e7f16-1a27-44e2-bfcc-d16cc7806954 tempest-TestMinimumBasicScenario-1385142937 tempest-TestMinimumBasicScenario-1385142937-project] [instance: 7a4d04ca-0909-481f-b859-bd99b327ddc3] Fetching instance by UUID {{(pid=116157) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:42:45.450111 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-d86e7f16-1a27-44e2-bfcc-d16cc7806954 tempest-TestMinimumBasicScenario-1385142937 tempest-TestMinimumBasicScenario-1385142937-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:42:45.450559 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-d86e7f16-1a27-44e2-bfcc-d16cc7806954 tempest-TestMinimumBasicScenario-1385142937 tempest-TestMinimumBasicScenario-1385142937-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:42:45.451331 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-d86e7f16-1a27-44e2-bfcc-d16cc7806954 tempest-TestMinimumBasicScenario-1385142937 tempest-TestMinimumBasicScenario-1385142937-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:42:45.451765 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-d86e7f16-1a27-44e2-bfcc-d16cc7806954 tempest-TestMinimumBasicScenario-1385142937 tempest-TestMinimumBasicScenario-1385142937-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:42:45.523666 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: INFO nova.api.openstack.requestlog [None req-d86e7f16-1a27-44e2-bfcc-d16cc7806954 tempest-TestMinimumBasicScenario-1385142937 tempest-TestMinimumBasicScenario-1385142937-project] 10.222.0.18 "POST /compute/v2.1/servers/7a4d04ca-0909-481f-b859-bd99b327ddc3/action" status: 202 len: 0 microversion: 2.1 time: 0.084932 Dec 15 03:42:45.527151 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: [pid: 116157|app: 0|req: 1089/2201] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Dec 15 03:42:45 2021] POST /compute/v2.1/servers/7a4d04ca-0909-481f-b859-bd99b327ddc3/action => generated 0 bytes in 86 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Dec 15 03:42:45.532334 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi [None req-506e790d-890b-4e52-943a-9ff38dffdb16 tempest-TestMinimumBasicScenario-1385142937 tempest-TestMinimumBasicScenario-1385142937-project] Calling method '>' {{(pid=116156) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:42:45.533018 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.compute.api [None req-506e790d-890b-4e52-943a-9ff38dffdb16 tempest-TestMinimumBasicScenario-1385142937 tempest-TestMinimumBasicScenario-1385142937-project] [instance: 7a4d04ca-0909-481f-b859-bd99b327ddc3] Fetching instance by UUID {{(pid=116156) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:42:45.539587 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-506e790d-890b-4e52-943a-9ff38dffdb16 tempest-TestMinimumBasicScenario-1385142937 tempest-TestMinimumBasicScenario-1385142937-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:42:45.540173 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-506e790d-890b-4e52-943a-9ff38dffdb16 tempest-TestMinimumBasicScenario-1385142937 tempest-TestMinimumBasicScenario-1385142937-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:42:45.541025 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-506e790d-890b-4e52-943a-9ff38dffdb16 tempest-TestMinimumBasicScenario-1385142937 tempest-TestMinimumBasicScenario-1385142937-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:42:45.541523 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-506e790d-890b-4e52-943a-9ff38dffdb16 tempest-TestMinimumBasicScenario-1385142937 tempest-TestMinimumBasicScenario-1385142937-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:42:45.857008 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.policy [None req-506e790d-890b-4e52-943a-9ff38dffdb16 tempest-TestMinimumBasicScenario-1385142937 tempest-TestMinimumBasicScenario-1385142937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '478d1c76208642f89d96afdf22f79829', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f9dcbfd69bc450691e2b036e864f7d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116156) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:42:45.867071 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: INFO nova.api.openstack.requestlog [None req-506e790d-890b-4e52-943a-9ff38dffdb16 tempest-TestMinimumBasicScenario-1385142937 tempest-TestMinimumBasicScenario-1385142937-project] 10.222.0.18 "GET /compute/v2.1/servers/7a4d04ca-0909-481f-b859-bd99b327ddc3" status: 200 len: 1750 microversion: 2.1 time: 0.338474 Dec 15 03:42:45.878788 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: [pid: 116156|app: 0|req: 1113/2202] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 03:42:45 2021] GET /compute/v2.1/servers/7a4d04ca-0909-481f-b859-bd99b327ddc3 => generated 1750 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 03:42:46.886409 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi [None req-e20a70fd-5541-4799-83e1-485f541f978d tempest-TestMinimumBasicScenario-1385142937 tempest-TestMinimumBasicScenario-1385142937-project] Calling method '>' {{(pid=116157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:42:46.887133 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.compute.api [None req-e20a70fd-5541-4799-83e1-485f541f978d tempest-TestMinimumBasicScenario-1385142937 tempest-TestMinimumBasicScenario-1385142937-project] [instance: 7a4d04ca-0909-481f-b859-bd99b327ddc3] Fetching instance by UUID {{(pid=116157) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:42:46.893455 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-e20a70fd-5541-4799-83e1-485f541f978d tempest-TestMinimumBasicScenario-1385142937 tempest-TestMinimumBasicScenario-1385142937-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:42:46.893907 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-e20a70fd-5541-4799-83e1-485f541f978d tempest-TestMinimumBasicScenario-1385142937 tempest-TestMinimumBasicScenario-1385142937-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:42:46.894708 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-e20a70fd-5541-4799-83e1-485f541f978d tempest-TestMinimumBasicScenario-1385142937 tempest-TestMinimumBasicScenario-1385142937-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:42:46.895145 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-e20a70fd-5541-4799-83e1-485f541f978d tempest-TestMinimumBasicScenario-1385142937 tempest-TestMinimumBasicScenario-1385142937-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:42:47.043033 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.policy [None req-e20a70fd-5541-4799-83e1-485f541f978d tempest-TestMinimumBasicScenario-1385142937 tempest-TestMinimumBasicScenario-1385142937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '478d1c76208642f89d96afdf22f79829', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f9dcbfd69bc450691e2b036e864f7d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116157) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:42:47.050829 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: INFO nova.api.openstack.requestlog [None req-e20a70fd-5541-4799-83e1-485f541f978d tempest-TestMinimumBasicScenario-1385142937 tempest-TestMinimumBasicScenario-1385142937-project] 10.222.0.18 "GET /compute/v2.1/servers/7a4d04ca-0909-481f-b859-bd99b327ddc3" status: 200 len: 1755 microversion: 2.1 time: 0.169003 Dec 15 03:42:47.051925 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: [pid: 116157|app: 0|req: 1090/2203] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 03:42:46 2021] GET /compute/v2.1/servers/7a4d04ca-0909-481f-b859-bd99b327ddc3 => generated 1755 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 03:42:47.510278 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi [None req-9b4f87e9-6ba3-4500-b793-73ffaab71a45 tempest-VolumesSnapshotsTestJSON-1093758929 tempest-VolumesSnapshotsTestJSON-1093758929-project] Action: 'create', calling method: .version_select at 0x7f126e85dee0>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-449171127"}} {{(pid=116156) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 03:42:47.771739 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: INFO nova.api.openstack.requestlog [None req-9b4f87e9-6ba3-4500-b793-73ffaab71a45 tempest-VolumesSnapshotsTestJSON-1093758929 tempest-VolumesSnapshotsTestJSON-1093758929-project] 10.222.0.18 "POST /compute/v2.1/os-volumes" status: 200 len: 344 microversion: 2.1 time: 0.369535 Dec 15 03:42:47.772347 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: [pid: 116156|app: 0|req: 1114/2204] 10.222.0.18 () {60 vars in 1154 bytes} [Wed Dec 15 03:42:47 2021] POST /compute/v2.1/os-volumes => generated 344 bytes in 371 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Dec 15 03:42:47.783519 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi [None req-b4ebc8f4-c024-44b1-b229-b502450c3c37 tempest-VolumesSnapshotsTestJSON-1093758929 tempest-VolumesSnapshotsTestJSON-1093758929-project] Calling method '.version_select at 0x7f126e81f8b0>' {{(pid=116157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:42:47.828762 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: INFO nova.api.openstack.requestlog [None req-b4ebc8f4-c024-44b1-b229-b502450c3c37 tempest-VolumesSnapshotsTestJSON-1093758929 tempest-VolumesSnapshotsTestJSON-1093758929-project] 10.222.0.18 "GET /compute/v2.1/os-volumes/5be6c702-374c-4279-a6a3-05525edbffc3" status: 200 len: 344 microversion: 2.1 time: 0.049073 Dec 15 03:42:47.829322 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: [pid: 116157|app: 0|req: 1091/2205] 10.222.0.18 () {58 vars in 1244 bytes} [Wed Dec 15 03:42:47 2021] GET /compute/v2.1/os-volumes/5be6c702-374c-4279-a6a3-05525edbffc3 => generated 344 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 03:42:48.069116 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi [None req-238f0578-8102-4a94-a42d-5629e6f9a3d8 tempest-TestMinimumBasicScenario-1385142937 tempest-TestMinimumBasicScenario-1385142937-project] Calling method '>' {{(pid=116156) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:42:48.069930 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.compute.api [None req-238f0578-8102-4a94-a42d-5629e6f9a3d8 tempest-TestMinimumBasicScenario-1385142937 tempest-TestMinimumBasicScenario-1385142937-project] [instance: 7a4d04ca-0909-481f-b859-bd99b327ddc3] Fetching instance by UUID {{(pid=116156) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:42:48.075738 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-238f0578-8102-4a94-a42d-5629e6f9a3d8 tempest-TestMinimumBasicScenario-1385142937 tempest-TestMinimumBasicScenario-1385142937-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:42:48.076184 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-238f0578-8102-4a94-a42d-5629e6f9a3d8 tempest-TestMinimumBasicScenario-1385142937 tempest-TestMinimumBasicScenario-1385142937-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:42:48.076949 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-238f0578-8102-4a94-a42d-5629e6f9a3d8 tempest-TestMinimumBasicScenario-1385142937 tempest-TestMinimumBasicScenario-1385142937-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:42:48.077382 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-238f0578-8102-4a94-a42d-5629e6f9a3d8 tempest-TestMinimumBasicScenario-1385142937 tempest-TestMinimumBasicScenario-1385142937-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:42:48.225101 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.policy [None req-238f0578-8102-4a94-a42d-5629e6f9a3d8 tempest-TestMinimumBasicScenario-1385142937 tempest-TestMinimumBasicScenario-1385142937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '478d1c76208642f89d96afdf22f79829', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f9dcbfd69bc450691e2b036e864f7d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116156) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:42:48.232796 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: INFO nova.api.openstack.requestlog [None req-238f0578-8102-4a94-a42d-5629e6f9a3d8 tempest-TestMinimumBasicScenario-1385142937 tempest-TestMinimumBasicScenario-1385142937-project] 10.222.0.18 "GET /compute/v2.1/servers/7a4d04ca-0909-481f-b859-bd99b327ddc3" status: 200 len: 1755 microversion: 2.1 time: 0.167798 Dec 15 03:42:48.233362 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: [pid: 116156|app: 0|req: 1115/2206] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 03:42:48 2021] GET /compute/v2.1/servers/7a4d04ca-0909-481f-b859-bd99b327ddc3 => generated 1755 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 03:42:48.842340 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi [None req-e849b8a4-6784-487f-9a09-db715367cdc6 tempest-VolumesSnapshotsTestJSON-1093758929 tempest-VolumesSnapshotsTestJSON-1093758929-project] Calling method '.version_select at 0x7f126e825b80>' {{(pid=116157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:42:48.886924 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: INFO nova.api.openstack.requestlog [None req-e849b8a4-6784-487f-9a09-db715367cdc6 tempest-VolumesSnapshotsTestJSON-1093758929 tempest-VolumesSnapshotsTestJSON-1093758929-project] 10.222.0.18 "GET /compute/v2.1/os-volumes/5be6c702-374c-4279-a6a3-05525edbffc3" status: 200 len: 345 microversion: 2.1 time: 0.048906 Dec 15 03:42:48.887487 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: [pid: 116157|app: 0|req: 1092/2207] 10.222.0.18 () {58 vars in 1244 bytes} [Wed Dec 15 03:42:48 2021] GET /compute/v2.1/os-volumes/5be6c702-374c-4279-a6a3-05525edbffc3 => generated 345 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 03:42:48.898572 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi [None req-8a4246e8-5a7e-40d2-ad7d-d7bae1f901e4 tempest-VolumesSnapshotsTestJSON-1093758929 tempest-VolumesSnapshotsTestJSON-1093758929-project] Action: 'create', calling method: .version_select at 0x7f126e7d48b0>, body: {"snapshot": {"volume_id": "5be6c702-374c-4279-a6a3-05525edbffc3", "display_name": "tempest-VolumesSnapshotsTestJSON-Snapshot-1576644955"}} {{(pid=116156) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 03:42:49.033505 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: INFO nova.api.openstack.requestlog [None req-8a4246e8-5a7e-40d2-ad7d-d7bae1f901e4 tempest-VolumesSnapshotsTestJSON-1093758929 tempest-VolumesSnapshotsTestJSON-1093758929-project] 10.222.0.18 "POST /compute/v2.1/os-snapshots" status: 200 len: 287 microversion: 2.1 time: 0.138529 Dec 15 03:42:49.034148 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: [pid: 116156|app: 0|req: 1116/2208] 10.222.0.18 () {60 vars in 1161 bytes} [Wed Dec 15 03:42:48 2021] POST /compute/v2.1/os-snapshots => generated 287 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 03:42:49.044208 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi [None req-c71e29cf-92f7-4284-92a9-0d5c397fd1a1 tempest-VolumesSnapshotsTestJSON-1093758929 tempest-VolumesSnapshotsTestJSON-1093758929-project] Calling method '.version_select at 0x7f126e879280>' {{(pid=116157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:42:49.075041 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: INFO nova.api.openstack.requestlog [None req-c71e29cf-92f7-4284-92a9-0d5c397fd1a1 tempest-VolumesSnapshotsTestJSON-1093758929 tempest-VolumesSnapshotsTestJSON-1093758929-project] 10.222.0.18 "GET /compute/v2.1/os-snapshots/54a5d6c4-c40c-4f1e-9f7f-779275e95bf5" status: 200 len: 287 microversion: 2.1 time: 0.034331 Dec 15 03:42:49.075661 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: [pid: 116157|app: 0|req: 1093/2209] 10.222.0.18 () {58 vars in 1250 bytes} [Wed Dec 15 03:42:49 2021] GET /compute/v2.1/os-snapshots/54a5d6c4-c40c-4f1e-9f7f-779275e95bf5 => generated 287 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 03:42:49.085779 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi [None req-cc8a578b-636f-4ef7-96dc-f3f34d99341e tempest-VolumesSnapshotsTestJSON-1093758929 tempest-VolumesSnapshotsTestJSON-1093758929-project] Calling method '.version_select at 0x7f126e7ce700>' {{(pid=116156) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:42:49.114110 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: INFO nova.api.openstack.requestlog [None req-cc8a578b-636f-4ef7-96dc-f3f34d99341e tempest-VolumesSnapshotsTestJSON-1093758929 tempest-VolumesSnapshotsTestJSON-1093758929-project] 10.222.0.18 "GET /compute/v2.1/os-snapshots" status: 200 len: 290 microversion: 2.1 time: 0.032414 Dec 15 03:42:49.114645 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: [pid: 116156|app: 0|req: 1117/2210] 10.222.0.18 () {58 vars in 1139 bytes} [Wed Dec 15 03:42:49 2021] GET /compute/v2.1/os-snapshots => generated 290 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 03:42:49.124277 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi [None req-546004bd-2445-49c0-b265-a991c74d5355 tempest-VolumesSnapshotsTestJSON-1093758929 tempest-VolumesSnapshotsTestJSON-1093758929-project] Calling method '.version_select at 0x7f126e879af0>' {{(pid=116157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:42:49.151736 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: INFO nova.api.openstack.requestlog [None req-546004bd-2445-49c0-b265-a991c74d5355 tempest-VolumesSnapshotsTestJSON-1093758929 tempest-VolumesSnapshotsTestJSON-1093758929-project] 10.222.0.18 "GET /compute/v2.1/os-snapshots/54a5d6c4-c40c-4f1e-9f7f-779275e95bf5" status: 200 len: 287 microversion: 2.1 time: 0.030971 Dec 15 03:42:49.152291 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: [pid: 116157|app: 0|req: 1094/2211] 10.222.0.18 () {58 vars in 1250 bytes} [Wed Dec 15 03:42:49 2021] GET /compute/v2.1/os-snapshots/54a5d6c4-c40c-4f1e-9f7f-779275e95bf5 => generated 287 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 03:42:49.249969 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi [None req-d38d4d1f-3efc-4067-ba32-8d9c0cab213c tempest-TestMinimumBasicScenario-1385142937 tempest-TestMinimumBasicScenario-1385142937-project] Calling method '>' {{(pid=116156) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:42:49.250630 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.compute.api [None req-d38d4d1f-3efc-4067-ba32-8d9c0cab213c tempest-TestMinimumBasicScenario-1385142937 tempest-TestMinimumBasicScenario-1385142937-project] [instance: 7a4d04ca-0909-481f-b859-bd99b327ddc3] Fetching instance by UUID {{(pid=116156) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:42:49.257156 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-d38d4d1f-3efc-4067-ba32-8d9c0cab213c tempest-TestMinimumBasicScenario-1385142937 tempest-TestMinimumBasicScenario-1385142937-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:42:49.257603 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-d38d4d1f-3efc-4067-ba32-8d9c0cab213c tempest-TestMinimumBasicScenario-1385142937 tempest-TestMinimumBasicScenario-1385142937-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:42:49.258401 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-d38d4d1f-3efc-4067-ba32-8d9c0cab213c tempest-TestMinimumBasicScenario-1385142937 tempest-TestMinimumBasicScenario-1385142937-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:42:49.258830 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-d38d4d1f-3efc-4067-ba32-8d9c0cab213c tempest-TestMinimumBasicScenario-1385142937 tempest-TestMinimumBasicScenario-1385142937-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:42:49.397923 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.policy [None req-d38d4d1f-3efc-4067-ba32-8d9c0cab213c tempest-TestMinimumBasicScenario-1385142937 tempest-TestMinimumBasicScenario-1385142937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '478d1c76208642f89d96afdf22f79829', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f9dcbfd69bc450691e2b036e864f7d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116156) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:42:49.409705 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: INFO nova.api.openstack.requestlog [None req-d38d4d1f-3efc-4067-ba32-8d9c0cab213c tempest-TestMinimumBasicScenario-1385142937 tempest-TestMinimumBasicScenario-1385142937-project] 10.222.0.18 "GET /compute/v2.1/servers/7a4d04ca-0909-481f-b859-bd99b327ddc3" status: 200 len: 1755 microversion: 2.1 time: 0.163502 Dec 15 03:42:49.410300 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: [pid: 116156|app: 0|req: 1118/2212] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 03:42:49 2021] GET /compute/v2.1/servers/7a4d04ca-0909-481f-b859-bd99b327ddc3 => generated 1755 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 03:42:50.164323 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi [None req-315b1651-d83d-4f1f-b032-a8846f99cc20 tempest-VolumesSnapshotsTestJSON-1093758929 tempest-VolumesSnapshotsTestJSON-1093758929-project] Calling method '.version_select at 0x7f126e81f1f0>' {{(pid=116157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:42:50.192710 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: INFO nova.api.openstack.requestlog [None req-315b1651-d83d-4f1f-b032-a8846f99cc20 tempest-VolumesSnapshotsTestJSON-1093758929 tempest-VolumesSnapshotsTestJSON-1093758929-project] 10.222.0.18 "GET /compute/v2.1/os-snapshots/54a5d6c4-c40c-4f1e-9f7f-779275e95bf5" status: 200 len: 287 microversion: 2.1 time: 0.033223 Dec 15 03:42:50.193265 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: [pid: 116157|app: 0|req: 1095/2213] 10.222.0.18 () {58 vars in 1250 bytes} [Wed Dec 15 03:42:50 2021] GET /compute/v2.1/os-snapshots/54a5d6c4-c40c-4f1e-9f7f-779275e95bf5 => generated 287 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 03:42:50.426925 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi [None req-aa27e5df-401a-4a5a-ab39-b4d4853dbd7c tempest-TestMinimumBasicScenario-1385142937 tempest-TestMinimumBasicScenario-1385142937-project] Calling method '>' {{(pid=116156) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:42:50.427482 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.compute.api [None req-aa27e5df-401a-4a5a-ab39-b4d4853dbd7c tempest-TestMinimumBasicScenario-1385142937 tempest-TestMinimumBasicScenario-1385142937-project] [instance: 7a4d04ca-0909-481f-b859-bd99b327ddc3] Fetching instance by UUID {{(pid=116156) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:42:50.433719 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-aa27e5df-401a-4a5a-ab39-b4d4853dbd7c tempest-TestMinimumBasicScenario-1385142937 tempest-TestMinimumBasicScenario-1385142937-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:42:50.434199 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-aa27e5df-401a-4a5a-ab39-b4d4853dbd7c tempest-TestMinimumBasicScenario-1385142937 tempest-TestMinimumBasicScenario-1385142937-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:42:50.434968 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-aa27e5df-401a-4a5a-ab39-b4d4853dbd7c tempest-TestMinimumBasicScenario-1385142937 tempest-TestMinimumBasicScenario-1385142937-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:42:50.435397 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-aa27e5df-401a-4a5a-ab39-b4d4853dbd7c tempest-TestMinimumBasicScenario-1385142937 tempest-TestMinimumBasicScenario-1385142937-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:42:50.573574 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.policy [None req-aa27e5df-401a-4a5a-ab39-b4d4853dbd7c tempest-TestMinimumBasicScenario-1385142937 tempest-TestMinimumBasicScenario-1385142937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '478d1c76208642f89d96afdf22f79829', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f9dcbfd69bc450691e2b036e864f7d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116156) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:42:50.581807 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: INFO nova.api.openstack.requestlog [None req-aa27e5df-401a-4a5a-ab39-b4d4853dbd7c tempest-TestMinimumBasicScenario-1385142937 tempest-TestMinimumBasicScenario-1385142937-project] 10.222.0.18 "GET /compute/v2.1/servers/7a4d04ca-0909-481f-b859-bd99b327ddc3" status: 200 len: 1755 microversion: 2.1 time: 0.158555 Dec 15 03:42:50.583137 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: [pid: 116156|app: 0|req: 1119/2214] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 03:42:50 2021] GET /compute/v2.1/servers/7a4d04ca-0909-481f-b859-bd99b327ddc3 => generated 1755 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 03:42:51.204674 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi [None req-6fa8e55e-fc93-4502-8a2f-53f11999343c tempest-VolumesSnapshotsTestJSON-1093758929 tempest-VolumesSnapshotsTestJSON-1093758929-project] Calling method '.version_select at 0x7f126e842670>' {{(pid=116157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:42:51.234502 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: INFO nova.api.openstack.requestlog [None req-6fa8e55e-fc93-4502-8a2f-53f11999343c tempest-VolumesSnapshotsTestJSON-1093758929 tempest-VolumesSnapshotsTestJSON-1093758929-project] 10.222.0.18 "GET /compute/v2.1/os-snapshots/54a5d6c4-c40c-4f1e-9f7f-779275e95bf5" status: 200 len: 287 microversion: 2.1 time: 0.033825 Dec 15 03:42:51.235046 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: [pid: 116157|app: 0|req: 1096/2215] 10.222.0.18 () {58 vars in 1250 bytes} [Wed Dec 15 03:42:51 2021] GET /compute/v2.1/os-snapshots/54a5d6c4-c40c-4f1e-9f7f-779275e95bf5 => generated 287 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 03:42:51.600477 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi [None req-1cb6ecc2-37e1-4437-b923-0742b890e093 tempest-TestMinimumBasicScenario-1385142937 tempest-TestMinimumBasicScenario-1385142937-project] Calling method '>' {{(pid=116156) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:42:51.601087 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.compute.api [None req-1cb6ecc2-37e1-4437-b923-0742b890e093 tempest-TestMinimumBasicScenario-1385142937 tempest-TestMinimumBasicScenario-1385142937-project] [instance: 7a4d04ca-0909-481f-b859-bd99b327ddc3] Fetching instance by UUID {{(pid=116156) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:42:51.607261 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-1cb6ecc2-37e1-4437-b923-0742b890e093 tempest-TestMinimumBasicScenario-1385142937 tempest-TestMinimumBasicScenario-1385142937-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:42:51.607706 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-1cb6ecc2-37e1-4437-b923-0742b890e093 tempest-TestMinimumBasicScenario-1385142937 tempest-TestMinimumBasicScenario-1385142937-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:42:51.608468 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-1cb6ecc2-37e1-4437-b923-0742b890e093 tempest-TestMinimumBasicScenario-1385142937 tempest-TestMinimumBasicScenario-1385142937-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:42:51.608896 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-1cb6ecc2-37e1-4437-b923-0742b890e093 tempest-TestMinimumBasicScenario-1385142937 tempest-TestMinimumBasicScenario-1385142937-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:42:51.750225 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.policy [None req-1cb6ecc2-37e1-4437-b923-0742b890e093 tempest-TestMinimumBasicScenario-1385142937 tempest-TestMinimumBasicScenario-1385142937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '478d1c76208642f89d96afdf22f79829', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f9dcbfd69bc450691e2b036e864f7d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116156) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:42:51.758298 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: INFO nova.api.openstack.requestlog [None req-1cb6ecc2-37e1-4437-b923-0742b890e093 tempest-TestMinimumBasicScenario-1385142937 tempest-TestMinimumBasicScenario-1385142937-project] 10.222.0.18 "GET /compute/v2.1/servers/7a4d04ca-0909-481f-b859-bd99b327ddc3" status: 200 len: 1755 microversion: 2.1 time: 0.162223 Dec 15 03:42:51.758854 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: [pid: 116156|app: 0|req: 1120/2216] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 03:42:51 2021] GET /compute/v2.1/servers/7a4d04ca-0909-481f-b859-bd99b327ddc3 => generated 1755 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 03:42:52.246397 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi [None req-3e3d1406-b1e2-49d6-8c5e-51232c96ce19 tempest-VolumesSnapshotsTestJSON-1093758929 tempest-VolumesSnapshotsTestJSON-1093758929-project] Calling method '.version_select at 0x7f126e8794c0>' {{(pid=116157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:42:52.274667 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: INFO nova.api.openstack.requestlog [None req-3e3d1406-b1e2-49d6-8c5e-51232c96ce19 tempest-VolumesSnapshotsTestJSON-1093758929 tempest-VolumesSnapshotsTestJSON-1093758929-project] 10.222.0.18 "GET /compute/v2.1/os-snapshots/54a5d6c4-c40c-4f1e-9f7f-779275e95bf5" status: 200 len: 287 microversion: 2.1 time: 0.032275 Dec 15 03:42:52.275232 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: [pid: 116157|app: 0|req: 1097/2217] 10.222.0.18 () {58 vars in 1250 bytes} [Wed Dec 15 03:42:52 2021] GET /compute/v2.1/os-snapshots/54a5d6c4-c40c-4f1e-9f7f-779275e95bf5 => generated 287 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 03:42:52.775311 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi [None req-a9442c70-9482-4d58-9b37-c510e7e9558c tempest-TestMinimumBasicScenario-1385142937 tempest-TestMinimumBasicScenario-1385142937-project] Calling method '>' {{(pid=116156) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:42:52.775911 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.compute.api [None req-a9442c70-9482-4d58-9b37-c510e7e9558c tempest-TestMinimumBasicScenario-1385142937 tempest-TestMinimumBasicScenario-1385142937-project] [instance: 7a4d04ca-0909-481f-b859-bd99b327ddc3] Fetching instance by UUID {{(pid=116156) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:42:52.782048 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-a9442c70-9482-4d58-9b37-c510e7e9558c tempest-TestMinimumBasicScenario-1385142937 tempest-TestMinimumBasicScenario-1385142937-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:42:52.782504 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-a9442c70-9482-4d58-9b37-c510e7e9558c tempest-TestMinimumBasicScenario-1385142937 tempest-TestMinimumBasicScenario-1385142937-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:42:52.783290 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-a9442c70-9482-4d58-9b37-c510e7e9558c tempest-TestMinimumBasicScenario-1385142937 tempest-TestMinimumBasicScenario-1385142937-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:42:52.783722 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-a9442c70-9482-4d58-9b37-c510e7e9558c tempest-TestMinimumBasicScenario-1385142937 tempest-TestMinimumBasicScenario-1385142937-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:42:52.930821 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.policy [None req-a9442c70-9482-4d58-9b37-c510e7e9558c tempest-TestMinimumBasicScenario-1385142937 tempest-TestMinimumBasicScenario-1385142937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '478d1c76208642f89d96afdf22f79829', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f9dcbfd69bc450691e2b036e864f7d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116156) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:42:52.938436 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: INFO nova.api.openstack.requestlog [None req-a9442c70-9482-4d58-9b37-c510e7e9558c tempest-TestMinimumBasicScenario-1385142937 tempest-TestMinimumBasicScenario-1385142937-project] 10.222.0.18 "GET /compute/v2.1/servers/7a4d04ca-0909-481f-b859-bd99b327ddc3" status: 200 len: 1755 microversion: 2.1 time: 0.166707 Dec 15 03:42:52.938989 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: [pid: 116156|app: 0|req: 1121/2218] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 03:42:52 2021] GET /compute/v2.1/servers/7a4d04ca-0909-481f-b859-bd99b327ddc3 => generated 1755 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 03:42:53.287894 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi [None req-1730e339-3f7f-45ad-99b5-1f079689bacf tempest-VolumesSnapshotsTestJSON-1093758929 tempest-VolumesSnapshotsTestJSON-1093758929-project] Calling method '.version_select at 0x7f126e864d30>' {{(pid=116157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:42:53.315455 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: INFO nova.api.openstack.requestlog [None req-1730e339-3f7f-45ad-99b5-1f079689bacf tempest-VolumesSnapshotsTestJSON-1093758929 tempest-VolumesSnapshotsTestJSON-1093758929-project] 10.222.0.18 "GET /compute/v2.1/os-snapshots/54a5d6c4-c40c-4f1e-9f7f-779275e95bf5" status: 200 len: 288 microversion: 2.1 time: 0.032924 Dec 15 03:42:53.316004 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: [pid: 116157|app: 0|req: 1098/2219] 10.222.0.18 () {58 vars in 1250 bytes} [Wed Dec 15 03:42:53 2021] GET /compute/v2.1/os-snapshots/54a5d6c4-c40c-4f1e-9f7f-779275e95bf5 => generated 288 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 03:42:53.326107 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi [None req-b2093157-9b34-491b-b870-9729dc0c58f8 tempest-VolumesSnapshotsTestJSON-1093758929 tempest-VolumesSnapshotsTestJSON-1093758929-project] Calling method '.version_select at 0x7f126e7d4820>' {{(pid=116156) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:42:53.379096 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: INFO nova.api.openstack.requestlog [None req-b2093157-9b34-491b-b870-9729dc0c58f8 tempest-VolumesSnapshotsTestJSON-1093758929 tempest-VolumesSnapshotsTestJSON-1093758929-project] 10.222.0.18 "DELETE /compute/v2.1/os-snapshots/54a5d6c4-c40c-4f1e-9f7f-779275e95bf5" status: 202 len: 0 microversion: 2.1 time: 0.056424 Dec 15 03:42:53.380176 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: [pid: 116156|app: 0|req: 1122/2220] 10.222.0.18 () {58 vars in 1253 bytes} [Wed Dec 15 03:42:53 2021] DELETE /compute/v2.1/os-snapshots/54a5d6c4-c40c-4f1e-9f7f-779275e95bf5 => generated 0 bytes in 58 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Dec 15 03:42:53.387924 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi [None req-a558a681-c6bb-450f-b991-2981b0dd85c4 tempest-VolumesSnapshotsTestJSON-1093758929 tempest-VolumesSnapshotsTestJSON-1093758929-project] Calling method '.version_select at 0x7f126e8459d0>' {{(pid=116157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:42:53.416354 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: INFO nova.api.openstack.requestlog [None req-a558a681-c6bb-450f-b991-2981b0dd85c4 tempest-VolumesSnapshotsTestJSON-1093758929 tempest-VolumesSnapshotsTestJSON-1093758929-project] 10.222.0.18 "GET /compute/v2.1/os-snapshots/54a5d6c4-c40c-4f1e-9f7f-779275e95bf5" status: 200 len: 287 microversion: 2.1 time: 0.031874 Dec 15 03:42:53.416896 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: [pid: 116157|app: 0|req: 1099/2221] 10.222.0.18 () {58 vars in 1250 bytes} [Wed Dec 15 03:42:53 2021] GET /compute/v2.1/os-snapshots/54a5d6c4-c40c-4f1e-9f7f-779275e95bf5 => generated 287 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 15 03:42:53.955968 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi [None req-39a65174-8f12-41ed-bfef-02428fdb3f75 tempest-TestMinimumBasicScenario-1385142937 tempest-TestMinimumBasicScenario-1385142937-project] Calling method '>' {{(pid=116156) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:42:53.956578 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.compute.api [None req-39a65174-8f12-41ed-bfef-02428fdb3f75 tempest-TestMinimumBasicScenario-1385142937 tempest-TestMinimumBasicScenario-1385142937-project] [instance: 7a4d04ca-0909-481f-b859-bd99b327ddc3] Fetching instance by UUID {{(pid=116156) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:42:53.962410 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-39a65174-8f12-41ed-bfef-02428fdb3f75 tempest-TestMinimumBasicScenario-1385142937 tempest-TestMinimumBasicScenario-1385142937-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:42:53.962861 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-39a65174-8f12-41ed-bfef-02428fdb3f75 tempest-TestMinimumBasicScenario-1385142937 tempest-TestMinimumBasicScenario-1385142937-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:42:53.963884 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-39a65174-8f12-41ed-bfef-02428fdb3f75 tempest-TestMinimumBasicScenario-1385142937 tempest-TestMinimumBasicScenario-1385142937-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:42:53.964317 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-39a65174-8f12-41ed-bfef-02428fdb3f75 tempest-TestMinimumBasicScenario-1385142937 tempest-TestMinimumBasicScenario-1385142937-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:42:54.106426 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.policy [None req-39a65174-8f12-41ed-bfef-02428fdb3f75 tempest-TestMinimumBasicScenario-1385142937 tempest-TestMinimumBasicScenario-1385142937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '478d1c76208642f89d96afdf22f79829', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f9dcbfd69bc450691e2b036e864f7d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116156) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:42:54.114610 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: INFO nova.api.openstack.requestlog [None req-39a65174-8f12-41ed-bfef-02428fdb3f75 tempest-TestMinimumBasicScenario-1385142937 tempest-TestMinimumBasicScenario-1385142937-project] 10.222.0.18 "GET /compute/v2.1/servers/7a4d04ca-0909-481f-b859-bd99b327ddc3" status: 200 len: 1755 microversion: 2.1 time: 0.162212 Dec 15 03:42:54.115173 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: [pid: 116156|app: 0|req: 1123/2222] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 03:42:53 2021] GET /compute/v2.1/servers/7a4d04ca-0909-481f-b859-bd99b327ddc3 => generated 1755 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 03:42:54.427878 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi [None req-903d49b6-03eb-4bd7-96e9-d994095759d7 tempest-VolumesSnapshotsTestJSON-1093758929 tempest-VolumesSnapshotsTestJSON-1093758929-project] Calling method '.version_select at 0x7f126e864e50>' {{(pid=116157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:42:54.450282 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: INFO nova.api.openstack.wsgi [None req-903d49b6-03eb-4bd7-96e9-d994095759d7 tempest-VolumesSnapshotsTestJSON-1093758929 tempest-VolumesSnapshotsTestJSON-1093758929-project] HTTP exception thrown: Snapshot 54a5d6c4-c40c-4f1e-9f7f-779275e95bf5 could not be found. Dec 15 03:42:54.450862 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi [None req-903d49b6-03eb-4bd7-96e9-d994095759d7 tempest-VolumesSnapshotsTestJSON-1093758929 tempest-VolumesSnapshotsTestJSON-1093758929-project] Returning 404 to user: Snapshot 54a5d6c4-c40c-4f1e-9f7f-779275e95bf5 could not be found. {{(pid=116157) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 15 03:42:54.451673 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: INFO nova.api.openstack.requestlog [None req-903d49b6-03eb-4bd7-96e9-d994095759d7 tempest-VolumesSnapshotsTestJSON-1093758929 tempest-VolumesSnapshotsTestJSON-1093758929-project] 10.222.0.18 "GET /compute/v2.1/os-snapshots/54a5d6c4-c40c-4f1e-9f7f-779275e95bf5" status: 404 len: 111 microversion: 2.1 time: 0.027840 Dec 15 03:42:54.452188 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: [pid: 116157|app: 0|req: 1100/2223] 10.222.0.18 () {58 vars in 1250 bytes} [Wed Dec 15 03:42:54 2021] GET /compute/v2.1/os-snapshots/54a5d6c4-c40c-4f1e-9f7f-779275e95bf5 => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 15 03:42:54.460516 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi [None req-86305f39-2b12-4d21-8c6d-a15ff3802cb2 tempest-VolumesSnapshotsTestJSON-1093758929 tempest-VolumesSnapshotsTestJSON-1093758929-project] Calling method '.version_select at 0x7f126997d700>' {{(pid=116156) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:42:54.517407 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: INFO nova.api.openstack.requestlog [None req-86305f39-2b12-4d21-8c6d-a15ff3802cb2 tempest-VolumesSnapshotsTestJSON-1093758929 tempest-VolumesSnapshotsTestJSON-1093758929-project] 10.222.0.18 "DELETE /compute/v2.1/os-volumes/5be6c702-374c-4279-a6a3-05525edbffc3" status: 202 len: 0 microversion: 2.1 time: 0.060965 Dec 15 03:42:54.517968 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: [pid: 116156|app: 0|req: 1124/2224] 10.222.0.18 () {58 vars in 1247 bytes} [Wed Dec 15 03:42:54 2021] DELETE /compute/v2.1/os-volumes/5be6c702-374c-4279-a6a3-05525edbffc3 => generated 0 bytes in 62 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Dec 15 03:42:54.526309 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi [None req-4af9a567-5eb8-483a-9552-cb462b73a078 tempest-VolumesSnapshotsTestJSON-1093758929 tempest-VolumesSnapshotsTestJSON-1093758929-project] Calling method '.version_select at 0x7f126e8794c0>' {{(pid=116157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:42:54.571074 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: INFO nova.api.openstack.requestlog [None req-4af9a567-5eb8-483a-9552-cb462b73a078 tempest-VolumesSnapshotsTestJSON-1093758929 tempest-VolumesSnapshotsTestJSON-1093758929-project] 10.222.0.18 "GET /compute/v2.1/os-volumes/5be6c702-374c-4279-a6a3-05525edbffc3" status: 200 len: 344 microversion: 2.1 time: 0.048248 Dec 15 03:42:54.571715 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: [pid: 116157|app: 0|req: 1101/2225] 10.222.0.18 () {58 vars in 1244 bytes} [Wed Dec 15 03:42:54 2021] GET /compute/v2.1/os-volumes/5be6c702-374c-4279-a6a3-05525edbffc3 => generated 344 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 03:42:55.132048 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi [None req-d59b9b85-dbef-4d0f-b898-262c81659c99 tempest-TestMinimumBasicScenario-1385142937 tempest-TestMinimumBasicScenario-1385142937-project] Calling method '>' {{(pid=116156) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:42:55.132686 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.compute.api [None req-d59b9b85-dbef-4d0f-b898-262c81659c99 tempest-TestMinimumBasicScenario-1385142937 tempest-TestMinimumBasicScenario-1385142937-project] [instance: 7a4d04ca-0909-481f-b859-bd99b327ddc3] Fetching instance by UUID {{(pid=116156) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:42:55.138499 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-d59b9b85-dbef-4d0f-b898-262c81659c99 tempest-TestMinimumBasicScenario-1385142937 tempest-TestMinimumBasicScenario-1385142937-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:42:55.138954 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-d59b9b85-dbef-4d0f-b898-262c81659c99 tempest-TestMinimumBasicScenario-1385142937 tempest-TestMinimumBasicScenario-1385142937-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:42:55.139724 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-d59b9b85-dbef-4d0f-b898-262c81659c99 tempest-TestMinimumBasicScenario-1385142937 tempest-TestMinimumBasicScenario-1385142937-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:42:55.140167 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-d59b9b85-dbef-4d0f-b898-262c81659c99 tempest-TestMinimumBasicScenario-1385142937 tempest-TestMinimumBasicScenario-1385142937-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:42:55.283295 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.policy [None req-d59b9b85-dbef-4d0f-b898-262c81659c99 tempest-TestMinimumBasicScenario-1385142937 tempest-TestMinimumBasicScenario-1385142937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '478d1c76208642f89d96afdf22f79829', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f9dcbfd69bc450691e2b036e864f7d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116156) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:42:55.290921 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: INFO nova.api.openstack.requestlog [None req-d59b9b85-dbef-4d0f-b898-262c81659c99 tempest-TestMinimumBasicScenario-1385142937 tempest-TestMinimumBasicScenario-1385142937-project] 10.222.0.18 "GET /compute/v2.1/servers/7a4d04ca-0909-481f-b859-bd99b327ddc3" status: 200 len: 1755 microversion: 2.1 time: 0.163614 Dec 15 03:42:55.291486 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: [pid: 116156|app: 0|req: 1125/2226] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 03:42:55 2021] GET /compute/v2.1/servers/7a4d04ca-0909-481f-b859-bd99b327ddc3 => generated 1755 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 03:42:55.584288 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi [None req-ee482534-34eb-4025-bf14-950a2dfa8964 tempest-VolumesSnapshotsTestJSON-1093758929 tempest-VolumesSnapshotsTestJSON-1093758929-project] Calling method '.version_select at 0x7f126e879af0>' {{(pid=116157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:42:55.609558 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: INFO nova.api.openstack.wsgi [None req-ee482534-34eb-4025-bf14-950a2dfa8964 tempest-VolumesSnapshotsTestJSON-1093758929 tempest-VolumesSnapshotsTestJSON-1093758929-project] HTTP exception thrown: Volume 5be6c702-374c-4279-a6a3-05525edbffc3 could not be found. Dec 15 03:42:55.610187 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi [None req-ee482534-34eb-4025-bf14-950a2dfa8964 tempest-VolumesSnapshotsTestJSON-1093758929 tempest-VolumesSnapshotsTestJSON-1093758929-project] Returning 404 to user: Volume 5be6c702-374c-4279-a6a3-05525edbffc3 could not be found. {{(pid=116157) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 15 03:42:55.611008 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: INFO nova.api.openstack.requestlog [None req-ee482534-34eb-4025-bf14-950a2dfa8964 tempest-VolumesSnapshotsTestJSON-1093758929 tempest-VolumesSnapshotsTestJSON-1093758929-project] 10.222.0.18 "GET /compute/v2.1/os-volumes/5be6c702-374c-4279-a6a3-05525edbffc3" status: 404 len: 109 microversion: 2.1 time: 0.031014 Dec 15 03:42:55.611530 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: [pid: 116157|app: 0|req: 1102/2227] 10.222.0.18 () {58 vars in 1244 bytes} [Wed Dec 15 03:42:55 2021] GET /compute/v2.1/os-volumes/5be6c702-374c-4279-a6a3-05525edbffc3 => generated 109 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 15 03:42:55.625485 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi [None req-cca7418e-dcdc-4aa5-b485-6b837876ac91 tempest-VolumesSnapshotsTestJSON-1093758929 tempest-VolumesSnapshotsTestJSON-1093758929-project] Calling method '.version_select at 0x7f12698583a0>' {{(pid=116156) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:42:55.651584 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: INFO nova.api.openstack.wsgi [None req-cca7418e-dcdc-4aa5-b485-6b837876ac91 tempest-VolumesSnapshotsTestJSON-1093758929 tempest-VolumesSnapshotsTestJSON-1093758929-project] HTTP exception thrown: Volume 5be6c702-374c-4279-a6a3-05525edbffc3 could not be found. Dec 15 03:42:55.652169 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi [None req-cca7418e-dcdc-4aa5-b485-6b837876ac91 tempest-VolumesSnapshotsTestJSON-1093758929 tempest-VolumesSnapshotsTestJSON-1093758929-project] Returning 404 to user: Volume 5be6c702-374c-4279-a6a3-05525edbffc3 could not be found. {{(pid=116156) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 15 03:42:55.652974 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: INFO nova.api.openstack.requestlog [None req-cca7418e-dcdc-4aa5-b485-6b837876ac91 tempest-VolumesSnapshotsTestJSON-1093758929 tempest-VolumesSnapshotsTestJSON-1093758929-project] 10.222.0.18 "DELETE /compute/v2.1/os-volumes/5be6c702-374c-4279-a6a3-05525edbffc3" status: 404 len: 109 microversion: 2.1 time: 0.031136 Dec 15 03:42:55.653484 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: [pid: 116156|app: 0|req: 1126/2228] 10.222.0.18 () {58 vars in 1247 bytes} [Wed Dec 15 03:42:55 2021] DELETE /compute/v2.1/os-volumes/5be6c702-374c-4279-a6a3-05525edbffc3 => generated 109 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 15 03:42:55.661026 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi [None req-09b92993-cb88-4330-ade1-3be12ab50f52 tempest-VolumesSnapshotsTestJSON-1093758929 tempest-VolumesSnapshotsTestJSON-1093758929-project] Calling method '.version_select at 0x7f126e81f700>' {{(pid=116157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:42:55.686877 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: INFO nova.api.openstack.wsgi [None req-09b92993-cb88-4330-ade1-3be12ab50f52 tempest-VolumesSnapshotsTestJSON-1093758929 tempest-VolumesSnapshotsTestJSON-1093758929-project] HTTP exception thrown: Volume 5be6c702-374c-4279-a6a3-05525edbffc3 could not be found. Dec 15 03:42:55.687460 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi [None req-09b92993-cb88-4330-ade1-3be12ab50f52 tempest-VolumesSnapshotsTestJSON-1093758929 tempest-VolumesSnapshotsTestJSON-1093758929-project] Returning 404 to user: Volume 5be6c702-374c-4279-a6a3-05525edbffc3 could not be found. {{(pid=116157) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 15 03:42:55.688271 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: INFO nova.api.openstack.requestlog [None req-09b92993-cb88-4330-ade1-3be12ab50f52 tempest-VolumesSnapshotsTestJSON-1093758929 tempest-VolumesSnapshotsTestJSON-1093758929-project] 10.222.0.18 "GET /compute/v2.1/os-volumes/5be6c702-374c-4279-a6a3-05525edbffc3" status: 404 len: 109 microversion: 2.1 time: 0.030800 Dec 15 03:42:55.688781 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: [pid: 116157|app: 0|req: 1103/2229] 10.222.0.18 () {58 vars in 1244 bytes} [Wed Dec 15 03:42:55 2021] GET /compute/v2.1/os-volumes/5be6c702-374c-4279-a6a3-05525edbffc3 => generated 109 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 15 03:42:56.308303 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi [None req-a54fb477-61e0-42a5-9fe4-4d9b6f84521e tempest-TestMinimumBasicScenario-1385142937 tempest-TestMinimumBasicScenario-1385142937-project] Calling method '>' {{(pid=116156) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:42:56.308913 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.compute.api [None req-a54fb477-61e0-42a5-9fe4-4d9b6f84521e tempest-TestMinimumBasicScenario-1385142937 tempest-TestMinimumBasicScenario-1385142937-project] [instance: 7a4d04ca-0909-481f-b859-bd99b327ddc3] Fetching instance by UUID {{(pid=116156) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:42:56.316836 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-a54fb477-61e0-42a5-9fe4-4d9b6f84521e tempest-TestMinimumBasicScenario-1385142937 tempest-TestMinimumBasicScenario-1385142937-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:42:56.317286 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-a54fb477-61e0-42a5-9fe4-4d9b6f84521e tempest-TestMinimumBasicScenario-1385142937 tempest-TestMinimumBasicScenario-1385142937-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:42:56.318130 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-a54fb477-61e0-42a5-9fe4-4d9b6f84521e tempest-TestMinimumBasicScenario-1385142937 tempest-TestMinimumBasicScenario-1385142937-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:42:56.318568 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-a54fb477-61e0-42a5-9fe4-4d9b6f84521e tempest-TestMinimumBasicScenario-1385142937 tempest-TestMinimumBasicScenario-1385142937-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:42:56.471899 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.policy [None req-a54fb477-61e0-42a5-9fe4-4d9b6f84521e tempest-TestMinimumBasicScenario-1385142937 tempest-TestMinimumBasicScenario-1385142937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '478d1c76208642f89d96afdf22f79829', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f9dcbfd69bc450691e2b036e864f7d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116156) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:42:56.480124 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: INFO nova.api.openstack.requestlog [None req-a54fb477-61e0-42a5-9fe4-4d9b6f84521e tempest-TestMinimumBasicScenario-1385142937 tempest-TestMinimumBasicScenario-1385142937-project] 10.222.0.18 "GET /compute/v2.1/servers/7a4d04ca-0909-481f-b859-bd99b327ddc3" status: 200 len: 1755 microversion: 2.1 time: 0.175857 Dec 15 03:42:56.481002 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: [pid: 116156|app: 0|req: 1127/2230] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 03:42:56 2021] GET /compute/v2.1/servers/7a4d04ca-0909-481f-b859-bd99b327ddc3 => generated 1755 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 03:42:57.497127 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi [None req-ee4fb71f-6c0c-4b89-9a90-316a5269a291 tempest-TestMinimumBasicScenario-1385142937 tempest-TestMinimumBasicScenario-1385142937-project] Calling method '>' {{(pid=116157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:42:57.497770 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.compute.api [None req-ee4fb71f-6c0c-4b89-9a90-316a5269a291 tempest-TestMinimumBasicScenario-1385142937 tempest-TestMinimumBasicScenario-1385142937-project] [instance: 7a4d04ca-0909-481f-b859-bd99b327ddc3] Fetching instance by UUID {{(pid=116157) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:42:57.503806 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-ee4fb71f-6c0c-4b89-9a90-316a5269a291 tempest-TestMinimumBasicScenario-1385142937 tempest-TestMinimumBasicScenario-1385142937-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:42:57.504238 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-ee4fb71f-6c0c-4b89-9a90-316a5269a291 tempest-TestMinimumBasicScenario-1385142937 tempest-TestMinimumBasicScenario-1385142937-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:42:57.505013 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-ee4fb71f-6c0c-4b89-9a90-316a5269a291 tempest-TestMinimumBasicScenario-1385142937 tempest-TestMinimumBasicScenario-1385142937-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:42:57.505465 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-ee4fb71f-6c0c-4b89-9a90-316a5269a291 tempest-TestMinimumBasicScenario-1385142937 tempest-TestMinimumBasicScenario-1385142937-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:42:57.657520 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.policy [None req-ee4fb71f-6c0c-4b89-9a90-316a5269a291 tempest-TestMinimumBasicScenario-1385142937 tempest-TestMinimumBasicScenario-1385142937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '478d1c76208642f89d96afdf22f79829', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f9dcbfd69bc450691e2b036e864f7d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116157) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:42:57.668970 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: INFO nova.api.openstack.requestlog [None req-ee4fb71f-6c0c-4b89-9a90-316a5269a291 tempest-TestMinimumBasicScenario-1385142937 tempest-TestMinimumBasicScenario-1385142937-project] 10.222.0.18 "GET /compute/v2.1/servers/7a4d04ca-0909-481f-b859-bd99b327ddc3" status: 200 len: 1755 microversion: 2.1 time: 0.175823 Dec 15 03:42:57.669672 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: [pid: 116157|app: 0|req: 1104/2231] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 03:42:57 2021] GET /compute/v2.1/servers/7a4d04ca-0909-481f-b859-bd99b327ddc3 => generated 1755 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 03:42:58.686613 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi [None req-b780a5ce-6144-4ae8-a43f-9bb45744e862 tempest-TestMinimumBasicScenario-1385142937 tempest-TestMinimumBasicScenario-1385142937-project] Calling method '>' {{(pid=116156) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:42:58.687234 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.compute.api [None req-b780a5ce-6144-4ae8-a43f-9bb45744e862 tempest-TestMinimumBasicScenario-1385142937 tempest-TestMinimumBasicScenario-1385142937-project] [instance: 7a4d04ca-0909-481f-b859-bd99b327ddc3] Fetching instance by UUID {{(pid=116156) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:42:58.694212 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-b780a5ce-6144-4ae8-a43f-9bb45744e862 tempest-TestMinimumBasicScenario-1385142937 tempest-TestMinimumBasicScenario-1385142937-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:42:58.694702 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-b780a5ce-6144-4ae8-a43f-9bb45744e862 tempest-TestMinimumBasicScenario-1385142937 tempest-TestMinimumBasicScenario-1385142937-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:42:58.695419 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-b780a5ce-6144-4ae8-a43f-9bb45744e862 tempest-TestMinimumBasicScenario-1385142937 tempest-TestMinimumBasicScenario-1385142937-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:42:58.695866 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-b780a5ce-6144-4ae8-a43f-9bb45744e862 tempest-TestMinimumBasicScenario-1385142937 tempest-TestMinimumBasicScenario-1385142937-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:42:58.842569 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.policy [None req-b780a5ce-6144-4ae8-a43f-9bb45744e862 tempest-TestMinimumBasicScenario-1385142937 tempest-TestMinimumBasicScenario-1385142937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '478d1c76208642f89d96afdf22f79829', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f9dcbfd69bc450691e2b036e864f7d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116156) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:42:58.850713 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: INFO nova.api.openstack.requestlog [None req-b780a5ce-6144-4ae8-a43f-9bb45744e862 tempest-TestMinimumBasicScenario-1385142937 tempest-TestMinimumBasicScenario-1385142937-project] 10.222.0.18 "GET /compute/v2.1/servers/7a4d04ca-0909-481f-b859-bd99b327ddc3" status: 200 len: 1758 microversion: 2.1 time: 0.167912 Dec 15 03:42:58.851271 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: [pid: 116156|app: 0|req: 1128/2232] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 03:42:58 2021] GET /compute/v2.1/servers/7a4d04ca-0909-481f-b859-bd99b327ddc3 => generated 1758 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 03:43:08.899630 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Dec 15 03:43:08.900416 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: Wed Dec 15 03:43:08 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Dec 15 03:43:14.196883 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi [None req-5a4eb62a-5e51-459c-9e59-45c2d7b0bace tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] Calling method '.version_select at 0x7f126e83a820>' {{(pid=116157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:43:14.215508 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: INFO nova.api.openstack.requestlog [None req-5a4eb62a-5e51-459c-9e59-45c2d7b0bace tempest-TestVolumeBootPattern-319820111 tempest-TestVolumeBootPattern-319820111-project] 10.222.0.18 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-2120609320" status: 202 len: 0 microversion: 2.1 time: 0.022676 Dec 15 03:43:14.216119 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: [pid: 116157|app: 0|req: 1105/2233] 10.222.0.18 () {58 vars in 1262 bytes} [Wed Dec 15 03:43:14 2021] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-2120609320 => generated 0 bytes in 24 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Dec 15 03:43:31.128441 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi [None req-c8492260-48f7-4472-b973-6bbe1cca8c64 tempest-TestMinimumBasicScenario-1385142937 tempest-TestMinimumBasicScenario-1385142937-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-1147248688"}} {{(pid=116156) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 03:43:31.129120 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.compute.api [None req-c8492260-48f7-4472-b973-6bbe1cca8c64 tempest-TestMinimumBasicScenario-1385142937 tempest-TestMinimumBasicScenario-1385142937-project] [instance: 7a4d04ca-0909-481f-b859-bd99b327ddc3] Fetching instance by UUID {{(pid=116156) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:43:31.135045 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-c8492260-48f7-4472-b973-6bbe1cca8c64 tempest-TestMinimumBasicScenario-1385142937 tempest-TestMinimumBasicScenario-1385142937-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:43:31.135496 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-c8492260-48f7-4472-b973-6bbe1cca8c64 tempest-TestMinimumBasicScenario-1385142937 tempest-TestMinimumBasicScenario-1385142937-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:43:31.136268 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-c8492260-48f7-4472-b973-6bbe1cca8c64 tempest-TestMinimumBasicScenario-1385142937 tempest-TestMinimumBasicScenario-1385142937-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:43:31.136703 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-c8492260-48f7-4472-b973-6bbe1cca8c64 tempest-TestMinimumBasicScenario-1385142937 tempest-TestMinimumBasicScenario-1385142937-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:43:31.268132 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: INFO nova.network.security_group_api [None req-c8492260-48f7-4472-b973-6bbe1cca8c64 tempest-TestMinimumBasicScenario-1385142937 tempest-TestMinimumBasicScenario-1385142937-project] Removing security group 285496d4-9f29-4a58-9223-f64d8465dd5d from port 25341a86-6728-46c3-8081-411876e42f16 Dec 15 03:43:31.592250 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: INFO nova.api.openstack.requestlog [None req-c8492260-48f7-4472-b973-6bbe1cca8c64 tempest-TestMinimumBasicScenario-1385142937 tempest-TestMinimumBasicScenario-1385142937-project] 10.222.0.18 "POST /compute/v2.1/servers/7a4d04ca-0909-481f-b859-bd99b327ddc3/action" status: 202 len: 0 microversion: 2.1 time: 0.468189 Dec 15 03:43:31.593538 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: [pid: 116156|app: 0|req: 1129/2234] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Dec 15 03:43:31 2021] POST /compute/v2.1/servers/7a4d04ca-0909-481f-b859-bd99b327ddc3/action => generated 0 bytes in 470 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Dec 15 03:43:31.606786 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi [req-41cdee37-d9e9-4d17-a749-0b8caa4be449 req-5b032b1e-f074-4512-a9fd-e1d1ad2f1a5c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7a4d04ca-0909-481f-b859-bd99b327ddc3", "tag": "25341a86-6728-46c3-8081-411876e42f16"}]} {{(pid=116157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 03:43:31.608938 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 15 03:43:31.608938 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: warnings.warn(msg) Dec 15 03:43:31.617554 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [req-41cdee37-d9e9-4d17-a749-0b8caa4be449 req-5b032b1e-f074-4512-a9fd-e1d1ad2f1a5c service nova] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:43:31.618258 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [req-41cdee37-d9e9-4d17-a749-0b8caa4be449 req-5b032b1e-f074-4512-a9fd-e1d1ad2f1a5c service nova] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:43:31.630672 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: INFO nova.api.openstack.compute.server_external_events [req-41cdee37-d9e9-4d17-a749-0b8caa4be449 req-5b032b1e-f074-4512-a9fd-e1d1ad2f1a5c service nova] Creating event network-changed:25341a86-6728-46c3-8081-411876e42f16 for instance 7a4d04ca-0909-481f-b859-bd99b327ddc3 on hv-cinder-81803 Dec 15 03:43:31.636211 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: INFO nova.api.openstack.requestlog [req-41cdee37-d9e9-4d17-a749-0b8caa4be449 req-5b032b1e-f074-4512-a9fd-e1d1ad2f1a5c service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032766 Dec 15 03:43:31.636781 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: [pid: 116157|app: 0|req: 1106/2235] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Dec 15 03:43:31 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 15 03:43:32.896949 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi [None req-f2594e10-d525-4231-90cd-c9ed162aa5e2 tempest-TestMinimumBasicScenario-1385142937 tempest-TestMinimumBasicScenario-1385142937-project] Calling method '>' {{(pid=116156) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:43:32.897708 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.compute.api [None req-f2594e10-d525-4231-90cd-c9ed162aa5e2 tempest-TestMinimumBasicScenario-1385142937 tempest-TestMinimumBasicScenario-1385142937-project] [instance: 7a4d04ca-0909-481f-b859-bd99b327ddc3] Fetching instance by UUID {{(pid=116156) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:43:32.901830 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi [req-31789869-d096-48d2-8248-5753c60a5d57 req-86e395bc-fe22-43e3-9bc4-68438940d79d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7a4d04ca-0909-481f-b859-bd99b327ddc3", "tag": "25341a86-6728-46c3-8081-411876e42f16"}]} {{(pid=116157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 03:43:32.903338 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 15 03:43:32.903338 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: warnings.warn(msg) Dec 15 03:43:32.904184 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-f2594e10-d525-4231-90cd-c9ed162aa5e2 tempest-TestMinimumBasicScenario-1385142937 tempest-TestMinimumBasicScenario-1385142937-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:43:32.904633 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-f2594e10-d525-4231-90cd-c9ed162aa5e2 tempest-TestMinimumBasicScenario-1385142937 tempest-TestMinimumBasicScenario-1385142937-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:43:32.905413 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-f2594e10-d525-4231-90cd-c9ed162aa5e2 tempest-TestMinimumBasicScenario-1385142937 tempest-TestMinimumBasicScenario-1385142937-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:43:32.905837 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-f2594e10-d525-4231-90cd-c9ed162aa5e2 tempest-TestMinimumBasicScenario-1385142937 tempest-TestMinimumBasicScenario-1385142937-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:43:32.911613 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [req-31789869-d096-48d2-8248-5753c60a5d57 req-86e395bc-fe22-43e3-9bc4-68438940d79d service nova] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:43:32.912302 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [req-31789869-d096-48d2-8248-5753c60a5d57 req-86e395bc-fe22-43e3-9bc4-68438940d79d service nova] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:43:32.923741 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: INFO nova.api.openstack.compute.server_external_events [req-31789869-d096-48d2-8248-5753c60a5d57 req-86e395bc-fe22-43e3-9bc4-68438940d79d service nova] Creating event network-changed:25341a86-6728-46c3-8081-411876e42f16 for instance 7a4d04ca-0909-481f-b859-bd99b327ddc3 on hv-cinder-81803 Dec 15 03:43:32.929297 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: INFO nova.api.openstack.requestlog [req-31789869-d096-48d2-8248-5753c60a5d57 req-86e395bc-fe22-43e3-9bc4-68438940d79d service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032188 Dec 15 03:43:32.930137 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: [pid: 116157|app: 0|req: 1107/2236] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Dec 15 03:43:32 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 15 03:43:32.986965 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.objects.instance [None req-f2594e10-d525-4231-90cd-c9ed162aa5e2 tempest-TestMinimumBasicScenario-1385142937 tempest-TestMinimumBasicScenario-1385142937-project] Lazy-loading 'services' on Instance uuid 7a4d04ca-0909-481f-b859-bd99b327ddc3 {{(pid=116156) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Dec 15 03:43:33.060948 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: INFO nova.api.openstack.requestlog [None req-f2594e10-d525-4231-90cd-c9ed162aa5e2 tempest-TestMinimumBasicScenario-1385142937 tempest-TestMinimumBasicScenario-1385142937-project] 10.222.0.18 "DELETE /compute/v2.1/servers/7a4d04ca-0909-481f-b859-bd99b327ddc3/os-volume_attachments/4c507a20-4e4d-48fd-9194-aa36a670fa35" status: 202 len: 0 microversion: 2.1 time: 0.167645 Dec 15 03:43:33.064702 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: [pid: 116156|app: 0|req: 1130/2237] 10.222.0.18 () {58 vars in 1415 bytes} [Wed Dec 15 03:43:32 2021] DELETE /compute/v2.1/servers/7a4d04ca-0909-481f-b859-bd99b327ddc3/os-volume_attachments/4c507a20-4e4d-48fd-9194-aa36a670fa35 => generated 0 bytes in 169 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Dec 15 03:43:33.070976 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi [None req-e7836700-1a33-469c-846b-286ae18cca0c tempest-TestMinimumBasicScenario-1385142937 tempest-TestMinimumBasicScenario-1385142937-project] Calling method '>' {{(pid=116157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:43:33.071985 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.compute.api [None req-e7836700-1a33-469c-846b-286ae18cca0c tempest-TestMinimumBasicScenario-1385142937 tempest-TestMinimumBasicScenario-1385142937-project] [instance: 7a4d04ca-0909-481f-b859-bd99b327ddc3] Fetching instance by UUID {{(pid=116157) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:43:33.078278 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-e7836700-1a33-469c-846b-286ae18cca0c tempest-TestMinimumBasicScenario-1385142937 tempest-TestMinimumBasicScenario-1385142937-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:43:33.079051 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-e7836700-1a33-469c-846b-286ae18cca0c tempest-TestMinimumBasicScenario-1385142937 tempest-TestMinimumBasicScenario-1385142937-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:43:33.080153 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-e7836700-1a33-469c-846b-286ae18cca0c tempest-TestMinimumBasicScenario-1385142937 tempest-TestMinimumBasicScenario-1385142937-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:43:33.080591 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-e7836700-1a33-469c-846b-286ae18cca0c tempest-TestMinimumBasicScenario-1385142937 tempest-TestMinimumBasicScenario-1385142937-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:43:33.117550 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: INFO nova.api.openstack.requestlog [None req-e7836700-1a33-469c-846b-286ae18cca0c tempest-TestMinimumBasicScenario-1385142937 tempest-TestMinimumBasicScenario-1385142937-project] 10.222.0.18 "GET /compute/v2.1/servers/7a4d04ca-0909-481f-b859-bd99b327ddc3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050658 Dec 15 03:43:33.118766 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: [pid: 116157|app: 0|req: 1108/2238] 10.222.0.18 () {58 vars in 1301 bytes} [Wed Dec 15 03:43:33 2021] GET /compute/v2.1/servers/7a4d04ca-0909-481f-b859-bd99b327ddc3/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 03:43:34.129677 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi [None req-fcc40c49-0b0b-4290-b73d-e467b38319b6 tempest-TestMinimumBasicScenario-1385142937 tempest-TestMinimumBasicScenario-1385142937-project] Calling method '>' {{(pid=116156) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:43:34.130672 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.compute.api [None req-fcc40c49-0b0b-4290-b73d-e467b38319b6 tempest-TestMinimumBasicScenario-1385142937 tempest-TestMinimumBasicScenario-1385142937-project] [instance: 7a4d04ca-0909-481f-b859-bd99b327ddc3] Fetching instance by UUID {{(pid=116156) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:43:34.136847 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-fcc40c49-0b0b-4290-b73d-e467b38319b6 tempest-TestMinimumBasicScenario-1385142937 tempest-TestMinimumBasicScenario-1385142937-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:43:34.137302 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-fcc40c49-0b0b-4290-b73d-e467b38319b6 tempest-TestMinimumBasicScenario-1385142937 tempest-TestMinimumBasicScenario-1385142937-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:43:34.138108 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-fcc40c49-0b0b-4290-b73d-e467b38319b6 tempest-TestMinimumBasicScenario-1385142937 tempest-TestMinimumBasicScenario-1385142937-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:43:34.138547 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-fcc40c49-0b0b-4290-b73d-e467b38319b6 tempest-TestMinimumBasicScenario-1385142937 tempest-TestMinimumBasicScenario-1385142937-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:43:34.165840 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: INFO nova.api.openstack.requestlog [None req-fcc40c49-0b0b-4290-b73d-e467b38319b6 tempest-TestMinimumBasicScenario-1385142937 tempest-TestMinimumBasicScenario-1385142937-project] 10.222.0.18 "GET /compute/v2.1/servers/7a4d04ca-0909-481f-b859-bd99b327ddc3/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.040840 Dec 15 03:43:34.166433 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: [pid: 116156|app: 0|req: 1131/2239] 10.222.0.18 () {58 vars in 1301 bytes} [Wed Dec 15 03:43:34 2021] GET /compute/v2.1/servers/7a4d04ca-0909-481f-b859-bd99b327ddc3/os-volume_attachments => generated 25 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Dec 15 03:43:34.175862 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi [None req-f1703577-4c4d-4e4b-90ba-7819b16db868 tempest-TestMinimumBasicScenario-1385142937 tempest-TestMinimumBasicScenario-1385142937-project] Calling method '>' {{(pid=116157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:43:34.176335 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.compute.api [None req-f1703577-4c4d-4e4b-90ba-7819b16db868 tempest-TestMinimumBasicScenario-1385142937 tempest-TestMinimumBasicScenario-1385142937-project] [instance: 7a4d04ca-0909-481f-b859-bd99b327ddc3] Fetching instance by UUID {{(pid=116157) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:43:34.183143 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-f1703577-4c4d-4e4b-90ba-7819b16db868 tempest-TestMinimumBasicScenario-1385142937 tempest-TestMinimumBasicScenario-1385142937-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:43:34.183581 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-f1703577-4c4d-4e4b-90ba-7819b16db868 tempest-TestMinimumBasicScenario-1385142937 tempest-TestMinimumBasicScenario-1385142937-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:43:34.184350 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-f1703577-4c4d-4e4b-90ba-7819b16db868 tempest-TestMinimumBasicScenario-1385142937 tempest-TestMinimumBasicScenario-1385142937-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:43:34.184779 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-f1703577-4c4d-4e4b-90ba-7819b16db868 tempest-TestMinimumBasicScenario-1385142937 tempest-TestMinimumBasicScenario-1385142937-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:43:34.255185 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: INFO nova.api.openstack.wsgi [None req-f1703577-4c4d-4e4b-90ba-7819b16db868 tempest-TestMinimumBasicScenario-1385142937 tempest-TestMinimumBasicScenario-1385142937-project] HTTP exception thrown: Instance 7a4d04ca-0909-481f-b859-bd99b327ddc3 is not attached to volume 4c507a20-4e4d-48fd-9194-aa36a670fa35 Dec 15 03:43:34.255779 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi [None req-f1703577-4c4d-4e4b-90ba-7819b16db868 tempest-TestMinimumBasicScenario-1385142937 tempest-TestMinimumBasicScenario-1385142937-project] Returning 404 to user: Instance 7a4d04ca-0909-481f-b859-bd99b327ddc3 is not attached to volume 4c507a20-4e4d-48fd-9194-aa36a670fa35 {{(pid=116157) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 15 03:43:34.256607 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: INFO nova.api.openstack.requestlog [None req-f1703577-4c4d-4e4b-90ba-7819b16db868 tempest-TestMinimumBasicScenario-1385142937 tempest-TestMinimumBasicScenario-1385142937-project] 10.222.0.18 "DELETE /compute/v2.1/servers/7a4d04ca-0909-481f-b859-bd99b327ddc3/os-volume_attachments/4c507a20-4e4d-48fd-9194-aa36a670fa35" status: 404 len: 154 microversion: 2.1 time: 0.084552 Dec 15 03:43:34.257136 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: [pid: 116157|app: 0|req: 1109/2240] 10.222.0.18 () {58 vars in 1415 bytes} [Wed Dec 15 03:43:34 2021] DELETE /compute/v2.1/servers/7a4d04ca-0909-481f-b859-bd99b327ddc3/os-volume_attachments/4c507a20-4e4d-48fd-9194-aa36a670fa35 => generated 154 bytes in 86 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 15 03:43:35.380517 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi [None req-fb28f001-9ee1-4a4a-8d67-cccc16853893 tempest-TestMinimumBasicScenario-1385142937 tempest-TestMinimumBasicScenario-1385142937-project] Calling method '>' {{(pid=116156) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:43:35.381587 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.compute.api [None req-fb28f001-9ee1-4a4a-8d67-cccc16853893 tempest-TestMinimumBasicScenario-1385142937 tempest-TestMinimumBasicScenario-1385142937-project] [instance: 7a4d04ca-0909-481f-b859-bd99b327ddc3] Fetching instance by UUID {{(pid=116156) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:43:35.387856 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-fb28f001-9ee1-4a4a-8d67-cccc16853893 tempest-TestMinimumBasicScenario-1385142937 tempest-TestMinimumBasicScenario-1385142937-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:43:35.388311 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-fb28f001-9ee1-4a4a-8d67-cccc16853893 tempest-TestMinimumBasicScenario-1385142937 tempest-TestMinimumBasicScenario-1385142937-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:43:35.389087 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-fb28f001-9ee1-4a4a-8d67-cccc16853893 tempest-TestMinimumBasicScenario-1385142937 tempest-TestMinimumBasicScenario-1385142937-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:43:35.389527 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-fb28f001-9ee1-4a4a-8d67-cccc16853893 tempest-TestMinimumBasicScenario-1385142937 tempest-TestMinimumBasicScenario-1385142937-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:43:35.412402 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.compute.api [None req-fb28f001-9ee1-4a4a-8d67-cccc16853893 tempest-TestMinimumBasicScenario-1385142937 tempest-TestMinimumBasicScenario-1385142937-project] [instance: 7a4d04ca-0909-481f-b859-bd99b327ddc3] Going to try to terminate instance {{(pid=116156) delete /opt/stack/nova/nova/compute/api.py:2614}} Dec 15 03:43:35.482959 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: INFO nova.api.openstack.requestlog [None req-fb28f001-9ee1-4a4a-8d67-cccc16853893 tempest-TestMinimumBasicScenario-1385142937 tempest-TestMinimumBasicScenario-1385142937-project] 10.222.0.18 "DELETE /compute/v2.1/servers/7a4d04ca-0909-481f-b859-bd99b327ddc3" status: 204 len: 0 microversion: 2.1 time: 0.105567 Dec 15 03:43:35.483393 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: [pid: 116156|app: 0|req: 1132/2241] 10.222.0.18 () {58 vars in 1238 bytes} [Wed Dec 15 03:43:35 2021] DELETE /compute/v2.1/servers/7a4d04ca-0909-481f-b859-bd99b327ddc3 => generated 0 bytes in 107 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Dec 15 03:43:35.491807 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi [None req-b4d25985-6734-4a63-bcfe-1e0c9ae4f112 tempest-TestMinimumBasicScenario-1385142937 tempest-TestMinimumBasicScenario-1385142937-project] Calling method '>' {{(pid=116157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:43:35.492423 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.compute.api [None req-b4d25985-6734-4a63-bcfe-1e0c9ae4f112 tempest-TestMinimumBasicScenario-1385142937 tempest-TestMinimumBasicScenario-1385142937-project] [instance: 7a4d04ca-0909-481f-b859-bd99b327ddc3] Fetching instance by UUID {{(pid=116157) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:43:35.498605 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-b4d25985-6734-4a63-bcfe-1e0c9ae4f112 tempest-TestMinimumBasicScenario-1385142937 tempest-TestMinimumBasicScenario-1385142937-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:43:35.499048 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-b4d25985-6734-4a63-bcfe-1e0c9ae4f112 tempest-TestMinimumBasicScenario-1385142937 tempest-TestMinimumBasicScenario-1385142937-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:43:35.499813 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-b4d25985-6734-4a63-bcfe-1e0c9ae4f112 tempest-TestMinimumBasicScenario-1385142937 tempest-TestMinimumBasicScenario-1385142937-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:43:35.500241 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-b4d25985-6734-4a63-bcfe-1e0c9ae4f112 tempest-TestMinimumBasicScenario-1385142937 tempest-TestMinimumBasicScenario-1385142937-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:43:35.632968 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.policy [None req-b4d25985-6734-4a63-bcfe-1e0c9ae4f112 tempest-TestMinimumBasicScenario-1385142937 tempest-TestMinimumBasicScenario-1385142937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '478d1c76208642f89d96afdf22f79829', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f9dcbfd69bc450691e2b036e864f7d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116157) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:43:35.640200 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: INFO nova.api.openstack.requestlog [None req-b4d25985-6734-4a63-bcfe-1e0c9ae4f112 tempest-TestMinimumBasicScenario-1385142937 tempest-TestMinimumBasicScenario-1385142937-project] 10.222.0.18 "GET /compute/v2.1/servers/7a4d04ca-0909-481f-b859-bd99b327ddc3" status: 200 len: 1553 microversion: 2.1 time: 0.152620 Dec 15 03:43:35.640783 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: [pid: 116157|app: 0|req: 1110/2242] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 03:43:35 2021] GET /compute/v2.1/servers/7a4d04ca-0909-481f-b859-bd99b327ddc3 => generated 1553 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 03:43:36.657232 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi [None req-13419383-2020-4ba3-a659-883d6eb37af9 tempest-TestMinimumBasicScenario-1385142937 tempest-TestMinimumBasicScenario-1385142937-project] Calling method '>' {{(pid=116156) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:43:36.657940 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.compute.api [None req-13419383-2020-4ba3-a659-883d6eb37af9 tempest-TestMinimumBasicScenario-1385142937 tempest-TestMinimumBasicScenario-1385142937-project] [instance: 7a4d04ca-0909-481f-b859-bd99b327ddc3] Fetching instance by UUID {{(pid=116156) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:43:36.664150 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-13419383-2020-4ba3-a659-883d6eb37af9 tempest-TestMinimumBasicScenario-1385142937 tempest-TestMinimumBasicScenario-1385142937-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:43:36.664603 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-13419383-2020-4ba3-a659-883d6eb37af9 tempest-TestMinimumBasicScenario-1385142937 tempest-TestMinimumBasicScenario-1385142937-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:43:36.665389 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-13419383-2020-4ba3-a659-883d6eb37af9 tempest-TestMinimumBasicScenario-1385142937 tempest-TestMinimumBasicScenario-1385142937-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:43:36.665812 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-13419383-2020-4ba3-a659-883d6eb37af9 tempest-TestMinimumBasicScenario-1385142937 tempest-TestMinimumBasicScenario-1385142937-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:43:36.797867 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.policy [None req-13419383-2020-4ba3-a659-883d6eb37af9 tempest-TestMinimumBasicScenario-1385142937 tempest-TestMinimumBasicScenario-1385142937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '478d1c76208642f89d96afdf22f79829', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f9dcbfd69bc450691e2b036e864f7d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116156) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:43:36.805602 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: INFO nova.api.openstack.requestlog [None req-13419383-2020-4ba3-a659-883d6eb37af9 tempest-TestMinimumBasicScenario-1385142937 tempest-TestMinimumBasicScenario-1385142937-project] 10.222.0.18 "GET /compute/v2.1/servers/7a4d04ca-0909-481f-b859-bd99b327ddc3" status: 200 len: 1553 microversion: 2.1 time: 0.152405 Dec 15 03:43:36.806191 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: [pid: 116156|app: 0|req: 1133/2243] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 03:43:36 2021] GET /compute/v2.1/servers/7a4d04ca-0909-481f-b859-bd99b327ddc3 => generated 1553 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 03:43:37.793538 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi [req-21183b11-a9a3-4bed-8cc3-5e5c5f528253 req-b00345b8-5e3a-42d1-a043-a45b660de20c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7a4d04ca-0909-481f-b859-bd99b327ddc3", "name": "network-vif-deleted", "tag": "25341a86-6728-46c3-8081-411876e42f16"}]} {{(pid=116157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 03:43:37.795540 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 15 03:43:37.795540 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: warnings.warn(msg) Dec 15 03:43:37.805353 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [req-21183b11-a9a3-4bed-8cc3-5e5c5f528253 req-b00345b8-5e3a-42d1-a043-a45b660de20c service nova] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:43:37.805802 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [req-21183b11-a9a3-4bed-8cc3-5e5c5f528253 req-b00345b8-5e3a-42d1-a043-a45b660de20c service nova] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:43:37.818763 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: INFO nova.api.openstack.compute.server_external_events [req-21183b11-a9a3-4bed-8cc3-5e5c5f528253 req-b00345b8-5e3a-42d1-a043-a45b660de20c service nova] Creating event network-vif-deleted:25341a86-6728-46c3-8081-411876e42f16 for instance 7a4d04ca-0909-481f-b859-bd99b327ddc3 on hv-cinder-81803 Dec 15 03:43:37.823404 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi [None req-3597bb8c-cfc5-4c20-bf13-572af1466d1e tempest-TestMinimumBasicScenario-1385142937 tempest-TestMinimumBasicScenario-1385142937-project] Calling method '>' {{(pid=116156) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:43:37.824233 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.compute.api [None req-3597bb8c-cfc5-4c20-bf13-572af1466d1e tempest-TestMinimumBasicScenario-1385142937 tempest-TestMinimumBasicScenario-1385142937-project] [instance: 7a4d04ca-0909-481f-b859-bd99b327ddc3] Fetching instance by UUID {{(pid=116156) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:43:37.824382 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: INFO nova.api.openstack.requestlog [req-21183b11-a9a3-4bed-8cc3-5e5c5f528253 req-b00345b8-5e3a-42d1-a043-a45b660de20c service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034296 Dec 15 03:43:37.825119 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: [pid: 116157|app: 0|req: 1111/2244] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Dec 15 03:43:37 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 03:43:37.831385 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-3597bb8c-cfc5-4c20-bf13-572af1466d1e tempest-TestMinimumBasicScenario-1385142937 tempest-TestMinimumBasicScenario-1385142937-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:43:37.831840 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-3597bb8c-cfc5-4c20-bf13-572af1466d1e tempest-TestMinimumBasicScenario-1385142937 tempest-TestMinimumBasicScenario-1385142937-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:43:37.832657 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-3597bb8c-cfc5-4c20-bf13-572af1466d1e tempest-TestMinimumBasicScenario-1385142937 tempest-TestMinimumBasicScenario-1385142937-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:43:37.833114 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG oslo_concurrency.lockutils [None req-3597bb8c-cfc5-4c20-bf13-572af1466d1e tempest-TestMinimumBasicScenario-1385142937 tempest-TestMinimumBasicScenario-1385142937-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:43:37.895406 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.policy [None req-3597bb8c-cfc5-4c20-bf13-572af1466d1e tempest-TestMinimumBasicScenario-1385142937 tempest-TestMinimumBasicScenario-1385142937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '478d1c76208642f89d96afdf22f79829', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f9dcbfd69bc450691e2b036e864f7d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116156) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 03:43:37.903690 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: INFO nova.api.openstack.requestlog [None req-3597bb8c-cfc5-4c20-bf13-572af1466d1e tempest-TestMinimumBasicScenario-1385142937 tempest-TestMinimumBasicScenario-1385142937-project] 10.222.0.18 "GET /compute/v2.1/servers/7a4d04ca-0909-481f-b859-bd99b327ddc3" status: 200 len: 1342 microversion: 2.1 time: 0.084100 Dec 15 03:43:37.904261 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: [pid: 116156|app: 0|req: 1134/2245] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 03:43:37 2021] GET /compute/v2.1/servers/7a4d04ca-0909-481f-b859-bd99b327ddc3 => generated 1342 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 03:43:38.920955 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi [None req-3af79e5f-35ab-4c8b-84b7-a2b78392d9f6 tempest-TestMinimumBasicScenario-1385142937 tempest-TestMinimumBasicScenario-1385142937-project] Calling method '>' {{(pid=116157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:43:38.921647 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.compute.api [None req-3af79e5f-35ab-4c8b-84b7-a2b78392d9f6 tempest-TestMinimumBasicScenario-1385142937 tempest-TestMinimumBasicScenario-1385142937-project] [instance: 7a4d04ca-0909-481f-b859-bd99b327ddc3] Fetching instance by UUID {{(pid=116157) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 03:43:38.929306 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-3af79e5f-35ab-4c8b-84b7-a2b78392d9f6 tempest-TestMinimumBasicScenario-1385142937 tempest-TestMinimumBasicScenario-1385142937-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:43:38.929750 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-3af79e5f-35ab-4c8b-84b7-a2b78392d9f6 tempest-TestMinimumBasicScenario-1385142937 tempest-TestMinimumBasicScenario-1385142937-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:43:38.930665 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-3af79e5f-35ab-4c8b-84b7-a2b78392d9f6 tempest-TestMinimumBasicScenario-1385142937 tempest-TestMinimumBasicScenario-1385142937-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 03:43:38.931105 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG oslo_concurrency.lockutils [None req-3af79e5f-35ab-4c8b-84b7-a2b78392d9f6 tempest-TestMinimumBasicScenario-1385142937 tempest-TestMinimumBasicScenario-1385142937-project] Lock "d853eee3-69a6-4e08-9a63-827acdfc7836" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 03:43:39.099758 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: INFO nova.api.openstack.wsgi [None req-3af79e5f-35ab-4c8b-84b7-a2b78392d9f6 tempest-TestMinimumBasicScenario-1385142937 tempest-TestMinimumBasicScenario-1385142937-project] HTTP exception thrown: Instance 7a4d04ca-0909-481f-b859-bd99b327ddc3 could not be found. Dec 15 03:43:39.100343 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: DEBUG nova.api.openstack.wsgi [None req-3af79e5f-35ab-4c8b-84b7-a2b78392d9f6 tempest-TestMinimumBasicScenario-1385142937 tempest-TestMinimumBasicScenario-1385142937-project] Returning 404 to user: Instance 7a4d04ca-0909-481f-b859-bd99b327ddc3 could not be found. {{(pid=116157) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 15 03:43:39.101166 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: INFO nova.api.openstack.requestlog [None req-3af79e5f-35ab-4c8b-84b7-a2b78392d9f6 tempest-TestMinimumBasicScenario-1385142937 tempest-TestMinimumBasicScenario-1385142937-project] 10.222.0.18 "GET /compute/v2.1/servers/7a4d04ca-0909-481f-b859-bd99b327ddc3" status: 404 len: 111 microversion: 2.1 time: 0.184189 Dec 15 03:43:39.101702 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: [pid: 116157|app: 0|req: 1112/2246] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Dec 15 03:43:38 2021] GET /compute/v2.1/servers/7a4d04ca-0909-481f-b859-bd99b327ddc3 => generated 111 bytes in 185 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 15 03:43:39.109526 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: DEBUG nova.api.openstack.wsgi [None req-bb6a506c-58b3-48c7-b04c-263e324ad256 tempest-TestMinimumBasicScenario-1385142937 tempest-TestMinimumBasicScenario-1385142937-project] Calling method '.version_select at 0x7f126e83a3a0>' {{(pid=116156) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 03:43:39.126999 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: INFO nova.api.openstack.requestlog [None req-bb6a506c-58b3-48c7-b04c-263e324ad256 tempest-TestMinimumBasicScenario-1385142937 tempest-TestMinimumBasicScenario-1385142937-project] 10.222.0.18 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-978013863" status: 202 len: 0 microversion: 2.1 time: 0.020963 Dec 15 03:43:39.127551 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: [pid: 116156|app: 0|req: 1135/2247] 10.222.0.18 () {58 vars in 1268 bytes} [Wed Dec 15 03:43:39 2021] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-978013863 => generated 0 bytes in 22 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Dec 15 03:44:49.628056 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Dec 15 03:44:49.628656 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: Wed Dec 15 03:44:49 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Dec 15 03:46:16.323796 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Dec 15 03:46:16.324360 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: Wed Dec 15 03:46:16 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Dec 15 03:46:28.918520 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Dec 15 03:46:28.919079 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: Wed Dec 15 03:46:28 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Dec 15 03:46:38.591778 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Dec 15 03:46:38.592395 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: Wed Dec 15 03:46:38 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Dec 15 03:46:49.984083 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Dec 15 03:46:49.984725 dv-cinder-818037-9-iscsi devstack@n-api.service[116156]: Wed Dec 15 03:46:49 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Dec 15 03:46:52.198138 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Dec 15 03:46:52.198733 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: Wed Dec 15 03:46:52 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Dec 15 03:48:09.646536 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Dec 15 03:48:09.647252 dv-cinder-818037-9-iscsi devstack@n-api.service[116157]: Wed Dec 15 03:48:09 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!!